2024-05-26T15:26:38.530 INFO:root:teuthology version: 0.0.1.dev287+gb9e3da8 2024-05-26T15:26:38.531 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570 --name teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi --owner scheduled_teuthology@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/openfiletable} -- /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570/orig.config.yaml 2024-05-26T15:26:38.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-26T15:26:38.666 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570 branch: reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/openfiletable} email: ceph-qa@ceph.com first_in_suite: false job_id: '7721570' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08 kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9743 sha1: 70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08 sleep_before_teardown: 0 subset: 366/512 suite: fs suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEFS+FUKhc1jqWe77aXCi73jMcidd40Cp2qkfBFjkl7YOz4L5t594K9w9ERitS/q1zWDngiGa9inqkVdVIanudU= smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPQAbAi6GdQo3gqlVFwqkLjS37qi2D+suT/l6vgFTL7BEuzQ0FLaTeYGf0D2thBCGnPAQRHed0y0U8kUYhvjHo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_openfiletable teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a timestamp: 2024-05-22_22:24:05 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-26T15:26:38.667 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/qa; will attempt to use it 2024-05-26T15:26:38.667 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/qa/tasks 2024-05-26T15:26:38.668 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-26T15:26:38.669 INFO:teuthology.task.internal:Checking packages... 2024-05-26T15:26:38.689 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08' 2024-05-26T15:26:38.690 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-26T15:26:38.690 INFO:teuthology.packaging:ref: None 2024-05-26T15:26:38.690 INFO:teuthology.packaging:tag: None 2024-05-26T15:26:38.690 INFO:teuthology.packaging:branch: reef 2024-05-26T15:26:38.690 INFO:teuthology.packaging:sha1: 70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08 2024-05-26T15:26:38.690 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-05-26T15:26:38.894 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1363.g19f3c031 2024-05-26T15:26:38.895 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-26T15:26:38.902 INFO:teuthology.task.internal:no buildpackages task found 2024-05-26T15:26:38.902 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-26T15:26:38.973 INFO:teuthology.task.internal:Saving configuration 2024-05-26T15:26:38.989 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-26T15:26:38.995 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-26T15:26:39.022 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-26 15:22:01.960400', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEFS+FUKhc1jqWe77aXCi73jMcidd40Cp2qkfBFjkl7YOz4L5t594K9w9ERitS/q1zWDngiGa9inqkVdVIanudU='} 2024-05-26T15:26:39.042 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-26 15:22:01.961803', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPQAbAi6GdQo3gqlVFwqkLjS37qi2D+suT/l6vgFTL7BEuzQ0FLaTeYGf0D2thBCGnPAQRHed0y0U8kUYhvjHo='} 2024-05-26T15:26:39.043 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-26T15:26:39.049 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-26T15:26:39.049 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-26T15:26:39.049 INFO:teuthology.run_tasks:Running task console_log... 2024-05-26T15:26:39.112 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5763f23be0>, signals=[15]) 2024-05-26T15:26:39.112 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-26T15:26:39.118 INFO:teuthology.task.internal:Opening connections... 2024-05-26T15:26:39.118 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:26:39.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-26T15:26:39.196 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:26:39.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-26T15:26:39.273 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-26T15:26:39.280 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2024-05-26T15:26:39.298 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2024-05-26T15:26:39.298 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-05-26T15:26:39.359 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-05-26T15:26:39.359 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-05-26T15:26:39.359 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-05-26T15:26:39.360 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-05-26T15:26:39.360 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-05-26T15:26:39.360 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-05-26T15:26:39.360 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-26T15:26:39.360 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-05-26T15:26:39.360 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-05-26T15:26:39.360 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-26T15:26:39.361 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-05-26T15:26:39.361 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-26T15:26:39.361 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-26T15:26:39.361 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-26T15:26:39.362 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-05-26T15:26:39.383 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-05-26T15:26:39.404 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-05-26T15:26:39.404 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-05-26T15:26:39.461 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-05-26T15:26:39.461 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="9" 2024-05-26T15:26:39.461 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-05-26T15:26:39.461 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-05-26T15:26:39.461 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="9" 2024-05-26T15:26:39.461 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el9" 2024-05-26T15:26:39.461 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-26T15:26:39.461 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-05-26T15:26:39.461 INFO:teuthology.orchestra.run.smithi047.stdout:LOGO="fedora-logo-icon" 2024-05-26T15:26:39.462 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-26T15:26:39.462 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-05-26T15:26:39.462 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-26T15:26:39.462 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-26T15:26:39.462 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-26T15:26:39.462 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-05-26T15:26:39.482 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-26T15:26:39.494 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-26T15:26:39.501 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-26T15:26:39.501 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2024-05-26T15:26:39.504 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-05-26T15:26:39.521 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-26T15:26:39.527 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-26T15:26:39.527 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2024-05-26T15:26:39.561 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-05-26T15:26:39.588 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-26T15:26:39.645 INFO:teuthology.run_tasks:Running task kernel... 2024-05-26T15:26:39.659 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-26T15:26:39.659 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-05-26T15:26:39.660 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-05-26T15:26:39.660 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-26T15:26:39.660 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-26T15:26:39.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:26:39.677 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-26T15:26:39.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:26:39.681 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-26T15:26:39.991 DEBUG:teuthology.task.kernel:sha1 for client.0 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-26T15:26:39.991 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-26T15:26:39.991 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2024-05-26T15:26:39.993 DEBUG:teuthology.task.kernel:sha1 for client.1 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-26T15:26:39.993 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-26T15:26:39.993 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-26T15:26:40.010 INFO:teuthology.orchestra.run.smithi008.stdout:5.14.0-437.el9.x86_64 2024-05-26T15:26:40.010 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-26T15:26:40.011 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-26T15:26:40.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum upgrade -y linux-firmware 2024-05-26T15:26:40.012 INFO:teuthology.orchestra.run.smithi047.stdout:5.14.0-437.el9.x86_64 2024-05-26T15:26:40.012 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-26T15:26:40.012 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-26T15:26:40.013 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum upgrade -y linux-firmware 2024-05-26T15:26:42.216 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.1 MB 00:00 2024-05-26T15:26:42.348 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-26T15:26:44.266 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-05-26T15:26:45.684 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 19 MB 00:02 2024-05-26T15:26:48.509 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-05-26T15:26:49.868 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-26T15:26:50.951 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 17 kB 00:01 2024-05-26T15:26:51.394 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 17 kB 00:00 2024-05-26T15:26:52.602 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-26T15:26:57.353 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 3.6 MB/s | 21 MB 00:05 2024-05-26T15:26:57.911 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-26T15:26:58.106 INFO:teuthology.orchestra.run.smithi047.stdout:Last metadata expiration check: 0:00:01 ago on Sun 26 May 2024 03:26:57 PM UTC. 2024-05-26T15:26:59.942 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-05-26T15:26:59.943 INFO:teuthology.orchestra.run.smithi047.stdout:Nothing to do. 2024-05-26T15:26:59.943 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-05-26T15:27:00.065 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.1... 2024-05-26T15:27:00.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-26T15:27:00.284 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-05-26T15:27:00.284 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-26T15:27:00.286 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi047.front.sepia.ceph.com to complete... 2024-05-26T15:27:02.736 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-26T15:27:04.820 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2024-05-26T15:27:04.821 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2024-05-26T15:27:04.821 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2024-05-26T15:27:04.927 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-05-26T15:27:04.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-26T15:27:05.084 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ 2024-05-26T15:27:05.084 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_gb9459a26b088-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-26T15:27:05.087 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi008.front.sepia.ceph.com to complete... 2024-05-26T15:27:13.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26 15:27:13 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-26T15:27:13.972 INFO:teuthology.orchestra.run.smithi047.stderr:FINISHED --2024-05-26 15:27:13-- 2024-05-26T15:27:13.972 INFO:teuthology.orchestra.run.smithi047.stderr:Total wall clock time: 14s 2024-05-26T15:27:13.972 INFO:teuthology.orchestra.run.smithi047.stderr:Downloaded: 1 files, 340M in 13s (25.4 MB/s) 2024-05-26T15:27:13.975 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.1... 2024-05-26T15:27:13.975 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-26T15:27:16.164 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying... ######################################## 2024-05-26T15:27:16.281 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing... ######################################## 2024-05-26T15:27:16.376 INFO:teuthology.orchestra.run.smithi047.stdout:Updating / installing... 2024-05-26T15:27:24.649 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-05-26T15:27:25.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26 15:27:25 URL:https://3.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/centos/9/flavors/default/x86_64/kernel-6.9.0_gb9459a26b088-1.x86_64.rpm [356863406/356863406] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-26T15:27:25.224 INFO:teuthology.orchestra.run.smithi008.stderr:FINISHED --2024-05-26 15:27:25-- 2024-05-26T15:27:25.224 INFO:teuthology.orchestra.run.smithi008.stderr:Total wall clock time: 20s 2024-05-26T15:27:25.224 INFO:teuthology.orchestra.run.smithi008.stderr:Downloaded: 1 files, 340M in 20s (17.4 MB/s) 2024-05-26T15:27:25.227 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-05-26T15:27:25.227 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-26T15:27:27.414 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying... ######################################## 2024-05-26T15:27:27.532 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing... ######################################## 2024-05-26T15:27:27.639 INFO:teuthology.orchestra.run.smithi008.stdout:Updating / installing... 2024-05-26T15:27:35.940 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-6.9.0_gb9459a26b088-1 ######################################## 2024-05-26T15:28:04.422 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-26T15:28:04.422 DEBUG:teuthology.orchestra.run.smithi047:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-26T15:28:04.509 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-05-26T15:28:04.509 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/config-6.9.0-gb9459a26b088 2024-05-26T15:28:04.509 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-26T15:28:04.509 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-05-26T15:28:04.509 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-26T15:28:04.510 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-26T15:28:04.511 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-26T15:28:04.512 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-26T15:28:04.513 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-26T15:28:04.514 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-26T15:28:04.515 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-26T15:28:04.516 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-26T15:28:04.517 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-26T15:28:04.518 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-26T15:28:04.519 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-26T15:28:04.520 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-26T15:28:04.521 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-05-26T15:28:04.522 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-05-26T15:28:04.523 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-26T15:28:04.524 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-05-26T15:28:04.525 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-05-26T15:28:04.526 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-26T15:28:04.527 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-26T15:28:04.528 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-26T15:28:04.529 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-26T15:28:04.530 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-26T15:28:04.531 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-26T15:28:04.532 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-26T15:28:04.533 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-26T15:28:04.534 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-26T15:28:04.535 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-26T15:28:04.536 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-26T15:28:04.537 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-26T15:28:04.538 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-26T15:28:04.539 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-26T15:28:04.540 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-26T15:28:04.541 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-26T15:28:04.542 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-26T15:28:04.543 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-05-26T15:28:04.544 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-26T15:28:04.545 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-05-26T15:28:04.546 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-26T15:28:04.547 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-05-26T15:28:04.548 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-05-26T15:28:04.549 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-05-26T15:28:04.550 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-26T15:28:04.551 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-26T15:28:04.552 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-26T15:28:04.553 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-26T15:28:04.554 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-26T15:28:04.555 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-26T15:28:04.556 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-26T15:28:04.557 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-26T15:28:04.558 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-05-26T15:28:04.559 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-26T15:28:04.560 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-26T15:28:04.561 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-26T15:28:04.562 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-26T15:28:04.563 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-05-26T15:28:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-26T15:28:04.565 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-26T15:28:04.566 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-26T15:28:04.567 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-05-26T15:28:04.568 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-05-26T15:28:04.569 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-26T15:28:04.570 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-05-26T15:28:04.571 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-26T15:28:04.572 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-26T15:28:04.573 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-26T15:28:04.574 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-26T15:28:04.575 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-26T15:28:04.576 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-05-26T15:28:04.577 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-26T15:28:04.578 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-26T15:28:04.579 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-26T15:28:04.580 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-05-26T15:28:04.581 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-05-26T15:28:04.582 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-26T15:28:04.583 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-26T15:28:04.584 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-26T15:28:04.585 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-26T15:28:04.586 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-26T15:28:04.587 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-26T15:28:04.588 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-26T15:28:04.589 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-26T15:28:04.590 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-05-26T15:28:04.591 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-26T15:28:04.592 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-26T15:28:04.593 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-05-26T15:28:04.594 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-05-26T15:28:04.595 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-26T15:28:04.596 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-26T15:28:04.597 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-26T15:28:04.598 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-26T15:28:04.599 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-26T15:28:04.600 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-26T15:28:04.601 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-26T15:28:04.602 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-26T15:28:04.603 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-05-26T15:28:04.604 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-26T15:28:04.605 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-26T15:28:04.606 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-26T15:28:04.607 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-26T15:28:04.608 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-26T15:28:04.609 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-05-26T15:28:04.610 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-26T15:28:04.611 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-05-26T15:28:04.612 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-26T15:28:04.613 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-26T15:28:04.614 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-26T15:28:04.615 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-26T15:28:04.616 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-05-26T15:28:04.617 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-05-26T15:28:04.618 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-05-26T15:28:04.619 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-26T15:28:04.620 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-26T15:28:04.621 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-05-26T15:28:04.622 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-26T15:28:04.623 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-26T15:28:04.624 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-26T15:28:04.625 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-26T15:28:04.626 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-26T15:28:04.627 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-26T15:28:04.628 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-26T15:28:04.629 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-26T15:28:04.630 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-26T15:28:04.631 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-26T15:28:04.632 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-26T15:28:04.633 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-05-26T15:28:04.634 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-05-26T15:28:04.635 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-26T15:28:04.636 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-26T15:28:04.637 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-26T15:28:04.638 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-26T15:28:04.639 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-26T15:28:04.640 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-26T15:28:04.641 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-26T15:28:04.642 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-26T15:28:04.643 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-26T15:28:04.644 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-26T15:28:04.645 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-26T15:28:04.646 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-05-26T15:28:04.647 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-26T15:28:04.648 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-26T15:28:04.649 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-26T15:28:04.650 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-05-26T15:28:04.651 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-26T15:28:04.652 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-26T15:28:04.653 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-26T15:28:04.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-26T15:28:04.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-26T15:28:04.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-26T15:28:04.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-26T15:28:04.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-26T15:28:04.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-26T15:28:04.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-26T15:28:04.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-26T15:28:04.654 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-26T15:28:04.658 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-26T15:28:04.658 DEBUG:teuthology.orchestra.run.smithi047:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-26T15:28:04.683 INFO:teuthology.orchestra.run.smithi047.stdout:postinstall scriptlet (using /bin/sh): 2024-05-26T15:28:04.683 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout:for file in vmlinuz System.map config; do 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout: fi 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout:done 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-05-26T15:28:04.684 INFO:teuthology.orchestra.run.smithi047.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-05-26T15:28:04.685 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-26T15:28:04.685 INFO:teuthology.orchestra.run.smithi047.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-26T15:28:04.685 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-26T15:28:04.685 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-05-26T15:28:04.685 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-26T15:28:04.686 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-05-26T15:28:04.760 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-05-26T15:28:04.760 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-05-26T15:28:04.760 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.06 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 68.el9 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Group : Unspecified 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 8264254 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : builder@centos.org 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-26T15:28:04.761 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-05-26T15:28:04.762 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-05-26T15:28:04.762 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:28:04.762 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-26T15:28:04.762 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-26T15:28:04.762 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-26T15:28:04.762 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-05-26T15:28:04.762 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:28:04.762 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-05-26T15:28:04.763 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-26T15:28:04.763 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 6.9.0-gb9459a26b088 2024-05-26T15:28:04.763 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-26T15:28:05.326 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-05-26T15:28:06.805 INFO:teuthology.orchestra.run.smithi047.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-26T15:28:06.831 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-05-26T15:28:06.833 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-26T15:28:06.848 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.rRWpwOwdUP 2024-05-26T15:28:06.848 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rRWpwOwdUP 2024-05-26T15:28:06.914 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.rRWpwOwdUP 2024-05-26T15:28:07.051 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.rRWpwOwdUP is 6KB 2024-05-26T15:28:07.072 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.rRWpwOwdUP 2024-05-26T15:28:07.087 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-05-26T15:28:07.149 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-26T15:28:07.149 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-26T15:28:07.149 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-26T15:28:07.149 INFO:teuthology.orchestra.run.smithi047.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-05-26T15:28:07.150 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-05-26T15:28:07.296 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-05-26T15:28:16.208 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-26T15:28:16.208 DEBUG:teuthology.orchestra.run.smithi008:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-26T15:28:16.281 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/System.map-6.9.0-gb9459a26b088 2024-05-26T15:28:16.281 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/config-6.9.0-gb9459a26b088 2024-05-26T15:28:16.281 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-26T15:28:16.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/System.map 2024-05-26T15:28:16.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/config 2024-05-26T15:28:16.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel 2024-05-26T15:28:16.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch 2024-05-26T15:28:16.281 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-26T15:28:16.282 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-26T15:28:16.283 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-26T15:28:16.284 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-26T15:28:16.285 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-26T15:28:16.286 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-26T15:28:16.287 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-26T15:28:16.288 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ata_generic.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-26T15:28:16.289 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-26T15:28:16.290 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sis.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-26T15:28:16.291 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-26T15:28:16.292 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-26T15:28:16.293 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/brd.ko 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/loop.ko 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/virtio_blk.ko 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback 2024-05-26T15:28:16.294 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkfront.ko 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi 2024-05-26T15:28:16.295 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm.ko 2024-05-26T15:28:16.296 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/uv_mmtimer.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/virtio_console.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-26T15:28:16.297 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio 2024-05-26T15:28:16.298 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-26T15:28:16.299 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/edd.ko 2024-05-26T15:28:16.300 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-26T15:28:16.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio 2024-05-26T15:28:16.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-26T15:28:16.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-26T15:28:16.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid 2024-05-26T15:28:16.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-26T15:28:16.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-26T15:28:16.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-26T15:28:16.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-26T15:28:16.301 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-26T15:28:16.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-26T15:28:16.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-26T15:28:16.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-26T15:28:16.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-26T15:28:16.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-26T15:28:16.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-26T15:28:16.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-26T15:28:16.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-26T15:28:16.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-26T15:28:16.302 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-26T15:28:16.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-26T15:28:16.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-26T15:28:16.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-26T15:28:16.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-26T15:28:16.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-26T15:28:16.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-26T15:28:16.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-26T15:28:16.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-26T15:28:16.303 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-26T15:28:16.304 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-26T15:28:16.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-26T15:28:16.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-26T15:28:16.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-26T15:28:16.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-26T15:28:16.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-26T15:28:16.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-26T15:28:16.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-26T15:28:16.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-26T15:28:16.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-26T15:28:16.305 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-26T15:28:16.306 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-26T15:28:16.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-26T15:28:16.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-26T15:28:16.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-26T15:28:16.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-26T15:28:16.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-26T15:28:16.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-26T15:28:16.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-26T15:28:16.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv 2024-05-26T15:28:16.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-26T15:28:16.307 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-26T15:28:16.308 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-26T15:28:16.309 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-26T15:28:16.310 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-26T15:28:16.311 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-26T15:28:16.312 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-26T15:28:16.313 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-26T15:28:16.314 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-26T15:28:16.315 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-26T15:28:16.316 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-26T15:28:16.317 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-26T15:28:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-26T15:28:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-26T15:28:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-26T15:28:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-26T15:28:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-26T15:28:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-26T15:28:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-26T15:28:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-26T15:28:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c 2024-05-26T15:28:16.318 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-26T15:28:16.319 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-dev.ko 2024-05-26T15:28:16.320 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-26T15:28:16.321 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser 2024-05-26T15:28:16.322 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-26T15:28:16.323 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-26T15:28:16.324 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-26T15:28:16.325 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-26T15:28:16.326 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-26T15:28:16.327 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mfd-core.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-26T15:28:16.328 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom 2024-05-26T15:28:16.329 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-26T15:28:16.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-26T15:28:16.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-26T15:28:16.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-26T15:28:16.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-26T15:28:16.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-26T15:28:16.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-26T15:28:16.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d 2024-05-26T15:28:16.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-26T15:28:16.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-26T15:28:16.330 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-26T15:28:16.331 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-26T15:28:16.332 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390 2024-05-26T15:28:16.333 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-26T15:28:16.334 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-26T15:28:16.335 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-26T15:28:16.336 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-26T15:28:16.337 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel 2024-05-26T15:28:16.338 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-26T15:28:16.339 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-26T15:28:16.340 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion 2024-05-26T15:28:16.341 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-26T15:28:16.342 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-26T15:28:16.343 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-26T15:28:16.344 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-26T15:28:16.345 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-26T15:28:16.346 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/net_failover.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-26T15:28:16.347 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/dp83640.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-26T15:28:16.348 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-26T15:28:16.349 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slhc.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tun.ko 2024-05-26T15:28:16.350 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/virtio_net.ko 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netfront.ko 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-26T15:28:16.351 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-26T15:28:16.352 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-26T15:28:16.353 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-26T15:28:16.354 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp 2024-05-26T15:28:16.355 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-26T15:28:16.356 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-26T15:28:16.357 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-26T15:28:16.358 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi 2024-05-26T15:28:16.359 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-26T15:28:16.360 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-26T15:28:16.361 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-26T15:28:16.362 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-26T15:28:16.363 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-26T15:28:16.364 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target 2024-05-26T15:28:16.365 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel 2024-05-26T15:28:16.366 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-26T15:28:16.367 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250 2024-05-26T15:28:16.368 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-26T15:28:16.369 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-26T15:28:16.370 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-26T15:28:16.371 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-26T15:28:16.372 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-26T15:28:16.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-26T15:28:16.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-26T15:28:16.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-26T15:28:16.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-26T15:28:16.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-26T15:28:16.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-26T15:28:16.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-26T15:28:16.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-26T15:28:16.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-26T15:28:16.373 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-26T15:28:16.374 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage 2024-05-26T15:28:16.375 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-26T15:28:16.376 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost 2024-05-26T15:28:16.377 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio.ko 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_balloon.ko 2024-05-26T15:28:16.378 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_mmio.ko 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci.ko 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/virtio/virtio_ring.ko 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-26T15:28:16.379 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-26T15:28:16.380 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-26T15:28:16.381 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-26T15:28:16.382 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-26T15:28:16.383 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm 2024-05-26T15:28:16.384 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/fat.ko 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/vfat.ko 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/fuse.ko 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-26T15:28:16.385 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-26T15:28:16.386 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-26T15:28:16.387 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-26T15:28:16.388 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-26T15:28:16.389 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-26T15:28:16.390 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-26T15:28:16.391 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore 2024-05-26T15:28:16.392 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-26T15:28:16.393 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/rcu/rcutorture.ko 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/asn1_encoder.ko 2024-05-26T15:28:16.394 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-26T15:28:16.395 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/lib/zstd/zstd_compress.ko 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-26T15:28:16.396 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p 2024-05-26T15:28:16.397 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-26T15:28:16.398 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-26T15:28:16.399 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/failover.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-26T15:28:16.400 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dns_resolver/dns_resolver.ko 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154 2024-05-26T15:28:16.401 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-26T15:28:16.402 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-26T15:28:16.403 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-26T15:28:16.404 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6 2024-05-26T15:28:16.405 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-26T15:28:16.406 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-26T15:28:16.407 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-26T15:28:16.408 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-26T15:28:16.409 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-26T15:28:16.410 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-26T15:28:16.411 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-26T15:28:16.412 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-26T15:28:16.413 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-26T15:28:16.414 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_quota.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tunnel.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-26T15:28:16.415 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-26T15:28:16.416 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-26T15:28:16.417 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-26T15:28:16.418 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-26T15:28:16.419 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-26T15:28:16.420 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-26T15:28:16.421 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-26T15:28:16.422 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-26T15:28:16.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-26T15:28:16.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-26T15:28:16.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-26T15:28:16.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-26T15:28:16.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-26T15:28:16.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-26T15:28:16.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-26T15:28:16.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-26T15:28:16.423 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-26T15:28:16.424 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc 2024-05-26T15:28:16.425 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-26T15:28:16.426 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/kernel/security/keys/trusted-keys/trusted.ko 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-26T15:28:16.427 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-26T15:28:16.428 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-26T15:28:16.432 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-26T15:28:16.432 DEBUG:teuthology.orchestra.run.smithi008:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-26T15:28:16.457 INFO:teuthology.orchestra.run.smithi008.stdout:postinstall scriptlet (using /bin/sh): 2024-05-26T15:28:16.457 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-26T15:28:16.457 INFO:teuthology.orchestra.run.smithi008.stdout: /usr/bin/kernel-install add 6.9.0-gb9459a26b088 /lib/modules/6.9.0-gb9459a26b088/vmlinuz 2024-05-26T15:28:16.457 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2024-05-26T15:28:16.457 INFO:teuthology.orchestra.run.smithi008.stdout:for file in vmlinuz System.map config; do 2024-05-26T15:28:16.457 INFO:teuthology.orchestra.run.smithi008.stdout: if ! cmp --silent "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088"; then 2024-05-26T15:28:16.457 INFO:teuthology.orchestra.run.smithi008.stdout: cp "/lib/modules/6.9.0-gb9459a26b088/${file}" "/boot/${file}-6.9.0-gb9459a26b088" 2024-05-26T15:28:16.457 INFO:teuthology.orchestra.run.smithi008.stdout: fi 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout:done 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -d "/lib/modules/6.9.0-gb9459a26b088/dtb" ] && \ 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout: ! diff -rq "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" >/dev/null 2>&1; then 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout: rm -rf "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout: cp -r "/lib/modules/6.9.0-gb9459a26b088/dtb" "/boot/dtb-6.9.0-gb9459a26b088" 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout:if [ ! -e "/lib/modules/6.9.0-gb9459a26b088/modules.dep" ]; then 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout: /usr/sbin/depmod 6.9.0-gb9459a26b088 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-install remove 6.9.0-gb9459a26b088 2024-05-26T15:28:16.458 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2024-05-26T15:28:16.459 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2024-05-26T15:28:16.533 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2024-05-26T15:28:16.534 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2024-05-26T15:28:16.534 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.06 2024-05-26T15:28:16.534 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 68.el9 2024-05-26T15:28:16.534 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2024-05-26T15:28:16.534 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-26T15:28:16.534 INFO:teuthology.orchestra.run.smithi008.stdout:Group : Unspecified 2024-05-26T15:28:16.534 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 8264254 2024-05-26T15:28:16.534 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2024-05-26T15:28:16.534 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : builder@centos.org 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : CentOS 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2024-05-26T15:28:16.535 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:28:16.536 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2024-05-26T15:28:16.536 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-26T15:28:16.536 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 6.9.0-gb9459a26b088 2024-05-26T15:28:16.537 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-26T15:28:17.091 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2024-05-26T15:28:18.469 INFO:teuthology.orchestra.run.smithi008.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-26T15:28:18.510 INFO:teuthology.orchestra.run.smithi008.stderr:done 2024-05-26T15:28:18.511 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2024-05-26T15:28:18.531 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.ODk6OBHPek 2024-05-26T15:28:18.531 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ODk6OBHPek 2024-05-26T15:28:18.607 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.ODk6OBHPek 2024-05-26T15:28:18.748 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.ODk6OBHPek is 6KB 2024-05-26T15:28:18.796 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.ODk6OBHPek 2024-05-26T15:28:18.811 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2024-05-26T15:28:18.874 INFO:teuthology.orchestra.run.smithi008.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-26T15:28:18.874 INFO:teuthology.orchestra.run.smithi008.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-26T15:28:18.874 INFO:teuthology.orchestra.run.smithi008.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-26T15:28:18.874 INFO:teuthology.orchestra.run.smithi008.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088.conf 2024-05-26T15:28:18.875 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-gb9459a26b088 2024-05-26T15:28:19.033 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2024-05-26T15:28:37.315 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-26T15:28:37.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-26T15:28:37.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-26T15:28:49.046 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-26T15:28:49.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-05-26T15:28:49.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-26T15:29:37.366 DEBUG:teuthology.orchestra.remote:timed out 2024-05-26T15:29:46.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-26T15:29:46.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-26T15:29:46.778 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-26T15:29:47.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-26T15:29:47.581 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-gb9459a26b088"... 2024-05-26T15:29:47.581 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-26T15:29:47.619 INFO:teuthology.orchestra.run.smithi047.stdout:6.9.0-gb9459a26b088 2024-05-26T15:29:47.619 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-26T15:29:47.619 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-26T15:29:47.619 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-26T15:29:48.623 DEBUG:teuthology.parallel:result is None 2024-05-26T15:29:49.049 DEBUG:teuthology.orchestra.remote:timed out 2024-05-26T15:29:58.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-05-26T15:29:58.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-26T15:30:01.472 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-05-26T15:30:02.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-05-26T15:30:02.190 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gb9459a26b088"... 2024-05-26T15:30:02.191 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2024-05-26T15:30:02.229 INFO:teuthology.orchestra.run.smithi008.stdout:6.9.0-gb9459a26b088 2024-05-26T15:30:02.230 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-26T15:30:02.230 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-26T15:30:02.230 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-26T15:30:03.233 DEBUG:teuthology.parallel:result is None 2024-05-26T15:30:03.233 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-26T15:30:03.240 INFO:teuthology.task.internal:Creating test directory... 2024-05-26T15:30:03.241 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-26T15:30:03.249 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-26T15:30:03.340 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-26T15:30:03.346 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-26T15:30:03.353 INFO:teuthology.task.internal:Creating archive directory... 2024-05-26T15:30:03.353 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-26T15:30:03.360 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-26T15:30:03.461 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-26T15:30:03.468 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-26T15:30:03.468 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-26T15:30:03.473 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-26T15:30:03.575 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-26T15:30:03.644 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-26T15:30:03.663 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-26T15:30:03.738 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-26T15:30:03.743 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-26T15:30:03.751 INFO:teuthology.task.internal:Configuring sudo... 2024-05-26T15:30:03.751 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-26T15:30:03.756 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-26T15:30:03.868 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-26T15:30:03.881 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-26T15:30:03.881 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-26T15:30:03.886 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-26T15:30:03.960 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-26T15:30:04.046 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-26T15:30:04.133 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-26T15:30:04.207 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-26T15:30:04.278 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:30:04.278 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-26T15:30:04.374 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-26T15:30:04.459 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-26T15:30:04.550 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-26T15:30:04.633 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-26T15:30:04.716 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:30:04.716 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-26T15:30:04.780 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2024-05-26T15:30:04.786 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-05-26T15:30:04.888 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-26T15:30:04.933 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-26T15:30:05.187 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-26T15:30:05.197 INFO:teuthology.task.internal:Starting timer... 2024-05-26T15:30:05.198 INFO:teuthology.run_tasks:Running task pcp... 2024-05-26T15:30:05.207 INFO:teuthology.run_tasks:Running task selinux... 2024-05-26T15:30:05.216 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2024-05-26T15:30:05.325 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2024-05-26T15:30:05.329 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-05-26T15:30:05.444 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-05-26T15:30:05.448 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-26T15:30:05.448 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2024-05-26T15:30:05.505 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2024-05-26T15:30:05.505 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-05-26T15:30:05.552 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-05-26T15:30:05.553 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi047.front.sepia.ceph.com': 'permissive'} 2024-05-26T15:30:05.553 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-26T15:30:05.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:30:05.627 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-26T15:30:05.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:30:05.708 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-26T15:30:05.708 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2024-05-26T15:30:05.792 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-05-26T15:30:05.966 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-26T15:30:05.976 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-26T15:30:05.986 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-26T15:30:05.987 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi047.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-26T15:36:29.407 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi047.front.sepia.ceph.com')] 2024-05-26T15:36:29.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-05-26T15:36:29.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-26T15:36:29.519 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-05-26T15:36:29.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-05-26T15:36:29.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-26T15:36:29.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-26T15:36:29.782 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-26T15:36:29.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-26T15:36:29.934 INFO:teuthology.run_tasks:Running task clock... 2024-05-26T15:36:29.948 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-26T15:36:29.949 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-26T15:36:29.949 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-26T15:36:29.957 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-26T15:36:29.958 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-26T15:36:30.048 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-26T15:36:30.059 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-26T15:36:30.093 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-26T15:36:30.105 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-26T15:36:30.174 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2024-05-26T15:36:30.182 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-05-26T15:36:30.210 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2024-05-26T15:36:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-05-26T15:36:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-26T15:36:30.261 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-26T15:36:30.296 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-26T15:36:30.304 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-26T15:36:30.430 INFO:teuthology.orchestra.run.smithi008.stderr:bash: line 1: ntpq: command not found 2024-05-26T15:36:30.438 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-26T15:36:30.438 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2024-05-26T15:36:30.438 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-26T15:36:30.438 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-26T15:36:30.438 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-26T15:36:30.438 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-26T15:36:30.440 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-05-26T15:36:30.448 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-26T15:36:30.448 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-05-26T15:36:30.449 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-26T15:36:30.449 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-26T15:36:30.449 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-26T15:36:30.449 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-26T15:36:30.451 INFO:teuthology.run_tasks:Running task install... 2024-05-26T15:36:30.460 DEBUG:teuthology.task.install:project ceph 2024-05-26T15:36:30.460 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08'}} 2024-05-26T15:36:30.461 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08'} 2024-05-26T15:36:30.461 INFO:teuthology.task.install:Using flavor: default 2024-05-26T15:36:30.466 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-26T15:36:30.466 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-26T15:36:30.467 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08', 'tag': None, 'wait_for_package': False} 2024-05-26T15:36:30.467 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08 2024-05-26T15:36:30.469 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08', 'tag': None, 'wait_for_package': False} 2024-05-26T15:36:30.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08 2024-05-26T15:36:30.626 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/centos/9/flavors/default/ 2024-05-26T15:36:30.626 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1353.g70bbb060 2024-05-26T15:36:30.683 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef/70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/centos/9/flavors/default/ 2024-05-26T15:36:30.683 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1353.g70bbb060 2024-05-26T15:36:30.736 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-26T15:36:30.736 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:36:30.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-26T15:36:30.838 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-26T15:36:30.838 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-26T15:36:30.853 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef/70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef/70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-26T15:36:30.853 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:36:30.853 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-26T15:36:30.949 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-26T15:36:30.949 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-26T15:36:30.970 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-26T15:36:31.086 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-26T15:36:31.089 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-26T15:36:31.171 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2024-05-26T15:36:31.176 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2024-05-26T15:36:31.209 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-26T15:36:31.286 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-05-26T15:36:31.289 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-05-26T15:36:31.507 INFO:teuthology.orchestra.run.smithi008.stdout:45 files removed 2024-05-26T15:36:31.547 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-26T15:36:31.614 INFO:teuthology.orchestra.run.smithi047.stdout:45 files removed 2024-05-26T15:36:31.654 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-26T15:36:32.475 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 160 kB/s | 77 kB 00:00 2024-05-26T15:36:32.580 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 161 kB/s | 77 kB 00:00 2024-05-26T15:36:33.092 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 22 kB/s | 11 kB 00:00 2024-05-26T15:36:33.340 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 17 kB/s | 11 kB 00:00 2024-05-26T15:36:33.960 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2024-05-26T15:36:34.340 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 2.1 kB/s | 1.9 kB 00:00 2024-05-26T15:36:34.690 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.1 MB 00:00 2024-05-26T15:36:36.414 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.1 MB 00:01 2024-05-26T15:36:38.430 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 19 MB 00:02 2024-05-26T15:36:40.614 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 19 MB 00:02 2024-05-26T15:36:43.010 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-26T15:36:45.241 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-05-26T15:36:47.586 INFO:teuthology.orchestra.run.smithi008.stdout:CentOS Stream 9 - Extras packages 5.2 kB/s | 17 kB 00:03 2024-05-26T15:36:48.266 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 17 kB 00:01 2024-05-26T15:36:49.435 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-26T15:36:54.164 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 3.7 MB/s | 21 MB 00:05 2024-05-26T15:36:55.821 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-26T15:36:58.395 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-26T15:36:58.397 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-26T15:36:58.417 INFO:teuthology.orchestra.run.smithi008.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-26T15:36:58.419 INFO:teuthology.orchestra.run.smithi008.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-26T15:36:58.420 INFO:teuthology.orchestra.run.smithi008.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-26T15:36:58.421 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-26T15:36:58.424 INFO:teuthology.orchestra.run.smithi008.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-26T15:36:58.428 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-26T15:36:58.429 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-26T15:36:58.504 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2024-05-26T15:36:58.521 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================= 2024-05-26T15:36:58.521 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2024-05-26T15:36:58.521 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================= 2024-05-26T15:36:58.521 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2024-05-26T15:36:58.521 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-26T15:36:58.521 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 6.5 k 2024-05-26T15:36:58.521 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 5.1 M 2024-05-26T15:36:58.521 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 849 k 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 143 k 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 1.5 M 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 139 k 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 3.5 M 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 7.4 M 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 49 k 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 7.7 M 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 40 M 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 264 k 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 224 k 2024-05-26T15:36:58.522 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 221 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 18 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 31 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 709 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 127 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-26T15:36:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 162 k 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 321 k 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 297 k 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 100 k 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 87 k 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 3.0 M 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 172 k 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-26T15:36:58.524 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 3.3 M 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 3.0 M 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 18 M 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 24 k 2024-05-26T15:36:58.525 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 2.1 M 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 246 k 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 4.7 M 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 17 M 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 16 k 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 25 k 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-26T15:36:58.526 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 166 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 474 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 4.5 M 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-26T15:36:58.527 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 45 k 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 129 k 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-26T15:36:58.528 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-26T15:36:58.529 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-26T15:36:58.530 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-26T15:36:58.531 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-26T15:36:58.532 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-26T15:36:58.533 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:36:58.533 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2024-05-26T15:36:58.533 INFO:teuthology.orchestra.run.smithi008.stdout:======================================================================================= 2024-05-26T15:36:58.533 INFO:teuthology.orchestra.run.smithi008.stdout:Install 130 Packages 2024-05-26T15:36:58.533 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 11 Packages 2024-05-26T15:36:58.533 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:36:58.533 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 203 M 2024-05-26T15:36:58.534 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2024-05-26T15:36:59.390 INFO:teuthology.orchestra.run.smithi008.stdout:(1/141): ceph-18.2.2-1353.g70bbb060.el9.x86_64. 19 kB/s | 6.5 kB 00:00 2024-05-26T15:36:59.898 INFO:teuthology.orchestra.run.smithi008.stdout:(2/141): ceph-base-18.2.2-1353.g70bbb060.el9.x8 6.0 MB/s | 5.1 MB 00:00 2024-05-26T15:36:59.948 INFO:teuthology.orchestra.run.smithi008.stdout:(3/141): ceph-immutable-object-cache-18.2.2-135 2.9 MB/s | 143 kB 00:00 2024-05-26T15:37:00.149 INFO:teuthology.orchestra.run.smithi008.stdout:(4/141): ceph-mds-18.2.2-1353.g70bbb060.el9.x86 11 MB/s | 2.1 MB 00:00 2024-05-26T15:37:00.316 INFO:teuthology.orchestra.run.smithi008.stdout:(5/141): ceph-mgr-18.2.2-1353.g70bbb060.el9.x86 8.8 MB/s | 1.5 MB 00:00 2024-05-26T15:37:00.542 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-26T15:37:00.658 INFO:teuthology.orchestra.run.smithi008.stdout:(6/141): ceph-common-18.2.2-1353.g70bbb060.el9. 11 MB/s | 18 MB 00:01 2024-05-26T15:37:00.699 INFO:teuthology.orchestra.run.smithi008.stdout:(7/141): ceph-fuse-18.2.2-1353.g70bbb060.el9.x8 649 kB/s | 849 kB 00:01 2024-05-26T15:37:00.850 INFO:teuthology.orchestra.run.smithi008.stdout:(8/141): ceph-mon-18.2.2-1353.g70bbb060.el9.x86 8.8 MB/s | 4.7 MB 00:00 2024-05-26T15:37:00.917 INFO:teuthology.orchestra.run.smithi008.stdout:(9/141): ceph-selinux-18.2.2-1353.g70bbb060.el9 383 kB/s | 25 kB 00:00 2024-05-26T15:37:01.884 INFO:teuthology.orchestra.run.smithi008.stdout:(10/141): ceph-osd-18.2.2-1353.g70bbb060.el9.x8 13 MB/s | 17 MB 00:01 2024-05-26T15:37:01.942 INFO:teuthology.orchestra.run.smithi008.stdout:(11/141): cephfs-mirror-18.2.2-1353.g70bbb060.e 3.8 MB/s | 221 kB 00:00 2024-05-26T15:37:02.034 INFO:teuthology.orchestra.run.smithi008.stdout:(12/141): libcephfs-devel-18.2.2-1353.g70bbb060 342 kB/s | 31 kB 00:00 2024-05-26T15:37:02.176 INFO:teuthology.orchestra.run.smithi008.stdout:(13/141): libcephfs2-18.2.2-1353.g70bbb060.el9. 4.9 MB/s | 709 kB 00:00 2024-05-26T15:37:02.251 INFO:teuthology.orchestra.run.smithi008.stdout:(14/141): libcephsqlite-18.2.2-1353.g70bbb060.e 2.2 MB/s | 166 kB 00:00 2024-05-26T15:37:02.352 INFO:teuthology.orchestra.run.smithi008.stdout:(15/141): librados-devel-18.2.2-1353.g70bbb060. 1.3 MB/s | 127 kB 00:00 2024-05-26T15:37:02.427 INFO:teuthology.orchestra.run.smithi008.stdout:(16/141): libradosstriper1-18.2.2-1353.g70bbb06 6.3 MB/s | 474 kB 00:00 2024-05-26T15:37:02.927 INFO:teuthology.orchestra.run.smithi008.stdout:(17/141): librgw2-18.2.2-1353.g70bbb060.el9.x86 8.9 MB/s | 4.5 MB 00:00 2024-05-26T15:37:02.969 INFO:teuthology.orchestra.run.smithi008.stdout:(18/141): python3-ceph-argparse-18.2.2-1353.g70 1.1 MB/s | 45 kB 00:00 2024-05-26T15:37:03.036 INFO:teuthology.orchestra.run.smithi008.stdout:(19/141): python3-ceph-common-18.2.2-1353.g70bb 1.9 MB/s | 129 kB 00:00 2024-05-26T15:37:03.072 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-26T15:37:03.074 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-26T15:37:03.087 INFO:teuthology.orchestra.run.smithi008.stdout:(20/141): python3-cephfs-18.2.2-1353.g70bbb060. 3.2 MB/s | 162 kB 00:00 2024-05-26T15:37:03.095 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-26T15:37:03.097 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-26T15:37:03.098 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-26T15:37:03.100 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-26T15:37:03.102 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-26T15:37:03.106 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-26T15:37:03.107 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-26T15:37:03.145 INFO:teuthology.orchestra.run.smithi008.stdout:(21/141): python3-rados-18.2.2-1353.g70bbb060.e 5.5 MB/s | 321 kB 00:00 2024-05-26T15:37:03.185 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-05-26T15:37:03.202 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-05-26T15:37:03.202 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-05-26T15:37:03.206 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-05-26T15:37:03.206 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-05-26T15:37:03.206 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-26T15:37:03.206 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 6.5 k 2024-05-26T15:37:03.206 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 5.1 M 2024-05-26T15:37:03.206 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 849 k 2024-05-26T15:37:03.206 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 143 k 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 1.5 M 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 139 k 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 3.5 M 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 7.4 M 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 49 k 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 7.7 M 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 40 M 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 264 k 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 224 k 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 221 k 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 18 k 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-26T15:37:03.207 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 31 k 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 709 k 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 127 k 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 162 k 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 321 k 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 297 k 2024-05-26T15:37:03.208 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 100 k 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 87 k 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 3.0 M 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 172 k 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-05-26T15:37:03.209 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 3.3 M 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 3.0 M 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 18 M 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 24 k 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 2.1 M 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 246 k 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 4.7 M 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 17 M 2024-05-26T15:37:03.210 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1353.g70bbb060.el9 ceph-noarch 16 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 25 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 166 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-26T15:37:03.211 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 474 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 4.5 M 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-26T15:37:03.212 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 45 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:18.2.2-1353.g70bbb060.el9 ceph 129 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-26T15:37:03.213 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-26T15:37:03.214 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-26T15:37:03.215 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-26T15:37:03.216 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-26T15:37:03.217 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-26T15:37:03.217 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-26T15:37:03.217 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-26T15:37:03.217 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-26T15:37:03.217 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:37:03.217 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-05-26T15:37:03.217 INFO:teuthology.orchestra.run.smithi047.stdout:======================================================================================= 2024-05-26T15:37:03.217 INFO:teuthology.orchestra.run.smithi047.stdout:Install 130 Packages 2024-05-26T15:37:03.217 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 11 Packages 2024-05-26T15:37:03.217 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:37:03.218 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 203 M 2024-05-26T15:37:03.218 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-05-26T15:37:03.563 INFO:teuthology.orchestra.run.smithi008.stdout:(22/141): ceph-test-18.2.2-1353.g70bbb060.el9.x 15 MB/s | 40 MB 00:02 2024-05-26T15:37:03.604 INFO:teuthology.orchestra.run.smithi008.stdout:(23/141): python3-rbd-18.2.2-1353.g70bbb060.el9 650 kB/s | 297 kB 00:00 2024-05-26T15:37:03.655 INFO:teuthology.orchestra.run.smithi008.stdout:(24/141): python3-rgw-18.2.2-1353.g70bbb060.el9 1.1 MB/s | 100 kB 00:00 2024-05-26T15:37:03.680 INFO:teuthology.orchestra.run.smithi008.stdout:(25/141): rbd-fuse-18.2.2-1353.g70bbb060.el9.x8 1.1 MB/s | 87 kB 00:00 2024-05-26T15:37:03.739 INFO:teuthology.orchestra.run.smithi008.stdout:(26/141): rbd-nbd-18.2.2-1353.g70bbb060.el9.x86 2.9 MB/s | 172 kB 00:00 2024-05-26T15:37:03.806 INFO:teuthology.orchestra.run.smithi008.stdout:(27/141): ceph-grafana-dashboards-18.2.2-1353.g 371 kB/s | 24 kB 00:00 2024-05-26T15:37:03.881 INFO:teuthology.orchestra.run.smithi008.stdout:(28/141): rbd-mirror-18.2.2-1353.g70bbb060.el9. 13 MB/s | 3.0 MB 00:00 2024-05-26T15:37:03.914 INFO:teuthology.orchestra.run.smithi008.stdout:(29/141): ceph-mgr-cephadm-18.2.2-1353.g70bbb06 1.3 MB/s | 139 kB 00:00 2024-05-26T15:37:04.140 INFO:teuthology.orchestra.run.smithi008.stdout:(30/141): ceph-mgr-dashboard-18.2.2-1353.g70bbb 14 MB/s | 3.5 MB 00:00 2024-05-26T15:37:04.177 INFO:teuthology.orchestra.run.smithi047.stdout:(1/141): ceph-18.2.2-1353.g70bbb060.el9.x86_64. 15 kB/s | 6.5 kB 00:00 2024-05-26T15:37:04.215 INFO:teuthology.orchestra.run.smithi008.stdout:(31/141): ceph-mgr-modules-core-18.2.2-1353.g70 3.3 MB/s | 246 kB 00:00 2024-05-26T15:37:04.282 INFO:teuthology.orchestra.run.smithi008.stdout:(32/141): ceph-mgr-rook-18.2.2-1353.g70bbb060.e 748 kB/s | 49 kB 00:00 2024-05-26T15:37:04.349 INFO:teuthology.orchestra.run.smithi008.stdout:(33/141): ceph-prometheus-alerts-18.2.2-1353.g7 250 kB/s | 16 kB 00:00 2024-05-26T15:37:04.508 INFO:teuthology.orchestra.run.smithi008.stdout:(34/141): ceph-mgr-diskprediction-local-18.2.2- 12 MB/s | 7.4 MB 00:00 2024-05-26T15:37:04.541 INFO:teuthology.orchestra.run.smithi008.stdout:(35/141): ceph-volume-18.2.2-1353.g70bbb060.el9 1.3 MB/s | 264 kB 00:00 2024-05-26T15:37:04.575 INFO:teuthology.orchestra.run.smithi008.stdout:(36/141): cephadm-18.2.2-1353.g70bbb060.el9.noa 3.3 MB/s | 224 kB 00:00 2024-05-26T15:37:04.600 INFO:teuthology.orchestra.run.smithi008.stdout:(37/141): cephfs-top-18.2.2-1353.g70bbb060.el9. 315 kB/s | 18 kB 00:00 2024-05-26T15:37:04.719 INFO:teuthology.orchestra.run.smithi047.stdout:(2/141): ceph-fuse-18.2.2-1353.g70bbb060.el9.x8 1.5 MB/s | 849 kB 00:00 2024-05-26T15:37:04.734 INFO:teuthology.orchestra.run.smithi008.stdout:(38/141): fuse-2.9.9-15.el9.x86_64.rpm 509 kB/s | 80 kB 00:00 2024-05-26T15:37:04.818 INFO:teuthology.orchestra.run.smithi008.stdout:(39/141): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-05-26T15:37:04.838 INFO:teuthology.orchestra.run.smithi047.stdout:(3/141): ceph-immutable-object-cache-18.2.2-135 1.2 MB/s | 143 kB 00:00 2024-05-26T15:37:04.851 INFO:teuthology.orchestra.run.smithi008.stdout:(40/141): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-05-26T15:37:04.893 INFO:teuthology.orchestra.run.smithi008.stdout:(41/141): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-05-26T15:37:04.944 INFO:teuthology.orchestra.run.smithi008.stdout:(42/141): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-26T15:37:04.969 INFO:teuthology.orchestra.run.smithi047.stdout:(4/141): ceph-base-18.2.2-1353.g70bbb060.el9.x8 4.1 MB/s | 5.1 MB 00:01 2024-05-26T15:37:04.994 INFO:teuthology.orchestra.run.smithi008.stdout:(43/141): python3-cryptography-36.0.1-4.el9.x86 8.7 MB/s | 1.2 MB 00:00 2024-05-26T15:37:05.028 INFO:teuthology.orchestra.run.smithi008.stdout:(44/141): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-26T15:37:05.054 INFO:teuthology.orchestra.run.smithi008.stdout:(45/141): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-26T15:37:05.087 INFO:teuthology.orchestra.run.smithi008.stdout:(46/141): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-05-26T15:37:05.153 INFO:teuthology.orchestra.run.smithi047.stdout:(5/141): ceph-mgr-18.2.2-1353.g70bbb060.el9.x86 8.0 MB/s | 1.5 MB 00:00 2024-05-26T15:37:05.246 INFO:teuthology.orchestra.run.smithi008.stdout:(47/141): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-05-26T15:37:05.304 INFO:teuthology.orchestra.run.smithi008.stdout:(48/141): bison-3.7.4-5.el9.x86_64.rpm 4.3 MB/s | 943 kB 00:00 2024-05-26T15:37:05.338 INFO:teuthology.orchestra.run.smithi008.stdout:(49/141): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-05-26T15:37:05.363 INFO:teuthology.orchestra.run.smithi008.stdout:(50/141): elfutils-libelf-devel-0.191-4.el9.x86 376 kB/s | 22 kB 00:00 2024-05-26T15:37:05.397 INFO:teuthology.orchestra.run.smithi008.stdout:(51/141): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-05-26T15:37:05.422 INFO:teuthology.orchestra.run.smithi008.stdout:(52/141): flexiblas-3.0.4-8.el9.x86_64.rpm 567 kB/s | 33 kB 00:00 2024-05-26T15:37:05.464 INFO:teuthology.orchestra.run.smithi008.stdout:(53/141): flexiblas-openblas-openmp-3.0.4-8.el9 447 kB/s | 18 kB 00:00 2024-05-26T15:37:05.628 INFO:teuthology.orchestra.run.smithi047.stdout:(6/141): ceph-mon-18.2.2-1353.g70bbb060.el9.x86 9.9 MB/s | 4.7 MB 00:00 2024-05-26T15:37:05.648 INFO:teuthology.orchestra.run.smithi008.stdout:(54/141): libaio-devel-0.3.111-13.el9.x86_64.rp 61 kB/s | 11 kB 00:00 2024-05-26T15:37:05.695 INFO:teuthology.orchestra.run.smithi047.stdout:(7/141): ceph-mds-18.2.2-1353.g70bbb060.el9.x86 2.4 MB/s | 2.1 MB 00:00 2024-05-26T15:37:05.698 INFO:teuthology.orchestra.run.smithi008.stdout:(55/141): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 160 kB 00:00 2024-05-26T15:37:05.782 INFO:teuthology.orchestra.run.smithi008.stdout:(56/141): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.8 MB/s | 3.0 MB 00:00 2024-05-26T15:37:05.807 INFO:teuthology.orchestra.run.smithi008.stdout:(57/141): librabbitmq-0.11.0-7.el9.x86_64.rpm 420 kB/s | 45 kB 00:00 2024-05-26T15:37:05.888 INFO:teuthology.orchestra.run.smithi008.stdout:(58/141): librdkafka-1.6.1-102.el9.x86_64.rpm 6.2 MB/s | 662 kB 00:00 2024-05-26T15:37:05.941 INFO:teuthology.orchestra.run.smithi008.stdout:(59/141): libtool-2.4.6-45.el9.x86_64.rpm 4.3 MB/s | 582 kB 00:00 2024-05-26T15:37:05.966 INFO:teuthology.orchestra.run.smithi008.stdout:(60/141): libuuid-devel-2.37.4-18.el9.x86_64.rp 329 kB/s | 25 kB 00:00 2024-05-26T15:37:05.991 INFO:teuthology.orchestra.run.smithi008.stdout:(61/141): libzstd-devel-1.5.1-2.el9.x86_64.rpm 958 kB/s | 47 kB 00:00 2024-05-26T15:37:06.025 INFO:teuthology.orchestra.run.smithi008.stdout:(62/141): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-05-26T15:37:06.050 INFO:teuthology.orchestra.run.smithi008.stdout:(63/141): openblas-0.3.21-2.el9.x86_64.rpm 612 kB/s | 35 kB 00:00 2024-05-26T15:37:06.184 INFO:teuthology.orchestra.run.smithi008.stdout:(64/141): ceph-radosgw-18.2.2-1353.g70bbb060.el 1.4 MB/s | 7.7 MB 00:05 2024-05-26T15:37:06.245 INFO:teuthology.orchestra.run.smithi047.stdout:(8/141): ceph-common-18.2.2-1353.g70bbb060.el9. 7.3 MB/s | 18 MB 00:02 2024-05-26T15:37:06.304 INFO:teuthology.orchestra.run.smithi047.stdout:(9/141): ceph-selinux-18.2.2-1353.g70bbb060.el9 440 kB/s | 25 kB 00:00 2024-05-26T15:37:06.343 INFO:teuthology.orchestra.run.smithi008.stdout:(65/141): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-26T15:37:06.451 INFO:teuthology.orchestra.run.smithi008.stdout:(66/141): openblas-openmp-0.3.21-2.el9.x86_64.r 11 MB/s | 4.7 MB 00:00 2024-05-26T15:37:06.502 INFO:teuthology.orchestra.run.smithi008.stdout:(67/141): postgresql-contrib-13.14-1.el9.x86_64 5.7 MB/s | 911 kB 00:00 2024-05-26T15:37:06.535 INFO:teuthology.orchestra.run.smithi008.stdout:(68/141): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-05-26T15:37:06.634 INFO:teuthology.orchestra.run.smithi008.stdout:(69/141): postgresql-13.14-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-05-26T15:37:06.748 INFO:teuthology.orchestra.run.smithi008.stdout:(70/141): python3-devel-3.9.18-3.el9.x86_64.rpm 2.1 MB/s | 244 kB 00:00 2024-05-26T15:37:06.812 INFO:teuthology.orchestra.run.smithi008.stdout:(71/141): python3-jinja2-2.11.3-6.el9.noarch.rp 3.9 MB/s | 248 kB 00:00 2024-05-26T15:37:06.854 INFO:teuthology.orchestra.run.smithi008.stdout:(72/141): python3-jsonpatch-1.21-16.el9.noarch. 631 kB/s | 26 kB 00:00 2024-05-26T15:37:06.896 INFO:teuthology.orchestra.run.smithi008.stdout:(73/141): python3-jsonpointer-2.0-4.el9.noarch. 469 kB/s | 19 kB 00:00 2024-05-26T15:37:06.946 INFO:teuthology.orchestra.run.smithi008.stdout:(74/141): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-26T15:37:07.013 INFO:teuthology.orchestra.run.smithi047.stdout:(10/141): ceph-osd-18.2.2-1353.g70bbb060.el9.x8 12 MB/s | 17 MB 00:01 2024-05-26T15:37:07.071 INFO:teuthology.orchestra.run.smithi047.stdout:(11/141): cephfs-mirror-18.2.2-1353.g70bbb060.e 3.8 MB/s | 221 kB 00:00 2024-05-26T15:37:07.071 INFO:teuthology.orchestra.run.smithi008.stdout:(75/141): postgresql-server-13.14-1.el9.x86_64. 10 MB/s | 5.8 MB 00:00 2024-05-26T15:37:07.096 INFO:teuthology.orchestra.run.smithi008.stdout:(76/141): python3-markupsafe-1.1.1-12.el9.x86_6 232 kB/s | 35 kB 00:00 2024-05-26T15:37:07.121 INFO:teuthology.orchestra.run.smithi047.stdout:(12/141): libcephfs-devel-18.2.2-1353.g70bbb060 635 kB/s | 31 kB 00:00 2024-05-26T15:37:07.222 INFO:teuthology.orchestra.run.smithi008.stdout:(77/141): python3-babel-2.9.1-2.el9.noarch.rpm 8.7 MB/s | 6.0 MB 00:00 2024-05-26T15:37:07.255 INFO:teuthology.orchestra.run.smithi008.stdout:(78/141): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-05-26T15:37:07.289 INFO:teuthology.orchestra.run.smithi008.stdout:(79/141): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-26T15:37:07.306 INFO:teuthology.orchestra.run.smithi047.stdout:(13/141): ceph-radosgw-18.2.2-1353.g70bbb060.el 4.8 MB/s | 7.7 MB 00:01 2024-05-26T15:37:07.314 INFO:teuthology.orchestra.run.smithi008.stdout:(80/141): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-26T15:37:07.340 INFO:teuthology.orchestra.run.smithi008.stdout:(81/141): python3-prettytable-0.7.2-27.el9.noar 857 kB/s | 42 kB 00:00 2024-05-26T15:37:07.355 INFO:teuthology.orchestra.run.smithi047.stdout:(14/141): libcephfs2-18.2.2-1353.g70bbb060.el9. 3.0 MB/s | 709 kB 00:00 2024-05-26T15:37:07.390 INFO:teuthology.orchestra.run.smithi008.stdout:(82/141): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-05-26T15:37:07.391 INFO:teuthology.orchestra.run.smithi047.stdout:(15/141): libcephsqlite-18.2.2-1353.g70bbb060.e 2.0 MB/s | 166 kB 00:00 2024-05-26T15:37:07.427 INFO:teuthology.orchestra.run.smithi047.stdout:(16/141): librados-devel-18.2.2-1353.g70bbb060. 1.9 MB/s | 127 kB 00:00 2024-05-26T15:37:07.428 INFO:teuthology.orchestra.run.smithi008.stdout:(83/141): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-05-26T15:37:07.449 INFO:teuthology.orchestra.run.smithi008.stdout:(84/141): python3-pytz-2021.1-5.el9.noarch.rpm 884 kB/s | 51 kB 00:00 2024-05-26T15:37:07.473 INFO:teuthology.orchestra.run.smithi047.stdout:(17/141): libradosstriper1-18.2.2-1353.g70bbb06 5.6 MB/s | 474 kB 00:00 2024-05-26T15:37:07.474 INFO:teuthology.orchestra.run.smithi008.stdout:(85/141): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-05-26T15:37:07.525 INFO:teuthology.orchestra.run.smithi008.stdout:(86/141): python3-toml-0.10.2-6.el9.noarch.rpm 861 kB/s | 42 kB 00:00 2024-05-26T15:37:07.573 INFO:teuthology.orchestra.run.smithi047.stdout:(18/141): python3-ceph-argparse-18.2.2-1353.g70 454 kB/s | 45 kB 00:00 2024-05-26T15:37:07.583 INFO:teuthology.orchestra.run.smithi008.stdout:(87/141): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-05-26T15:37:07.626 INFO:teuthology.orchestra.run.smithi008.stdout:(88/141): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-05-26T15:37:07.675 INFO:teuthology.orchestra.run.smithi008.stdout:(89/141): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-05-26T15:37:07.682 INFO:teuthology.orchestra.run.smithi047.stdout:(19/141): python3-ceph-common-18.2.2-1353.g70bb 1.2 MB/s | 129 kB 00:00 2024-05-26T15:37:07.799 INFO:teuthology.orchestra.run.smithi047.stdout:(20/141): librgw2-18.2.2-1353.g70bbb060.el9.x86 12 MB/s | 4.5 MB 00:00 2024-05-26T15:37:07.801 INFO:teuthology.orchestra.run.smithi008.stdout:(90/141): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.0 MB/s | 5.1 MB 00:00 2024-05-26T15:37:07.826 INFO:teuthology.orchestra.run.smithi008.stdout:(91/141): xmlstarlet-1.6.1-20.el9.x86_64.rpm 426 kB/s | 64 kB 00:00 2024-05-26T15:37:07.832 INFO:teuthology.orchestra.run.smithi047.stdout:(21/141): python3-cephfs-18.2.2-1353.g70bbb060. 1.1 MB/s | 162 kB 00:00 2024-05-26T15:37:07.851 INFO:teuthology.orchestra.run.smithi008.stdout:(92/141): zlib-devel-1.2.11-41.el9.x86_64.rpm 908 kB/s | 45 kB 00:00 2024-05-26T15:37:07.874 INFO:teuthology.orchestra.run.smithi047.stdout:(22/141): python3-rados-18.2.2-1353.g70bbb060.e 4.2 MB/s | 321 kB 00:00 2024-05-26T15:37:07.916 INFO:teuthology.orchestra.run.smithi047.stdout:(23/141): python3-rbd-18.2.2-1353.g70bbb060.el9 3.5 MB/s | 297 kB 00:00 2024-05-26T15:37:07.950 INFO:teuthology.orchestra.run.smithi047.stdout:(24/141): python3-rgw-18.2.2-1353.g70bbb060.el9 1.3 MB/s | 100 kB 00:00 2024-05-26T15:37:07.992 INFO:teuthology.orchestra.run.smithi047.stdout:(25/141): rbd-fuse-18.2.2-1353.g70bbb060.el9.x8 1.1 MB/s | 87 kB 00:00 2024-05-26T15:37:08.109 INFO:teuthology.orchestra.run.smithi047.stdout:(26/141): rbd-nbd-18.2.2-1353.g70bbb060.el9.x86 1.5 MB/s | 172 kB 00:00 2024-05-26T15:37:08.177 INFO:teuthology.orchestra.run.smithi008.stdout:(93/141): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-05-26T15:37:08.217 INFO:teuthology.orchestra.run.smithi047.stdout:(27/141): rbd-mirror-18.2.2-1353.g70bbb060.el9. 11 MB/s | 3.0 MB 00:00 2024-05-26T15:37:08.243 INFO:teuthology.orchestra.run.smithi047.stdout:(28/141): ceph-grafana-dashboards-18.2.2-1353.g 184 kB/s | 24 kB 00:00 2024-05-26T15:37:08.277 INFO:teuthology.orchestra.run.smithi047.stdout:(29/141): ceph-mgr-cephadm-18.2.2-1353.g70bbb06 2.4 MB/s | 139 kB 00:00 2024-05-26T15:37:08.402 INFO:teuthology.orchestra.run.smithi008.stdout:(94/141): fmt-8.1.1-5.el9.x86_64.rpm 193 kB/s | 111 kB 00:00 2024-05-26T15:37:08.544 INFO:teuthology.orchestra.run.smithi008.stdout:(95/141): libarrow-doc-9.0.0-11.el9.noarch.rpm 184 kB/s | 26 kB 00:00 2024-05-26T15:37:08.644 INFO:teuthology.orchestra.run.smithi008.stdout:(96/141): gperftools-libs-2.9.1-2.el9.x86_64.rp 390 kB/s | 309 kB 00:00 2024-05-26T15:37:08.686 INFO:teuthology.orchestra.run.smithi008.stdout:(97/141): liboath-2.6.7-2.el9.x86_64.rpm 344 kB/s | 49 kB 00:00 2024-05-26T15:37:08.735 INFO:teuthology.orchestra.run.smithi047.stdout:(30/141): ceph-mgr-dashboard-18.2.2-1353.g70bbb 7.2 MB/s | 3.5 MB 00:00 2024-05-26T15:37:08.804 INFO:teuthology.orchestra.run.smithi008.stdout:(98/141): libunwind-1.6.2-1.el9.x86_64.rpm 425 kB/s | 67 kB 00:00 2024-05-26T15:37:08.849 INFO:teuthology.orchestra.run.smithi047.stdout:(31/141): ceph-mgr-modules-core-18.2.2-1353.g70 2.1 MB/s | 246 kB 00:00 2024-05-26T15:37:08.986 INFO:teuthology.orchestra.run.smithi047.stdout:(32/141): ceph-mgr-diskprediction-local-18.2.2- 10 MB/s | 7.4 MB 00:00 2024-05-26T15:37:09.011 INFO:teuthology.orchestra.run.smithi047.stdout:(33/141): ceph-mgr-rook-18.2.2-1353.g70bbb060.e 307 kB/s | 49 kB 00:00 2024-05-26T15:37:09.044 INFO:teuthology.orchestra.run.smithi047.stdout:(34/141): ceph-prometheus-alerts-18.2.2-1353.g7 286 kB/s | 16 kB 00:00 2024-05-26T15:37:09.086 INFO:teuthology.orchestra.run.smithi047.stdout:(35/141): ceph-volume-18.2.2-1353.g70bbb060.el9 3.5 MB/s | 264 kB 00:00 2024-05-26T15:37:09.103 INFO:teuthology.orchestra.run.smithi008.stdout:(99/141): libarrow-9.0.0-11.el9.x86_64.rpm 4.8 MB/s | 4.4 MB 00:00 2024-05-26T15:37:09.120 INFO:teuthology.orchestra.run.smithi047.stdout:(36/141): cephadm-18.2.2-1353.g70bbb060.el9.noa 2.9 MB/s | 224 kB 00:00 2024-05-26T15:37:09.146 INFO:teuthology.orchestra.run.smithi008.stdout:(100/141): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.8 MB/s | 839 kB 00:00 2024-05-26T15:37:09.162 INFO:teuthology.orchestra.run.smithi047.stdout:(37/141): cephfs-top-18.2.2-1353.g70bbb060.el9. 245 kB/s | 18 kB 00:00 2024-05-26T15:37:09.196 INFO:teuthology.orchestra.run.smithi008.stdout:(101/141): python3-bcrypt-3.2.2-1.el9.x86_64.rp 475 kB/s | 43 kB 00:00 2024-05-26T15:37:09.238 INFO:teuthology.orchestra.run.smithi008.stdout:(102/141): python3-cachetools-4.2.4-1.el9.noarc 352 kB/s | 32 kB 00:00 2024-05-26T15:37:09.245 INFO:teuthology.orchestra.run.smithi047.stdout:(38/141): fuse-2.9.9-15.el9.x86_64.rpm 646 kB/s | 80 kB 00:00 2024-05-26T15:37:09.288 INFO:teuthology.orchestra.run.smithi008.stdout:(103/141): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2024-05-26T15:37:09.312 INFO:teuthology.orchestra.run.smithi047.stdout:(39/141): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-05-26T15:37:09.347 INFO:teuthology.orchestra.run.smithi008.stdout:(104/141): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2024-05-26T15:37:09.354 INFO:teuthology.orchestra.run.smithi047.stdout:(40/141): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-05-26T15:37:09.381 INFO:teuthology.orchestra.run.smithi008.stdout:(105/141): python3-asyncssh-2.13.2-5.el9.noarch 952 kB/s | 548 kB 00:00 2024-05-26T15:37:09.388 INFO:teuthology.orchestra.run.smithi047.stdout:(41/141): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-05-26T15:37:09.414 INFO:teuthology.orchestra.run.smithi008.stdout:(106/141): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-05-26T15:37:09.438 INFO:teuthology.orchestra.run.smithi047.stdout:(42/141): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-26T15:37:09.464 INFO:teuthology.orchestra.run.smithi008.stdout:(107/141): python3-google-auth-2.29.0-1.el9.noa 1.7 MB/s | 206 kB 00:00 2024-05-26T15:37:09.490 INFO:teuthology.orchestra.run.smithi008.stdout:(108/141): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-05-26T15:37:09.497 INFO:teuthology.orchestra.run.smithi047.stdout:(43/141): python3-cryptography-36.0.1-4.el9.x86 8.7 MB/s | 1.2 MB 00:00 2024-05-26T15:37:09.515 INFO:teuthology.orchestra.run.smithi008.stdout:(109/141): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-05-26T15:37:09.530 INFO:teuthology.orchestra.run.smithi047.stdout:(44/141): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2024-05-26T15:37:09.564 INFO:teuthology.orchestra.run.smithi047.stdout:(45/141): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-05-26T15:37:09.565 INFO:teuthology.orchestra.run.smithi008.stdout:(110/141): python3-jaraco-collections-3.0.0-8.e 232 kB/s | 23 kB 00:00 2024-05-26T15:37:09.598 INFO:teuthology.orchestra.run.smithi047.stdout:(46/141): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-05-26T15:37:09.599 INFO:teuthology.orchestra.run.smithi008.stdout:(111/141): python3-jaraco-functools-3.5.0-2.el9 180 kB/s | 19 kB 00:00 2024-05-26T15:37:09.656 INFO:teuthology.orchestra.run.smithi008.stdout:(112/141): python3-jaraco-text-3.2.0-6.el9.noar 140 kB/s | 20 kB 00:00 2024-05-26T15:37:09.750 INFO:teuthology.orchestra.run.smithi008.stdout:(113/141): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2024-05-26T15:37:09.775 INFO:teuthology.orchestra.run.smithi008.stdout:(114/141): python3-logutils-0.3.5-21.el9.noarch 265 kB/s | 46 kB 00:00 2024-05-26T15:37:09.800 INFO:teuthology.orchestra.run.smithi008.stdout:(115/141): python3-more-itertools-8.12.0-2.el9. 552 kB/s | 79 kB 00:00 2024-05-26T15:37:09.851 INFO:teuthology.orchestra.run.smithi008.stdout:(116/141): python3-natsort-7.1.1-5.el9.noarch.r 579 kB/s | 58 kB 00:00 2024-05-26T15:37:09.901 INFO:teuthology.orchestra.run.smithi008.stdout:(117/141): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-05-26T15:37:09.962 INFO:teuthology.orchestra.run.smithi008.stdout:(118/141): python3-pyOpenSSL-21.0.0-1.el9.noarc 832 kB/s | 90 kB 00:00 2024-05-26T15:37:10.034 INFO:teuthology.orchestra.run.smithi008.stdout:(119/141): python3-repoze-lru-0.7-16.el9.noarch 232 kB/s | 31 kB 00:00 2024-05-26T15:37:10.077 INFO:teuthology.orchestra.run.smithi008.stdout:(120/141): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-05-26T15:37:10.102 INFO:teuthology.orchestra.run.smithi008.stdout:(121/141): python3-pecan-1.4.2-3.el9.noarch.rpm 835 kB/s | 272 kB 00:00 2024-05-26T15:37:10.115 INFO:teuthology.orchestra.run.smithi047.stdout:(47/141): ceph-test-18.2.2-1353.g70bbb060.el9.x 10 MB/s | 40 MB 00:03 2024-05-26T15:37:10.135 INFO:teuthology.orchestra.run.smithi008.stdout:(122/141): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-05-26T15:37:10.178 INFO:teuthology.orchestra.run.smithi008.stdout:(123/141): python3-tempora-5.0.0-2.el9.noarch.r 358 kB/s | 36 kB 00:00 2024-05-26T15:37:10.190 INFO:teuthology.orchestra.run.smithi047.stdout:(48/141): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-05-26T15:37:10.232 INFO:teuthology.orchestra.run.smithi047.stdout:(49/141): bison-3.7.4-5.el9.x86_64.rpm 1.5 MB/s | 943 kB 00:00 2024-05-26T15:37:10.236 INFO:teuthology.orchestra.run.smithi008.stdout:(124/141): python3-typing-extensions-4.4.0-2.el 382 kB/s | 51 kB 00:00 2024-05-26T15:37:10.257 INFO:teuthology.orchestra.run.smithi047.stdout:(50/141): elfutils-libelf-devel-0.191-4.el9.x86 327 kB/s | 22 kB 00:00 2024-05-26T15:37:10.270 INFO:teuthology.orchestra.run.smithi008.stdout:(125/141): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-05-26T15:37:10.291 INFO:teuthology.orchestra.run.smithi047.stdout:(51/141): boost-program-options-1.75.0-8.el9.x8 612 kB/s | 107 kB 00:00 2024-05-26T15:37:10.295 INFO:teuthology.orchestra.run.smithi008.stdout:(126/141): python3-websocket-client-1.2.3-2.el9 767 kB/s | 90 kB 00:00 2024-05-26T15:37:10.325 INFO:teuthology.orchestra.run.smithi047.stdout:(52/141): flex-2.6.4-9.el9.x86_64.rpm 3.4 MB/s | 313 kB 00:00 2024-05-26T15:37:10.350 INFO:teuthology.orchestra.run.smithi047.stdout:(53/141): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 33 kB 00:00 2024-05-26T15:37:10.371 INFO:teuthology.orchestra.run.smithi008.stdout:(127/141): python3-zc-lockfile-2.0-10.el9.noarc 201 kB/s | 20 kB 00:00 2024-05-26T15:37:10.421 INFO:teuthology.orchestra.run.smithi008.stdout:(128/141): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-05-26T15:37:10.425 INFO:teuthology.orchestra.run.smithi047.stdout:(54/141): flexiblas-openblas-openmp-3.0.4-8.el9 183 kB/s | 18 kB 00:00 2024-05-26T15:37:10.451 INFO:teuthology.orchestra.run.smithi047.stdout:(55/141): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-05-26T15:37:10.493 INFO:teuthology.orchestra.run.smithi047.stdout:(56/141): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-05-26T15:37:10.518 INFO:teuthology.orchestra.run.smithi047.stdout:(57/141): librabbitmq-0.11.0-7.el9.x86_64.rpm 683 kB/s | 45 kB 00:00 2024-05-26T15:37:10.521 INFO:teuthology.orchestra.run.smithi008.stdout:(129/141): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-26T15:37:10.602 INFO:teuthology.orchestra.run.smithi047.stdout:(58/141): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.7 MB/s | 3.0 MB 00:00 2024-05-26T15:37:10.630 INFO:teuthology.orchestra.run.smithi008.stdout:(130/141): python3-werkzeug-2.0.3-3.el9.1.noarc 1.1 MB/s | 427 kB 00:00 2024-05-26T15:37:10.643 INFO:teuthology.orchestra.run.smithi047.stdout:(59/141): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-05-26T15:37:10.669 INFO:teuthology.orchestra.run.smithi047.stdout:(60/141): libuuid-devel-2.37.4-18.el9.x86_64.rp 384 kB/s | 25 kB 00:00 2024-05-26T15:37:10.711 INFO:teuthology.orchestra.run.smithi047.stdout:(61/141): libtool-2.4.6-45.el9.x86_64.rpm 3.0 MB/s | 582 kB 00:00 2024-05-26T15:37:10.736 INFO:teuthology.orchestra.run.smithi047.stdout:(62/141): libzstd-devel-1.5.1-2.el9.x86_64.rpm 519 kB/s | 47 kB 00:00 2024-05-26T15:37:10.770 INFO:teuthology.orchestra.run.smithi047.stdout:(63/141): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-05-26T15:37:10.795 INFO:teuthology.orchestra.run.smithi047.stdout:(64/141): openblas-0.3.21-2.el9.x86_64.rpm 425 kB/s | 35 kB 00:00 2024-05-26T15:37:10.805 INFO:teuthology.orchestra.run.smithi008.stdout:(131/141): NetworkManager-1.47.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-05-26T15:37:10.897 INFO:teuthology.orchestra.run.smithi008.stdout:(132/141): librbd1-18.2.2-1353.g70bbb060.el9.x8 8.0 MB/s | 3.0 MB 00:00 2024-05-26T15:37:10.939 INFO:teuthology.orchestra.run.smithi008.stdout:(133/141): NetworkManager-team-1.47.90-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-05-26T15:37:10.979 INFO:teuthology.orchestra.run.smithi047.stdout:(65/141): postgresql-13.14-1.el9.x86_64.rpm 8.7 MB/s | 1.6 MB 00:00 2024-05-26T15:37:11.006 INFO:teuthology.orchestra.run.smithi008.stdout:(134/141): NetworkManager-libnm-1.47.90-1.el9.x 9.0 MB/s | 1.8 MB 00:00 2024-05-26T15:37:11.048 INFO:teuthology.orchestra.run.smithi008.stdout:(135/141): NetworkManager-tui-1.47.90-1.el9.x86 2.2 MB/s | 248 kB 00:00 2024-05-26T15:37:11.073 INFO:teuthology.orchestra.run.smithi008.stdout:(136/141): elfutils-debuginfod-client-0.191-4.e 556 kB/s | 37 kB 00:00 2024-05-26T15:37:11.096 INFO:teuthology.orchestra.run.smithi047.stdout:(66/141): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-05-26T15:37:11.107 INFO:teuthology.orchestra.run.smithi008.stdout:(137/141): elfutils-libelf-0.191-4.el9.x86_64.r 3.5 MB/s | 207 kB 00:00 2024-05-26T15:37:11.161 INFO:teuthology.orchestra.run.smithi008.stdout:(138/141): elfutils-libs-0.191-4.el9.x86_64.rpm 2.9 MB/s | 260 kB 00:00 2024-05-26T15:37:11.196 INFO:teuthology.orchestra.run.smithi047.stdout:(67/141): openblas-openmp-0.3.21-2.el9.x86_64.r 10 MB/s | 4.7 MB 00:00 2024-05-26T15:37:11.229 INFO:teuthology.orchestra.run.smithi047.stdout:(68/141): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-05-26T15:37:11.241 INFO:teuthology.orchestra.run.smithi008.stdout:(139/141): openssl-3.2.1-1.el9.x86_64.rpm 10 MB/s | 1.3 MB 00:00 2024-05-26T15:37:11.280 INFO:teuthology.orchestra.run.smithi047.stdout:(69/141): postgresql-contrib-13.14-1.el9.x86_64 3.0 MB/s | 911 kB 00:00 2024-05-26T15:37:11.333 INFO:teuthology.orchestra.run.smithi008.stdout:(140/141): openssl-libs-3.2.1-1.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-05-26T15:37:11.422 INFO:teuthology.orchestra.run.smithi047.stdout:(70/141): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-05-26T15:37:11.547 INFO:teuthology.orchestra.run.smithi047.stdout:(71/141): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-05-26T15:37:11.581 INFO:teuthology.orchestra.run.smithi047.stdout:(72/141): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-05-26T15:37:11.597 INFO:teuthology.orchestra.run.smithi047.stdout:(73/141): python3-jsonpatch-1.21-16.el9.noarch. 521 kB/s | 26 kB 00:00 2024-05-26T15:37:11.623 INFO:teuthology.orchestra.run.smithi047.stdout:(74/141): python3-jsonpointer-2.0-4.el9.noarch. 466 kB/s | 19 kB 00:00 2024-05-26T15:37:11.665 INFO:teuthology.orchestra.run.smithi047.stdout:(75/141): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-05-26T15:37:11.682 INFO:teuthology.orchestra.run.smithi047.stdout:(76/141): python3-markupsafe-1.1.1-12.el9.x86_6 601 kB/s | 35 kB 00:00 2024-05-26T15:37:11.815 INFO:teuthology.orchestra.run.smithi047.stdout:(77/141): postgresql-server-13.14-1.el9.x86_64. 9.3 MB/s | 5.8 MB 00:00 2024-05-26T15:37:11.849 INFO:teuthology.orchestra.run.smithi047.stdout:(78/141): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-05-26T15:37:11.882 INFO:teuthology.orchestra.run.smithi047.stdout:(79/141): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-26T15:37:11.907 INFO:teuthology.orchestra.run.smithi047.stdout:(80/141): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-26T15:37:11.933 INFO:teuthology.orchestra.run.smithi047.stdout:(81/141): python3-prettytable-0.7.2-27.el9.noar 857 kB/s | 42 kB 00:00 2024-05-26T15:37:11.983 INFO:teuthology.orchestra.run.smithi047.stdout:(82/141): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-05-26T15:37:11.989 INFO:teuthology.orchestra.run.smithi008.stdout:(141/141): librados2-18.2.2-1353.g70bbb060.el9. 2.1 MB/s | 3.3 MB 00:01 2024-05-26T15:37:11.995 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2024-05-26T15:37:11.996 INFO:teuthology.orchestra.run.smithi008.stdout:Total 15 MB/s | 203 MB 00:13 2024-05-26T15:37:12.159 INFO:teuthology.orchestra.run.smithi047.stdout:(83/141): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-05-26T15:37:12.184 INFO:teuthology.orchestra.run.smithi047.stdout:(84/141): python3-pytz-2021.1-5.el9.noarch.rpm 255 kB/s | 51 kB 00:00 2024-05-26T15:37:12.218 INFO:teuthology.orchestra.run.smithi047.stdout:(85/141): python3-pyasn1-modules-0.4.8-6.el9.no 982 kB/s | 279 kB 00:00 2024-05-26T15:37:12.243 INFO:teuthology.orchestra.run.smithi047.stdout:(86/141): python3-requests-oauthlib-1.3.0-12.el 648 kB/s | 54 kB 00:00 2024-05-26T15:37:12.268 INFO:teuthology.orchestra.run.smithi047.stdout:(87/141): python3-toml-0.10.2-6.el9.noarch.rpm 843 kB/s | 42 kB 00:00 2024-05-26T15:37:12.335 INFO:teuthology.orchestra.run.smithi047.stdout:(88/141): socat-1.7.4.1-5.el9.x86_64.rpm 3.3 MB/s | 305 kB 00:00 2024-05-26T15:37:12.402 INFO:teuthology.orchestra.run.smithi047.stdout:(89/141): uuid-1.6.2-55.el9.x86_64.rpm 435 kB/s | 58 kB 00:00 2024-05-26T15:37:12.427 INFO:teuthology.orchestra.run.smithi047.stdout:(90/141): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-05-26T15:37:12.478 INFO:teuthology.orchestra.run.smithi047.stdout:(91/141): xmlstarlet-1.6.1-20.el9.x86_64.rpm 856 kB/s | 64 kB 00:00 2024-05-26T15:37:12.603 INFO:teuthology.orchestra.run.smithi047.stdout:(92/141): zlib-devel-1.2.11-41.el9.x86_64.rpm 257 kB/s | 45 kB 00:00 2024-05-26T15:37:12.803 INFO:teuthology.orchestra.run.smithi047.stdout:(93/141): fmt-8.1.1-5.el9.x86_64.rpm 341 kB/s | 111 kB 00:00 2024-05-26T15:37:13.004 INFO:teuthology.orchestra.run.smithi047.stdout:(94/141): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-05-26T15:37:13.137 INFO:teuthology.orchestra.run.smithi047.stdout:(95/141): gperftools-libs-2.9.1-2.el9.x86_64.rp 579 kB/s | 309 kB 00:00 2024-05-26T15:37:13.196 INFO:teuthology.orchestra.run.smithi047.stdout:(96/141): liboath-2.6.7-2.el9.x86_64.rpm 893 kB/s | 49 kB 00:00 2024-05-26T15:37:13.229 INFO:teuthology.orchestra.run.smithi047.stdout:(97/141): libarrow-doc-9.0.0-11.el9.noarch.rpm 115 kB/s | 26 kB 00:00 2024-05-26T15:37:13.255 INFO:teuthology.orchestra.run.smithi047.stdout:(98/141): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-26T15:37:13.522 INFO:teuthology.orchestra.run.smithi047.stdout:(99/141): python3-asyncssh-2.13.2-5.el9.noarch. 2.0 MB/s | 548 kB 00:00 2024-05-26T15:37:13.580 INFO:teuthology.orchestra.run.smithi047.stdout:(100/141): python3-bcrypt-3.2.2-1.el9.x86_64.rp 758 kB/s | 43 kB 00:00 2024-05-26T15:37:13.622 INFO:teuthology.orchestra.run.smithi047.stdout:(101/141): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.1 MB/s | 839 kB 00:00 2024-05-26T15:37:13.647 INFO:teuthology.orchestra.run.smithi047.stdout:(102/141): python3-cachetools-4.2.4-1.el9.noarc 488 kB/s | 32 kB 00:00 2024-05-26T15:37:13.681 INFO:teuthology.orchestra.run.smithi047.stdout:(103/141): python3-certifi-2021.10.8-2.el9.noar 260 kB/s | 15 kB 00:00 2024-05-26T15:37:13.740 INFO:teuthology.orchestra.run.smithi047.stdout:(104/141): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-05-26T15:37:13.890 INFO:teuthology.orchestra.run.smithi047.stdout:(105/141): libarrow-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2024-05-26T15:37:13.924 INFO:teuthology.orchestra.run.smithi047.stdout:(106/141): python3-google-auth-2.29.0-1.el9.noa 1.1 MB/s | 206 kB 00:00 2024-05-26T15:37:13.949 INFO:teuthology.orchestra.run.smithi047.stdout:(107/141): python3-jaraco-8.2.1-3.el9.noarch.rp 186 kB/s | 11 kB 00:00 2024-05-26T15:37:13.982 INFO:teuthology.orchestra.run.smithi047.stdout:(108/141): python3-cherrypy-18.6.1-2.el9.noarch 1.2 MB/s | 358 kB 00:00 2024-05-26T15:37:14.024 INFO:teuthology.orchestra.run.smithi047.stdout:(109/141): python3-jaraco-classes-3.2.1-5.el9.n 178 kB/s | 18 kB 00:00 2024-05-26T15:37:14.049 INFO:teuthology.orchestra.run.smithi047.stdout:(110/141): python3-jaraco-collections-3.0.0-8.e 232 kB/s | 23 kB 00:00 2024-05-26T15:37:14.075 INFO:teuthology.orchestra.run.smithi047.stdout:(111/141): python3-jaraco-functools-3.5.0-2.el9 212 kB/s | 19 kB 00:00 2024-05-26T15:37:14.100 INFO:teuthology.orchestra.run.smithi047.stdout:(112/141): python3-jaraco-text-3.2.0-6.el9.noar 404 kB/s | 20 kB 00:00 2024-05-26T15:37:14.126 INFO:teuthology.orchestra.run.smithi047.stdout:(113/141): python3-logutils-0.3.5-21.el9.noarch 927 kB/s | 46 kB 00:00 2024-05-26T15:37:14.151 INFO:teuthology.orchestra.run.smithi047.stdout:(114/141): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-05-26T15:37:14.176 INFO:teuthology.orchestra.run.smithi047.stdout:(115/141): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-26T15:37:14.218 INFO:teuthology.orchestra.run.smithi047.stdout:(116/141): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-05-26T15:37:14.235 INFO:teuthology.orchestra.run.smithi047.stdout:(117/141): python3-portend-3.1.0-2.el9.noarch.r 284 kB/s | 16 kB 00:00 2024-05-26T15:37:14.277 INFO:teuthology.orchestra.run.smithi047.stdout:(118/141): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-05-26T15:37:14.294 INFO:teuthology.orchestra.run.smithi047.stdout:(119/141): python3-repoze-lru-0.7-16.el9.noarch 531 kB/s | 31 kB 00:00 2024-05-26T15:37:14.344 INFO:teuthology.orchestra.run.smithi047.stdout:(120/141): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-05-26T15:37:14.370 INFO:teuthology.orchestra.run.smithi047.stdout:(121/141): python3-rsa-4.9-2.el9.noarch.rpm 793 kB/s | 59 kB 00:00 2024-05-26T15:37:14.411 INFO:teuthology.orchestra.run.smithi047.stdout:(122/141): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-05-26T15:37:14.437 INFO:teuthology.orchestra.run.smithi047.stdout:(123/141): python3-tempora-5.0.0-2.el9.noarch.r 391 kB/s | 36 kB 00:00 2024-05-26T15:37:14.470 INFO:teuthology.orchestra.run.smithi047.stdout:(124/141): python3-typing-extensions-4.4.0-2.el 511 kB/s | 51 kB 00:00 2024-05-26T15:37:14.496 INFO:teuthology.orchestra.run.smithi047.stdout:(125/141): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-05-26T15:37:14.529 INFO:teuthology.orchestra.run.smithi047.stdout:(126/141): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-05-26T15:37:14.554 INFO:teuthology.orchestra.run.smithi047.stdout:(127/141): python3-zc-lockfile-2.0-10.el9.noarc 346 kB/s | 20 kB 00:00 2024-05-26T15:37:14.622 INFO:teuthology.orchestra.run.smithi047.stdout:(128/141): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-05-26T15:37:14.647 INFO:teuthology.orchestra.run.smithi047.stdout:(129/141): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-05-26T15:37:14.797 INFO:teuthology.orchestra.run.smithi047.stdout:(130/141): thrift-0.15.0-2.el9.x86_64.rpm 6.6 MB/s | 1.6 MB 00:00 2024-05-26T15:37:14.952 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2024-05-26T15:37:14.997 INFO:teuthology.orchestra.run.smithi047.stdout:(131/141): librbd1-18.2.2-1353.g70bbb060.el9.x8 8.6 MB/s | 3.0 MB 00:00 2024-05-26T15:37:15.048 INFO:teuthology.orchestra.run.smithi047.stdout:(132/141): NetworkManager-1.47.90-1.el9.x86_64. 9.3 MB/s | 2.3 MB 00:00 2024-05-26T15:37:15.081 INFO:teuthology.orchestra.run.smithi047.stdout:(133/141): NetworkManager-team-1.47.90-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-05-26T15:37:15.180 INFO:teuthology.orchestra.run.smithi047.stdout:(134/141): librados2-18.2.2-1353.g70bbb060.el9. 5.9 MB/s | 3.3 MB 00:00 2024-05-26T15:37:15.214 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2024-05-26T15:37:15.214 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2024-05-26T15:37:15.215 INFO:teuthology.orchestra.run.smithi047.stdout:(135/141): NetworkManager-tui-1.47.90-1.el9.x86 1.8 MB/s | 248 kB 00:00 2024-05-26T15:37:15.290 INFO:teuthology.orchestra.run.smithi047.stdout:(136/141): NetworkManager-libnm-1.47.90-1.el9.x 6.2 MB/s | 1.8 MB 00:00 2024-05-26T15:37:15.315 INFO:teuthology.orchestra.run.smithi047.stdout:(137/141): elfutils-debuginfod-client-0.191-4.e 273 kB/s | 37 kB 00:00 2024-05-26T15:37:15.349 INFO:teuthology.orchestra.run.smithi047.stdout:(138/141): elfutils-libelf-0.191-4.el9.x86_64.r 1.5 MB/s | 207 kB 00:00 2024-05-26T15:37:15.382 INFO:teuthology.orchestra.run.smithi047.stdout:(139/141): elfutils-libs-0.191-4.el9.x86_64.rpm 2.8 MB/s | 260 kB 00:00 2024-05-26T15:37:15.475 INFO:teuthology.orchestra.run.smithi047.stdout:(140/141): openssl-libs-3.2.1-1.el9.x86_64.rpm 19 MB/s | 2.4 MB 00:00 2024-05-26T15:37:15.525 INFO:teuthology.orchestra.run.smithi047.stdout:(141/141): openssl-3.2.1-1.el9.x86_64.rpm 6.5 MB/s | 1.3 MB 00:00 2024-05-26T15:37:15.537 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-05-26T15:37:15.538 INFO:teuthology.orchestra.run.smithi047.stdout:Total 16 MB/s | 203 MB 00:12 2024-05-26T15:37:17.883 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2024-05-26T15:37:17.884 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2024-05-26T15:37:18.362 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-05-26T15:37:18.628 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-05-26T15:37:18.628 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-05-26T15:37:21.204 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-05-26T15:37:21.205 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-05-26T15:37:24.213 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2024-05-26T15:37:24.298 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/152 2024-05-26T15:37:24.379 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/152 2024-05-26T15:37:24.507 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/152 2024-05-26T15:37:24.563 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/152 2024-05-26T15:37:24.601 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/152 2024-05-26T15:37:24.704 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/152 2024-05-26T15:37:25.294 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/152 2024-05-26T15:37:25.399 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:18.2.2-1353.g70bbb060.el9.x86_64 8/152 2024-05-26T15:37:25.577 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:18.2.2-1353.g70bbb060.el9.x86_64 8/152 2024-05-26T15:37:25.616 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:18.2.2-1353.g70bbb060.el9.x86_64 9/152 2024-05-26T15:37:25.759 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:18.2.2-1353.g70bbb060.el9.x86_64 9/152 2024-05-26T15:37:25.791 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:18.2.2-1353.g70bbb060.el9.x86_64 10/152 2024-05-26T15:37:25.881 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/152 2024-05-26T15:37:26.311 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/152 2024-05-26T15:37:26.381 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/152 2024-05-26T15:37:26.406 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:18.2.2-1353.g70bbb060.el9.x86_64 14/152 2024-05-26T15:37:26.551 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1353.g70bbb060.el9.x86_64 14/152 2024-05-26T15:37:26.582 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:18.2.2-1353.g70bbb060.el9.x86 15/152 2024-05-26T15:37:26.944 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1353.g70bbb060.el9.x86 15/152 2024-05-26T15:37:27.134 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 16/152 2024-05-26T15:37:27.225 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 16/152 2024-05-26T15:37:27.257 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-05-26T15:37:27.414 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 17/152 2024-05-26T15:37:27.432 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/152 2024-05-26T15:37:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/152 2024-05-26T15:37:27.546 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 17/152 2024-05-26T15:37:27.639 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/152 2024-05-26T15:37:27.698 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/152 2024-05-26T15:37:27.734 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/152 2024-05-26T15:37:27.844 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/152 2024-05-26T15:37:27.955 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 17/152 2024-05-26T15:37:28.004 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-05-26T15:37:28.054 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-05-26T15:37:28.168 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-05-26T15:37:28.218 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-05-26T15:37:28.251 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-05-26T15:37:28.275 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/152 2024-05-26T15:37:28.390 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:18.2.2-1353.g70bbb060.el9.x86_64 8/152 2024-05-26T15:37:28.401 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/152 2024-05-26T15:37:28.477 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 24/152 2024-05-26T15:37:28.512 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/152 2024-05-26T15:37:28.559 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/152 2024-05-26T15:37:28.570 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:18.2.2-1353.g70bbb060.el9.x86_64 8/152 2024-05-26T15:37:28.607 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:18.2.2-1353.g70bbb060.el9.x86_64 9/152 2024-05-26T15:37:28.666 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/152 2024-05-26T15:37:28.708 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:18.2.2-1353.g70bbb060.el9. 28/152 2024-05-26T15:37:28.751 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:18.2.2-1353.g70bbb060.el9.x86_64 9/152 2024-05-26T15:37:28.761 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:18.2.2-1353.g70bbb060.el 29/152 2024-05-26T15:37:28.790 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:18.2.2-1353.g70bbb060.el9.x86_64 10/152 2024-05-26T15:37:28.878 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/152 2024-05-26T15:37:28.888 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:18.2.2-1353.g70bbb060.el9.x86_6 30/152 2024-05-26T15:37:29.062 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/152 2024-05-26T15:37:29.218 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/152 2024-05-26T15:37:29.259 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/152 2024-05-26T15:37:29.330 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/152 2024-05-26T15:37:29.354 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:18.2.2-1353.g70bbb060.el9.x86_64 14/152 2024-05-26T15:37:29.505 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1353.g70bbb060.el9.x86_64 14/152 2024-05-26T15:37:29.539 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:18.2.2-1353.g70bbb060.el9.x86 15/152 2024-05-26T15:37:29.854 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1353.g70bbb060.el9.x86 15/152 2024-05-26T15:37:29.944 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/152 2024-05-26T15:37:30.071 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 16/152 2024-05-26T15:37:30.091 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/152 2024-05-26T15:37:30.133 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/152 2024-05-26T15:37:30.149 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 16/152 2024-05-26T15:37:30.196 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/152 2024-05-26T15:37:30.262 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:18.2.2-1353.g70bbb060.el9.x86_6 37/152 2024-05-26T15:37:30.318 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 17/152 2024-05-26T15:37:30.439 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 17/152 2024-05-26T15:37:30.672 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 38/152 2024-05-26T15:37:30.835 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 17/152 2024-05-26T15:37:30.877 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-05-26T15:37:30.923 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 39/152 2024-05-26T15:37:30.927 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-05-26T15:37:31.002 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 40/152 2024-05-26T15:37:31.041 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-05-26T15:37:31.098 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-05-26T15:37:31.131 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-05-26T15:37:31.170 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : re2-1:20211101-3.el9.x86_64 41/152 2024-05-26T15:37:31.246 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/152 2024-05-26T15:37:31.283 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 42/152 2024-05-26T15:37:31.324 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 24/152 2024-05-26T15:37:31.360 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/152 2024-05-26T15:37:31.375 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 43/152 2024-05-26T15:37:31.417 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/152 2024-05-26T15:37:31.492 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 44/152 2024-05-26T15:37:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/152 2024-05-26T15:37:31.542 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 45/152 2024-05-26T15:37:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:18.2.2-1353.g70bbb060.el9. 28/152 2024-05-26T15:37:31.592 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 46/152 2024-05-26T15:37:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:18.2.2-1353.g70bbb060.el 29/152 2024-05-26T15:37:31.674 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 47/152 2024-05-26T15:37:31.732 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:18.2.2-1353.g70bbb060.el9.x86_6 30/152 2024-05-26T15:37:31.742 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 48/152 2024-05-26T15:37:31.809 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 49/152 2024-05-26T15:37:31.905 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/152 2024-05-26T15:37:31.964 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/152 2024-05-26T15:37:32.021 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 50/152 2024-05-26T15:37:32.083 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 51/152 2024-05-26T15:37:32.131 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 52/152 2024-05-26T15:37:32.284 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 53/152 2024-05-26T15:37:32.332 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 54/152 2024-05-26T15:37:32.385 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 55/152 2024-05-26T15:37:32.423 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 56/152 2024-05-26T15:37:32.463 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 57/152 2024-05-26T15:37:32.504 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fmt-8.1.1-5.el9.x86_64 58/152 2024-05-26T15:37:32.558 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 59/152 2024-05-26T15:37:32.639 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/152 2024-05-26T15:37:32.658 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 60/152 2024-05-26T15:37:32.723 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : uuid-1.6.2-55.el9.x86_64 61/152 2024-05-26T15:37:32.781 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 62/152 2024-05-26T15:37:32.845 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 63/152 2024-05-26T15:37:32.857 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/152 2024-05-26T15:37:32.902 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 64/152 2024-05-26T15:37:32.907 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/152 2024-05-26T15:37:32.968 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/152 2024-05-26T15:37:33.000 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 65/152 2024-05-26T15:37:33.017 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:18.2.2-1353.g70bbb060.el9.x86_6 37/152 2024-05-26T15:37:33.039 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 66/152 2024-05-26T15:37:33.081 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 38/152 2024-05-26T15:37:33.086 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 67/152 2024-05-26T15:37:33.176 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 68/152 2024-05-26T15:37:33.295 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 39/152 2024-05-26T15:37:33.366 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 40/152 2024-05-26T15:37:33.467 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-packaging-20.9-5.el9.noarch 69/152 2024-05-26T15:37:33.532 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : re2-1:20211101-3.el9.x86_64 41/152 2024-05-26T15:37:33.535 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 70/152 2024-05-26T15:37:33.580 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 42/152 2024-05-26T15:37:33.657 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 43/152 2024-05-26T15:37:33.766 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 44/152 2024-05-26T15:37:33.805 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 45/152 2024-05-26T15:37:33.846 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 46/152 2024-05-26T15:37:33.905 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 47/152 2024-05-26T15:37:33.958 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 48/152 2024-05-26T15:37:34.013 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 49/152 2024-05-26T15:37:34.229 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 50/152 2024-05-26T15:37:34.279 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 51/152 2024-05-26T15:37:34.349 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 52/152 2024-05-26T15:37:34.480 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 53/152 2024-05-26T15:37:34.527 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 54/152 2024-05-26T15:37:34.545 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/152 2024-05-26T15:37:34.591 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 55/152 2024-05-26T15:37:34.607 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 72/152 2024-05-26T15:37:34.627 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 56/152 2024-05-26T15:37:34.639 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 73/152 2024-05-26T15:37:34.666 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 57/152 2024-05-26T15:37:34.708 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fmt-8.1.1-5.el9.x86_64 58/152 2024-05-26T15:37:34.763 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 59/152 2024-05-26T15:37:34.767 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 74/152 2024-05-26T15:37:34.814 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 75/152 2024-05-26T15:37:34.836 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 60/152 2024-05-26T15:37:34.911 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-55.el9.x86_64 61/152 2024-05-26T15:37:34.960 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 62/152 2024-05-26T15:37:35.004 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 63/152 2024-05-26T15:37:35.042 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 64/152 2024-05-26T15:37:35.088 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 65/152 2024-05-26T15:37:35.091 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.21-2.el9.x86_64 76/152 2024-05-26T15:37:35.129 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 66/152 2024-05-26T15:37:35.136 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 77/152 2024-05-26T15:37:35.174 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 67/152 2024-05-26T15:37:35.251 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 68/152 2024-05-26T15:37:35.258 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 78/152 2024-05-26T15:37:35.411 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-20.9-5.el9.noarch 69/152 2024-05-26T15:37:35.477 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 70/152 2024-05-26T15:37:36.178 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 79/152 2024-05-26T15:37:36.330 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 80/152 2024-05-26T15:37:36.461 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/152 2024-05-26T15:37:36.525 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 72/152 2024-05-26T15:37:36.559 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 73/152 2024-05-26T15:37:36.690 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 74/152 2024-05-26T15:37:36.733 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 75/152 2024-05-26T15:37:36.994 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.21-2.el9.x86_64 76/152 2024-05-26T15:37:37.031 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 77/152 2024-05-26T15:37:37.154 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 78/152 2024-05-26T15:37:38.012 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 79/152 2024-05-26T15:37:38.079 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 81/152 2024-05-26T15:37:38.158 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 80/152 2024-05-26T15:37:38.185 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 82/152 2024-05-26T15:37:38.220 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 83/152 2024-05-26T15:37:38.273 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 84/152 2024-05-26T15:37:38.651 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 85/152 2024-05-26T15:37:38.689 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:18.2.2-1353.g70bbb060.el9.x86_64 86/152 2024-05-26T15:37:38.803 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:18.2.2-1353.g70bbb060.el9.x86_64 86/152 2024-05-26T15:37:38.838 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:18.2.2-1353.g70bbb060.el9.x86_64 87/152 2024-05-26T15:37:38.895 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 88/152 2024-05-26T15:37:39.394 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 89/152 2024-05-26T15:37:39.425 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:18.2.2-1353.g70bbb060.el9.x86_64 90/152 2024-05-26T15:37:39.527 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:18.2.2-1353.g70bbb060.el9.x86_64 90/152 2024-05-26T15:37:39.553 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:18.2.2-1353.g70bbb060.el9.x86_64 91/152 2024-05-26T15:37:39.885 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 81/152 2024-05-26T15:37:40.003 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 82/152 2024-05-26T15:37:40.041 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 83/152 2024-05-26T15:37:40.084 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 84/152 2024-05-26T15:37:40.476 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 85/152 2024-05-26T15:37:40.516 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:18.2.2-1353.g70bbb060.el9.x86_64 86/152 2024-05-26T15:37:40.622 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:18.2.2-1353.g70bbb060.el9.x86_64 86/152 2024-05-26T15:37:40.672 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:18.2.2-1353.g70bbb060.el9.x86_64 87/152 2024-05-26T15:37:40.729 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 88/152 2024-05-26T15:37:41.241 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 89/152 2024-05-26T15:37:41.277 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:18.2.2-1353.g70bbb060.el9.x86_64 90/152 2024-05-26T15:37:41.377 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:18.2.2-1353.g70bbb060.el9.x86_64 90/152 2024-05-26T15:37:41.404 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:18.2.2-1353.g70bbb060.el9.x86_64 91/152 2024-05-26T15:37:42.147 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 92/152 2024-05-26T15:37:42.183 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 92/152 2024-05-26T15:37:42.849 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 92/152 2024-05-26T15:37:42.895 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:18.2.2-1353.g70bbb060.el9.x86_64 93/152 2024-05-26T15:37:43.056 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:18.2.2-1353.g70bbb060.el9.x86_64 93/152 2024-05-26T15:37:43.057 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-26T15:37:43.057 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-26T15:37:43.057 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:37:43.113 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:18.2.2-1353.g70bbb060.el9.x86_64 94/152 2024-05-26T15:37:43.937 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 92/152 2024-05-26T15:37:43.983 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 92/152 2024-05-26T15:37:44.631 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 92/152 2024-05-26T15:37:44.678 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:18.2.2-1353.g70bbb060.el9.x86_64 93/152 2024-05-26T15:37:44.849 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:18.2.2-1353.g70bbb060.el9.x86_64 93/152 2024-05-26T15:37:44.849 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-26T15:37:44.849 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-26T15:37:44.849 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:37:45.004 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:18.2.2-1353.g70bbb060.el9.x86_64 94/152 2024-05-26T15:37:56.699 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1353.g70bbb060.el9.x86_64 94/152 2024-05-26T15:37:56.699 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2024-05-26T15:37:56.699 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2024-05-26T15:37:56.699 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2024-05-26T15:37:56.700 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2024-05-26T15:37:56.700 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2024-05-26T15:37:56.700 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /root 2024-05-26T15:37:56.700 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2024-05-26T15:37:56.700 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:37:56.931 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:18.2.2-1353.g70bbb060.el9.noarch 95/152 2024-05-26T15:37:56.981 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:18.2.2-1353.g70bbb060.el9.noarch 95/152 2024-05-26T15:37:56.981 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:37:56.981 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-26T15:37:56.981 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:37:57.835 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1353.g70bbb060.el9.x86_64 94/152 2024-05-26T15:37:57.835 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-05-26T15:37:57.835 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-05-26T15:37:57.835 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-05-26T15:37:57.835 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-05-26T15:37:57.835 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-05-26T15:37:57.835 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /root 2024-05-26T15:37:57.835 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-05-26T15:37:57.836 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:37:58.093 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:18.2.2-1353.g70bbb060.el9.noarch 95/152 2024-05-26T15:37:58.142 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:18.2.2-1353.g70bbb060.el9.noarch 95/152 2024-05-26T15:37:58.142 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:37:58.143 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-26T15:37:58.143 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:37:58.631 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:18.2.2-1353.g70bbb060.el9.x86_64 96/152 2024-05-26T15:37:58.716 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:18.2.2-1353.g70bbb060.el9.x86_64 96/152 2024-05-26T15:37:58.716 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:37:58.717 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-26T15:37:58.717 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-26T15:37:58.717 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-26T15:37:58.717 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:37:58.956 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:18.2.2-1353.g70bbb060.el9.x86_64 97/152 2024-05-26T15:37:59.031 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:18.2.2-1353.g70bbb060.el9.x86_64 97/152 2024-05-26T15:37:59.031 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:37:59.031 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-26T15:37:59.032 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-26T15:37:59.032 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-26T15:37:59.032 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:37:59.557 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:18.2.2-1353.g70bbb060.el9.x86_64 98/152 2024-05-26T15:37:59.632 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:18.2.2-1353.g70bbb060.el9.x86_64 98/152 2024-05-26T15:37:59.633 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:37:59.633 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-26T15:37:59.633 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-26T15:37:59.633 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-26T15:37:59.633 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:37:59.795 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:18.2.2-1353.g70bbb060.el9.x86_64 96/152 2024-05-26T15:37:59.795 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.2-8.el9.noarch 99/152 2024-05-26T15:37:59.868 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ply-3.11-14.el9.noarch 100/152 2024-05-26T15:37:59.875 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:18.2.2-1353.g70bbb060.el9.x86_64 96/152 2024-05-26T15:37:59.875 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:37:59.875 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-26T15:37:59.875 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-26T15:37:59.875 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-26T15:37:59.875 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:37:59.952 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 101/152 2024-05-26T15:38:00.112 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:18.2.2-1353.g70bbb060.el9.x86_64 97/152 2024-05-26T15:38:00.188 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:18.2.2-1353.g70bbb060.el9.x86_64 97/152 2024-05-26T15:38:00.188 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:00.188 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-26T15:38:00.188 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-26T15:38:00.188 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-26T15:38:00.189 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:00.234 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 102/152 2024-05-26T15:38:00.314 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 103/152 2024-05-26T15:38:00.408 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 104/152 2024-05-26T15:38:00.525 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 105/152 2024-05-26T15:38:00.704 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:18.2.2-1353.g70bbb060.el9.x86_64 98/152 2024-05-26T15:38:00.715 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2024-05-26T15:38:00.771 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 107/152 2024-05-26T15:38:00.776 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:18.2.2-1353.g70bbb060.el9.x86_64 98/152 2024-05-26T15:38:00.777 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:00.777 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-26T15:38:00.777 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-26T15:38:00.777 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-26T15:38:00.777 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:00.811 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 108/152 2024-05-26T15:38:00.851 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.9-15.el9.x86_64 109/152 2024-05-26T15:38:00.922 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.2-8.el9.noarch 99/152 2024-05-26T15:38:00.987 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ply-3.11-14.el9.noarch 100/152 2024-05-26T15:38:01.061 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 101/152 2024-05-26T15:38:01.316 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 102/152 2024-05-26T15:38:01.385 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 103/152 2024-05-26T15:38:01.484 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 104/152 2024-05-26T15:38:01.563 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:18.2.2-1353.g70bbb060.el9.noarch 110/152 2024-05-26T15:38:01.595 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:18.2.2-1353.g70bbb060.el9.noarch 110/152 2024-05-26T15:38:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 105/152 2024-05-26T15:38:01.673 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1353.g70bbb060.e 111/152 2024-05-26T15:38:01.794 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2024-05-26T15:38:01.800 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1353.g70bbb060. 112/152 2024-05-26T15:38:01.840 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1353.g70bbb060.el9.noa 113/152 2024-05-26T15:38:01.850 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 107/152 2024-05-26T15:38:01.891 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 108/152 2024-05-26T15:38:01.923 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.9-15.el9.x86_64 109/152 2024-05-26T15:38:02.496 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:18.2.2-1353.g70bbb060.el9.noarch 110/152 2024-05-26T15:38:02.527 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:18.2.2-1353.g70bbb060.el9.noarch 110/152 2024-05-26T15:38:02.577 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1353.g70bbb060.e 111/152 2024-05-26T15:38:02.702 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1353.g70bbb060. 112/152 2024-05-26T15:38:02.736 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1353.g70bbb060.el9.noa 113/152 2024-05-26T15:38:03.216 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1353.g70bbb060.el9.noa 113/152 2024-05-26T15:38:03.267 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1353.g70bbb060.el9.n 114/152 2024-05-26T15:38:04.087 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1353.g70bbb060.el9.noa 113/152 2024-05-26T15:38:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1353.g70bbb060.el9.n 114/152 2024-05-26T15:38:04.436 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1353.g70bbb060.el9.n 114/152 2024-05-26T15:38:04.475 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1353.g70b 115/152 2024-05-26T15:38:04.632 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1353.g70b 115/152 2024-05-26T15:38:04.817 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1353.g70bbb060.el 116/152 2024-05-26T15:38:04.844 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:18.2.2-1353.g70bbb060.el9.x86_64 117/152 2024-05-26T15:38:04.917 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1353.g70bbb060.el9.x86_64 117/152 2024-05-26T15:38:04.917 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:04.917 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-26T15:38:04.918 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-26T15:38:04.918 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-26T15:38:04.918 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:04.970 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:18.2.2-1353.g70bbb060.el9.noarch 118/152 2024-05-26T15:38:05.009 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1353.g70bbb060.el9.noarch 118/152 2024-05-26T15:38:05.131 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:18.2.2-1353.g70bbb060.el9.x86_64 119/152 2024-05-26T15:38:05.211 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 120/152 2024-05-26T15:38:05.296 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1353.g70bbb060.el9.n 114/152 2024-05-26T15:38:05.321 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1353.g70b 115/152 2024-05-26T15:38:05.475 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1353.g70b 115/152 2024-05-26T15:38:05.654 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1353.g70bbb060.el 116/152 2024-05-26T15:38:05.689 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:18.2.2-1353.g70bbb060.el9.x86_64 117/152 2024-05-26T15:38:05.762 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1353.g70bbb060.el9.x86_64 117/152 2024-05-26T15:38:05.762 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:05.762 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-26T15:38:05.762 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-26T15:38:05.762 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-26T15:38:05.762 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:05.815 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:18.2.2-1353.g70bbb060.el9.noarch 118/152 2024-05-26T15:38:05.854 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1353.g70bbb060.el9.noarch 118/152 2024-05-26T15:38:05.985 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:18.2.2-1353.g70bbb060.el9.x86_64 119/152 2024-05-26T15:38:06.045 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-45.el9.x86_64 121/152 2024-05-26T15:38:06.062 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 120/152 2024-05-26T15:38:06.072 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:18.2.2-1353.g70bbb060.el9.x86_64 122/152 2024-05-26T15:38:06.161 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1353.g70bbb060.el9.x86_64 122/152 2024-05-26T15:38:06.161 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:06.161 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-26T15:38:06.161 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-26T15:38:06.162 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-26T15:38:06.162 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:06.223 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1353.g70bbb 123/152 2024-05-26T15:38:06.294 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1353.g70bbb 123/152 2024-05-26T15:38:06.294 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:06.294 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-26T15:38:06.294 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:06.374 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 124/152 2024-05-26T15:38:06.457 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 124/152 2024-05-26T15:38:06.457 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:06.457 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-26T15:38:06.458 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-26T15:38:06.458 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-26T15:38:06.458 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:06.833 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 125/152 2024-05-26T15:38:06.885 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-45.el9.x86_64 121/152 2024-05-26T15:38:06.917 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 125/152 2024-05-26T15:38:06.918 INFO:teuthology.orchestra.run.smithi008.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:06.918 INFO:teuthology.orchestra.run.smithi008.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-26T15:38:06.918 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-26T15:38:06.918 INFO:teuthology.orchestra.run.smithi008.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-26T15:38:06.918 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:06.918 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:18.2.2-1353.g70bbb060.el9.x86_64 122/152 2024-05-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1353.g70bbb060.el9.x86_64 122/152 2024-05-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-26T15:38:07.003 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:07.060 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1353.g70bbb 123/152 2024-05-26T15:38:07.133 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1353.g70bbb 123/152 2024-05-26T15:38:07.133 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:07.134 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-26T15:38:07.134 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:07.202 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 124/152 2024-05-26T15:38:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 124/152 2024-05-26T15:38:07.282 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:07.282 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-26T15:38:07.282 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-26T15:38:07.282 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-26T15:38:07.282 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:07.653 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 125/152 2024-05-26T15:38:07.745 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 125/152 2024-05-26T15:38:07.745 INFO:teuthology.orchestra.run.smithi047.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-26T15:38:07.746 INFO:teuthology.orchestra.run.smithi047.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-26T15:38:07.746 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-26T15:38:07.746 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-26T15:38:07.746 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:11.181 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:18.2.2-1353.g70bbb060.el9.x86_64 126/152 2024-05-26T15:38:11.236 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 127/152 2024-05-26T15:38:11.282 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:18.2.2-1353.g70bbb060.el9.x86_64 128/152 2024-05-26T15:38:11.312 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 129/152 2024-05-26T15:38:11.572 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 130/152 2024-05-26T15:38:11.628 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 131/152 2024-05-26T15:38:11.664 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:18.2.2-1353.g70bbb060.el9.x86_ 132/152 2024-05-26T15:38:11.703 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 133/152 2024-05-26T15:38:11.785 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 134/152 2024-05-26T15:38:11.830 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 135/152 2024-05-26T15:38:12.001 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:18.2.2-1353.g70bbb060.el9.x86_64 126/152 2024-05-26T15:38:12.056 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 127/152 2024-05-26T15:38:12.129 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:18.2.2-1353.g70bbb060.el9.x86_64 128/152 2024-05-26T15:38:12.167 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 129/152 2024-05-26T15:38:12.460 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 130/152 2024-05-26T15:38:12.511 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 131/152 2024-05-26T15:38:12.544 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:18.2.2-1353.g70bbb060.el9.x86_ 132/152 2024-05-26T15:38:12.590 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 133/152 2024-05-26T15:38:12.640 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 134/152 2024-05-26T15:38:12.692 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 135/152 2024-05-26T15:38:12.740 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 136/152 2024-05-26T15:38:12.785 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 136/152 2024-05-26T15:38:12.843 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 136/152 2024-05-26T15:38:13.665 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 136/152 2024-05-26T15:38:13.712 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 136/152 2024-05-26T15:38:13.770 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 136/152 2024-05-26T15:38:14.263 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-top-2:18.2.2-1353.g70bbb060.el9.noarch 137/152 2024-05-26T15:38:14.382 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 138/152 2024-05-26T15:38:14.447 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 139/152 2024-05-26T15:38:14.601 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.4-9.el9.x86_64 140/152 2024-05-26T15:38:14.643 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.7.4-5.el9.x86_64 141/152 2024-05-26T15:38:14.677 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 142/152 2024-05-26T15:38:14.742 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 143/152 2024-05-26T15:38:14.787 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 144/152 2024-05-26T15:38:14.788 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/152 2024-05-26T15:38:14.923 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/152 2024-05-26T15:38:14.964 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 146/152 2024-05-26T15:38:14.965 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 147/152 2024-05-26T15:38:15.084 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 147/152 2024-05-26T15:38:15.140 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 148/152 2024-05-26T15:38:15.175 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 149/152 2024-05-26T15:38:15.176 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 149/152 2024-05-26T15:38:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:18.2.2-1353.g70bbb060.el9.noarch 137/152 2024-05-26T15:38:15.344 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 138/152 2024-05-26T15:38:15.406 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 139/152 2024-05-26T15:38:15.519 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 149/152 2024-05-26T15:38:15.520 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 150/152 2024-05-26T15:38:15.551 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.4-9.el9.x86_64 140/152 2024-05-26T15:38:15.587 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.7.4-5.el9.x86_64 141/152 2024-05-26T15:38:15.621 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 142/152 2024-05-26T15:38:15.655 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 143/152 2024-05-26T15:38:15.665 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 150/152 2024-05-26T15:38:15.697 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 144/152 2024-05-26T15:38:15.697 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/152 2024-05-26T15:38:15.701 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 151/152 2024-05-26T15:38:15.824 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 152/152 2024-05-26T15:38:15.846 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/152 2024-05-26T15:38:15.893 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 146/152 2024-05-26T15:38:15.894 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 147/152 2024-05-26T15:38:16.029 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 147/152 2024-05-26T15:38:16.068 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 148/152 2024-05-26T15:38:16.087 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 152/152 2024-05-26T15:38:16.087 INFO:teuthology.orchestra.run.smithi008.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-26T15:38:16.087 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:16.103 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 149/152 2024-05-26T15:38:16.103 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 149/152 2024-05-26T15:38:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 149/152 2024-05-26T15:38:16.422 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 150/152 2024-05-26T15:38:16.567 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 150/152 2024-05-26T15:38:16.620 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 151/152 2024-05-26T15:38:16.745 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 152/152 2024-05-26T15:38:16.996 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: elfutils-libelf-0.190-2.el9.x86_64 152/152 2024-05-26T15:38:16.996 INFO:teuthology.orchestra.run.smithi047.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-26T15:38:16.997 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:21.509 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:18.2.2-1353.g70bbb060.el9.x86_64 1/152 2024-05-26T15:38:21.509 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:18.2.2-1353.g70bbb060.el9.x86_64 2/152 2024-05-26T15:38:21.509 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 3/152 2024-05-26T15:38:21.509 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 4/152 2024-05-26T15:38:21.509 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1353.g70bbb 5/152 2024-05-26T15:38:21.509 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:18.2.2-1353.g70bbb060.el9.x86_64 6/152 2024-05-26T15:38:21.509 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:18.2.2-1353.g70bbb060.el9.x86_64 7/152 2024-05-26T15:38:21.509 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:18.2.2-1353.g70bbb060.el9.x86_64 8/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:18.2.2-1353.g70bbb060.el9.x86_64 9/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:18.2.2-1353.g70bbb060.el9.x86_64 10/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:18.2.2-1353.g70bbb060.el9.x86_64 11/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:18.2.2-1353.g70bbb060.el9.x86_64 12/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 13/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:18.2.2-1353.g70bbb060.el9.x86_ 14/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:18.2.2-1353.g70bbb060.el9.x86_64 15/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:18.2.2-1353.g70bbb060.el9.x86_64 16/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:18.2.2-1353.g70bbb060.el9.x86_6 17/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:18.2.2-1353.g70bbb060.el9.x86 18/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:18.2.2-1353.g70bbb060.el9.x86_64 19/152 2024-05-26T15:38:21.510 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1353.g70bbb060.el 20/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:18.2.2-1353.g70bbb060.el9. 21/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:18.2.2-1353.g70bbb060.el9.x86_6 22/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:18.2.2-1353.g70bbb060.el9.x86_64 23/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:18.2.2-1353.g70bbb060.el9.x86_64 24/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:18.2.2-1353.g70bbb060.el9.x86_64 25/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 26/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 27/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:18.2.2-1353.g70bbb060.el9.x86_64 28/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1353.g70bbb060. 29/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1353.g70bbb060.el9.noa 30/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1353.g70bbb060.el9.n 31/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1353.g70b 32/152 2024-05-26T15:38:21.511 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1353.g70bbb060.el 33/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1353.g70bbb060.el9.noarch 34/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1353.g70bbb060.e 35/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:18.2.2-1353.g70bbb060.el9.noarch 36/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:18.2.2-1353.g70bbb060.el9.noarch 37/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-top-2:18.2.2-1353.g70bbb060.el9.noarch 38/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 39/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/152 2024-05-26T15:38:21.512 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 47/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/152 2024-05-26T15:38:21.513 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 60/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 61/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 64/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 65/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 66/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-13.14-1.el9.x86_64 67/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 68/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 69/152 2024-05-26T15:38:21.514 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 70/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 72/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/152 2024-05-26T15:38:21.515 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 91/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/152 2024-05-26T15:38:21.516 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 107/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/152 2024-05-26T15:38:21.517 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/152 2024-05-26T15:38:21.518 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 124/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 125/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : re2-1:20211101-3.el9.x86_64 129/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:18.2.2-1353.g70bbb060.el9.x86_64 131/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:18.2.2-1353.g70bbb060.el9.x86_64 133/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/152 2024-05-26T15:38:21.519 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 135/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 136/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 137/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 138/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 139/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 141/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 142/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 143/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 145/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 146/152 2024-05-26T15:38:21.520 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 147/152 2024-05-26T15:38:21.521 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 148/152 2024-05-26T15:38:21.521 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 149/152 2024-05-26T15:38:21.521 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 150/152 2024-05-26T15:38:21.521 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 151/152 2024-05-26T15:38:22.350 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:18.2.2-1353.g70bbb060.el9.x86_64 1/152 2024-05-26T15:38:22.350 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:18.2.2-1353.g70bbb060.el9.x86_64 2/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 3/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 4/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1353.g70bbb 5/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:18.2.2-1353.g70bbb060.el9.x86_64 6/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:18.2.2-1353.g70bbb060.el9.x86_64 7/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:18.2.2-1353.g70bbb060.el9.x86_64 8/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:18.2.2-1353.g70bbb060.el9.x86_64 9/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:18.2.2-1353.g70bbb060.el9.x86_64 10/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:18.2.2-1353.g70bbb060.el9.x86_64 11/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:18.2.2-1353.g70bbb060.el9.x86_64 12/152 2024-05-26T15:38:22.351 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 13/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:18.2.2-1353.g70bbb060.el9.x86_ 14/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:18.2.2-1353.g70bbb060.el9.x86_64 15/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:18.2.2-1353.g70bbb060.el9.x86_64 16/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:18.2.2-1353.g70bbb060.el9.x86_6 17/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:18.2.2-1353.g70bbb060.el9.x86 18/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:18.2.2-1353.g70bbb060.el9.x86_64 19/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1353.g70bbb060.el 20/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:18.2.2-1353.g70bbb060.el9. 21/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:18.2.2-1353.g70bbb060.el9.x86_6 22/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:18.2.2-1353.g70bbb060.el9.x86_64 23/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:18.2.2-1353.g70bbb060.el9.x86_64 24/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:18.2.2-1353.g70bbb060.el9.x86_64 25/152 2024-05-26T15:38:22.352 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 26/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 27/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:18.2.2-1353.g70bbb060.el9.x86_64 28/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1353.g70bbb060. 29/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1353.g70bbb060.el9.noa 30/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1353.g70bbb060.el9.n 31/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1353.g70b 32/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1353.g70bbb060.el 33/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1353.g70bbb060.el9.noarch 34/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1353.g70bbb060.e 35/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:18.2.2-1353.g70bbb060.el9.noarch 36/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:18.2.2-1353.g70bbb060.el9.noarch 37/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:18.2.2-1353.g70bbb060.el9.noarch 38/152 2024-05-26T15:38:22.364 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 39/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 47/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/152 2024-05-26T15:38:22.365 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 60/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 61/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 64/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 65/152 2024-05-26T15:38:22.366 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 66/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-13.14-1.el9.x86_64 67/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 68/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 69/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 70/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 72/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/152 2024-05-26T15:38:22.367 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 89/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 91/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/152 2024-05-26T15:38:22.368 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 107/152 2024-05-26T15:38:22.369 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/152 2024-05-26T15:38:22.370 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 124/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 125/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : re2-1:20211101-3.el9.x86_64 129/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:18.2.2-1353.g70bbb060.el9.x86_64 131/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:18.2.2-1353.g70bbb060.el9.x86_64 133/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 135/152 2024-05-26T15:38:22.371 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 136/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 137/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 138/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 139/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 141/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 142/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 143/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 145/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 146/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 147/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 148/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 149/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 150/152 2024-05-26T15:38:22.372 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 151/152 2024-05-26T15:38:23.815 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 152/152 2024-05-26T15:38:23.815 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:23.815 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2024-05-26T15:38:23.815 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-26T15:38:23.815 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-26T15:38:23.815 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-26T15:38:23.815 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-26T15:38:23.815 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-26T15:38:23.815 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.2-8.el9.noarch 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.7.4-5.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:23.816 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.817 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.4-9.el9.x86_64 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: fmt-8.1.1-5.el9.x86_64 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-26T15:38:23.818 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-26T15:38:23.819 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-13.14-1.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-26T15:38:23.820 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-26T15:38:23.821 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-26T15:38:23.822 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ply-3.11-14.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-26T15:38:23.823 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.824 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.825 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:23.825 INFO:teuthology.orchestra.run.smithi008.stdout: re2-1:20211101-3.el9.x86_64 2024-05-26T15:38:23.825 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-26T15:38:23.825 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-26T15:38:23.825 INFO:teuthology.orchestra.run.smithi008.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-26T15:38:23.825 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-26T15:38:23.825 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-26T15:38:23.825 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-26T15:38:23.825 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:23.825 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2024-05-26T15:38:24.374 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 152/152 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-26T15:38:24.375 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.2-8.el9.noarch 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.7.4-5.el9.x86_64 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:24.376 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.377 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:18.2.2-1353.g70bbb060.el9.noarch 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.4-9.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: fmt-8.1.1-5.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.378 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-26T15:38:24.379 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-13.14-1.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.380 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-26T15:38:24.381 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ply-3.11-14.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-26T15:38:24.382 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-26T15:38:24.383 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:18.2.2-1353.g70bbb060.el9.x86_64 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: re2-1:20211101-3.el9.x86_64 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-26T15:38:24.384 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-26T15:38:24.385 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-26T15:38:24.385 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:24.385 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-05-26T15:38:24.519 DEBUG:teuthology.parallel:result is None 2024-05-26T15:38:25.063 DEBUG:teuthology.parallel:result is None 2024-05-26T15:38:25.064 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08 2024-05-26T15:38:25.326 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-26T15:38:25.392 INFO:teuthology.orchestra.run.smithi008.stdout:18.2.2-1353.g70bbb060.el9 2024-05-26T15:38:25.392 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1353.g70bbb060.el9 2024-05-26T15:38:25.393 INFO:teuthology.task.install:The correct ceph version 18.2.2-1353.g70bbb060 is installed. 2024-05-26T15:38:25.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08 2024-05-26T15:38:25.535 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-26T15:38:25.593 INFO:teuthology.orchestra.run.smithi047.stdout:18.2.2-1353.g70bbb060.el9 2024-05-26T15:38:25.594 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1353.g70bbb060.el9 2024-05-26T15:38:25.594 INFO:teuthology.task.install:The correct ceph version 18.2.2-1353.g70bbb060 is installed. 2024-05-26T15:38:25.597 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-26T15:38:25.597 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:25.597 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-26T15:38:25.669 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:38:25.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-26T15:38:25.742 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-26T15:38:25.742 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:25.742 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2024-05-26T15:38:25.811 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-26T15:38:25.923 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:38:25.923 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-05-26T15:38:25.994 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-26T15:38:26.099 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-26T15:38:26.100 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:26.100 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-26T15:38:26.172 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-26T15:38:26.286 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:38:26.286 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-26T15:38:26.367 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-26T15:38:26.479 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-26T15:38:26.480 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:26.480 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2024-05-26T15:38:26.551 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-26T15:38:26.672 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:38:26.672 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-05-26T15:38:26.742 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-26T15:38:26.848 INFO:teuthology.run_tasks:Running task ceph... 2024-05-26T15:38:26.925 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-26T15:38:26.925 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /var/log/ceph 2024-05-26T15:38:26.931 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-05-26T15:38:27.005 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-26T15:38:27.005 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-26T15:38:27.009 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-26T15:38:27.072 INFO:tasks.ceph:Creating extra log directories... 2024-05-26T15:38:27.072 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-26T15:38:27.077 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-26T15:38:27.146 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-26T15:38:27.146 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-26T15:38:27.146 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-26T15:38:27.146 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:27.146 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-26T15:38:27.190 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-26T15:38:27.385 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-26T15:38:27.450 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:38:27.450 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-26T15:38:27.494 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-26T15:38:27.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-26T15:38:27.748 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-26T15:38:27.748 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-26T15:38:27.748 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570', 'branch': 'reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/openfiletable}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7721570', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9743, 'sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08', 'sleep_before_teardown': 0, 'subset': '366/512', 'suite': 'fs', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi008.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEFS+FUKhc1jqWe77aXCi73jMcidd40Cp2qkfBFjkl7YOz4L5t594K9w9ERitS/q1zWDngiGa9inqkVdVIanudU=', 'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPQAbAi6GdQo3gqlVFwqkLjS37qi2D+suT/l6vgFTL7BEuzQ0FLaTeYGf0D2thBCGnPAQRHed0y0U8kUYhvjHo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_openfiletable']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a', 'timestamp': '2024-05-22_22:24:05', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-26T15:38:27.748 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-26T15:38:27.753 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-26T15:38:27.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/run/ceph 2024-05-26T15:38:27.836 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-05-26T15:38:27.906 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:27.906 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2024-05-26T15:38:27.948 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-26T15:38:27.949 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2024-05-26T15:38:28.031 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-26T15:38:28.031 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-26T15:38:28.031 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-05-26T15:38:28.031 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-26T15:38:28.031 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2024-05-26T15:38:28.031 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-05-26 15:38:16.565103111 +0000 2024-05-26T15:38:28.031 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-05-26 15:35:33.131505793 +0000 2024-05-26T15:38:28.031 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-05-26 15:35:33.131505793 +0000 2024-05-26T15:38:28.031 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-05-26 15:35:33.131505793 +0000 2024-05-26T15:38:28.032 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-26T15:38:28.135 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:38:28.135 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:38:28.135 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000273764 s, 1.9 MB/s 2024-05-26T15:38:28.137 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-26T15:38:28.179 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2024-05-26T15:38:28.261 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-26T15:38:28.261 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-26T15:38:28.261 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-26T15:38:28.261 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-26T15:38:28.261 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2024-05-26T15:38:28.261 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-05-26 15:38:16.566103100 +0000 2024-05-26T15:38:28.261 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-05-26 15:35:33.741498721 +0000 2024-05-26T15:38:28.261 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-05-26 15:35:33.741498721 +0000 2024-05-26T15:38:28.262 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-05-26 15:35:33.741498721 +0000 2024-05-26T15:38:28.262 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-26T15:38:28.358 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:38:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:38:28.359 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000189877 s, 2.7 MB/s 2024-05-26T15:38:28.361 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-26T15:38:28.402 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2024-05-26T15:38:28.481 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-26T15:38:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-26T15:38:28.482 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-05-26T15:38:28.482 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-26T15:38:28.482 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2024-05-26T15:38:28.482 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-05-26 15:38:16.567103088 +0000 2024-05-26T15:38:28.482 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-05-26 15:35:34.366491476 +0000 2024-05-26T15:38:28.482 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-05-26 15:35:34.366491476 +0000 2024-05-26T15:38:28.482 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-05-26 15:35:34.366491476 +0000 2024-05-26T15:38:28.483 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-26T15:38:28.580 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:38:28.581 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:38:28.581 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000185324 s, 2.8 MB/s 2024-05-26T15:38:28.583 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-26T15:38:28.626 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2024-05-26T15:38:28.708 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-26T15:38:28.708 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-26T15:38:28.708 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-05-26T15:38:28.708 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-26T15:38:28.708 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2024-05-26T15:38:28.708 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2024-05-26 15:38:16.567103088 +0000 2024-05-26T15:38:28.708 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2024-05-26 15:35:34.977484392 +0000 2024-05-26T15:38:28.708 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2024-05-26 15:35:34.977484392 +0000 2024-05-26T15:38:28.708 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2024-05-26 15:35:34.977484392 +0000 2024-05-26T15:38:28.709 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-26T15:38:28.807 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:38:28.807 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:38:28.807 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000186185 s, 2.7 MB/s 2024-05-26T15:38:28.810 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-26T15:38:28.849 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-26T15:38:28.849 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:38:28.849 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-05-26T15:38:28.896 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-26T15:38:28.897 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-05-26T15:38:28.991 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-26T15:38:28.992 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-26T15:38:28.992 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-05-26T15:38:28.992 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-26T15:38:28.992 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-26T15:38:28.992 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-26 15:38:17.456279959 +0000 2024-05-26T15:38:28.992 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-26 15:35:31.265292697 +0000 2024-05-26T15:38:28.992 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-26 15:35:31.265292697 +0000 2024-05-26T15:38:28.992 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-26 15:35:31.265292697 +0000 2024-05-26T15:38:28.993 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-26T15:38:29.064 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-26T15:38:29.064 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-26T15:38:29.064 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000356133 s, 1.4 MB/s 2024-05-26T15:38:29.068 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-26T15:38:29.112 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-05-26T15:38:29.192 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-26T15:38:29.192 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-26T15:38:29.192 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-05-26T15:38:29.192 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-26T15:38:29.193 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-26T15:38:29.193 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-26 15:38:17.457279938 +0000 2024-05-26T15:38:29.193 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-26 15:35:31.850280228 +0000 2024-05-26T15:38:29.193 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-26 15:35:31.850280228 +0000 2024-05-26T15:38:29.193 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-26 15:35:31.850280228 +0000 2024-05-26T15:38:29.193 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-26T15:38:29.291 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-26T15:38:29.292 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-26T15:38:29.292 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000227128 s, 2.3 MB/s 2024-05-26T15:38:29.294 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-26T15:38:29.336 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-05-26T15:38:29.430 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-26T15:38:29.430 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-26T15:38:29.431 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-05-26T15:38:29.431 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-26T15:38:29.431 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-26T15:38:29.431 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-26 15:38:17.458279917 +0000 2024-05-26T15:38:29.431 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-26 15:35:32.417268142 +0000 2024-05-26T15:38:29.431 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-26 15:35:32.417268142 +0000 2024-05-26T15:38:29.431 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-26 15:35:32.417268142 +0000 2024-05-26T15:38:29.431 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-26T15:38:29.511 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-26T15:38:29.511 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-26T15:38:29.511 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000254223 s, 2.0 MB/s 2024-05-26T15:38:29.515 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-26T15:38:29.572 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-05-26T15:38:29.623 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-26T15:38:29.623 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-26T15:38:29.624 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-05-26T15:38:29.624 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-26T15:38:29.624 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-26T15:38:29.624 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-26 15:38:17.459279896 +0000 2024-05-26T15:38:29.624 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-26 15:35:32.990255929 +0000 2024-05-26T15:38:29.624 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-26 15:35:32.990255929 +0000 2024-05-26T15:38:29.624 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-26 15:35:32.990255929 +0000 2024-05-26T15:38:29.624 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-26T15:38:29.705 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-26T15:38:29.706 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-26T15:38:29.706 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000315871 s, 1.6 MB/s 2024-05-26T15:38:29.710 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-26T15:38:29.764 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-26T15:38:29.764 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-26T15:38:29.764 INFO:tasks.ceph:Generating config... 2024-05-26T15:38:29.765 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-26T15:38:29.765 INFO:tasks.ceph:[client] debug client = 20 2024-05-26T15:38:29.765 INFO:tasks.ceph:[client] debug ms = 1 2024-05-26T15:38:29.766 INFO:tasks.ceph:[client] pid file = 2024-05-26T15:38:29.766 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-26T15:38:29.766 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-26T15:38:29.766 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-26T15:38:29.766 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-26T15:38:29.766 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-26T15:38:29.766 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-26T15:38:29.766 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-26T15:38:29.766 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-26T15:38:29.766 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-26T15:38:29.766 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-26T15:38:29.766 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-26T15:38:29.767 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-26T15:38:29.767 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-26T15:38:29.767 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-26T15:38:29.767 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-26T15:38:29.767 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-26T15:38:29.767 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-26T15:38:29.767 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-26T15:38:29.767 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-26T15:38:29.767 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-26T15:38:29.767 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-26T15:38:29.767 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-26T15:38:29.767 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-26T15:38:29.767 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-26T15:38:29.767 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-26T15:38:29.768 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-26T15:38:29.768 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-26T15:38:29.768 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-26T15:38:29.768 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-26T15:38:29.768 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-26T15:38:29.768 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-26T15:38:29.768 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-26T15:38:29.768 INFO:tasks.ceph:Setting up mon.a... 2024-05-26T15:38:29.768 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-26T15:38:29.928 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.keyring 2024-05-26T15:38:29.939 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-26T15:38:30.066 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-26T15:38:30.147 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.8'), ('mon.b', '172.21.15.47'), ('mon.c', '[v2:172.21.15.47:3301,v1:172.21.15.47:6790]')] 2024-05-26T15:38:30.147 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-26T15:38:30.148 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:30.148 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-26T15:38:30.205 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.8 --add b 172.21.15.47 --addv c '[v2:172.21.15.47:3301,v1:172.21.15.47:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:30.363 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:30.363 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: generated fsid 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:38:30.363 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = pacific 2024-05-26T15:38:30.363 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 0 2024-05-26T15:38:30.363 INFO:teuthology.orchestra.run.smithi008.stdout:fsid 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:38:30.363 INFO:teuthology.orchestra.run.smithi008.stdout:last_changed 2024-05-26T15:38:30.365875+0000 2024-05-26T15:38:30.363 INFO:teuthology.orchestra.run.smithi008.stdout:created 2024-05-26T15:38:30.365875+0000 2024-05-26T15:38:30.363 INFO:teuthology.orchestra.run.smithi008.stdout:min_mon_release 16 (pacific) 2024-05-26T15:38:30.363 INFO:teuthology.orchestra.run.smithi008.stdout:election_strategy: 1 2024-05-26T15:38:30.364 INFO:teuthology.orchestra.run.smithi008.stdout:0: [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon.a 2024-05-26T15:38:30.364 INFO:teuthology.orchestra.run.smithi008.stdout:1: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.b 2024-05-26T15:38:30.364 INFO:teuthology.orchestra.run.smithi008.stdout:2: [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] mon.c 2024-05-26T15:38:30.364 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-26T15:38:30.367 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-26T15:38:30.417 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 03132396-4584-4cf0-b2e0-b5ae6040045e... 2024-05-26T15:38:30.418 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-26T15:38:30.423 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-26T15:38:30.560 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2024-05-26T15:38:30.561 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2024-05-26T15:38:30.562 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2024-05-26T15:38:30.563 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2024-05-26T15:38:30.564 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2024-05-26T15:38:30.565 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 20 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 20 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 10 2024-05-26T15:38:30.566 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:38:30.567 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:38:30.568 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2024-05-26T15:38:30.569 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = "" 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2024-05-26T15:38:30.570 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds balancer = 20 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2024-05-26T15:38:30.571 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2024-05-26T15:38:30.572 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-05-26T15:38:30.572 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-05-26T15:38:30.572 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-05-26T15:38:30.574 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-05-26T15:38:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-05-26T15:38:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-26T15:38:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-05-26T15:38:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-05-26T15:38:30.574 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-26T15:38:30.575 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-05-26T15:38:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-05-26T15:38:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-05-26T15:38:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-05-26T15:38:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-05-26T15:38:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-05-26T15:38:30.576 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-05-26T15:38:30.577 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on skipped message = False 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-05-26T15:38:30.578 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.579 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 20 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 20 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 10 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-05-26T15:38:30.580 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:38:30.581 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:38:30.582 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:38:30.583 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = "" 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-05-26T15:38:30.584 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-26T15:38:30.585 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-26T15:38:30.608 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-26T15:38:30.609 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-26T15:38:30.746 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-26T15:38:30.746 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:30.746 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-26T15:38:30.801 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:30.802 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-26T15:38:30.857 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:38:30.857 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:30.857 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-26T15:38:30.857 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-26T15:38:30.991 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:38:30.992 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:31.093 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:38:31.093 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:38:31.093 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-26T15:38:31.093 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-26T15:38:31.227 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:38:31.227 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:31.311 INFO:tasks.ceph:Setting up mon nodes... 2024-05-26T15:38:31.311 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-26T15:38:31.311 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-26T15:38:31.473 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-26T15:38:31.483 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-26T15:38:31.642 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-26T15:38:31.651 INFO:tasks.ceph:Setting up mds nodes... 2024-05-26T15:38:31.651 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-26T15:38:31.830 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-26T15:38:31.840 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-26T15:38:31.932 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-26T15:38:32.106 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-26T15:38:32.116 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-26T15:38:32.206 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-26T15:38:32.350 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-26T15:38:32.358 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-26T15:38:32.436 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-26T15:38:32.560 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-26T15:38:32.567 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-26T15:38:32.646 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-26T15:38:32.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-26T15:38:32.775 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-26T15:38:32.818 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-26T15:38:32.942 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-26T15:38:32.999 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-26T15:38:33.128 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-26T15:38:33.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-26T15:38:33.302 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-26T15:38:33.350 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-26T15:38:33.351 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-26T15:38:33.351 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-26T15:38:33.446 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-26T15:38:33.446 INFO:tasks.ceph:role: osd.0 2024-05-26T15:38:33.446 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:38:33.447 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-26T15:38:33.535 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-26T15:38:33.535 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-26T15:38:33.535 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-26T15:38:33.535 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-26T15:38:33.535 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-26T15:38:33.535 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2024-05-26T15:38:33.535 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-26T15:38:33.535 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-26T15:38:33.535 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-26T15:38:33.535 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-26T15:38:33.568 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2024-05-26T15:38:33.574 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2024-05-26T15:38:33.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-26T15:38:33.676 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-26T15:38:33.748 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-26T15:38:33.813 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-26T15:38:33.813 INFO:tasks.ceph:role: osd.1 2024-05-26T15:38:33.814 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:38:33.814 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-26T15:38:33.884 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-26T15:38:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-26T15:38:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-26T15:38:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-26T15:38:33.885 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-26T15:38:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2024-05-26T15:38:33.885 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-26T15:38:33.885 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-26T15:38:33.885 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-26T15:38:33.885 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-26T15:38:33.918 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2024-05-26T15:38:33.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2024-05-26T15:38:33.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-26T15:38:34.032 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-26T15:38:34.108 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-26T15:38:34.185 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-26T15:38:34.185 INFO:tasks.ceph:role: osd.2 2024-05-26T15:38:34.186 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:38:34.186 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-26T15:38:34.268 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-26T15:38:34.268 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-26T15:38:34.268 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-26T15:38:34.268 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-26T15:38:34.268 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-26T15:38:34.268 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2024-05-26T15:38:34.269 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-26T15:38:34.269 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-26T15:38:34.269 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-26T15:38:34.269 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-26T15:38:34.303 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2024-05-26T15:38:34.309 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2024-05-26T15:38:34.310 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-26T15:38:34.407 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-26T15:38:34.486 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-26T15:38:34.568 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-26T15:38:34.568 INFO:tasks.ceph:role: osd.3 2024-05-26T15:38:34.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:38:34.568 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-26T15:38:34.649 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-26T15:38:34.649 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-26T15:38:34.649 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-26T15:38:34.649 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-26T15:38:34.649 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-26T15:38:34.649 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2024-05-26T15:38:34.649 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-26T15:38:34.649 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-26T15:38:34.650 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-26T15:38:34.650 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-26T15:38:34.683 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2024-05-26T15:38:34.689 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2024-05-26T15:38:34.689 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-26T15:38:34.796 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-26T15:38:34.877 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:35.021+0000 7f013f7b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-26T15:38:35.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:35.022+0000 7f013f7b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-26T15:38:35.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:35.022+0000 7f013f7b1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-26T15:38:35.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:35.022+0000 7f013f7b1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-26T15:38:35.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:35.022+0000 7f013f7b1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-26T15:38:35.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:35.026+0000 7f013f7b1640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-26T15:38:38.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-26T15:38:38.596 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:38.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:38.733+0000 7f71b301e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-26T15:38:38.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:38.733+0000 7f71b301e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-26T15:38:38.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:38.733+0000 7f71b301e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-26T15:38:38.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:38.734+0000 7f71b301e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-26T15:38:38.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:38.734+0000 7f71b301e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-26T15:38:38.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:38.736+0000 7f71b301e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-26T15:38:41.723 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-26T15:38:41.814 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:41.953+0000 7fa4aae0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-26T15:38:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:41.954+0000 7fa4aae0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-26T15:38:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:41.954+0000 7fa4aae0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-26T15:38:41.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:41.954+0000 7fa4aae0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-26T15:38:41.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:41.954+0000 7fa4aae0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-26T15:38:41.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:41.957+0000 7fa4aae0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-26T15:38:45.148 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-26T15:38:45.238 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:45.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:45.379+0000 7f3c1001e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-26T15:38:45.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:45.379+0000 7f3c1001e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-26T15:38:45.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:45.379+0000 7f3c1001e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-26T15:38:45.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:45.379+0000 7f3c1001e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-26T15:38:45.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:45.379+0000 7f3c1001e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-26T15:38:45.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:38:45.382+0000 7f3c1001e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-26T15:38:48.382 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-26T15:38:48.474 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-26T15:38:48.571 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-26T15:38:48.571 INFO:tasks.ceph:role: osd.4 2024-05-26T15:38:48.571 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:38:48.571 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-26T15:38:48.660 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-26T15:38:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-26T15:38:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-26T15:38:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-26T15:38:48.660 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-26T15:38:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-26T15:38:48.660 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-26T15:38:48.660 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-26T15:38:48.660 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-26T15:38:48.661 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-26T15:38:48.695 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-26T15:38:48.703 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-26T15:38:48.703 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-26T15:38:48.803 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-26T15:38:48.896 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-26T15:38:48.967 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-26T15:38:48.968 INFO:tasks.ceph:role: osd.5 2024-05-26T15:38:48.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:38:48.968 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-26T15:38:49.042 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-26T15:38:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-26T15:38:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-26T15:38:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-26T15:38:49.042 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-26T15:38:49.042 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-26T15:38:49.043 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-26T15:38:49.043 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-26T15:38:49.043 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-26T15:38:49.043 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-26T15:38:49.076 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-26T15:38:49.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-26T15:38:49.081 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-26T15:38:49.181 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-26T15:38:49.253 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-26T15:38:49.320 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-26T15:38:49.320 INFO:tasks.ceph:role: osd.6 2024-05-26T15:38:49.320 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:38:49.320 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-26T15:38:49.387 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-26T15:38:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-26T15:38:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-26T15:38:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-26T15:38:49.388 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-26T15:38:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-26T15:38:49.388 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-26T15:38:49.388 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-26T15:38:49.388 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-26T15:38:49.388 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-26T15:38:49.421 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-26T15:38:49.426 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-26T15:38:49.426 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-26T15:38:49.523 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-26T15:38:49.591 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-26T15:38:49.666 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-26T15:38:49.666 INFO:tasks.ceph:role: osd.7 2024-05-26T15:38:49.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:38:49.666 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-26T15:38:49.739 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-26T15:38:49.739 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-26T15:38:49.739 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-26T15:38:49.739 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-26T15:38:49.739 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-26T15:38:49.739 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-26T15:38:49.739 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-26T15:38:49.739 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-26T15:38:49.739 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-26T15:38:49.739 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-26T15:38:49.772 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-26T15:38:49.776 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-26T15:38:49.777 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-26T15:38:49.868 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-26T15:38:49.942 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:50.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:50.075+0000 7ff493814640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-26T15:38:50.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:50.076+0000 7ff493814640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-26T15:38:50.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:50.076+0000 7ff493814640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-26T15:38:50.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:50.076+0000 7ff493814640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-26T15:38:50.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:50.076+0000 7ff493814640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-26T15:38:50.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:50.079+0000 7ff493814640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-26T15:38:53.290 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-26T15:38:53.382 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:53.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:53.521+0000 7efd593dc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-26T15:38:53.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:53.521+0000 7efd593dc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-26T15:38:53.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:53.521+0000 7efd593dc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-26T15:38:53.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:53.521+0000 7efd593dc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-26T15:38:53.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:53.521+0000 7efd593dc640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-26T15:38:53.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:53.524+0000 7efd593dc640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-26T15:38:56.737 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-26T15:38:56.823 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:38:56.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:56.954+0000 7ff40801c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-26T15:38:56.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:56.954+0000 7ff40801c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-26T15:38:56.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:56.954+0000 7ff40801c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-26T15:38:56.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:56.954+0000 7ff40801c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-26T15:38:56.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:56.954+0000 7ff40801c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-26T15:38:56.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:38:56.957+0000 7ff40801c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-26T15:38:57.749 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:38:57.757 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:38:59.901 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-26T15:38:59.987 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:39:00.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:00.127+0000 7fca67213640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-26T15:39:00.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:00.128+0000 7fca67213640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-26T15:39:00.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:00.128+0000 7fca67213640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-26T15:39:00.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:00.128+0000 7fca67213640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-26T15:39:00.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:00.128+0000 7fca67213640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-26T15:39:00.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:00.130+0000 7fca67213640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-26T15:39:03.102 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-26T15:39:03.185 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-26T15:39:03.186 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:03.186 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-26T15:39:03.280 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:03.280 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-26T15:39:03.367 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:03.368 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-26T15:39:03.458 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:03.458 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-26T15:39:03.545 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:03.545 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-26T15:39:03.635 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:03.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-26T15:39:03.720 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:03.720 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-26T15:39:03.807 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:03.807 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-26T15:39:03.901 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:03.902 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-26T15:39:03.989 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:03.989 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-26T15:39:04.079 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:04.079 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-26T15:39:04.175 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:04.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-26T15:39:04.264 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:04.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-26T15:39:04.350 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:04.350 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-26T15:39:04.444 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:04.444 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-26T15:39:04.506 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:04.506 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-26T15:39:04.563 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:04.563 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-26T15:39:04.623 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:04.623 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-26T15:39:04.678 INFO:tasks.ceph:Adding keys to all mons... 2024-05-26T15:39:04.678 DEBUG:teuthology.orchestra.run.smithi008:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-26T15:39:04.686 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-26T15:39:04.766 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.y] 2024-05-26T15:39:04.766 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB3V1NmaWlhHBAAAmAg0cJJXK6UzcMmFMT/yw== 2024-05-26T15:39:04.766 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2024-05-26T15:39:04.766 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB3V1NmZ26wMRAAoZoNjeFBUXMxHbYTfCOtBA== 2024-05-26T15:39:04.766 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB4V1NmX+V9BhAAx6S6tCtBR2tDklqe7CG7wA== 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.0] 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB7V1NmUOpZARAAc3uRvjCYeU4lJw7r1s3AiQ== 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.1] 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB+V1Nmk/3GKxAAp8wyZeQKXPi9V+o7LVAbKg== 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.2] 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCBV1NmLTbpOBAAaC6G7SPiVuU6KmTlRSClbA== 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.3] 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCFV1NmYoKqFhAAflK4KjRRmrOu+EgBuQT7jg== 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.x] 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB3V1Nm+T1xJhAA3mTY1BPQLGk3uIbA1mic8Q== 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2024-05-26T15:39:04.767 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB4V1Nmy8AOFRAAjOVwhaaLUK6wSxy7D1Z3QA== 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB4V1NmXO+YIRAA88P2s22Ru5aq9vPYoW92qw== 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.4] 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCKV1NmqHWPBBAAruqt9oErqNVChgDC1iRGGA== 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.5] 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCNV1NmgukeHxAAvVd3SjLYAJ6QZKmNwMmWow== 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.6] 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCQV1Nmd4vuOBAAJHtG1d3rWdmKu/7rTPOlBw== 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.7] 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQCUV1Nm/CGlBxAA8STfkaBPPGT7qdfhMsO42g== 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB4V1NmxdRoLhAAY+pqIQGp2qO1BhQMGzQCHg== 2024-05-26T15:39:04.768 INFO:teuthology.orchestra.run.smithi008.stdout:[client.2] 2024-05-26T15:39:04.769 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB4V1NmosBQOBAAKKnJi6JYefpiRa0WliTUyw== 2024-05-26T15:39:04.769 INFO:teuthology.orchestra.run.smithi008.stdout:[client.1] 2024-05-26T15:39:04.769 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB5V1NmdWPVBxAAOZColRSycWDkdlALIYEyow== 2024-05-26T15:39:04.769 INFO:teuthology.orchestra.run.smithi008.stdout:[client.3] 2024-05-26T15:39:04.769 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB5V1Nmu2cxEhAA7SM7KN9DjHqazqVSC1Fjeg== 2024-05-26T15:39:04.772 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.y] 2024-05-26T15:39:04.772 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB3V1NmaWlhHBAAAmAg0cJJXK6UzcMmFMT/yw== 2024-05-26T15:39:04.772 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-26T15:39:04.772 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB3V1NmZ26wMRAAoZoNjeFBUXMxHbYTfCOtBA== 2024-05-26T15:39:04.772 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-26T15:39:04.772 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB4V1NmX+V9BhAAx6S6tCtBR2tDklqe7CG7wA== 2024-05-26T15:39:04.772 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-05-26T15:39:04.772 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB7V1NmUOpZARAAc3uRvjCYeU4lJw7r1s3AiQ== 2024-05-26T15:39:04.772 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB+V1Nmk/3GKxAAp8wyZeQKXPi9V+o7LVAbKg== 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCBV1NmLTbpOBAAaC6G7SPiVuU6KmTlRSClbA== 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCFV1NmYoKqFhAAflK4KjRRmrOu+EgBuQT7jg== 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB3V1Nm+T1xJhAA3mTY1BPQLGk3uIbA1mic8Q== 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB4V1Nmy8AOFRAAjOVwhaaLUK6wSxy7D1Z3QA== 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB4V1NmXO+YIRAA88P2s22Ru5aq9vPYoW92qw== 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCKV1NmqHWPBBAAruqt9oErqNVChgDC1iRGGA== 2024-05-26T15:39:04.773 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCNV1NmgukeHxAAvVd3SjLYAJ6QZKmNwMmWow== 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.6] 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCQV1Nmd4vuOBAAJHtG1d3rWdmKu/7rTPOlBw== 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.7] 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCUV1Nm/CGlBxAA8STfkaBPPGT7qdfhMsO42g== 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB4V1NmxdRoLhAAY+pqIQGp2qO1BhQMGzQCHg== 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout:[client.2] 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB4V1NmosBQOBAAKKnJi6JYefpiRa0WliTUyw== 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout:[client.1] 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB5V1NmdWPVBxAAOZColRSycWDkdlALIYEyow== 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout:[client.3] 2024-05-26T15:39:04.774 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB5V1Nmu2cxEhAA7SM7KN9DjHqazqVSC1Fjeg== 2024-05-26T15:39:04.776 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-26T15:39:04.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-26T15:39:04.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-26T15:39:04.965 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-26T15:39:05.106 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-26T15:39:05.113 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-26T15:39:05.250 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:05.256 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:05.393 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:05.398 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:05.541 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:05.546 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:05.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:05.691 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:05.831 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-26T15:39:05.839 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-26T15:39:05.981 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-26T15:39:05.986 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-26T15:39:06.128 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-26T15:39:06.136 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-26T15:39:06.282 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:06.287 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:06.424 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:06.431 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:06.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:06.580 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:06.723 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:06.731 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-26T15:39:06.872 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-26T15:39:06.877 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-26T15:39:07.016 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-26T15:39:07.021 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-26T15:39:07.159 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-26T15:39:07.166 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-26T15:39:07.312 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-26T15:39:07.319 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-26T15:39:07.460 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-26T15:39:07.460 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-26T15:39:07.553 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-26T15:39:07.715 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-26T15:39:07.795 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-26T15:39:07.890 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-26T15:39:08.044 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-26T15:39:08.119 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-26T15:39:08.205 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-26T15:39:08.359 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-26T15:39:08.435 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:39:08.442 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-26T15:39:08.495 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-26T15:39:08.495 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-26T15:39:08.495 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-26T15:39:08.501 INFO:tasks.ceph.mon.a:Started 2024-05-26T15:39:08.501 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-26T15:39:08.501 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-26T15:39:08.506 INFO:tasks.ceph.mon.b:Started 2024-05-26T15:39:08.506 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-26T15:39:08.506 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-26T15:39:08.510 INFO:tasks.ceph.mon.c:Started 2024-05-26T15:39:08.510 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-26T15:39:08.510 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-26T15:39:08.511 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-26T15:39:08.515 INFO:tasks.ceph.mgr.y:Started 2024-05-26T15:39:08.516 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-26T15:39:08.516 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-26T15:39:08.520 INFO:tasks.ceph.mgr.x:Started 2024-05-26T15:39:08.520 INFO:tasks.ceph:Setting crush tunables to default 2024-05-26T15:39:08.520 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd crush tunables default 2024-05-26T15:39:08.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.693+0000 7fa35e000640 1 Processor -- start 2024-05-26T15:39:08.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.693+0000 7fa35e000640 1 -- start start 2024-05-26T15:39:08.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.694+0000 7fa35e000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 0x7fa3580ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:08.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.694+0000 7fa35e000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa3580cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:08.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.694+0000 7fa35e000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3580cdb80 con 0x7fa358160870 2024-05-26T15:39:08.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.694+0000 7fa35e000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa358154190 con 0x7fa358153db0 2024-05-26T15:39:08.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.694+0000 7fa35e000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa358161410 con 0x7fa3580cf3b0 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa357e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa3580cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa35cc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 0x7fa3580ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa35cc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 0x7fa3580ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:46926/0 (socket says 172.21.15.8:46926) 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa35cc00640 1 -- 172.21.15.8:0/146336036 learned_addr learned my addr 172.21.15.8:0/146336036 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa357e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa3580cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:55592/0 (socket says 172.21.15.8:55592) 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa35d600640 1 --1- 172.21.15.8:0/146336036 >> v1:172.21.15.47:6789/0 conn(0x7fa358160870 0x7fa358160d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:40770/0 (socket says 172.21.15.8:40770) 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa35cc00640 1 -- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 msgr2=0x7fa3580ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa35cc00640 1 -- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 msgr2=0x7fa3580ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa35cc00640 1 --2- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 0x7fa3580ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa357e00640 1 -- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 msgr2=0x7fa3580cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-26T15:39:08.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa357e00640 1 -- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 msgr2=0x7fa3580cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-26T15:39:08.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa35cc00640 1 --2- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 0x7fa3580ce010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-26T15:39:08.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa357e00640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa3580cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-26T15:39:08.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.695+0000 7fa357e00640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa3580cf810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-26T15:39:08.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.896+0000 7fa357e00640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa3580cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:08.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.896+0000 7fa35cc00640 1 --2- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 0x7fa3580ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:08.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.897+0000 7fa357e00640 1 -- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 msgr2=0x7fa3580cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-26T15:39:08.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.897+0000 7fa357e00640 1 -- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 msgr2=0x7fa3580cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-26T15:39:08.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.897+0000 7fa357e00640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa3580cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-26T15:39:08.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.897+0000 7fa357e00640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa3580cf810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-26T15:39:08.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.897+0000 7fa35cc00640 1 -- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 msgr2=0x7fa3580ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-26T15:39:08.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.897+0000 7fa35cc00640 1 -- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 msgr2=0x7fa3580ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-26T15:39:08.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.897+0000 7fa35cc00640 1 --2- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 0x7fa3580ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-26T15:39:08.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.897+0000 7fa35cc00640 1 --2- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 0x7fa3580ce010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-26T15:39:08.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.949+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371816500 0 0) 0x7fa3580cdb80 con 0x7fa358160870 2024-05-26T15:39:08.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.949+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa340003520 con 0x7fa358160870 2024-05-26T15:39:08.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.950+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 <== mon.1 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141719664 0 0) 0x7fa340003520 con 0x7fa358160870 2024-05-26T15:39:08.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.950+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 msgr2=0x7fa3580cf810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-26T15:39:08.948 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.950+0000 7fa357400640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa3580cf810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:08.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.950+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 msgr2=0x7fa3580ce010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-26T15:39:08.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.950+0000 7fa357400640 1 --2- 172.21.15.8:0/146336036 >> v2:172.21.15.47:3300/0 conn(0x7fa358153db0 0x7fa3580ce010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:08.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.950+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580cd270 con 0x7fa358160870 2024-05-26T15:39:08.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.950+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 <== mon.1 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fa3500019f0 con 0x7fa358160870 2024-05-26T15:39:08.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.950+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 >> v1:172.21.15.47:6789/0 conn(0x7fa358160870 legacy=0x7fa358160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.950+0000 7fa357400640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3400039a0 0x7fa340003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.950+0000 7fa357400640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3400047c0 0x7fa340004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.951+0000 7fa357400640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa340005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.951+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa358154190 con 0x7fa3400047c0 2024-05-26T15:39:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.951+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa358161410 con 0x7fa3400039a0 2024-05-26T15:39:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.951+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34000bb00 con 0x7fa3580cf3b0 2024-05-26T15:39:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.951+0000 7fa35cc00640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3400039a0 0x7fa340003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:08.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.952+0000 7fa357e00640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3400047c0 0x7fa340004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.952+0000 7fa35d600640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa340005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:08.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.953+0000 7fa35cc00640 1 -- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 msgr2=0x7fa340005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:08.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.953+0000 7fa35cc00640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3580cf3b0 0x7fa340005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:08.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.953+0000 7fa35cc00640 1 -- 172.21.15.8:0/146336036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3400047c0 msgr2=0x7fa340004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:08.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.953+0000 7fa35cc00640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3400047c0 0x7fa340004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:08.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.953+0000 7fa35cc00640 1 -- 172.21.15.8:0/146336036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa340003520 con 0x7fa3400039a0 2024-05-26T15:39:08.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.955+0000 7fa35cc00640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3400039a0 0x7fa340003dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009940 tx=0x7fa3400057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ec37fe8aef8fea0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:08.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.957+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c033410 con 0x7fa3400039a0 2024-05-26T15:39:08.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.957+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c02d030 con 0x7fa3400039a0 2024-05-26T15:39:08.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.957+0000 7fa357400640 1 -- 172.21.15.8:0/146336036 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c0337b0 con 0x7fa3400039a0 2024-05-26T15:39:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.958+0000 7fa35e000640 1 -- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3400039a0 msgr2=0x7fa340003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.958+0000 7fa35e000640 1 --2- 172.21.15.8:0/146336036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3400039a0 0x7fa340003dc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009940 tx=0x7fa3400057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.958+0000 7fa35d600640 1 -- 172.21.15.8:0/146336036 reap_dead start 2024-05-26T15:39:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.958+0000 7fa35e000640 1 -- 172.21.15.8:0/146336036 shutdown_connections 2024-05-26T15:39:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.958+0000 7fa35e000640 1 -- 172.21.15.8:0/146336036 >> 172.21.15.8:0/146336036 conn(0x7fa35806b880 msgr2=0x7fa3580715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.959+0000 7fa35e000640 1 -- 172.21.15.8:0/146336036 shutdown_connections 2024-05-26T15:39:08.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.959+0000 7fa35e000640 1 -- 172.21.15.8:0/146336036 wait complete. 2024-05-26T15:39:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.962+0000 7fa35e000640 1 Processor -- start 2024-05-26T15:39:08.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.962+0000 7fa35e000640 1 -- start start 2024-05-26T15:39:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.964+0000 7fa35e000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3400039a0 0x7fa35814e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.964+0000 7fa35e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa358155ec0 0x7fa3581f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.964+0000 7fa35e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358143b50 0x7fa358152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:08.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.964+0000 7fa35e000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35814e350 con 0x7fa358155ec0 2024-05-26T15:39:08.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.964+0000 7fa35e000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa358156ed0 con 0x7fa358143b50 2024-05-26T15:39:08.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.964+0000 7fa35e000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa358156630 con 0x7fa3400039a0 2024-05-26T15:39:08.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.964+0000 7fa357e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa358155ec0 0x7fa3581f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:08.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.964+0000 7fa357e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa358155ec0 0x7fa3581f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34996/0 (socket says 172.21.15.8:34996) 2024-05-26T15:39:08.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.964+0000 7fa357e00640 1 -- 172.21.15.8:0/2082482658 learned_addr learned my addr 172.21.15.8:0/2082482658 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:08.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.964+0000 7fa35cc00640 1 --2- 172.21.15.8:0/2082482658 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3400039a0 0x7fa35814e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:08.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.965+0000 7fa35d600640 1 --2- 172.21.15.8:0/2082482658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358143b50 0x7fa358152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:08.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.965+0000 7fa357e00640 1 -- 172.21.15.8:0/2082482658 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3400039a0 msgr2=0x7fa35814e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:08.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.965+0000 7fa357e00640 1 --2- 172.21.15.8:0/2082482658 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3400039a0 0x7fa35814e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:08.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.965+0000 7fa357e00640 1 -- 172.21.15.8:0/2082482658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358143b50 msgr2=0x7fa358152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:08.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.965+0000 7fa357e00640 1 --2- 172.21.15.8:0/2082482658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358143b50 0x7fa358152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:08.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.965+0000 7fa357e00640 1 -- 172.21.15.8:0/2082482658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358156910 con 0x7fa358155ec0 2024-05-26T15:39:08.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.965+0000 7fa357e00640 1 --2- 172.21.15.8:0/2082482658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa358155ec0 0x7fa3581f2a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa34400dfd0 tx=0x7fa344011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:08.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.966+0000 7fa354c00640 1 -- 172.21.15.8:0/2082482658 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344004220 con 0x7fa358155ec0 2024-05-26T15:39:08.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.966+0000 7fa354c00640 1 -- 172.21.15.8:0/2082482658 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa344004380 con 0x7fa358155ec0 2024-05-26T15:39:08.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.966+0000 7fa354c00640 1 -- 172.21.15.8:0/2082482658 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34400f9e0 con 0x7fa358155ec0 2024-05-26T15:39:08.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.966+0000 7fa35e000640 1 -- 172.21.15.8:0/2082482658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa358156bf0 con 0x7fa358155ec0 2024-05-26T15:39:08.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.966+0000 7fa35e000640 1 -- 172.21.15.8:0/2082482658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa358156320 con 0x7fa358155ec0 2024-05-26T15:39:08.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.968+0000 7fa35e000640 1 -- 172.21.15.8:0/2082482658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35804e210 con 0x7fa358155ec0 2024-05-26T15:39:08.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.969+0000 7fa354c00640 1 -- 172.21.15.8:0/2082482658 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa34400fb40 con 0x7fa358155ec0 2024-05-26T15:39:08.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.969+0000 7fa354c00640 1 -- 172.21.15.8:0/2082482658 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa344006030 con 0x7fa358155ec0 2024-05-26T15:39:08.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:08.974+0000 7fa354c00640 1 -- 172.21.15.8:0/2082482658 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa344023060 con 0x7fa358155ec0 2024-05-26T15:39:09.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.071+0000 7fa35e000640 1 -- 172.21.15.8:0/2082482658 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa3580d08f0 con 0x7fa358155ec0 2024-05-26T15:39:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.076+0000 7fa354c00640 1 -- 172.21.15.8:0/2082482658 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa34401a070 con 0x7fa358155ec0 2024-05-26T15:39:09.075 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2024-05-26T15:39:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.078+0000 7fa35e000640 1 -- 172.21.15.8:0/2082482658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa358155ec0 msgr2=0x7fa3581f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.078+0000 7fa35e000640 1 --2- 172.21.15.8:0/2082482658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa358155ec0 0x7fa3581f2a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa34400dfd0 tx=0x7fa344011b30 comp rx=0 tx=0).stop 2024-05-26T15:39:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.078+0000 7fa35e000640 1 -- 172.21.15.8:0/2082482658 shutdown_connections 2024-05-26T15:39:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.078+0000 7fa35e000640 1 --2- 172.21.15.8:0/2082482658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa358143b50 0x7fa358152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.078+0000 7fa35e000640 1 --2- 172.21.15.8:0/2082482658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa358155ec0 0x7fa3581f2a50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:09.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.078+0000 7fa35e000640 1 --2- 172.21.15.8:0/2082482658 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa3400039a0 0x7fa35814e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:09.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.078+0000 7fa35e000640 1 -- 172.21.15.8:0/2082482658 >> 172.21.15.8:0/2082482658 conn(0x7fa35806b880 msgr2=0x7fa35815e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:09.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.079+0000 7fa35e000640 1 -- 172.21.15.8:0/2082482658 shutdown_connections 2024-05-26T15:39:09.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:09.079+0000 7fa35e000640 1 -- 172.21.15.8:0/2082482658 wait complete. 2024-05-26T15:39:09.094 INFO:tasks.ceph:check_enable_crimson: False 2024-05-26T15:39:09.094 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-26T15:39:09.095 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:09.095 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-26T15:39:09.121 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:09.122+0000 7f9a39521040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-26T15:39:09.138 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:09.139+0000 7fc913532040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-26T15:39:09.175 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:09.175 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-26T15:39:09.301 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:09.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-26T15:39:09.309 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:09.310+0000 7f9a39521040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-26T15:39:09.351 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:09.352+0000 7fc913532040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-26T15:39:09.376 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:09.378+0000 7f9a39521040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-26T15:39:09.377 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:09.377 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-26T15:39:09.425 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:09.427+0000 7fc913532040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-26T15:39:09.457 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:09.457 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-26T15:39:09.538 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:09.538 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-26T15:39:09.617 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:09.617 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-26T15:39:09.694 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:39:09.694 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-26T15:39:09.712 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:09.713+0000 7f9a39521040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-26T15:39:09.738 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:09.740+0000 7fc913532040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-26T15:39:09.765 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new ce28be81-d7be-482d-974c-53260ab6f22c 0 2024-05-26T15:39:09.770 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:09.772+0000 7f9a39521040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-26T15:39:09.799 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:09.801+0000 7fc913532040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-26T15:39:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.956+0000 7f5d53e00640 1 Processor -- start 2024-05-26T15:39:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.956+0000 7f5d53e00640 1 -- start start 2024-05-26T15:39:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.957+0000 7f5d53e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d540d2fc0 0x7f5d540d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.958+0000 7f5d53e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d540b6340 con 0x7f5d54160490 2024-05-26T15:39:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.958+0000 7f5d53e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d540b6010 con 0x7f5d540d13e0 2024-05-26T15:39:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.958+0000 7f5d53e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d540b59b0 con 0x7f5d540d2fc0 2024-05-26T15:39:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.958+0000 7f5d53400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5d540d13e0 0x7f5d540b67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:47974/0 (socket says 172.21.15.47:47974) 2024-05-26T15:39:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.958+0000 7f5d53400640 1 -- 172.21.15.47:0/906184745 learned_addr learned my addr 172.21.15.47:0/906184745 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-26T15:39:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.958+0000 7f5d52000640 1 --2- 172.21.15.47:0/906184745 >> v2:172.21.15.8:3300/0 conn(0x7f5d540d2fc0 0x7f5d540d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.958+0000 7f5d51600640 1 -- 172.21.15.47:0/906184745 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566540890 0 0) 0x7f5d540b6010 con 0x7f5d540d13e0 2024-05-26T15:39:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.958+0000 7f5d51600640 1 -- 172.21.15.47:0/906184745 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d38003520 con 0x7f5d540d13e0 2024-05-26T15:39:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.959+0000 7f5d52000640 1 -- 172.21.15.47:0/906184745 >> v1:172.21.15.47:6789/0 conn(0x7f5d540d13e0 legacy=0x7f5d540b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.959+0000 7f5d51600640 1 -- 172.21.15.47:0/906184745 <== mon.1 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4054957334 0 0) 0x7f5d38003520 con 0x7f5d540d13e0 2024-05-26T15:39:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.959+0000 7f5d52000640 1 -- 172.21.15.47:0/906184745 >> v1:172.21.15.8:6789/0 conn(0x7f5d54160490 legacy=0x7f5d540d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.959+0000 7f5d52000640 1 -- 172.21.15.47:0/906184745 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d540d1b40 con 0x7f5d540d2fc0 2024-05-26T15:39:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.960+0000 7f5d52000640 1 --2- 172.21.15.47:0/906184745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540d2fc0 0x7f5d540d0ea0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009720 tx=0x7f5d4002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103ceee5dfdd12cb server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.960+0000 7f5d51600640 1 -- 172.21.15.47:0/906184745 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c0019f0 con 0x7f5d540d2fc0 2024-05-26T15:39:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.960+0000 7f5d51600640 1 -- 172.21.15.47:0/906184745 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4002ac60 con 0x7f5d540d2fc0 2024-05-26T15:39:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.960+0000 7f5d51600640 1 -- 172.21.15.47:0/906184745 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d40032440 con 0x7f5d540d2fc0 2024-05-26T15:39:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.961+0000 7f5d53e00640 1 -- 172.21.15.47:0/906184745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540d2fc0 msgr2=0x7f5d540d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.961+0000 7f5d53e00640 1 --2- 172.21.15.47:0/906184745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540d2fc0 0x7f5d540d0ea0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d40009720 tx=0x7f5d4002a150 comp rx=0 tx=0).stop 2024-05-26T15:39:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.961+0000 7f5d53e00640 1 -- 172.21.15.47:0/906184745 shutdown_connections 2024-05-26T15:39:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.961+0000 7f5d53e00640 1 --2- 172.21.15.47:0/906184745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d540d2fc0 0x7f5d540d0ea0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.961+0000 7f5d53e00640 1 -- 172.21.15.47:0/906184745 >> 172.21.15.47:0/906184745 conn(0x7f5d540715a0 msgr2=0x7f5d540719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.961+0000 7f5d53e00640 1 -- 172.21.15.47:0/906184745 shutdown_connections 2024-05-26T15:39:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.961+0000 7f5d53e00640 1 -- 172.21.15.47:0/906184745 wait complete. 2024-05-26T15:39:09.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.963+0000 7f5d53e00640 1 Processor -- start 2024-05-26T15:39:09.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.963+0000 7f5d53e00640 1 -- start start 2024-05-26T15:39:09.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d53e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d540d13e0 0x7f5d5414ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d53e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d540d2fc0 0x7f5d540c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d53e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d54160490 0x7f5d540c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d53e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5414f390 con 0x7f5d54160490 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d53e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540ca7b0 con 0x7f5d540d2fc0 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d53e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d540c8f10 con 0x7f5d540d13e0 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d52a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d540d13e0 0x7f5d5414ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d52000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d540d2fc0 0x7f5d540c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d52000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d540d2fc0 0x7f5d540c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59800/0 (socket says 172.21.15.47:59800) 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d52000640 1 -- 172.21.15.47:0/4036988352 learned_addr learned my addr 172.21.15.47:0/4036988352 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d52a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d540d13e0 0x7f5d5414ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:53374/0 (socket says 172.21.15.47:53374) 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d53400640 1 --2- 172.21.15.47:0/4036988352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d54160490 0x7f5d540c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.964+0000 7f5d52000640 1 -- 172.21.15.47:0/4036988352 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d540d13e0 msgr2=0x7f5d5414ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d52000640 1 --2- 172.21.15.47:0/4036988352 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d540d13e0 0x7f5d5414ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:09.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d52000640 1 -- 172.21.15.47:0/4036988352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d54160490 msgr2=0x7f5d540c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:09.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d52000640 1 --2- 172.21.15.47:0/4036988352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d54160490 0x7f5d540c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:09.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d52000640 1 -- 172.21.15.47:0/4036988352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40009400 con 0x7f5d540d2fc0 2024-05-26T15:39:09.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d52a00640 1 --2- 172.21.15.47:0/4036988352 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d540d13e0 0x7f5d5414ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:39:09.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d52000640 1 --2- 172.21.15.47:0/4036988352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d540d2fc0 0x7f5d540c6a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d40035040 tx=0x7f5d400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:09.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d4aa00640 1 -- 172.21.15.47:0/4036988352 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4003b810 con 0x7f5d540d2fc0 2024-05-26T15:39:09.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d4aa00640 1 -- 172.21.15.47:0/4036988352 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4003b970 con 0x7f5d540d2fc0 2024-05-26T15:39:09.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d53e00640 1 -- 172.21.15.47:0/4036988352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5415e910 con 0x7f5d540d2fc0 2024-05-26T15:39:09.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d4aa00640 1 -- 172.21.15.47:0/4036988352 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4003bd20 con 0x7f5d540d2fc0 2024-05-26T15:39:09.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.965+0000 7f5d53e00640 1 -- 172.21.15.47:0/4036988352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d540ca9c0 con 0x7f5d540d2fc0 2024-05-26T15:39:09.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.966+0000 7f5d4aa00640 1 -- 172.21.15.47:0/4036988352 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5d40039040 con 0x7f5d540d2fc0 2024-05-26T15:39:09.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.966+0000 7f5d4aa00640 1 -- 172.21.15.47:0/4036988352 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5d400456a0 con 0x7f5d540d2fc0 2024-05-26T15:39:09.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.966+0000 7f5d53e00640 1 -- 172.21.15.47:0/4036988352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d5404e210 con 0x7f5d540d2fc0 2024-05-26T15:39:09.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:09.969+0000 7f5d4aa00640 1 -- 172.21.15.47:0/4036988352 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f5d4004c060 con 0x7f5d540d2fc0 2024-05-26T15:39:10.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.049+0000 7f5d53e00640 1 -- 172.21.15.47:0/4036988352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ce28be81-d7be-482d-974c-53260ab6f22c", "id": 0} v 0) v1 -- 0x7f5d540ce1d0 con 0x7f5d540d2fc0 2024-05-26T15:39:10.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.058+0000 7f5d4aa00640 1 -- 172.21.15.47:0/4036988352 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce28be81-d7be-482d-974c-53260ab6f22c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5d40042070 con 0x7f5d540d2fc0 2024-05-26T15:39:10.056 INFO:teuthology.orchestra.run.smithi047.stdout:0 2024-05-26T15:39:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.059+0000 7f5d53e00640 1 -- 172.21.15.47:0/4036988352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d540d2fc0 msgr2=0x7f5d540c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.059+0000 7f5d53e00640 1 --2- 172.21.15.47:0/4036988352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d540d2fc0 0x7f5d540c6a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5d40035040 tx=0x7f5d400046c0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.059+0000 7f5d53e00640 1 -- 172.21.15.47:0/4036988352 shutdown_connections 2024-05-26T15:39:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.059+0000 7f5d53e00640 1 --2- 172.21.15.47:0/4036988352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d54160490 0x7f5d540c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.059+0000 7f5d53e00640 1 --2- 172.21.15.47:0/4036988352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d540d2fc0 0x7f5d540c6a80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.059+0000 7f5d53e00640 1 --2- 172.21.15.47:0/4036988352 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d540d13e0 0x7f5d5414ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.059+0000 7f5d53e00640 1 -- 172.21.15.47:0/4036988352 >> 172.21.15.47:0/4036988352 conn(0x7f5d540715a0 msgr2=0x7f5d540b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.060+0000 7f5d53e00640 1 -- 172.21.15.47:0/4036988352 shutdown_connections 2024-05-26T15:39:10.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.060+0000 7f5d53e00640 1 -- 172.21.15.47:0/4036988352 wait complete. 2024-05-26T15:39:10.074 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 29f22fca-6669-4bb9-8ef8-c5933d5ea9f6 1 2024-05-26T15:39:10.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.254+0000 7f45d7e00640 1 Processor -- start 2024-05-26T15:39:10.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.254+0000 7f45d7e00640 1 -- start start 2024-05-26T15:39:10.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.256+0000 7f45d7e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d00cd9f0 0x7f45d00cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.256+0000 7f45d7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45d00b46a0 0x7f45d00b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.256+0000 7f45d7e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d006c1d0 con 0x7f45d015cca0 2024-05-26T15:39:10.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.256+0000 7f45d7e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d006b600 con 0x7f45d00b46a0 2024-05-26T15:39:10.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.256+0000 7f45d7e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d006b8a0 con 0x7f45d00cd9f0 2024-05-26T15:39:10.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.256+0000 7f45d5e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45d00b46a0 0x7f45d00b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.256+0000 7f45d4a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d00cd9f0 0x7f45d00cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.256+0000 7f45d5e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45d00b46a0 0x7f45d00b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59812/0 (socket says 172.21.15.47:59812) 2024-05-26T15:39:10.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.256+0000 7f45d5e00640 1 -- 172.21.15.47:0/1501352871 learned_addr learned my addr 172.21.15.47:0/1501352871 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-26T15:39:10.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.257+0000 7f45d5e00640 1 -- 172.21.15.47:0/1501352871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d00cd9f0 msgr2=0x7f45d00cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:10.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.257+0000 7f45d5e00640 1 --2- 172.21.15.47:0/1501352871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d00cd9f0 0x7f45d00cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.257+0000 7f45d5e00640 1 -- 172.21.15.47:0/1501352871 >> v1:172.21.15.8:6789/0 conn(0x7f45d015cca0 legacy=0x7f45d015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:10.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.257+0000 7f45d5e00640 1 -- 172.21.15.47:0/1501352871 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d006bb80 con 0x7f45d00b46a0 2024-05-26T15:39:10.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.258+0000 7f45d5e00640 1 --2- 172.21.15.47:0/1501352871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d00b46a0 0x7f45d00b4b10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009e50 tx=0x7f45c802a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34eeae0af00ea9c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:10.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.258+0000 7f45cfe00640 1 -- 172.21.15.47:0/1501352871 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8031600 con 0x7f45d00b46a0 2024-05-26T15:39:10.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.258+0000 7f45cfe00640 1 -- 172.21.15.47:0/1501352871 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c802d050 con 0x7f45d00b46a0 2024-05-26T15:39:10.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.258+0000 7f45cfe00640 1 -- 172.21.15.47:0/1501352871 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c8031980 con 0x7f45d00b46a0 2024-05-26T15:39:10.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.259+0000 7f45d7e00640 1 -- 172.21.15.47:0/1501352871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d00b46a0 msgr2=0x7f45d00b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.259+0000 7f45d7e00640 1 --2- 172.21.15.47:0/1501352871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d00b46a0 0x7f45d00b4b10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009e50 tx=0x7f45c802a6d0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.259+0000 7f45d7e00640 1 -- 172.21.15.47:0/1501352871 shutdown_connections 2024-05-26T15:39:10.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.259+0000 7f45d7e00640 1 --2- 172.21.15.47:0/1501352871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d00b46a0 0x7f45d00b4b10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.259+0000 7f45d7e00640 1 --2- 172.21.15.47:0/1501352871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d00cd9f0 0x7f45d00cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.259+0000 7f45d7e00640 1 -- 172.21.15.47:0/1501352871 >> 172.21.15.47:0/1501352871 conn(0x7f45d00cf630 msgr2=0x7f45d00cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:10.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.259+0000 7f45d7e00640 1 -- 172.21.15.47:0/1501352871 shutdown_connections 2024-05-26T15:39:10.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.259+0000 7f45d7e00640 1 -- 172.21.15.47:0/1501352871 wait complete. 2024-05-26T15:39:10.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.261+0000 7f45d7e00640 1 Processor -- start 2024-05-26T15:39:10.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.262+0000 7f45d7e00640 1 -- start start 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.263+0000 7f45d7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d00b46a0 0x7f45d0146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.263+0000 7f45d7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d00cd9f0 0x7f45d00cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.263+0000 7f45d7e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d015cca0 0x7f45d00c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.263+0000 7f45d7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d0151520 con 0x7f45d00b46a0 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.263+0000 7f45d7e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d01474d0 con 0x7f45d00cd9f0 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.263+0000 7f45d7e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00c7750 con 0x7f45d015cca0 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d5e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d015cca0 0x7f45d00c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d4a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d00cd9f0 0x7f45d00cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d5e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d015cca0 0x7f45d00c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:53392/0 (socket says 172.21.15.47:53392) 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d00b46a0 0x7f45d0146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d5e00640 1 -- 172.21.15.47:0/2715149352 learned_addr learned my addr 172.21.15.47:0/2715149352 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-26T15:39:10.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d4a00640 1 -- 172.21.15.47:0/2715149352 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d015cca0 msgr2=0x7f45d00c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d4a00640 1 --2- 172.21.15.47:0/2715149352 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d015cca0 0x7f45d00c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d4a00640 1 -- 172.21.15.47:0/2715149352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d00b46a0 msgr2=0x7f45d0146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d4a00640 1 --2- 172.21.15.47:0/2715149352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d00b46a0 0x7f45d0146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d4a00640 1 -- 172.21.15.47:0/2715149352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c8009b30 con 0x7f45d00cd9f0 2024-05-26T15:39:10.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.264+0000 7f45d5e00640 1 --2- 172.21.15.47:0/2715149352 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d015cca0 0x7f45d00c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:39:10.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.265+0000 7f45d4a00640 1 --2- 172.21.15.47:0/2715149352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d00cd9f0 0x7f45d00cbdb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00e850 tx=0x7f45bc00ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:10.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.265+0000 7f45cd600640 1 -- 172.21.15.47:0/2715149352 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0095b0 con 0x7f45d00cd9f0 2024-05-26T15:39:10.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.265+0000 7f45cd600640 1 -- 172.21.15.47:0/2715149352 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00c940 con 0x7f45d00cd9f0 2024-05-26T15:39:10.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.265+0000 7f45d7e00640 1 -- 172.21.15.47:0/2715149352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d00c6b40 con 0x7f45d00cd9f0 2024-05-26T15:39:10.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.265+0000 7f45cd600640 1 -- 172.21.15.47:0/2715149352 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00ccd0 con 0x7f45d00cd9f0 2024-05-26T15:39:10.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.265+0000 7f45d7e00640 1 -- 172.21.15.47:0/2715149352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d00c7100 con 0x7f45d00cd9f0 2024-05-26T15:39:10.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.265+0000 7f45cd600640 1 -- 172.21.15.47:0/2715149352 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f45bc005c90 con 0x7f45d00cd9f0 2024-05-26T15:39:10.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.265+0000 7f45cd600640 1 -- 172.21.15.47:0/2715149352 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f45bc013820 con 0x7f45d00cd9f0 2024-05-26T15:39:10.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.266+0000 7f45d7e00640 1 -- 172.21.15.47:0/2715149352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d0065f40 con 0x7f45d00cd9f0 2024-05-26T15:39:10.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.268+0000 7f45cd600640 1 -- 172.21.15.47:0/2715149352 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f45bc021060 con 0x7f45d00cd9f0 2024-05-26T15:39:10.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.347+0000 7f45d7e00640 1 -- 172.21.15.47:0/2715149352 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "29f22fca-6669-4bb9-8ef8-c5933d5ea9f6", "id": 1} v 0) v1 -- 0x7f45d00b5580 con 0x7f45d00cd9f0 2024-05-26T15:39:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.353+0000 7f45cd600640 1 -- 172.21.15.47:0/2715149352 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29f22fca-6669-4bb9-8ef8-c5933d5ea9f6", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f45bc017070 con 0x7f45d00cd9f0 2024-05-26T15:39:10.351 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-26T15:39:10.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.354+0000 7f45d7e00640 1 -- 172.21.15.47:0/2715149352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d00cd9f0 msgr2=0x7f45d00cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.354+0000 7f45d7e00640 1 --2- 172.21.15.47:0/2715149352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d00cd9f0 0x7f45d00cbdb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00e850 tx=0x7f45bc00ed10 comp rx=0 tx=0).stop 2024-05-26T15:39:10.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.354+0000 7f45d7e00640 1 -- 172.21.15.47:0/2715149352 shutdown_connections 2024-05-26T15:39:10.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.354+0000 7f45d7e00640 1 --2- 172.21.15.47:0/2715149352 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45d015cca0 0x7f45d00c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.354+0000 7f45d7e00640 1 --2- 172.21.15.47:0/2715149352 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45d00cd9f0 0x7f45d00cbdb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.354+0000 7f45d7e00640 1 --2- 172.21.15.47:0/2715149352 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45d00b46a0 0x7f45d0146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.354+0000 7f45d7e00640 1 -- 172.21.15.47:0/2715149352 >> 172.21.15.47:0/2715149352 conn(0x7f45d00cf630 msgr2=0x7f45d015d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:10.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.354+0000 7f45d7e00640 1 -- 172.21.15.47:0/2715149352 shutdown_connections 2024-05-26T15:39:10.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.354+0000 7f45d7e00640 1 -- 172.21.15.47:0/2715149352 wait complete. 2024-05-26T15:39:10.370 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 02fbf9f1-e104-4477-8d87-9b891ed0ab4e 2 2024-05-26T15:39:10.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.554+0000 7fb872200640 1 Processor -- start 2024-05-26T15:39:10.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.554+0000 7fb872200640 1 -- start start 2024-05-26T15:39:10.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.555+0000 7fb872200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb86c0cd910 0x7fb86c0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.555+0000 7fb872200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c0cea40 con 0x7fb86c0cb280 2024-05-26T15:39:10.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.556+0000 7fb872200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c0ced20 con 0x7fb86c15aca0 2024-05-26T15:39:10.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.556+0000 7fb872200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c15b080 con 0x7fb86c0cd910 2024-05-26T15:39:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.556+0000 7fb86b400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb86c15aca0 0x7fb86c0cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:47982/0 (socket says 172.21.15.47:47982) 2024-05-26T15:39:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.556+0000 7fb86b400640 1 -- 172.21.15.47:0/95709996 learned_addr learned my addr 172.21.15.47:0/95709996 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-26T15:39:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.556+0000 7fb863e00640 1 --2- 172.21.15.47:0/95709996 >> v2:172.21.15.8:3300/0 conn(0x7fb86c0cd910 0x7fb86c0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.556+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625468158 0 0) 0x7fb86c0ced20 con 0x7fb86c15aca0 2024-05-26T15:39:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.556+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb850003520 con 0x7fb86c15aca0 2024-05-26T15:39:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 <== mon.1 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 312986268 0 0) 0x7fb850003520 con 0x7fb86c15aca0 2024-05-26T15:39:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 >> v2:172.21.15.8:3300/0 conn(0x7fb86c0cd910 msgr2=0x7fb86c0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 --2- 172.21.15.47:0/95709996 >> v2:172.21.15.8:3300/0 conn(0x7fb86c0cd910 0x7fb86c0cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 >> v1:172.21.15.8:6789/0 conn(0x7fb86c0cb280 legacy=0x7fb86c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c0cf000 con 0x7fb86c15aca0 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 <== mon.1 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fb85c001670 con 0x7fb86c15aca0 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 >> v1:172.21.15.47:6789/0 conn(0x7fb86c15aca0 legacy=0x7fb86c0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb850003a30 0x7fb850003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb850004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500052a0 0x7fb85000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85000c140 con 0x7fb850003a30 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85000c2b0 con 0x7fb8500047c0 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85000c470 con 0x7fb8500052a0 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb863e00640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb850004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86b400640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb850003a30 0x7fb850003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.557+0000 7fb86be00640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500052a0 0x7fb85000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.558+0000 7fb863e00640 1 -- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500052a0 msgr2=0x7fb85000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.558+0000 7fb863e00640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500052a0 0x7fb85000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.558+0000 7fb863e00640 1 -- 172.21.15.47:0/95709996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb850003a30 msgr2=0x7fb850003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:10.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.558+0000 7fb863e00640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb850003a30 0x7fb850003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.558+0000 7fb863e00640 1 -- 172.21.15.47:0/95709996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb850003520 con 0x7fb8500047c0 2024-05-26T15:39:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.558+0000 7fb86be00640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8500052a0 0x7fb85000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:10.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.558+0000 7fb86be00640 1 -- 172.21.15.47:0/95709996 reap_dead start 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.559+0000 7fb863e00640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb850004c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb854009ac0 tx=0x7fb8500057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c129ef324b891114 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.560+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854031400 con 0x7fb8500047c0 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.560+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85402d050 con 0x7fb8500047c0 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.560+0000 7fb86aa00640 1 -- 172.21.15.47:0/95709996 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854031780 con 0x7fb8500047c0 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.560+0000 7fb872200640 1 -- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 msgr2=0x7fb850004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.560+0000 7fb872200640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb850004c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb854009ac0 tx=0x7fb8500057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.560+0000 7fb872200640 1 -- 172.21.15.47:0/95709996 shutdown_connections 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.560+0000 7fb872200640 1 --2- 172.21.15.47:0/95709996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb850004c40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.560+0000 7fb872200640 1 -- 172.21.15.47:0/95709996 >> 172.21.15.47:0/95709996 conn(0x7fb86c06e6e0 msgr2=0x7fb86c06eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.561+0000 7fb872200640 1 -- 172.21.15.47:0/95709996 shutdown_connections 2024-05-26T15:39:10.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.561+0000 7fb872200640 1 -- 172.21.15.47:0/95709996 wait complete. 2024-05-26T15:39:10.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.562+0000 7fb872200640 1 Processor -- start 2024-05-26T15:39:10.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.563+0000 7fb872200640 1 -- start start 2024-05-26T15:39:10.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb872200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb86c0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb872200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb86c0c8e50 0x7fb86c14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb872200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb86c15b160 0x7fb86c0c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb872200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0ca020 con 0x7fb86c0c8e50 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb872200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c14c1f0 con 0x7fb8500047c0 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb872200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0c93a0 con 0x7fb86c15b160 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb86b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb86c0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb86be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb86c15b160 0x7fb86c0c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb86b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb86c0ca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59830/0 (socket says 172.21.15.47:59830) 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb86b400640 1 -- 172.21.15.47:0/3407710230 learned_addr learned my addr 172.21.15.47:0/3407710230 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb863e00640 1 --2- 172.21.15.47:0/3407710230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb86c0c8e50 0x7fb86c14bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb86b400640 1 -- 172.21.15.47:0/3407710230 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb86c15b160 msgr2=0x7fb86c0c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb86b400640 1 --2- 172.21.15.47:0/3407710230 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb86c15b160 0x7fb86c0c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb86b400640 1 -- 172.21.15.47:0/3407710230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb86c0c8e50 msgr2=0x7fb86c14bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb86b400640 1 --2- 172.21.15.47:0/3407710230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb86c0c8e50 0x7fb86c14bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb86b400640 1 -- 172.21.15.47:0/3407710230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c0c9680 con 0x7fb8500047c0 2024-05-26T15:39:10.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.564+0000 7fb863e00640 1 --2- 172.21.15.47:0/3407710230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb86c0c8e50 0x7fb86c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:10.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.565+0000 7fb86b400640 1 --2- 172.21.15.47:0/3407710230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb86c0ca440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0072c0 tx=0x7fb85c0076c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.565+0000 7fb863400640 1 -- 172.21.15.47:0/3407710230 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c007730 con 0x7fb8500047c0 2024-05-26T15:39:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.565+0000 7fb863400640 1 -- 172.21.15.47:0/3407710230 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c00f9c0 con 0x7fb8500047c0 2024-05-26T15:39:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.565+0000 7fb863400640 1 -- 172.21.15.47:0/3407710230 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00fd70 con 0x7fb8500047c0 2024-05-26T15:39:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.565+0000 7fb872200640 1 -- 172.21.15.47:0/3407710230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c0c9960 con 0x7fb8500047c0 2024-05-26T15:39:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.565+0000 7fb872200640 1 -- 172.21.15.47:0/3407710230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c15b5e0 con 0x7fb8500047c0 2024-05-26T15:39:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.565+0000 7fb863400640 1 -- 172.21.15.47:0/3407710230 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb85c01d760 con 0x7fb8500047c0 2024-05-26T15:39:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.566+0000 7fb863400640 1 -- 172.21.15.47:0/3407710230 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fb85c013900 con 0x7fb8500047c0 2024-05-26T15:39:10.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.566+0000 7fb872200640 1 -- 172.21.15.47:0/3407710230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c04e210 con 0x7fb8500047c0 2024-05-26T15:39:10.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.569+0000 7fb863400640 1 -- 172.21.15.47:0/3407710230 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fb85c0134e0 con 0x7fb8500047c0 2024-05-26T15:39:10.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.648+0000 7fb872200640 1 -- 172.21.15.47:0/3407710230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "02fbf9f1-e104-4477-8d87-9b891ed0ab4e", "id": 2} v 0) v1 -- 0x7fb86c06cbe0 con 0x7fb8500047c0 2024-05-26T15:39:10.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.655+0000 7fb863400640 1 -- 172.21.15.47:0/3407710230 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02fbf9f1-e104-4477-8d87-9b891ed0ab4e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb85c013740 con 0x7fb8500047c0 2024-05-26T15:39:10.654 INFO:teuthology.orchestra.run.smithi047.stdout:2 2024-05-26T15:39:10.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.657+0000 7fb872200640 1 -- 172.21.15.47:0/3407710230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 msgr2=0x7fb86c0ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.657+0000 7fb872200640 1 --2- 172.21.15.47:0/3407710230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb86c0ca440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb85c0072c0 tx=0x7fb85c0076c0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.657+0000 7fb872200640 1 -- 172.21.15.47:0/3407710230 shutdown_connections 2024-05-26T15:39:10.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.657+0000 7fb872200640 1 --2- 172.21.15.47:0/3407710230 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb86c15b160 0x7fb86c0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.657+0000 7fb872200640 1 --2- 172.21.15.47:0/3407710230 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb86c0c8e50 0x7fb86c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.657+0000 7fb872200640 1 --2- 172.21.15.47:0/3407710230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8500047c0 0x7fb86c0ca440 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.657+0000 7fb872200640 1 -- 172.21.15.47:0/3407710230 >> 172.21.15.47:0/3407710230 conn(0x7fb86c06e6e0 msgr2=0x7fb86c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:10.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.657+0000 7fb872200640 1 -- 172.21.15.47:0/3407710230 shutdown_connections 2024-05-26T15:39:10.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.657+0000 7fb872200640 1 -- 172.21.15.47:0/3407710230 wait complete. 2024-05-26T15:39:10.671 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 89fd069f-7f95-430a-be25-5064903c9cfc 3 2024-05-26T15:39:10.740 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:10.742+0000 7f9a39521040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-26T15:39:10.799 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:10.800+0000 7fc913532040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-26T15:39:10.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.849+0000 7fbd59e00640 1 Processor -- start 2024-05-26T15:39:10.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.849+0000 7fbd59e00640 1 -- start start 2024-05-26T15:39:10.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.850+0000 7fbd59e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd540ce0c0 0x7fbd54167ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.851+0000 7fbd59e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd540b21d0 con 0x7fbd5415d0b0 2024-05-26T15:39:10.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.851+0000 7fbd59e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd540d22b0 con 0x7fbd540cfb10 2024-05-26T15:39:10.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.851+0000 7fbd59e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541615a0 con 0x7fbd540ce0c0 2024-05-26T15:39:10.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.851+0000 7fbd53e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbd540cfb10 0x7fbd540cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:47992/0 (socket says 172.21.15.47:47992) 2024-05-26T15:39:10.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.851+0000 7fbd53e00640 1 -- 172.21.15.47:0/4138326325 learned_addr learned my addr 172.21.15.47:0/4138326325 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-26T15:39:10.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.851+0000 7fbd59400640 1 --2- 172.21.15.47:0/4138326325 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd540ce0c0 0x7fbd54167ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.851+0000 7fbd53400640 1 -- 172.21.15.47:0/4138326325 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554746685 0 0) 0x7fbd540d22b0 con 0x7fbd540cfb10 2024-05-26T15:39:10.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.851+0000 7fbd59400640 1 -- 172.21.15.47:0/4138326325 >> v1:172.21.15.47:6789/0 conn(0x7fbd540cfb10 legacy=0x7fbd540cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.851+0000 7fbd59400640 1 -- 172.21.15.47:0/4138326325 >> v1:172.21.15.8:6789/0 conn(0x7fbd5415d0b0 legacy=0x7fbd540b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.851+0000 7fbd59400640 1 -- 172.21.15.47:0/4138326325 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54160c00 con 0x7fbd540ce0c0 2024-05-26T15:39:10.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.852+0000 7fbd59400640 1 --2- 172.21.15.47:0/4138326325 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd540ce0c0 0x7fbd54167ef0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbd540d24a0 tx=0x7fbd4c02a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5725d3800c2b02fd server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:10.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.853+0000 7fbd53400640 1 -- 172.21.15.47:0/4138326325 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c007740 con 0x7fbd540ce0c0 2024-05-26T15:39:10.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.853+0000 7fbd53400640 1 -- 172.21.15.47:0/4138326325 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c02d050 con 0x7fbd540ce0c0 2024-05-26T15:39:10.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.853+0000 7fbd53400640 1 -- 172.21.15.47:0/4138326325 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c007ac0 con 0x7fbd540ce0c0 2024-05-26T15:39:10.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.853+0000 7fbd59e00640 1 -- 172.21.15.47:0/4138326325 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd540ce0c0 msgr2=0x7fbd54167ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.853+0000 7fbd59e00640 1 --2- 172.21.15.47:0/4138326325 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd540ce0c0 0x7fbd54167ef0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbd540d24a0 tx=0x7fbd4c02a630 comp rx=0 tx=0).stop 2024-05-26T15:39:10.852 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:10.853+0000 7f9a39521040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-26T15:39:10.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.853+0000 7fbd59e00640 1 -- 172.21.15.47:0/4138326325 shutdown_connections 2024-05-26T15:39:10.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.853+0000 7fbd59e00640 1 --2- 172.21.15.47:0/4138326325 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd540ce0c0 0x7fbd54167ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.853+0000 7fbd59e00640 1 -- 172.21.15.47:0/4138326325 >> 172.21.15.47:0/4138326325 conn(0x7fbd5406b160 msgr2=0x7fbd5406b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:10.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.853+0000 7fbd59e00640 1 -- 172.21.15.47:0/4138326325 shutdown_connections 2024-05-26T15:39:10.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.854+0000 7fbd59e00640 1 -- 172.21.15.47:0/4138326325 wait complete. 2024-05-26T15:39:10.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.855+0000 7fbd59e00640 1 Processor -- start 2024-05-26T15:39:10.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.855+0000 7fbd59e00640 1 -- start start 2024-05-26T15:39:10.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd59e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd540ce0c0 0x7fbd540c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd59e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd540cfb10 0x7fbd54156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd59e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd5415d0b0 0x7fbd5415ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:10.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd59e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540c6c20 con 0x7fbd540cfb10 2024-05-26T15:39:10.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd59e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540c6f00 con 0x7fbd540ce0c0 2024-05-26T15:39:10.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd59e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540c71e0 con 0x7fbd5415d0b0 2024-05-26T15:39:10.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd58a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd540ce0c0 0x7fbd540c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd59400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd5415d0b0 0x7fbd5415ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd58a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd540ce0c0 0x7fbd540c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59842/0 (socket says 172.21.15.47:59842) 2024-05-26T15:39:10.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd58a00640 1 -- 172.21.15.47:0/2324756121 learned_addr learned my addr 172.21.15.47:0/2324756121 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-26T15:39:10.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.856+0000 7fbd53e00640 1 --2- 172.21.15.47:0/2324756121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd540cfb10 0x7fbd54156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.857+0000 7fbd59400640 1 -- 172.21.15.47:0/2324756121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd540ce0c0 msgr2=0x7fbd540c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.857+0000 7fbd59400640 1 --2- 172.21.15.47:0/2324756121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd540ce0c0 0x7fbd540c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.857+0000 7fbd59400640 1 -- 172.21.15.47:0/2324756121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd540cfb10 msgr2=0x7fbd54156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.857+0000 7fbd59400640 1 --2- 172.21.15.47:0/2324756121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd540cfb10 0x7fbd54156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.857+0000 7fbd59400640 1 -- 172.21.15.47:0/2324756121 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c009a70 con 0x7fbd5415d0b0 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.857+0000 7fbd58a00640 1 --2- 172.21.15.47:0/2324756121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd540ce0c0 0x7fbd540c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.857+0000 7fbd59400640 1 --2- 172.21.15.47:0/2324756121 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd5415d0b0 0x7fbd5415ed90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c031000 tx=0x7fbd4c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.857+0000 7fbd50c00640 1 -- 172.21.15.47:0/2324756121 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c031bc0 con 0x7fbd5415d0b0 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.858+0000 7fbd50c00640 1 -- 172.21.15.47:0/2324756121 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c031d20 con 0x7fbd5415d0b0 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.858+0000 7fbd59e00640 1 -- 172.21.15.47:0/2324756121 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd540c74c0 con 0x7fbd5415d0b0 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.858+0000 7fbd50c00640 1 -- 172.21.15.47:0/2324756121 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0456a0 con 0x7fbd5415d0b0 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.858+0000 7fbd59e00640 1 -- 172.21.15.47:0/2324756121 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd540c6910 con 0x7fbd5415d0b0 2024-05-26T15:39:10.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.858+0000 7fbd50c00640 1 -- 172.21.15.47:0/2324756121 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fbd4c045b00 con 0x7fbd5415d0b0 2024-05-26T15:39:10.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.858+0000 7fbd50c00640 1 -- 172.21.15.47:0/2324756121 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fbd4c045db0 con 0x7fbd5415d0b0 2024-05-26T15:39:10.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.859+0000 7fbd59e00640 1 -- 172.21.15.47:0/2324756121 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd540c79e0 con 0x7fbd5415d0b0 2024-05-26T15:39:10.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.862+0000 7fbd50c00640 1 -- 172.21.15.47:0/2324756121 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fbd540c79e0 con 0x7fbd5415d0b0 2024-05-26T15:39:10.908 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:10.910+0000 7f9a39521040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-26T15:39:10.908 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:10.910+0000 7fc913532040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-26T15:39:10.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.942+0000 7fbd59e00640 1 -- 172.21.15.47:0/2324756121 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd new", "uuid": "89fd069f-7f95-430a-be25-5064903c9cfc", "id": 3} v 0) v1 -- 0x7fbd5404e210 con 0x7fbd5415d0b0 2024-05-26T15:39:10.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.954+0000 7fbd50c00640 1 -- 172.21.15.47:0/2324756121 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89fd069f-7f95-430a-be25-5064903c9cfc", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbd4c040070 con 0x7fbd5415d0b0 2024-05-26T15:39:10.952 INFO:teuthology.orchestra.run.smithi047.stdout:3 2024-05-26T15:39:10.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.955+0000 7fbd59e00640 1 -- 172.21.15.47:0/2324756121 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd5415d0b0 msgr2=0x7fbd5415ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.955+0000 7fbd59e00640 1 --2- 172.21.15.47:0/2324756121 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd5415d0b0 0x7fbd5415ed90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c031000 tx=0x7fbd4c004a40 comp rx=0 tx=0).stop 2024-05-26T15:39:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.955+0000 7fbd59e00640 1 -- 172.21.15.47:0/2324756121 shutdown_connections 2024-05-26T15:39:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.955+0000 7fbd59e00640 1 --2- 172.21.15.47:0/2324756121 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd5415d0b0 0x7fbd5415ed90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.955+0000 7fbd59e00640 1 --2- 172.21.15.47:0/2324756121 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd540cfb10 0x7fbd54156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.955+0000 7fbd59e00640 1 --2- 172.21.15.47:0/2324756121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd540ce0c0 0x7fbd540c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.955+0000 7fbd59e00640 1 -- 172.21.15.47:0/2324756121 >> 172.21.15.47:0/2324756121 conn(0x7fbd5406b160 msgr2=0x7fbd540b72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.955+0000 7fbd59e00640 1 -- 172.21.15.47:0/2324756121 shutdown_connections 2024-05-26T15:39:10.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:10.955+0000 7fbd59e00640 1 -- 172.21.15.47:0/2324756121 wait complete. 2024-05-26T15:39:10.962 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:10.964+0000 7fc913532040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-26T15:39:10.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 65a1860d-cd7a-40de-9302-f373e8890ada 4 2024-05-26T15:39:11.120 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:11.122+0000 7f9a39521040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-26T15:39:11.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.153+0000 7fa2d3e00640 1 Processor -- start 2024-05-26T15:39:11.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.153+0000 7fa2d3e00640 1 -- start start 2024-05-26T15:39:11.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.155+0000 7fa2d3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa2d40b77e0 0x7fa2d41679d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.155+0000 7fa2d3e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40b6340 con 0x7fa2d4160490 2024-05-26T15:39:11.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.155+0000 7fa2d3e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d40b6010 con 0x7fa2d40d2fc0 2024-05-26T15:39:11.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.155+0000 7fa2d3e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d40b59b0 con 0x7fa2d40b77e0 2024-05-26T15:39:11.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.155+0000 7fa2d2000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa2d40d2fc0 0x7fa2d40d0ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58012/0 (socket says 172.21.15.47:58012) 2024-05-26T15:39:11.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.155+0000 7fa2d2000640 1 -- 172.21.15.47:0/3003410589 learned_addr learned my addr 172.21.15.47:0/3003410589 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-26T15:39:11.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.155+0000 7fa2d3400640 1 --2- 172.21.15.47:0/3003410589 >> v2:172.21.15.8:3300/0 conn(0x7fa2d40b77e0 0x7fa2d41679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.155+0000 7fa2d1600640 1 -- 172.21.15.47:0/3003410589 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921899290 0 0) 0x7fa2d40b6010 con 0x7fa2d40d2fc0 2024-05-26T15:39:11.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.156+0000 7fa2d1600640 1 -- 172.21.15.47:0/3003410589 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2b8003520 con 0x7fa2d40d2fc0 2024-05-26T15:39:11.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.156+0000 7fa2d3400640 1 -- 172.21.15.47:0/3003410589 >> v1:172.21.15.47:6789/0 conn(0x7fa2d40d2fc0 legacy=0x7fa2d40d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.156+0000 7fa2d1600640 1 -- 172.21.15.47:0/3003410589 <== mon.1 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1604484648 0 0) 0x7fa2b8003520 con 0x7fa2d40d2fc0 2024-05-26T15:39:11.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.156+0000 7fa2d3400640 1 -- 172.21.15.47:0/3003410589 >> v1:172.21.15.8:6789/0 conn(0x7fa2d4160490 legacy=0x7fa2d40d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.156+0000 7fa2d3400640 1 -- 172.21.15.47:0/3003410589 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40d1b40 con 0x7fa2d40b77e0 2024-05-26T15:39:11.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.157+0000 7fa2d3400640 1 --2- 172.21.15.47:0/3003410589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2d40b77e0 0x7fa2d41679d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009d90 tx=0x7fa2cc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a337646e87d318 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:11.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.157+0000 7fa2d1600640 1 -- 172.21.15.47:0/3003410589 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0001670 con 0x7fa2d40b77e0 2024-05-26T15:39:11.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.158+0000 7fa2d1600640 1 -- 172.21.15.47:0/3003410589 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc02d050 con 0x7fa2d40b77e0 2024-05-26T15:39:11.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.158+0000 7fa2d1600640 1 -- 172.21.15.47:0/3003410589 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc007540 con 0x7fa2d40b77e0 2024-05-26T15:39:11.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.158+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3003410589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2d40b77e0 msgr2=0x7fa2d41679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.158+0000 7fa2d3e00640 1 --2- 172.21.15.47:0/3003410589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2d40b77e0 0x7fa2d41679d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009d90 tx=0x7fa2cc02a6a0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.158+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3003410589 shutdown_connections 2024-05-26T15:39:11.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.158+0000 7fa2d3e00640 1 --2- 172.21.15.47:0/3003410589 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2d40b77e0 0x7fa2d41679d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.158+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3003410589 >> 172.21.15.47:0/3003410589 conn(0x7fa2d40715a0 msgr2=0x7fa2d40719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:11.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.158+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3003410589 shutdown_connections 2024-05-26T15:39:11.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.158+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3003410589 wait complete. 2024-05-26T15:39:11.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.160+0000 7fa2d3e00640 1 Processor -- start 2024-05-26T15:39:11.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.160+0000 7fa2d3e00640 1 -- start start 2024-05-26T15:39:11.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.161+0000 7fa2d3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d40b77e0 0x7fa2d4153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.161+0000 7fa2d3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2d40d2fc0 0x7fa2d4158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.161+0000 7fa2d3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2d4160490 0x7fa2d415b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.161+0000 7fa2d3e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41f0300 con 0x7fa2d4160490 2024-05-26T15:39:11.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.161+0000 7fa2d3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40c70e0 con 0x7fa2d40b77e0 2024-05-26T15:39:11.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.161+0000 7fa2d3e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d40c73c0 con 0x7fa2d40d2fc0 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.161+0000 7fa2d2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d40b77e0 0x7fa2d4153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.161+0000 7fa2d2000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2d40d2fc0 0x7fa2d4158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.161+0000 7fa2d2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d40b77e0 0x7fa2d4153790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54150/0 (socket says 172.21.15.47:54150) 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.161+0000 7fa2d2a00640 1 -- 172.21.15.47:0/3116513497 learned_addr learned my addr 172.21.15.47:0/3116513497 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.162+0000 7fa2d3400640 1 --2- 172.21.15.47:0/3116513497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2d4160490 0x7fa2d415b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.162+0000 7fa2d2a00640 1 -- 172.21.15.47:0/3116513497 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2d40d2fc0 msgr2=0x7fa2d4158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.162+0000 7fa2d2a00640 1 --2- 172.21.15.47:0/3116513497 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2d40d2fc0 0x7fa2d4158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.162+0000 7fa2d2a00640 1 -- 172.21.15.47:0/3116513497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2d4160490 msgr2=0x7fa2d415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.162+0000 7fa2d2a00640 1 --2- 172.21.15.47:0/3116513497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2d4160490 0x7fa2d415b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.162+0000 7fa2d2a00640 1 -- 172.21.15.47:0/3116513497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc009a70 con 0x7fa2d40b77e0 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.162+0000 7fa2d2000640 1 --2- 172.21.15.47:0/3116513497 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2d40d2fc0 0x7fa2d4158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:39:11.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.162+0000 7fa2d3400640 1 --2- 172.21.15.47:0/3116513497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2d4160490 0x7fa2d415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:11.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.163+0000 7fa2d2a00640 1 --2- 172.21.15.47:0/3116513497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d40b77e0 0x7fa2d4153790 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400c450 tx=0x7fa2c400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:11.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.163+0000 7fa2cb400640 1 -- 172.21.15.47:0/3116513497 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40052d0 con 0x7fa2d40b77e0 2024-05-26T15:39:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.163+0000 7fa2cb400640 1 -- 172.21.15.47:0/3116513497 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c4005430 con 0x7fa2d40b77e0 2024-05-26T15:39:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.163+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3116513497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d40c76a0 con 0x7fa2d40b77e0 2024-05-26T15:39:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.163+0000 7fa2cb400640 1 -- 172.21.15.47:0/3116513497 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4012870 con 0x7fa2d40b77e0 2024-05-26T15:39:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.163+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3116513497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d40c8380 con 0x7fa2d40b77e0 2024-05-26T15:39:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.163+0000 7fa2cb400640 1 -- 172.21.15.47:0/3116513497 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa2c4012cd0 con 0x7fa2d40b77e0 2024-05-26T15:39:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.163+0000 7fa2cb400640 1 -- 172.21.15.47:0/3116513497 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa2c4003b00 con 0x7fa2d40b77e0 2024-05-26T15:39:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.164+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3116513497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d404e210 con 0x7fa2d40b77e0 2024-05-26T15:39:11.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.168+0000 7fa2cb400640 1 -- 172.21.15.47:0/3116513497 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fa2c40035f0 con 0x7fa2d40b77e0 2024-05-26T15:39:11.175 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:11.177+0000 7fc913532040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-26T15:39:11.189 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:11.191+0000 7f9a39521040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-26T15:39:11.242 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:11.243+0000 7fc913532040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-26T15:39:11.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.248+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3116513497 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "65a1860d-cd7a-40de-9302-f373e8890ada", "id": 4} v 0) v1 -- 0x7fa2d40ce320 con 0x7fa2d40b77e0 2024-05-26T15:39:11.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.255+0000 7fa2cb400640 1 -- 172.21.15.47:0/3116513497 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65a1860d-cd7a-40de-9302-f373e8890ada", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa2c4003790 con 0x7fa2d40b77e0 2024-05-26T15:39:11.254 INFO:teuthology.orchestra.run.smithi047.stdout:4 2024-05-26T15:39:11.254 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:11.256+0000 7f9a39521040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-26T15:39:11.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.257+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3116513497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d40b77e0 msgr2=0x7fa2d4153790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.257+0000 7fa2d3e00640 1 --2- 172.21.15.47:0/3116513497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d40b77e0 0x7fa2d4153790 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400c450 tx=0x7fa2c400c910 comp rx=0 tx=0).stop 2024-05-26T15:39:11.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.257+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3116513497 shutdown_connections 2024-05-26T15:39:11.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.257+0000 7fa2d3e00640 1 --2- 172.21.15.47:0/3116513497 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa2d4160490 0x7fa2d415b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.257+0000 7fa2d3e00640 1 --2- 172.21.15.47:0/3116513497 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa2d40d2fc0 0x7fa2d4158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.257+0000 7fa2d3e00640 1 --2- 172.21.15.47:0/3116513497 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2d40b77e0 0x7fa2d4153790 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.257+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3116513497 >> 172.21.15.47:0/3116513497 conn(0x7fa2d40715a0 msgr2=0x7fa2d40b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:11.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.257+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3116513497 shutdown_connections 2024-05-26T15:39:11.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.257+0000 7fa2d3e00640 1 -- 172.21.15.47:0/3116513497 wait complete. 2024-05-26T15:39:11.271 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new aef034e4-0e41-4167-ac67-bedb934892f6 5 2024-05-26T15:39:11.307 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:11.309+0000 7fc913532040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-26T15:39:11.390 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:11.392+0000 7f9a39521040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-26T15:39:11.441 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:11.442+0000 7fc913532040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-26T15:39:11.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.458+0000 7fbf86e00640 1 Processor -- start 2024-05-26T15:39:11.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.458+0000 7fbf86e00640 1 -- start start 2024-05-26T15:39:11.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.460+0000 7fbf86e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf800cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.460+0000 7fbf86e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf80144520 con 0x7fbf800cd7c0 2024-05-26T15:39:11.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.460+0000 7fbf86e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf800cdd80 con 0x7fbf80070ba0 2024-05-26T15:39:11.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.460+0000 7fbf86e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800ce060 con 0x7fbf80144140 2024-05-26T15:39:11.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.460+0000 7fbf84e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbf80070ba0 0x7fbf8006cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58024/0 (socket says 172.21.15.47:58024) 2024-05-26T15:39:11.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.460+0000 7fbf84e00640 1 -- 172.21.15.47:0/3855126087 learned_addr learned my addr 172.21.15.47:0/3855126087 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-26T15:39:11.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.460+0000 7fbf7fe00640 1 --2- 172.21.15.47:0/3855126087 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf800cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.461+0000 7fbf7ea00640 1 -- 172.21.15.47:0/3855126087 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725085470 0 0) 0x7fbf800cdd80 con 0x7fbf80070ba0 2024-05-26T15:39:11.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.461+0000 7fbf7ea00640 1 -- 172.21.15.47:0/3855126087 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf64003520 con 0x7fbf80070ba0 2024-05-26T15:39:11.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.461+0000 7fbf7fe00640 1 -- 172.21.15.47:0/3855126087 >> v1:172.21.15.47:6789/0 conn(0x7fbf80070ba0 legacy=0x7fbf8006cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.461+0000 7fbf7fe00640 1 -- 172.21.15.47:0/3855126087 >> v1:172.21.15.8:6789/0 conn(0x7fbf800cd7c0 legacy=0x7fbf80070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.461+0000 7fbf7fe00640 1 -- 172.21.15.47:0/3855126087 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf800ce340 con 0x7fbf80144140 2024-05-26T15:39:11.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.462+0000 7fbf7fe00640 1 --2- 172.21.15.47:0/3855126087 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf800cbf50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbf700097d0 tx=0x7fbf7002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=126b85b2587f51a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:11.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.462+0000 7fbf7ea00640 1 -- 172.21.15.47:0/3855126087 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70032440 con 0x7fbf80144140 2024-05-26T15:39:11.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.462+0000 7fbf7ea00640 1 -- 172.21.15.47:0/3855126087 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf700325a0 con 0x7fbf80144140 2024-05-26T15:39:11.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.462+0000 7fbf7ea00640 1 -- 172.21.15.47:0/3855126087 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70032910 con 0x7fbf80144140 2024-05-26T15:39:11.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.463+0000 7fbf86e00640 1 -- 172.21.15.47:0/3855126087 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 msgr2=0x7fbf800cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.463+0000 7fbf86e00640 1 --2- 172.21.15.47:0/3855126087 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf800cbf50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbf700097d0 tx=0x7fbf7002a200 comp rx=0 tx=0).stop 2024-05-26T15:39:11.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.463+0000 7fbf86e00640 1 -- 172.21.15.47:0/3855126087 shutdown_connections 2024-05-26T15:39:11.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.463+0000 7fbf86e00640 1 --2- 172.21.15.47:0/3855126087 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf800cbf50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.463+0000 7fbf86e00640 1 -- 172.21.15.47:0/3855126087 >> 172.21.15.47:0/3855126087 conn(0x7fbf80069e70 msgr2=0x7fbf8006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:11.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.463+0000 7fbf86e00640 1 -- 172.21.15.47:0/3855126087 shutdown_connections 2024-05-26T15:39:11.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.463+0000 7fbf86e00640 1 -- 172.21.15.47:0/3855126087 wait complete. 2024-05-26T15:39:11.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.465+0000 7fbf86e00640 1 Processor -- start 2024-05-26T15:39:11.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.465+0000 7fbf86e00640 1 -- start start 2024-05-26T15:39:11.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf86e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf80070ba0 0x7fbf800b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf86e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf800cd7c0 0x7fbf8013e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf86e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf801f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf86e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf800c34f0 con 0x7fbf800cd7c0 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf86e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf801f3560 con 0x7fbf80070ba0 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf86e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8015ae00 con 0x7fbf80144140 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf84e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf801f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf7fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf80070ba0 0x7fbf800b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf84e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf801f3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:40454/0 (socket says 172.21.15.47:40454) 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf84e00640 1 -- 172.21.15.47:0/4252935761 learned_addr learned my addr 172.21.15.47:0/4252935761 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf7f400640 1 --2- 172.21.15.47:0/4252935761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf800cd7c0 0x7fbf8013e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf84e00640 1 -- 172.21.15.47:0/4252935761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf80070ba0 msgr2=0x7fbf800b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf84e00640 1 --2- 172.21.15.47:0/4252935761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf80070ba0 0x7fbf800b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf84e00640 1 -- 172.21.15.47:0/4252935761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf800cd7c0 msgr2=0x7fbf8013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf84e00640 1 --2- 172.21.15.47:0/4252935761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf800cd7c0 0x7fbf8013e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.466+0000 7fbf84e00640 1 -- 172.21.15.47:0/4252935761 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf70009400 con 0x7fbf80144140 2024-05-26T15:39:11.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.467+0000 7fbf84e00640 1 --2- 172.21.15.47:0/4252935761 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf801f3020 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800cbb0 tx=0x7fbf7800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:11.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.467+0000 7fbf77e00640 1 -- 172.21.15.47:0/4252935761 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800ad40 con 0x7fbf80144140 2024-05-26T15:39:11.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.467+0000 7fbf77e00640 1 -- 172.21.15.47:0/4252935761 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78012400 con 0x7fbf80144140 2024-05-26T15:39:11.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.467+0000 7fbf86e00640 1 -- 172.21.15.47:0/4252935761 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf800cefa0 con 0x7fbf80144140 2024-05-26T15:39:11.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.467+0000 7fbf77e00640 1 -- 172.21.15.47:0/4252935761 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800aea0 con 0x7fbf80144140 2024-05-26T15:39:11.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.467+0000 7fbf86e00640 1 -- 172.21.15.47:0/4252935761 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8015b0c0 con 0x7fbf80144140 2024-05-26T15:39:11.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.467+0000 7fbf77e00640 1 -- 172.21.15.47:0/4252935761 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fbf78012ab0 con 0x7fbf80144140 2024-05-26T15:39:11.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.468+0000 7fbf77e00640 1 -- 172.21.15.47:0/4252935761 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fbf78012d60 con 0x7fbf80144140 2024-05-26T15:39:11.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.468+0000 7fbf86e00640 1 -- 172.21.15.47:0/4252935761 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8004e210 con 0x7fbf80144140 2024-05-26T15:39:11.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.471+0000 7fbf77e00640 1 -- 172.21.15.47:0/4252935761 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fbf78021060 con 0x7fbf80144140 2024-05-26T15:39:11.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.549+0000 7fbf86e00640 1 -- 172.21.15.47:0/4252935761 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aef034e4-0e41-4167-ac67-bedb934892f6", "id": 5} v 0) v1 -- 0x7fbf8006e440 con 0x7fbf80144140 2024-05-26T15:39:11.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.556+0000 7fbf77e00640 1 -- 172.21.15.47:0/4252935761 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aef034e4-0e41-4167-ac67-bedb934892f6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbf78017070 con 0x7fbf80144140 2024-05-26T15:39:11.554 INFO:teuthology.orchestra.run.smithi047.stdout:5 2024-05-26T15:39:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.557+0000 7fbf86e00640 1 -- 172.21.15.47:0/4252935761 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 msgr2=0x7fbf801f3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.557+0000 7fbf86e00640 1 --2- 172.21.15.47:0/4252935761 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf801f3020 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800cbb0 tx=0x7fbf7800a430 comp rx=0 tx=0).stop 2024-05-26T15:39:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.557+0000 7fbf86e00640 1 -- 172.21.15.47:0/4252935761 shutdown_connections 2024-05-26T15:39:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.557+0000 7fbf86e00640 1 --2- 172.21.15.47:0/4252935761 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf80144140 0x7fbf801f3020 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.557+0000 7fbf86e00640 1 --2- 172.21.15.47:0/4252935761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf800cd7c0 0x7fbf8013e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.557+0000 7fbf86e00640 1 --2- 172.21.15.47:0/4252935761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf80070ba0 0x7fbf800b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.557+0000 7fbf86e00640 1 -- 172.21.15.47:0/4252935761 >> 172.21.15.47:0/4252935761 conn(0x7fbf80069e70 msgr2=0x7fbf8006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.558+0000 7fbf86e00640 1 -- 172.21.15.47:0/4252935761 shutdown_connections 2024-05-26T15:39:11.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.558+0000 7fbf86e00640 1 -- 172.21.15.47:0/4252935761 wait complete. 2024-05-26T15:39:11.571 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new e328e30e-60f5-4cba-9d1b-39ba2e4da81e 6 2024-05-26T15:39:11.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.747+0000 7fd0eb200640 1 Processor -- start 2024-05-26T15:39:11.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.747+0000 7fd0eb200640 1 -- start start 2024-05-26T15:39:11.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.749+0000 7fd0eb200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec0cfb10 0x7fd0ec0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.749+0000 7fd0eb200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ec0b21d0 con 0x7fd0ec0cdef0 2024-05-26T15:39:11.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.749+0000 7fd0eb200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ec160c00 con 0x7fd0ec15d0b0 2024-05-26T15:39:11.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.749+0000 7fd0eb200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec1615a0 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.749+0000 7fd0e9400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec0cfb10 0x7fd0ec0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.749+0000 7fd0e9e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd0ec15d0b0 0x7fd0ec0b1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58038/0 (socket says 172.21.15.47:58038) 2024-05-26T15:39:11.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.749+0000 7fd0e9e00640 1 -- 172.21.15.47:0/975724288 learned_addr learned my addr 172.21.15.47:0/975724288 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-26T15:39:11.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.750+0000 7fd0e8a00640 1 -- 172.21.15.47:0/975724288 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369036733 0 0) 0x7fd0ec160c00 con 0x7fd0ec15d0b0 2024-05-26T15:39:11.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.750+0000 7fd0e9400640 1 -- 172.21.15.47:0/975724288 >> v1:172.21.15.47:6789/0 conn(0x7fd0ec15d0b0 legacy=0x7fd0ec0b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.750+0000 7fd0e9400640 1 -- 172.21.15.47:0/975724288 >> v1:172.21.15.8:6789/0 conn(0x7fd0ec0cdef0 legacy=0x7fd0ec0d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.750+0000 7fd0e9400640 1 -- 172.21.15.47:0/975724288 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec160ee0 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.751+0000 7fd0e9400640 1 --2- 172.21.15.47:0/975724288 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec0cfb10 0x7fd0ec0cd9b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80097d0 tx=0x7fd0d802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4710e1b8ae63f853 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:11.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.751+0000 7fd0e8a00640 1 -- 172.21.15.47:0/975724288 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8032440 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.751+0000 7fd0e8a00640 1 -- 172.21.15.47:0/975724288 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d80325a0 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.751+0000 7fd0e8a00640 1 -- 172.21.15.47:0/975724288 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8032930 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.752+0000 7fd0eb200640 1 -- 172.21.15.47:0/975724288 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec0cfb10 msgr2=0x7fd0ec0cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.752+0000 7fd0eb200640 1 --2- 172.21.15.47:0/975724288 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec0cfb10 0x7fd0ec0cd9b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80097d0 tx=0x7fd0d802a180 comp rx=0 tx=0).stop 2024-05-26T15:39:11.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.752+0000 7fd0eb200640 1 -- 172.21.15.47:0/975724288 shutdown_connections 2024-05-26T15:39:11.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.752+0000 7fd0eb200640 1 --2- 172.21.15.47:0/975724288 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec0cfb10 0x7fd0ec0cd9b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.752+0000 7fd0eb200640 1 -- 172.21.15.47:0/975724288 >> 172.21.15.47:0/975724288 conn(0x7fd0ec06b160 msgr2=0x7fd0ec06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:11.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.752+0000 7fd0eb200640 1 -- 172.21.15.47:0/975724288 shutdown_connections 2024-05-26T15:39:11.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.752+0000 7fd0eb200640 1 -- 172.21.15.47:0/975724288 wait complete. 2024-05-26T15:39:11.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.754+0000 7fd0eb200640 1 Processor -- start 2024-05-26T15:39:11.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.754+0000 7fd0eb200640 1 -- start start 2024-05-26T15:39:11.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0eb200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0cdef0 0x7fd0ec149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0eb200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ec0cfb10 0x7fd0ec15d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0eb200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec15d0b0 0x7fd0ec0c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:11.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0eb200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec15d9d0 con 0x7fd0ec0cdef0 2024-05-26T15:39:11.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0eb200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec15dc80 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0eb200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec15df60 con 0x7fd0ec15d0b0 2024-05-26T15:39:11.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0e9400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ec0cfb10 0x7fd0ec15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0ea800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec15d0b0 0x7fd0ec0c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0e9400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ec0cfb10 0x7fd0ec15d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54174/0 (socket says 172.21.15.47:54174) 2024-05-26T15:39:11.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0e9400640 1 -- 172.21.15.47:0/921882269 learned_addr learned my addr 172.21.15.47:0/921882269 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-26T15:39:11.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0e9e00640 1 --2- 172.21.15.47:0/921882269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0cdef0 0x7fd0ec149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:11.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0e9400640 1 -- 172.21.15.47:0/921882269 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec15d0b0 msgr2=0x7fd0ec0c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0e9400640 1 --2- 172.21.15.47:0/921882269 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec15d0b0 0x7fd0ec0c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0e9400640 1 -- 172.21.15.47:0/921882269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0cdef0 msgr2=0x7fd0ec149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.755+0000 7fd0e9400640 1 --2- 172.21.15.47:0/921882269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0cdef0 0x7fd0ec149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.756+0000 7fd0e9400640 1 -- 172.21.15.47:0/921882269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8009400 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.756+0000 7fd0ea800640 1 --2- 172.21.15.47:0/921882269 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec15d0b0 0x7fd0ec0c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.756+0000 7fd0e9e00640 1 --2- 172.21.15.47:0/921882269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0cdef0 0x7fd0ec149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.756+0000 7fd0e9400640 1 --2- 172.21.15.47:0/921882269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ec0cfb10 0x7fd0ec15d490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80097d0 tx=0x7fd0d80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.756+0000 7fd0e2000640 1 -- 172.21.15.47:0/921882269 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8030b80 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.756+0000 7fd0e2000640 1 -- 172.21.15.47:0/921882269 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d8030d00 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.756+0000 7fd0e2000640 1 -- 172.21.15.47:0/921882269 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d803d680 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.756+0000 7fd0eb200640 1 -- 172.21.15.47:0/921882269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec15e240 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.756+0000 7fd0eb200640 1 -- 172.21.15.47:0/921882269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec15f1b0 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.757+0000 7fd0e2000640 1 -- 172.21.15.47:0/921882269 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd0d8039040 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.757+0000 7fd0e2000640 1 -- 172.21.15.47:0/921882269 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd0d8046b80 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.757+0000 7fd0eb200640 1 -- 172.21.15.47:0/921882269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ec04e210 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.760+0000 7fd0e2000640 1 -- 172.21.15.47:0/921882269 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fd0d8041020 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.838+0000 7fd0eb200640 1 -- 172.21.15.47:0/921882269 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e328e30e-60f5-4cba-9d1b-39ba2e4da81e", "id": 6} v 0) v1 -- 0x7fd0ec0d0b70 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.846+0000 7fd0e2000640 1 -- 172.21.15.47:0/921882269 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e328e30e-60f5-4cba-9d1b-39ba2e4da81e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd0d8037070 con 0x7fd0ec0cfb10 2024-05-26T15:39:11.844 INFO:teuthology.orchestra.run.smithi047.stdout:6 2024-05-26T15:39:11.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.847+0000 7fd0eb200640 1 -- 172.21.15.47:0/921882269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ec0cfb10 msgr2=0x7fd0ec15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:11.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.847+0000 7fd0eb200640 1 --2- 172.21.15.47:0/921882269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ec0cfb10 0x7fd0ec15d490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd0d80097d0 tx=0x7fd0d80046c0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.847+0000 7fd0eb200640 1 -- 172.21.15.47:0/921882269 shutdown_connections 2024-05-26T15:39:11.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.847+0000 7fd0eb200640 1 --2- 172.21.15.47:0/921882269 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd0ec15d0b0 0x7fd0ec0c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.847+0000 7fd0eb200640 1 --2- 172.21.15.47:0/921882269 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0ec0cfb10 0x7fd0ec15d490 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.847+0000 7fd0eb200640 1 --2- 172.21.15.47:0/921882269 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd0ec0cdef0 0x7fd0ec149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:11.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.847+0000 7fd0eb200640 1 -- 172.21.15.47:0/921882269 >> 172.21.15.47:0/921882269 conn(0x7fd0ec06b160 msgr2=0x7fd0ec0b6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:11.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.847+0000 7fd0eb200640 1 -- 172.21.15.47:0/921882269 shutdown_connections 2024-05-26T15:39:11.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:11.847+0000 7fd0eb200640 1 -- 172.21.15.47:0/921882269 wait complete. 2024-05-26T15:39:11.862 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 11e891d6-7f59-40fc-aeeb-75d0c607c5c0 7 2024-05-26T15:39:11.881 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:11.883+0000 7f9a39521040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-26T15:39:11.926 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:11.927+0000 7fc913532040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-26T15:39:12.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.046+0000 7f89ade00640 1 Processor -- start 2024-05-26T15:39:12.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.046+0000 7f89ade00640 1 -- start start 2024-05-26T15:39:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.048+0000 7f89ade00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f89a815d0b0 0x7f89a80b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:12.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.048+0000 7f89ade00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a80cfb10 0x7f89a80cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.048+0000 7f89ade00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a80b21d0 con 0x7f89a80cdef0 2024-05-26T15:39:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.048+0000 7f89ade00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a81615a0 con 0x7f89a815d0b0 2024-05-26T15:39:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.048+0000 7f89ade00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a815d490 con 0x7f89a80cfb10 2024-05-26T15:39:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.048+0000 7f899fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a80cfb10 0x7f89a80cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.048+0000 7f89aca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f89a815d0b0 0x7f89a80b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.048+0000 7f899fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a80cfb10 0x7f89a80cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.47:40480/0 (socket says 172.21.15.47:40480) 2024-05-26T15:39:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.048+0000 7f899fe00640 1 -- 172.21.15.47:0/237689671 learned_addr learned my addr 172.21.15.47:0/237689671 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-26T15:39:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.049+0000 7f899fe00640 1 -- 172.21.15.47:0/237689671 >> v2:172.21.15.47:3300/0 conn(0x7f89a815d0b0 msgr2=0x7f89a80b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:12.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.049+0000 7f899fe00640 1 --2- 172.21.15.47:0/237689671 >> v2:172.21.15.47:3300/0 conn(0x7f89a815d0b0 0x7f89a80b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.049+0000 7f899fe00640 1 -- 172.21.15.47:0/237689671 >> v1:172.21.15.8:6789/0 conn(0x7f89a80cdef0 legacy=0x7f89a80b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:12.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.049+0000 7f899fe00640 1 -- 172.21.15.47:0/237689671 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a80b1ab0 con 0x7f89a80cfb10 2024-05-26T15:39:12.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.049+0000 7f89aca00640 1 --2- 172.21.15.47:0/237689671 >> v2:172.21.15.47:3300/0 conn(0x7f89a815d0b0 0x7f89a80b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:39:12.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.050+0000 7f899fe00640 1 --2- 172.21.15.47:0/237689671 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a80cfb10 0x7f89a80cd9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8990009870 tx=0x7f899002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f02dbdbcd56793d server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:12.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.050+0000 7f89a7e00640 1 -- 172.21.15.47:0/237689671 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990032440 con 0x7f89a80cfb10 2024-05-26T15:39:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.050+0000 7f89a7e00640 1 -- 172.21.15.47:0/237689671 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89900325a0 con 0x7f89a80cfb10 2024-05-26T15:39:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.050+0000 7f89a7e00640 1 -- 172.21.15.47:0/237689671 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990032930 con 0x7f89a80cfb10 2024-05-26T15:39:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.051+0000 7f89ade00640 1 -- 172.21.15.47:0/237689671 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a80cfb10 msgr2=0x7f89a80cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.051+0000 7f89ade00640 1 --2- 172.21.15.47:0/237689671 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a80cfb10 0x7f89a80cd9b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8990009870 tx=0x7f899002a1c0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.051+0000 7f89ade00640 1 -- 172.21.15.47:0/237689671 shutdown_connections 2024-05-26T15:39:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.051+0000 7f89ade00640 1 --2- 172.21.15.47:0/237689671 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a80cfb10 0x7f89a80cd9b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.051+0000 7f89ade00640 1 --2- 172.21.15.47:0/237689671 >> v2:172.21.15.47:3300/0 conn(0x7f89a815d0b0 0x7f89a80b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.051+0000 7f89ade00640 1 -- 172.21.15.47:0/237689671 >> 172.21.15.47:0/237689671 conn(0x7f89a806b160 msgr2=0x7f89a806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.051+0000 7f89ade00640 1 -- 172.21.15.47:0/237689671 shutdown_connections 2024-05-26T15:39:12.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.051+0000 7f89ade00640 1 -- 172.21.15.47:0/237689671 wait complete. 2024-05-26T15:39:12.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.053+0000 7f89ade00640 1 Processor -- start 2024-05-26T15:39:12.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.053+0000 7f89ade00640 1 -- start start 2024-05-26T15:39:12.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.054+0000 7f89ade00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a80cdef0 0x7f89a8153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:12.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.054+0000 7f89ade00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80cfb10 0x7f89a80c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:12.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.054+0000 7f89ade00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a815d0b0 0x7f89a815f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:12.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.054+0000 7f89ade00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a815d710 con 0x7f89a80cfb10 2024-05-26T15:39:12.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.054+0000 7f89ade00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a8153f80 con 0x7f89a80cdef0 2024-05-26T15:39:12.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.054+0000 7f89ade00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a815d9b0 con 0x7f89a815d0b0 2024-05-26T15:39:12.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.054+0000 7f89aca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a80cdef0 0x7f89a8153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:12.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.054+0000 7f89ad400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a815d0b0 0x7f89a815f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:12.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.054+0000 7f89aca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a80cdef0 0x7f89a8153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54196/0 (socket says 172.21.15.47:54196) 2024-05-26T15:39:12.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.054+0000 7f89aca00640 1 -- 172.21.15.47:0/1321813253 learned_addr learned my addr 172.21.15.47:0/1321813253 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-26T15:39:12.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89aca00640 1 -- 172.21.15.47:0/1321813253 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a815d0b0 msgr2=0x7f89a815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:12.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89aca00640 1 --2- 172.21.15.47:0/1321813253 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a815d0b0 0x7f89a815f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89aca00640 1 -- 172.21.15.47:0/1321813253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80cfb10 msgr2=0x7f89a80c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:12.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89aca00640 1 --2- 172.21.15.47:0/1321813253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80cfb10 0x7f89a80c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89aca00640 1 -- 172.21.15.47:0/1321813253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8998009a70 con 0x7f89a80cdef0 2024-05-26T15:39:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89ad400640 1 --2- 172.21.15.47:0/1321813253 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a815d0b0 0x7f89a815f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:39:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89aca00640 1 --2- 172.21.15.47:0/1321813253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a80cdef0 0x7f89a8153a40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f899800efc0 tx=0x7f899800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89a5600640 1 -- 172.21.15.47:0/1321813253 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998014680 con 0x7f89a80cdef0 2024-05-26T15:39:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89a5600640 1 -- 172.21.15.47:0/1321813253 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899800f040 con 0x7f89a80cdef0 2024-05-26T15:39:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89a5600640 1 -- 172.21.15.47:0/1321813253 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998014a00 con 0x7f89a80cdef0 2024-05-26T15:39:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89ade00640 1 -- 172.21.15.47:0/1321813253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89900094d0 con 0x7f89a80cdef0 2024-05-26T15:39:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.055+0000 7f89ade00640 1 -- 172.21.15.47:0/1321813253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a815df70 con 0x7f89a80cdef0 2024-05-26T15:39:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.056+0000 7f89a5600640 1 -- 172.21.15.47:0/1321813253 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f899801d400 con 0x7f89a80cdef0 2024-05-26T15:39:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.056+0000 7f89a5600640 1 -- 172.21.15.47:0/1321813253 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f899800ce70 con 0x7f89a80cdef0 2024-05-26T15:39:12.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.057+0000 7f89ade00640 1 -- 172.21.15.47:0/1321813253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a804e210 con 0x7f89a80cdef0 2024-05-26T15:39:12.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.059+0000 7f89a5600640 1 -- 172.21.15.47:0/1321813253 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f899803bdc0 con 0x7f89a80cdef0 2024-05-26T15:39:12.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.137+0000 7f89ade00640 1 -- 172.21.15.47:0/1321813253 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "11e891d6-7f59-40fc-aeeb-75d0c607c5c0", "id": 7} v 0) v1 -- 0x7f89a81611b0 con 0x7f89a80cdef0 2024-05-26T15:39:12.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.145+0000 7f89a5600640 1 -- 172.21.15.47:0/1321813253 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "11e891d6-7f59-40fc-aeeb-75d0c607c5c0", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f899802a070 con 0x7f89a80cdef0 2024-05-26T15:39:12.143 INFO:teuthology.orchestra.run.smithi047.stdout:7 2024-05-26T15:39:12.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.146+0000 7f89ade00640 1 -- 172.21.15.47:0/1321813253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a80cdef0 msgr2=0x7f89a8153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:12.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.146+0000 7f89ade00640 1 --2- 172.21.15.47:0/1321813253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a80cdef0 0x7f89a8153a40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f899800efc0 tx=0x7f899800c490 comp rx=0 tx=0).stop 2024-05-26T15:39:12.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.146+0000 7f89ade00640 1 -- 172.21.15.47:0/1321813253 shutdown_connections 2024-05-26T15:39:12.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.146+0000 7f89ade00640 1 --2- 172.21.15.47:0/1321813253 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f89a815d0b0 0x7f89a815f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.146+0000 7f89ade00640 1 --2- 172.21.15.47:0/1321813253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f89a80cfb10 0x7f89a80c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.146+0000 7f89ade00640 1 --2- 172.21.15.47:0/1321813253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89a80cdef0 0x7f89a8153a40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.146+0000 7f89ade00640 1 -- 172.21.15.47:0/1321813253 >> 172.21.15.47:0/1321813253 conn(0x7f89a806b160 msgr2=0x7f89a806b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:12.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.147+0000 7f89ade00640 1 -- 172.21.15.47:0/1321813253 shutdown_connections 2024-05-26T15:39:12.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-26T15:39:12.147+0000 7f89ade00640 1 -- 172.21.15.47:0/1321813253 wait complete. 2024-05-26T15:39:12.162 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-26T15:39:12.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-26T15:39:12.170 INFO:tasks.ceph.osd.0:Started 2024-05-26T15:39:12.171 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-26T15:39:12.171 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-26T15:39:12.178 INFO:tasks.ceph.osd.1:Started 2024-05-26T15:39:12.178 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-26T15:39:12.178 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-26T15:39:12.183 INFO:tasks.ceph.osd.2:Started 2024-05-26T15:39:12.183 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-26T15:39:12.183 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-26T15:39:12.190 INFO:tasks.ceph.osd.3:Started 2024-05-26T15:39:12.190 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-26T15:39:12.190 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-26T15:39:12.194 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:12.196+0000 7f9a39521040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-26T15:39:12.198 INFO:tasks.ceph.osd.4:Started 2024-05-26T15:39:12.198 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-26T15:39:12.198 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-26T15:39:12.202 INFO:tasks.ceph.osd.5:Started 2024-05-26T15:39:12.202 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-26T15:39:12.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-26T15:39:12.206 INFO:tasks.ceph.osd.6:Started 2024-05-26T15:39:12.207 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-26T15:39:12.207 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-26T15:39:12.211 INFO:tasks.ceph.osd.7:Started 2024-05-26T15:39:12.212 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:12.256 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:12.258+0000 7fc913532040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-26T15:39:12.279 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:12.281+0000 7f9a39521040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-26T15:39:12.349 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:12.351+0000 7fc913532040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-26T15:39:12.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.421+0000 7fb0e3200640 1 Processor -- start 2024-05-26T15:39:12.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.421+0000 7fb0e3200640 1 -- start start 2024-05-26T15:39:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.422+0000 7fb0e3200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0dc15cf10 0x7fb0dc0b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.422+0000 7fb0e3200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb0dc1615f0 0x7fb0dc1609e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.422+0000 7fb0e3200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0dc0b6a50 con 0x7fb0dc160f20 2024-05-26T15:39:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.422+0000 7fb0e3200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0dc1613b0 con 0x7fb0dc1615f0 2024-05-26T15:39:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.422+0000 7fb0e3200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0b5c30 con 0x7fb0dc15cf10 2024-05-26T15:39:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.423+0000 7fb0d3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb0dc1615f0 0x7fb0dc1609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.423+0000 7fb0d3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb0dc1615f0 0x7fb0dc1609e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46020/0 (socket says 172.21.15.8:46020) 2024-05-26T15:39:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.423+0000 7fb0d3e00640 1 -- 172.21.15.8:0/2171478312 learned_addr learned my addr 172.21.15.8:0/2171478312 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:12.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.423+0000 7fb0dbe00640 1 --2- 172.21.15.8:0/2171478312 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0dc15cf10 0x7fb0dc0b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:12.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.423+0000 7fb0d3e00640 1 -- 172.21.15.8:0/2171478312 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0dc15cf10 msgr2=0x7fb0dc0b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:12.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.423+0000 7fb0d3e00640 1 --2- 172.21.15.8:0/2171478312 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0dc15cf10 0x7fb0dc0b84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.423+0000 7fb0d3e00640 1 -- 172.21.15.8:0/2171478312 >> v1:172.21.15.47:6789/0 conn(0x7fb0dc160f20 legacy=0x7fb0dc0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:12.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.423+0000 7fb0d3e00640 1 -- 172.21.15.8:0/2171478312 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc15d2f0 con 0x7fb0dc1615f0 2024-05-26T15:39:12.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.424+0000 7fb0d3e00640 1 --2- 172.21.15.8:0/2171478312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc1615f0 0x7fb0dc1609e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009870 tx=0x7fb0c402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b670626f3ede4b0f server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:12.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.424+0000 7fb0db400640 1 -- 172.21.15.8:0/2171478312 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4032640 con 0x7fb0dc1615f0 2024-05-26T15:39:12.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.424+0000 7fb0db400640 1 -- 172.21.15.8:0/2171478312 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c40327a0 con 0x7fb0dc1615f0 2024-05-26T15:39:12.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.424+0000 7fb0db400640 1 -- 172.21.15.8:0/2171478312 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4032b30 con 0x7fb0dc1615f0 2024-05-26T15:39:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.425+0000 7fb0e3200640 1 -- 172.21.15.8:0/2171478312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc1615f0 msgr2=0x7fb0dc1609e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.425+0000 7fb0e3200640 1 --2- 172.21.15.8:0/2171478312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc1615f0 0x7fb0dc1609e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009870 tx=0x7fb0c402a300 comp rx=0 tx=0).stop 2024-05-26T15:39:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.425+0000 7fb0e3200640 1 -- 172.21.15.8:0/2171478312 shutdown_connections 2024-05-26T15:39:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.425+0000 7fb0e3200640 1 --2- 172.21.15.8:0/2171478312 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc1615f0 0x7fb0dc1609e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.425+0000 7fb0e3200640 1 --2- 172.21.15.8:0/2171478312 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0dc15cf10 0x7fb0dc0b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.425+0000 7fb0e3200640 1 -- 172.21.15.8:0/2171478312 >> 172.21.15.8:0/2171478312 conn(0x7fb0dc071990 msgr2=0x7fb0dc071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.425+0000 7fb0e3200640 1 -- 172.21.15.8:0/2171478312 shutdown_connections 2024-05-26T15:39:12.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.425+0000 7fb0e3200640 1 -- 172.21.15.8:0/2171478312 wait complete. 2024-05-26T15:39:12.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.427+0000 7fb0e3200640 1 Processor -- start 2024-05-26T15:39:12.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.427+0000 7fb0e3200640 1 -- start start 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0e3200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0dc15cf10 0x7fb0dc157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0e3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc160f20 0x7fb0dc1f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0e3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0dc1615f0 0x7fb0dc15e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0e3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0c7ca0 con 0x7fb0dc160f20 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0e3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc158390 con 0x7fb0dc1615f0 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0e3200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc1f25a0 con 0x7fb0dc15cf10 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0d3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc160f20 0x7fb0dc1f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0d3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc160f20 0x7fb0dc1f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46028/0 (socket says 172.21.15.8:46028) 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0d3e00640 1 -- 172.21.15.8:0/2291528787 learned_addr learned my addr 172.21.15.8:0/2291528787 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0dbe00640 1 --2- 172.21.15.8:0/2291528787 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0dc15cf10 0x7fb0dc157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.428+0000 7fb0e1200640 1 --2- 172.21.15.8:0/2291528787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0dc1615f0 0x7fb0dc15e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:12.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0d3e00640 1 -- 172.21.15.8:0/2291528787 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0dc15cf10 msgr2=0x7fb0dc157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0d3e00640 1 --2- 172.21.15.8:0/2291528787 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0dc15cf10 0x7fb0dc157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0d3e00640 1 -- 172.21.15.8:0/2291528787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0dc1615f0 msgr2=0x7fb0dc15e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0d3e00640 1 --2- 172.21.15.8:0/2291528787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0dc1615f0 0x7fb0dc15e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0d3e00640 1 -- 172.21.15.8:0/2291528787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c40094d0 con 0x7fb0dc160f20 2024-05-26T15:39:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0d3e00640 1 --2- 172.21.15.8:0/2291528787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc160f20 0x7fb0dc1f2060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009870 tx=0x7fb0c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0d8c00640 1 -- 172.21.15.8:0/2291528787 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c403b810 con 0x7fb0dc160f20 2024-05-26T15:39:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0d8c00640 1 -- 172.21.15.8:0/2291528787 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c403b970 con 0x7fb0dc160f20 2024-05-26T15:39:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0d8c00640 1 -- 172.21.15.8:0/2291528787 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c403bd20 con 0x7fb0dc160f20 2024-05-26T15:39:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0e3200640 1 -- 172.21.15.8:0/2291528787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc156010 con 0x7fb0dc160f20 2024-05-26T15:39:12.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.429+0000 7fb0e3200640 1 -- 172.21.15.8:0/2291528787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc0c7930 con 0x7fb0dc160f20 2024-05-26T15:39:12.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.430+0000 7fb0d8c00640 1 -- 172.21.15.8:0/2291528787 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb0c4039040 con 0x7fb0dc160f20 2024-05-26T15:39:12.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.430+0000 7fb0d8c00640 1 -- 172.21.15.8:0/2291528787 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb0c4030bd0 con 0x7fb0dc160f20 2024-05-26T15:39:12.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.431+0000 7fb0e3200640 1 -- 172.21.15.8:0/2291528787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc0b63e0 con 0x7fb0dc160f20 2024-05-26T15:39:12.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.433+0000 7fb0d8c00640 1 -- 172.21.15.8:0/2291528787 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fb0dc0b63e0 con 0x7fb0dc160f20 2024-05-26T15:39:12.446 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:12.448+0000 7f9a39521040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-26T15:39:12.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.498+0000 7fb0e3200640 1 -- 172.21.15.8:0/2291528787 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0dc0681d0 con 0x7fb0dc160f20 2024-05-26T15:39:12.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.499+0000 7fb0d8c00640 1 -- 172.21.15.8:0/2291528787 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb0c404c060 con 0x7fb0dc160f20 2024-05-26T15:39:12.498 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:12.498 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:12.140210+0000","last_up_change":"0.000000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:12.498 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:12.500+0000 7fc913532040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-26T15:39:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.501+0000 7fb0e3200640 1 -- 172.21.15.8:0/2291528787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc160f20 msgr2=0x7fb0dc1f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.501+0000 7fb0e3200640 1 --2- 172.21.15.8:0/2291528787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc160f20 0x7fb0dc1f2060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009870 tx=0x7fb0c40046c0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.501+0000 7fb0e3200640 1 -- 172.21.15.8:0/2291528787 shutdown_connections 2024-05-26T15:39:12.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.501+0000 7fb0e3200640 1 --2- 172.21.15.8:0/2291528787 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb0dc1615f0 0x7fb0dc15e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.501+0000 7fb0e3200640 1 --2- 172.21.15.8:0/2291528787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0dc160f20 0x7fb0dc1f2060 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.501+0000 7fb0e3200640 1 --2- 172.21.15.8:0/2291528787 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb0dc15cf10 0x7fb0dc157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:12.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.501+0000 7fb0e3200640 1 -- 172.21.15.8:0/2291528787 >> 172.21.15.8:0/2291528787 conn(0x7fb0dc071990 msgr2=0x7fb0dc0d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:12.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.501+0000 7fb0e3200640 1 -- 172.21.15.8:0/2291528787 shutdown_connections 2024-05-26T15:39:12.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:12.501+0000 7fb0e3200640 1 -- 172.21.15.8:0/2291528787 wait complete. 2024-05-26T15:39:12.515 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-26T15:39:12.515 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-26T15:39:12.789 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:12.791+0000 7f9a39521040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-26T15:39:12.845 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:12.847+0000 7fc913532040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-26T15:39:12.847 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:12.849+0000 7f9a39521040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-26T15:39:12.872 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-05-26T15:39:12.874+0000 7f899ba31640 -1 Falling back to public interface 2024-05-26T15:39:12.877 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-05-26T15:39:12.879+0000 7efe4e20c640 -1 Falling back to public interface 2024-05-26T15:39:12.888 INFO:tasks.ceph.osd.2.smithi008.stderr:2024-05-26T15:39:12.890+0000 7f8eaad4c640 -1 Falling back to public interface 2024-05-26T15:39:12.893 INFO:tasks.ceph.osd.1.smithi008.stderr:2024-05-26T15:39:12.895+0000 7f2396e0e640 -1 Falling back to public interface 2024-05-26T15:39:12.895 INFO:tasks.ceph.osd.0.smithi008.stderr:2024-05-26T15:39:12.897+0000 7f4efeb44640 -1 Falling back to public interface 2024-05-26T15:39:12.897 INFO:tasks.ceph.osd.3.smithi008.stderr:2024-05-26T15:39:12.899+0000 7f3a8b682640 -1 Falling back to public interface 2024-05-26T15:39:12.907 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-05-26T15:39:12.909+0000 7f965b52a640 -1 Falling back to public interface 2024-05-26T15:39:12.912 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:12.914+0000 7fc913532040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-26T15:39:12.923 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-05-26T15:39:12.924+0000 7f66de617640 -1 Falling back to public interface 2024-05-26T15:39:13.044 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:13.046+0000 7f9a39521040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-26T15:39:13.104 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:13.106+0000 7fc913532040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-26T15:39:13.220 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:13.222+0000 7f9a39521040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-26T15:39:13.280 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:13.282+0000 7f9a39521040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-26T15:39:13.282 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:13.284+0000 7fc913532040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-26T15:39:13.320 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:13.344 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:13.346+0000 7fc913532040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-26T15:39:13.365 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:13.367+0000 7f9a39521040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-26T15:39:13.420 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:13.422+0000 7f9a39521040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-26T15:39:13.430 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:13.432+0000 7fc913532040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-26T15:39:13.480 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.481+0000 7fb4dc200640 1 Processor -- start 2024-05-26T15:39:13.480 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.482+0000 7fb4dc200640 1 -- start start 2024-05-26T15:39:13.482 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4dc200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb4d4143fe0 0x7fb4d406d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4dc200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4d41443c0 0x7fb4d4070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4dc200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb4d406e3a0 0x7fb4d4070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4dc200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d406d780 con 0x7fb4d406e3a0 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4dc200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40cb490 con 0x7fb4d4143fe0 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4dc200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40cb770 con 0x7fb4d41443c0 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4da200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb4d406e3a0 0x7fb4d4070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4d9800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb4d4143fe0 0x7fb4d406d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4d8e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4d41443c0 0x7fb4d4070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4d9800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb4d4143fe0 0x7fb4d406d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:42482/0 (socket says 172.21.15.8:42482) 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.483+0000 7fb4d9800640 1 -- 172.21.15.8:0/1308878045 learned_addr learned my addr 172.21.15.8:0/1308878045 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:13.483 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.484+0000 7fb4d9800640 1 -- 172.21.15.8:0/1308878045 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4d41443c0 msgr2=0x7fb4d4070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:13.484 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.484+0000 7fb4d9800640 1 --2- 172.21.15.8:0/1308878045 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4d41443c0 0x7fb4d4070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.484 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.484+0000 7fb4d9800640 1 -- 172.21.15.8:0/1308878045 >> v2:172.21.15.8:3300/0 conn(0x7fb4d406e3a0 msgr2=0x7fb4d4070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:13.484 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.484+0000 7fb4d9800640 1 --2- 172.21.15.8:0/1308878045 >> v2:172.21.15.8:3300/0 conn(0x7fb4d406e3a0 0x7fb4d4070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.484 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.484+0000 7fb4d9800640 1 -- 172.21.15.8:0/1308878045 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d40cba50 con 0x7fb4d4143fe0 2024-05-26T15:39:13.485 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.485+0000 7fb4d9800640 1 --2- 172.21.15.8:0/1308878045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4d4143fe0 0x7fb4d406d240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40b3f80 tx=0x7fb4c802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e4c33f1209cad93 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:13.485 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.485+0000 7fb4d3e00640 1 -- 172.21.15.8:0/1308878045 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8032440 con 0x7fb4d4143fe0 2024-05-26T15:39:13.485 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.485+0000 7fb4d3e00640 1 -- 172.21.15.8:0/1308878045 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c80325a0 con 0x7fb4d4143fe0 2024-05-26T15:39:13.485 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.485+0000 7fb4d3e00640 1 -- 172.21.15.8:0/1308878045 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8032930 con 0x7fb4d4143fe0 2024-05-26T15:39:13.485 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.486+0000 7fb4dc200640 1 -- 172.21.15.8:0/1308878045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4d4143fe0 msgr2=0x7fb4d406d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:13.485 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.486+0000 7fb4dc200640 1 --2- 172.21.15.8:0/1308878045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4d4143fe0 0x7fb4d406d240 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40b3f80 tx=0x7fb4c802a1e0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.485 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.486+0000 7fb4dc200640 1 -- 172.21.15.8:0/1308878045 shutdown_connections 2024-05-26T15:39:13.485 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.486+0000 7fb4dc200640 1 --2- 172.21.15.8:0/1308878045 >> v2:172.21.15.8:3300/0 conn(0x7fb4d406e3a0 0x7fb4d4070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.485 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.486+0000 7fb4dc200640 1 --2- 172.21.15.8:0/1308878045 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4d41443c0 0x7fb4d4070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.486 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.486+0000 7fb4dc200640 1 --2- 172.21.15.8:0/1308878045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4d4143fe0 0x7fb4d406d240 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.486 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.486+0000 7fb4dc200640 1 -- 172.21.15.8:0/1308878045 >> 172.21.15.8:0/1308878045 conn(0x7fb4d4066310 msgr2=0x7fb4d4069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:13.486 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.486+0000 7fb4dc200640 1 -- 172.21.15.8:0/1308878045 shutdown_connections 2024-05-26T15:39:13.486 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.486+0000 7fb4dc200640 1 -- 172.21.15.8:0/1308878045 wait complete. 2024-05-26T15:39:13.486 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.488+0000 7fb4dc200640 1 Processor -- start 2024-05-26T15:39:13.487 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.488+0000 7fb4dc200640 1 -- start start 2024-05-26T15:39:13.488 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4dc200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d4143fe0 0x7fb4d40b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4dc200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4d41443c0 0x7fb4d41407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4dc200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4d40b1c10 0x7fb4d413f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4dc200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40b20d0 con 0x7fb4d4143fe0 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4dc200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40b23b0 con 0x7fb4d41443c0 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4dc200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40b2690 con 0x7fb4d40b1c10 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4d9800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d4143fe0 0x7fb4d40b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4d9800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d4143fe0 0x7fb4d40b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46044/0 (socket says 172.21.15.8:46044) 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4d9800640 1 -- 172.21.15.8:0/2374649407 learned_addr learned my addr 172.21.15.8:0/2374649407 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4d8e00640 1 --2- 172.21.15.8:0/2374649407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4d41443c0 0x7fb4d41407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.489+0000 7fb4da200640 1 --2- 172.21.15.8:0/2374649407 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4d40b1c10 0x7fb4d413f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4d9800640 1 -- 172.21.15.8:0/2374649407 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4d40b1c10 msgr2=0x7fb4d413f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4d9800640 1 --2- 172.21.15.8:0/2374649407 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4d40b1c10 0x7fb4d413f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.489 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4d9800640 1 -- 172.21.15.8:0/2374649407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4d41443c0 msgr2=0x7fb4d41407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:13.490 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4d9800640 1 --2- 172.21.15.8:0/2374649407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4d41443c0 0x7fb4d41407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.490 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4d9800640 1 -- 172.21.15.8:0/2374649407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80094d0 con 0x7fb4d4143fe0 2024-05-26T15:39:13.490 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4d8e00640 1 --2- 172.21.15.8:0/2374649407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4d41443c0 0x7fb4d41407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:13.490 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4d9800640 1 --2- 172.21.15.8:0/2374649407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d4143fe0 0x7fb4d40b3170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb4c802a220 tx=0x7fb4c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:13.490 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4d1600640 1 -- 172.21.15.8:0/2374649407 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c803d830 con 0x7fb4d4143fe0 2024-05-26T15:39:13.490 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4d1600640 1 -- 172.21.15.8:0/2374649407 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c803d990 con 0x7fb4d4143fe0 2024-05-26T15:39:13.490 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4dc200640 1 -- 172.21.15.8:0/2374649407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d40b2970 con 0x7fb4d4143fe0 2024-05-26T15:39:13.490 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fb4d1600640 1 -- 172.21.15.8:0/2374649407 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c803dd40 con 0x7fb4d4143fe0 2024-05-26T15:39:13.490 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:13.490+0000 7fc913532040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-26T15:39:13.491 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.491+0000 7fb4dc200640 1 -- 172.21.15.8:0/2374649407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d4140d10 con 0x7fb4d4143fe0 2024-05-26T15:39:13.491 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.491+0000 7fb4d1600640 1 -- 172.21.15.8:0/2374649407 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb4c8039040 con 0x7fb4d4143fe0 2024-05-26T15:39:13.491 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.491+0000 7fb4d1600640 1 -- 172.21.15.8:0/2374649407 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb4c803bac0 con 0x7fb4d4143fe0 2024-05-26T15:39:13.491 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.492+0000 7fb4dc200640 1 -- 172.21.15.8:0/2374649407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d40b2e90 con 0x7fb4d4143fe0 2024-05-26T15:39:13.492 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.494+0000 7fb4d1600640 1 -- 172.21.15.8:0/2374649407 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fb4d40b2e90 con 0x7fb4d4143fe0 2024-05-26T15:39:13.559 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.561+0000 7fb4dc200640 1 -- 172.21.15.8:0/2374649407 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4d40681d0 con 0x7fb4d4143fe0 2024-05-26T15:39:13.561 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.562+0000 7fb4d1600640 1 -- 172.21.15.8:0/2374649407 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb4c804b060 con 0x7fb4d4143fe0 2024-05-26T15:39:13.561 INFO:teuthology.misc.health.smithi008.stdout: 2024-05-26T15:39:13.561 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":10,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:12.140210+0000","last_up_change":"0.000000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:13.562 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.564+0000 7fb4dc200640 1 -- 172.21.15.8:0/2374649407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d4143fe0 msgr2=0x7fb4d40b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:13.562 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.564+0000 7fb4dc200640 1 --2- 172.21.15.8:0/2374649407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d4143fe0 0x7fb4d40b3170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb4c802a220 tx=0x7fb4c80046c0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.562 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.564+0000 7fb4dc200640 1 -- 172.21.15.8:0/2374649407 shutdown_connections 2024-05-26T15:39:13.562 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.564+0000 7fb4dc200640 1 --2- 172.21.15.8:0/2374649407 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4d40b1c10 0x7fb4d413f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.562 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.564+0000 7fb4dc200640 1 --2- 172.21.15.8:0/2374649407 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4d41443c0 0x7fb4d41407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.563 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.564+0000 7fb4dc200640 1 --2- 172.21.15.8:0/2374649407 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb4d4143fe0 0x7fb4d40b3170 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:13.563 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.564+0000 7fb4dc200640 1 -- 172.21.15.8:0/2374649407 >> 172.21.15.8:0/2374649407 conn(0x7fb4d406e3a0 msgr2=0x7fb4d4069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:13.563 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.564+0000 7fb4dc200640 1 -- 172.21.15.8:0/2374649407 shutdown_connections 2024-05-26T15:39:13.563 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:13.564+0000 7fb4dc200640 1 -- 172.21.15.8:0/2374649407 wait complete. 2024-05-26T15:39:13.574 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-26T15:39:13.977 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:13.979+0000 7f9a39521040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-26T15:39:14.050 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:14.052+0000 7fc913532040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-26T15:39:14.114 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:14.116+0000 7f9a39521040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-26T15:39:14.191 INFO:tasks.ceph.mgr.y.smithi008.stderr:2024-05-26T15:39:14.192+0000 7fc913532040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-26T15:39:15.154 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:15.156+0000 7f99d9e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-26T15:39:15.155 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-05-26T15:39:15.157+0000 7f99d9e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-26T15:39:16.249 INFO:tasks.ceph.osd.2.smithi008.stderr:2024-05-26T15:39:16.251+0000 7f8eaad4c640 -1 osd.2 0 log_to_monitors true 2024-05-26T15:39:16.320 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-05-26T15:39:16.322+0000 7f66de617640 -1 osd.5 0 log_to_monitors true 2024-05-26T15:39:16.451 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-05-26T15:39:16.453+0000 7f899ba31640 -1 osd.4 0 log_to_monitors true 2024-05-26T15:39:16.479 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-05-26T15:39:16.481+0000 7efe4e20c640 -1 osd.6 0 log_to_monitors true 2024-05-26T15:39:16.501 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-05-26T15:39:16.503+0000 7f965b52a640 -1 osd.7 0 log_to_monitors true 2024-05-26T15:39:16.515 INFO:tasks.ceph.osd.3.smithi008.stderr:2024-05-26T15:39:16.517+0000 7f3a8b682640 -1 osd.3 0 log_to_monitors true 2024-05-26T15:39:16.540 INFO:tasks.ceph.osd.0.smithi008.stderr:2024-05-26T15:39:16.542+0000 7f4efeb44640 -1 osd.0 0 log_to_monitors true 2024-05-26T15:39:16.762 INFO:tasks.ceph.osd.1.smithi008.stderr:2024-05-26T15:39:16.764+0000 7f2396e0e640 -1 osd.1 0 log_to_monitors true 2024-05-26T15:39:19.883 INFO:tasks.ceph.osd.3.smithi008.stderr:2024-05-26T15:39:19.882+0000 7f3a86600640 -1 osd.3 0 waiting for initial osdmap 2024-05-26T15:39:19.889 INFO:tasks.ceph.osd.3.smithi008.stderr:2024-05-26T15:39:19.891+0000 7f3a7c600640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-26T15:39:19.923 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-05-26T15:39:19.924+0000 7efe48a00640 -1 osd.6 0 waiting for initial osdmap 2024-05-26T15:39:19.931 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-05-26T15:39:19.932+0000 7efe3ea00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-26T15:39:19.937 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-05-26T15:39:19.938+0000 7f66d9000640 -1 osd.5 0 waiting for initial osdmap 2024-05-26T15:39:19.941 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-05-26T15:39:19.941+0000 7f8995e00640 -1 osd.4 0 waiting for initial osdmap 2024-05-26T15:39:19.942 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-05-26T15:39:19.943+0000 7f66cf000640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-26T15:39:19.947 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-05-26T15:39:19.948+0000 7f898be00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-26T15:39:19.973 INFO:tasks.ceph.osd.0.smithi008.stderr:2024-05-26T15:39:19.975+0000 7f4ef9a00640 -1 osd.0 0 waiting for initial osdmap 2024-05-26T15:39:19.974 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-05-26T15:39:19.975+0000 7f9656400640 -1 osd.7 0 waiting for initial osdmap 2024-05-26T15:39:19.981 INFO:tasks.ceph.osd.0.smithi008.stderr:2024-05-26T15:39:19.983+0000 7f4eefa00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-26T15:39:19.981 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-05-26T15:39:19.982+0000 7f964c400640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-26T15:39:19.985 INFO:tasks.ceph.osd.2.smithi008.stderr:2024-05-26T15:39:19.987+0000 7f8ea5c00640 -1 osd.2 0 waiting for initial osdmap 2024-05-26T15:39:19.991 INFO:tasks.ceph.osd.2.smithi008.stderr:2024-05-26T15:39:19.993+0000 7f8e9bc00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-26T15:39:20.007 INFO:tasks.ceph.osd.1.smithi008.stderr:2024-05-26T15:39:20.009+0000 7f2391600640 -1 osd.1 0 waiting for initial osdmap 2024-05-26T15:39:20.014 INFO:tasks.ceph.osd.1.smithi008.stderr:2024-05-26T15:39:20.015+0000 7f2387600640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-26T15:39:20.380 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:20.562 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.564+0000 7f8432c00640 1 Processor -- start 2024-05-26T15:39:20.562 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.564+0000 7f8432c00640 1 -- start start 2024-05-26T15:39:20.564 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.565+0000 7f8432c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c15cc20 0x7f842c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:20.564 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.565+0000 7f8432c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f842c0d1830 0x7f842c0cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:20.564 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.565+0000 7f8432c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c15d000 con 0x7f842c0cd8d0 2024-05-26T15:39:20.564 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.566+0000 7f8432c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842c0ce110 con 0x7f842c0d1830 2024-05-26T15:39:20.564 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.566+0000 7f8432c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0cde30 con 0x7f842c15cc20 2024-05-26T15:39:20.565 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.566+0000 7f8430c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f842c0cd8d0 0x7f842c0b4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:56108/0 (socket says 172.21.15.8:56108) 2024-05-26T15:39:20.565 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.566+0000 7f8430c00640 1 -- 172.21.15.8:0/2165973083 learned_addr learned my addr 172.21.15.8:0/2165973083 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:20.565 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.566+0000 7f842b400640 1 --2- 172.21.15.8:0/2165973083 >> v2:172.21.15.47:3300/0 conn(0x7f842c0d1830 0x7f842c0cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:20.565 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.566+0000 7f842be00640 1 --2- 172.21.15.8:0/2165973083 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c15cc20 0x7f842c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:20.565 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.566+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517554560 0 0) 0x7f842c15d000 con 0x7f842c0cd8d0 2024-05-26T15:39:20.565 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8410003520 con 0x7f842c0cd8d0 2024-05-26T15:39:20.566 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1460560410 0 0) 0x7f8410003520 con 0x7f842c0cd8d0 2024-05-26T15:39:20.566 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c15cc20 msgr2=0x7f842c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:20.566 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 --2- 172.21.15.8:0/2165973083 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c15cc20 0x7f842c0d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 >> v2:172.21.15.47:3300/0 conn(0x7f842c0d1830 msgr2=0x7f842c0cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 --2- 172.21.15.8:0/2165973083 >> v2:172.21.15.47:3300/0 conn(0x7f842c0d1830 0x7f842c0cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0d0810 con 0x7f842c0cd8d0 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f84240019f0 con 0x7f842c0cd8d0 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 >> v1:172.21.15.8:6789/0 conn(0x7f842c0cd8d0 legacy=0x7f842c0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 --2- 172.21.15.8:0/2165973083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8410003970 0x7f8410003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 --2- 172.21.15.8:0/2165973083 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c15cc20 0x7f84100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 --2- 172.21.15.8:0/2165973083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410004d00 0x7f8410005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0ce110 con 0x7f8410003970 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0cde30 con 0x7f8410004d00 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841000b980 con 0x7f842c15cc20 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.567+0000 7f842be00640 1 --2- 172.21.15.8:0/2165973083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8410003970 0x7f8410003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.568+0000 7f842be00640 1 -- 172.21.15.8:0/2165973083 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c15cc20 msgr2=0x7f84100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:20.567 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.568+0000 7f842be00640 1 --2- 172.21.15.8:0/2165973083 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c15cc20 0x7f84100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.568 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.568+0000 7f842be00640 1 -- 172.21.15.8:0/2165973083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410004d00 msgr2=0x7f8410005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:20.568 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.568+0000 7f842be00640 1 --2- 172.21.15.8:0/2165973083 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410004d00 0x7f8410005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.568 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.568+0000 7f842be00640 1 -- 172.21.15.8:0/2165973083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8410003520 con 0x7f8410003970 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.569+0000 7f842be00640 1 --2- 172.21.15.8:0/2165973083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8410003970 0x7f8410003d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f841c009ac0 tx=0x7f84100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fcb20682272aab server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.569+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c031400 con 0x7f8410003970 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.569+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c02d050 con 0x7f8410003970 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.569+0000 7f842aa00640 1 -- 172.21.15.8:0/2165973083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c031780 con 0x7f8410003970 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.570+0000 7f8432c00640 1 -- 172.21.15.8:0/2165973083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8410003970 msgr2=0x7f8410003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.570+0000 7f8432c00640 1 --2- 172.21.15.8:0/2165973083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8410003970 0x7f8410003d90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f841c009ac0 tx=0x7f84100057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.570+0000 7f8430c00640 1 -- 172.21.15.8:0/2165973083 reap_dead start 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.570+0000 7f8432c00640 1 -- 172.21.15.8:0/2165973083 shutdown_connections 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.570+0000 7f8432c00640 1 -- 172.21.15.8:0/2165973083 >> 172.21.15.8:0/2165973083 conn(0x7f842c06b890 msgr2=0x7f842c06bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.570+0000 7f8432c00640 1 -- 172.21.15.8:0/2165973083 shutdown_connections 2024-05-26T15:39:20.569 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.570+0000 7f8432c00640 1 -- 172.21.15.8:0/2165973083 wait complete. 2024-05-26T15:39:20.570 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.572+0000 7f8432c00640 1 Processor -- start 2024-05-26T15:39:20.571 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.573+0000 7f8432c00640 1 -- start start 2024-05-26T15:39:20.573 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f8432c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410003970 0x7f842c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:20.573 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f8432c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c14df80 0x7f842c0cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:20.573 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f8432c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f842c0cbc60 0x7f842c0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:20.573 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f8432c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c15d6d0 con 0x7f842c0cbc60 2024-05-26T15:39:20.573 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f8432c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0cc0e0 con 0x7f8410003970 2024-05-26T15:39:20.573 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f8432c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c15d8e0 con 0x7f842c14df80 2024-05-26T15:39:20.573 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f8430c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f842c0cbc60 0x7f842c0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:20.573 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f8430c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f842c0cbc60 0x7f842c0c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46096/0 (socket says 172.21.15.8:46096) 2024-05-26T15:39:20.573 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f8430c00640 1 -- 172.21.15.8:0/1605288161 learned_addr learned my addr 172.21.15.8:0/1605288161 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:20.574 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f842be00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410003970 0x7f842c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:20.574 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.574+0000 7f842b400640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c14df80 0x7f842c0cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:20.574 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8430c00640 1 -- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c14df80 msgr2=0x7f842c0cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:20.574 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8430c00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c14df80 0x7f842c0cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.574 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8430c00640 1 -- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410003970 msgr2=0x7f842c15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:20.574 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8430c00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410003970 0x7f842c15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.574 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8430c00640 1 -- 172.21.15.8:0/1605288161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c15dbc0 con 0x7f842c0cbc60 2024-05-26T15:39:20.574 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f842b400640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c14df80 0x7f842c0cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:20.574 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8430c00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f842c0cbc60 0x7f842c0c7080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f842c160660 tx=0x7f842400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:20.575 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8423e00640 1 -- 172.21.15.8:0/1605288161 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842400a610 con 0x7f842c0cbc60 2024-05-26T15:39:20.575 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8423e00640 1 -- 172.21.15.8:0/1605288161 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842400a770 con 0x7f842c0cbc60 2024-05-26T15:39:20.575 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8423e00640 1 -- 172.21.15.8:0/1605288161 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842400aae0 con 0x7f842c0cbc60 2024-05-26T15:39:20.575 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8432c00640 1 -- 172.21.15.8:0/1605288161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c15dea0 con 0x7f842c0cbc60 2024-05-26T15:39:20.575 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.575+0000 7f8432c00640 1 -- 172.21.15.8:0/1605288161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c15e460 con 0x7f842c0cbc60 2024-05-26T15:39:20.575 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.577+0000 7f8432c00640 1 -- 172.21.15.8:0/1605288161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c0681d0 con 0x7f842c0cbc60 2024-05-26T15:39:20.576 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.577+0000 7f8423e00640 1 -- 172.21.15.8:0/1605288161 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f842400ac40 con 0x7f842c0cbc60 2024-05-26T15:39:20.576 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.578+0000 7f8423e00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f840806abc0 0x7f840806d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:20.576 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.578+0000 7f8423e00640 1 -- 172.21.15.8:0/1605288161 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f8424088250 con 0x7f842c0cbc60 2024-05-26T15:39:20.577 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.579+0000 7f842be00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f840806abc0 0x7f840806d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:20.578 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.580+0000 7f842be00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f840806abc0 0x7f840806d080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f841c033000 tx=0x7f841c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:20.582 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.584+0000 7f8423e00640 1 -- 172.21.15.8:0/1605288161 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8424054280 con 0x7f842c0cbc60 2024-05-26T15:39:20.776 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.778+0000 7f8432c00640 1 -- 172.21.15.8:0/1605288161 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f842c0b32b0 con 0x7f842c0cbc60 2024-05-26T15:39:20.781 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.782+0000 7f8423e00640 1 -- 172.21.15.8:0/1605288161 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f84240578a0 con 0x7f842c0cbc60 2024-05-26T15:39:20.781 INFO:teuthology.misc.health.smithi008.stdout: 2024-05-26T15:39:20.781 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":12,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:18.156773+0000","last_up_change":"0.000000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:20.783 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 -- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f840806abc0 msgr2=0x7f840806d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f840806abc0 0x7f840806d080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f841c033000 tx=0x7f841c008030 comp rx=0 tx=0).stop 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 -- 172.21.15.8:0/1605288161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f842c0cbc60 msgr2=0x7f842c0c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f842c0cbc60 0x7f842c0c7080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f842c160660 tx=0x7f842400ccd0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 -- 172.21.15.8:0/1605288161 shutdown_connections 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f842c0cbc60 0x7f842c0c7080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f842c14df80 0x7f842c0cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f840806abc0 0x7f840806d080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 --2- 172.21.15.8:0/1605288161 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8410003970 0x7f842c15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 -- 172.21.15.8:0/1605288161 >> 172.21.15.8:0/1605288161 conn(0x7f842c06b890 msgr2=0x7f842c0b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 -- 172.21.15.8:0/1605288161 shutdown_connections 2024-05-26T15:39:20.784 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:20.785+0000 7f8432c00640 1 -- 172.21.15.8:0/1605288161 wait complete. 2024-05-26T15:39:20.797 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-26T15:39:27.605 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:27.798 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.799+0000 7f98f8000640 1 Processor -- start 2024-05-26T15:39:27.798 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.800+0000 7f98f8000640 1 -- start start 2024-05-26T15:39:27.800 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.801+0000 7f98f8000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f98f015e7d0 0x7f98f00b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:27.800 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.801+0000 7f98f8000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f98f015e020 0x7f98f00b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:27.800 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.801+0000 7f98f8000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f00b4820 con 0x7f98f015dc40 2024-05-26T15:39:27.800 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.801+0000 7f98f8000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f00b0ab0 con 0x7f98f015e7d0 2024-05-26T15:39:27.800 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.801+0000 7f98f8000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f00b0cc0 con 0x7f98f015e020 2024-05-26T15:39:27.800 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.802+0000 7f98f5600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f98f015dc40 0x7f98f00d0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35180/0 (socket says 172.21.15.8:35180) 2024-05-26T15:39:27.800 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.802+0000 7f98f5600640 1 -- 172.21.15.8:0/229036036 learned_addr learned my addr 172.21.15.8:0/229036036 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:27.800 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.802+0000 7f98f4c00640 1 --2- 172.21.15.8:0/229036036 >> v2:172.21.15.8:3300/0 conn(0x7f98f015e7d0 0x7f98f00b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:27.801 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.802+0000 7f98f6000640 1 --2- 172.21.15.8:0/229036036 >> v2:172.21.15.47:3300/0 conn(0x7f98f015e020 0x7f98f00b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:27.801 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.802+0000 7f98f4c00640 1 -- 172.21.15.8:0/229036036 >> v2:172.21.15.47:3300/0 conn(0x7f98f015e020 msgr2=0x7f98f00b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:27.801 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.802+0000 7f98f4c00640 1 --2- 172.21.15.8:0/229036036 >> v2:172.21.15.47:3300/0 conn(0x7f98f015e020 0x7f98f00b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:27.801 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.802+0000 7f98f4c00640 1 -- 172.21.15.8:0/229036036 >> v1:172.21.15.8:6789/0 conn(0x7f98f015dc40 legacy=0x7f98f00d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:27.801 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.802+0000 7f98f4c00640 1 -- 172.21.15.8:0/229036036 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f00b0fa0 con 0x7f98f015e7d0 2024-05-26T15:39:27.801 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.802+0000 7f98efe00640 1 -- 172.21.15.8:0/229036036 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693552440 0 0) 0x7f98f00b4820 con 0x7f98f015dc40 2024-05-26T15:39:27.802 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.802+0000 7f98f6000640 1 --2- 172.21.15.8:0/229036036 >> v2:172.21.15.47:3300/0 conn(0x7f98f015e020 0x7f98f00b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.803+0000 7f98f4c00640 1 --2- 172.21.15.8:0/229036036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e7d0 0x7f98f00b4c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98f0071030 tx=0x7f98e002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c992afb2553159 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.804+0000 7f98efe00640 1 -- 172.21.15.8:0/229036036 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e002aea0 con 0x7f98f015e7d0 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.804+0000 7f98efe00640 1 -- 172.21.15.8:0/229036036 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e002d050 con 0x7f98f015e7d0 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.804+0000 7f98efe00640 1 -- 172.21.15.8:0/229036036 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0007960 con 0x7f98f015e7d0 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.804+0000 7f98f8000640 1 -- 172.21.15.8:0/229036036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e7d0 msgr2=0x7f98f00b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.804+0000 7f98f8000640 1 --2- 172.21.15.8:0/229036036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e7d0 0x7f98f00b4c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f98f0071030 tx=0x7f98e002a680 comp rx=0 tx=0).stop 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.804+0000 7f98f8000640 1 -- 172.21.15.8:0/229036036 shutdown_connections 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.804+0000 7f98f8000640 1 --2- 172.21.15.8:0/229036036 >> v2:172.21.15.47:3300/0 conn(0x7f98f015e020 0x7f98f00b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.804+0000 7f98f8000640 1 --2- 172.21.15.8:0/229036036 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e7d0 0x7f98f00b4c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.804+0000 7f98f8000640 1 -- 172.21.15.8:0/229036036 >> 172.21.15.8:0/229036036 conn(0x7f98f0098a50 msgr2=0x7f98f0098e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:27.803 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.805+0000 7f98f8000640 1 -- 172.21.15.8:0/229036036 shutdown_connections 2024-05-26T15:39:27.804 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.805+0000 7f98f8000640 1 -- 172.21.15.8:0/229036036 wait complete. 2024-05-26T15:39:27.805 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.807+0000 7f98f8000640 1 Processor -- start 2024-05-26T15:39:27.805 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.807+0000 7f98f8000640 1 -- start start 2024-05-26T15:39:27.807 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.808+0000 7f98f8000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f015dc40 0x7f98f013d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:27.807 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.808+0000 7f98f8000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e020 0x7f98f009bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:27.808 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.808+0000 7f98f8000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f98f015e7d0 0x7f98f00c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:27.808 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.808+0000 7f98f8000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f009adc0 con 0x7f98f015e020 2024-05-26T15:39:27.808 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.808+0000 7f98f8000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f009a1b0 con 0x7f98f015dc40 2024-05-26T15:39:27.808 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.808+0000 7f98f8000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f009a490 con 0x7f98f015e7d0 2024-05-26T15:39:27.808 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f4c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e020 0x7f98f009bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:27.808 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f4c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e020 0x7f98f009bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56304/0 (socket says 172.21.15.8:56304) 2024-05-26T15:39:27.808 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f4c00640 1 -- 172.21.15.8:0/2046947141 learned_addr learned my addr 172.21.15.8:0/2046947141 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:27.810 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f5600640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f015dc40 0x7f98f013d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:27.810 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f6000640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f98f015e7d0 0x7f98f00c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:27.811 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f4c00640 1 -- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f98f015e7d0 msgr2=0x7f98f00c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:27.811 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f4c00640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f98f015e7d0 0x7f98f00c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:27.811 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f4c00640 1 -- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f015dc40 msgr2=0x7f98f013d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:27.811 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f4c00640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f015dc40 0x7f98f013d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:27.811 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f4c00640 1 -- 172.21.15.8:0/2046947141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0009a70 con 0x7f98f015e020 2024-05-26T15:39:27.811 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.809+0000 7f98f6000640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f98f015e7d0 0x7f98f00c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:27.811 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.810+0000 7f98f4c00640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e020 0x7f98f009bad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009e80 tx=0x7f98e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:27.811 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.810+0000 7f98ed600640 1 -- 172.21.15.8:0/2046947141 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0031c40 con 0x7f98f015e020 2024-05-26T15:39:27.811 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.810+0000 7f98ed600640 1 -- 172.21.15.8:0/2046947141 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0031da0 con 0x7f98f015e020 2024-05-26T15:39:27.812 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.810+0000 7f98ed600640 1 -- 172.21.15.8:0/2046947141 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0003bb0 con 0x7f98f015e020 2024-05-26T15:39:27.812 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.810+0000 7f98f8000640 1 -- 172.21.15.8:0/2046947141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f009a770 con 0x7f98f015e020 2024-05-26T15:39:27.812 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.810+0000 7f98f8000640 1 -- 172.21.15.8:0/2046947141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f009c010 con 0x7f98f015e020 2024-05-26T15:39:27.812 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.811+0000 7f98f8000640 1 -- 172.21.15.8:0/2046947141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f00681d0 con 0x7f98f015e020 2024-05-26T15:39:27.813 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.813+0000 7f98ed600640 1 -- 172.21.15.8:0/2046947141 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f98e003b410 con 0x7f98f015e020 2024-05-26T15:39:27.813 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.814+0000 7f98ed600640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f98d406ac00 0x7f98d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:27.813 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.814+0000 7f98ed600640 1 -- 172.21.15.8:0/2046947141 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98e00a9e50 con 0x7f98f015e020 2024-05-26T15:39:27.813 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.814+0000 7f98f5600640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f98d406ac00 0x7f98d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:27.814 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.816+0000 7f98f5600640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f98d406ac00 0x7f98d406d0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98e4000f60 tx=0x7f98e4007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:27.820 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:27.821+0000 7f98ed600640 1 -- 172.21.15.8:0/2046947141 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f98e0075370 con 0x7f98f015e020 2024-05-26T15:39:27.899 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:39:27.908 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:39:28.028 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.030+0000 7f98f8000640 1 -- 172.21.15.8:0/2046947141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98f00cfa40 con 0x7f98f015e020 2024-05-26T15:39:28.031 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.032+0000 7f98ed600640 1 -- 172.21.15.8:0/2046947141 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12286 (secure 0 0 0) 0x7f98e0009450 con 0x7f98f015e020 2024-05-26T15:39:28.031 INFO:teuthology.misc.health.smithi008.stdout: 2024-05-26T15:39:28.031 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":16,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:24.251297+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 -- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f98d406ac00 msgr2=0x7f98d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f98d406ac00 0x7f98d406d0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98e4000f60 tx=0x7f98e4007b50 comp rx=0 tx=0).stop 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 -- 172.21.15.8:0/2046947141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e020 msgr2=0x7f98f009bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e020 0x7f98f009bad0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f98e0009e80 tx=0x7f98e0004a40 comp rx=0 tx=0).stop 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 -- 172.21.15.8:0/2046947141 shutdown_connections 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f98f015e7d0 0x7f98f00c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f98f015e020 0x7f98f009bad0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f98d406ac00 0x7f98d406d0c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 --2- 172.21.15.8:0/2046947141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98f015dc40 0x7f98f013d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 -- 172.21.15.8:0/2046947141 >> 172.21.15.8:0/2046947141 conn(0x7f98f0098a50 msgr2=0x7f98f006e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 -- 172.21.15.8:0/2046947141 shutdown_connections 2024-05-26T15:39:28.034 INFO:teuthology.misc.health.smithi008.stderr:2024-05-26T15:39:28.035+0000 7f98f8000640 1 -- 172.21.15.8:0/2046947141 wait complete. 2024-05-26T15:39:28.048 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-26T15:39:28.048 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-26T15:39:28.048 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-26T15:39:28.049 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-26T15:39:28.095 INFO:tasks.ceph.mds.a:Started 2024-05-26T15:39:28.096 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-26T15:39:28.096 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-26T15:39:28.103 INFO:tasks.ceph.mds.c:Started 2024-05-26T15:39:28.103 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-26T15:39:28.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-26T15:39:28.111 INFO:tasks.ceph.mds.b:Started 2024-05-26T15:39:28.111 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-26T15:39:28.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-26T15:39:28.118 INFO:tasks.ceph.mds.d:Started 2024-05-26T15:39:28.118 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-26T15:39:28.119 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:28.251 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2024-05-26T15:39:28.252 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2024-05-26T15:39:28.272 INFO:tasks.ceph.mds.b.smithi047.stdout:starting mds.b at 2024-05-26T15:39:28.272 INFO:tasks.ceph.mds.d.smithi047.stdout:starting mds.d at 2024-05-26T15:39:28.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.304+0000 7f48fb600640 1 Processor -- start 2024-05-26T15:39:28.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.304+0000 7f48fb600640 1 -- start start 2024-05-26T15:39:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48fb600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f415cb80 0x7f48f40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48fb600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f48f4161030 0x7f48f40cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48fb600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f41617e0 con 0x7f48f415cf60 2024-05-26T15:39:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48fb600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f40cce00 con 0x7f48f4161030 2024-05-26T15:39:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48fb600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4161500 con 0x7f48f415cb80 2024-05-26T15:39:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48ebe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f48f415cf60 0x7f48f4160920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35204/0 (socket says 172.21.15.8:35204) 2024-05-26T15:39:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48ebe00640 1 -- 172.21.15.8:0/3808419160 learned_addr learned my addr 172.21.15.8:0/3808419160 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48f8c00640 1 --2- 172.21.15.8:0/3808419160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f415cb80 0x7f48f40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48f9600640 1 --2- 172.21.15.8:0/3808419160 >> v2:172.21.15.47:3300/0 conn(0x7f48f4161030 0x7f48f40cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48f3e00640 1 -- 172.21.15.8:0/3808419160 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477594540 0 0) 0x7f48f41617e0 con 0x7f48f415cf60 2024-05-26T15:39:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.306+0000 7f48f3e00640 1 -- 172.21.15.8:0/3808419160 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d8003520 con 0x7f48f415cf60 2024-05-26T15:39:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.307+0000 7f48f8c00640 1 -- 172.21.15.8:0/3808419160 >> v2:172.21.15.47:3300/0 conn(0x7f48f4161030 msgr2=0x7f48f40cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.307+0000 7f48f8c00640 1 --2- 172.21.15.8:0/3808419160 >> v2:172.21.15.47:3300/0 conn(0x7f48f4161030 0x7f48f40cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.307+0000 7f48f8c00640 1 -- 172.21.15.8:0/3808419160 >> v1:172.21.15.8:6789/0 conn(0x7f48f415cf60 legacy=0x7f48f4160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.307+0000 7f48f8c00640 1 -- 172.21.15.8:0/3808419160 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40cd470 con 0x7f48f415cb80 2024-05-26T15:39:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.308+0000 7f48f8c00640 1 --2- 172.21.15.8:0/3808419160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f415cb80 0x7f48f40cdf50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48e40097a0 tx=0x7f48e402a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698b6a4cd9b3941e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:28.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.308+0000 7f48f3e00640 1 -- 172.21.15.8:0/3808419160 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e402ae40 con 0x7f48f415cb80 2024-05-26T15:39:28.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.308+0000 7f48f3e00640 1 -- 172.21.15.8:0/3808419160 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e4032440 con 0x7f48f415cb80 2024-05-26T15:39:28.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.308+0000 7f48f3e00640 1 -- 172.21.15.8:0/3808419160 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e40327d0 con 0x7f48f415cb80 2024-05-26T15:39:28.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.309+0000 7f48fb600640 1 -- 172.21.15.8:0/3808419160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f415cb80 msgr2=0x7f48f40cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.309+0000 7f48fb600640 1 --2- 172.21.15.8:0/3808419160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f415cb80 0x7f48f40cdf50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48e40097a0 tx=0x7f48e402a0f0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.309+0000 7f48fb600640 1 -- 172.21.15.8:0/3808419160 shutdown_connections 2024-05-26T15:39:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.309+0000 7f48fb600640 1 --2- 172.21.15.8:0/3808419160 >> v2:172.21.15.47:3300/0 conn(0x7f48f4161030 0x7f48f40cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.309+0000 7f48fb600640 1 --2- 172.21.15.8:0/3808419160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f415cb80 0x7f48f40cdf50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.309+0000 7f48fb600640 1 -- 172.21.15.8:0/3808419160 >> 172.21.15.8:0/3808419160 conn(0x7f48f40b0570 msgr2=0x7f48f40b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.309+0000 7f48fb600640 1 -- 172.21.15.8:0/3808419160 shutdown_connections 2024-05-26T15:39:28.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.309+0000 7f48fb600640 1 -- 172.21.15.8:0/3808419160 wait complete. 2024-05-26T15:39:28.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.311+0000 7f48fb600640 1 Processor -- start 2024-05-26T15:39:28.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.311+0000 7f48fb600640 1 -- start start 2024-05-26T15:39:28.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.312+0000 7f48fb600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48f415cb80 0x7f48f4154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.312+0000 7f48fb600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f415cf60 0x7f48f4155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.312+0000 7f48fb600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f4161030 0x7f48f415e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.312+0000 7f48fb600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f415bce0 con 0x7f48f415cb80 2024-05-26T15:39:28.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.312+0000 7f48fb600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4155910 con 0x7f48f415cf60 2024-05-26T15:39:28.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.312+0000 7f48fb600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f4158a80 con 0x7f48f4161030 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.312+0000 7f48f8c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48f415cb80 0x7f48f4154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.312+0000 7f48f8c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48f415cb80 0x7f48f4154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56346/0 (socket says 172.21.15.8:56346) 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.312+0000 7f48f8c00640 1 -- 172.21.15.8:0/2531285870 learned_addr learned my addr 172.21.15.8:0/2531285870 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48f9600640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f4161030 0x7f48f415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48ebe00640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f415cf60 0x7f48f4155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48f8c00640 1 -- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f4161030 msgr2=0x7f48f415e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48f8c00640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f4161030 0x7f48f415e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48f8c00640 1 -- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f415cf60 msgr2=0x7f48f4155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48f8c00640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f415cf60 0x7f48f4155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48f8c00640 1 -- 172.21.15.8:0/2531285870 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4009400 con 0x7f48f415cb80 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48ebe00640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f415cf60 0x7f48f4155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48f8c00640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48f415cb80 0x7f48f4154200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f48e4035040 tx=0x7f48e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48f1600640 1 -- 172.21.15.8:0/2531285870 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e403d8f0 con 0x7f48f415cb80 2024-05-26T15:39:28.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48f1600640 1 -- 172.21.15.8:0/2531285870 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e403da70 con 0x7f48f415cb80 2024-05-26T15:39:28.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48f1600640 1 -- 172.21.15.8:0/2531285870 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e403de20 con 0x7f48f415cb80 2024-05-26T15:39:28.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.313+0000 7f48fb600640 1 -- 172.21.15.8:0/2531285870 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f4159240 con 0x7f48f415cb80 2024-05-26T15:39:28.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.314+0000 7f48fb600640 1 -- 172.21.15.8:0/2531285870 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f4159800 con 0x7f48f415cb80 2024-05-26T15:39:28.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.315+0000 7f48fb600640 1 -- 172.21.15.8:0/2531285870 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f4155a50 con 0x7f48f415cb80 2024-05-26T15:39:28.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.316+0000 7f48f1600640 1 -- 172.21.15.8:0/2531285870 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f48e4039040 con 0x7f48f415cb80 2024-05-26T15:39:28.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.316+0000 7f48f1600640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f48d006ac00 0x7f48d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.317+0000 7f48f1600640 1 -- 172.21.15.8:0/2531285870 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f48e40a9450 con 0x7f48f415cb80 2024-05-26T15:39:28.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.317+0000 7f48ebe00640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f48d006ac00 0x7f48d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.318+0000 7f48ebe00640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f48d006ac00 0x7f48d006d0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48f4160030 tx=0x7f48dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:28.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.321+0000 7f48f1600640 1 -- 172.21.15.8:0/2531285870 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f48e4074970 con 0x7f48f415cb80 2024-05-26T15:39:28.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.518+0000 7f48fb600640 1 -- 172.21.15.8:0/2531285870 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48f40681d0 con 0x7f48f415cb80 2024-05-26T15:39:28.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.521+0000 7f48f1600640 1 -- 172.21.15.8:0/2531285870 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12286 (secure 0 0 0) 0x7f48e4077f90 con 0x7f48f415cb80 2024-05-26T15:39:28.519 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:28.519 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:24.251297+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.523+0000 7f48fb600640 1 -- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f48d006ac00 msgr2=0x7f48d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.523+0000 7f48fb600640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f48d006ac00 0x7f48d006d0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48f4160030 tx=0x7f48dc009040 comp rx=0 tx=0).stop 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.524+0000 7f48fb600640 1 -- 172.21.15.8:0/2531285870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48f415cb80 msgr2=0x7f48f4154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.524+0000 7f48fb600640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48f415cb80 0x7f48f4154200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f48e4035040 tx=0x7f48e40046c0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.524+0000 7f48fb600640 1 -- 172.21.15.8:0/2531285870 shutdown_connections 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.524+0000 7f48fb600640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f48f4161030 0x7f48f415e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.524+0000 7f48fb600640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f48d006ac00 0x7f48d006d0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.524+0000 7f48fb600640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f48f415cf60 0x7f48f4155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.524+0000 7f48fb600640 1 --2- 172.21.15.8:0/2531285870 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48f415cb80 0x7f48f4154200 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.524+0000 7f48fb600640 1 -- 172.21.15.8:0/2531285870 >> 172.21.15.8:0/2531285870 conn(0x7f48f40b0570 msgr2=0x7f48f40b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.524+0000 7f48fb600640 1 -- 172.21.15.8:0/2531285870 shutdown_connections 2024-05-26T15:39:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.524+0000 7f48fb600640 1 -- 172.21.15.8:0/2531285870 wait complete. 2024-05-26T15:39:28.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-26T15:39:28.541 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:39:28.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.758+0000 7f4d52600640 1 Processor -- start 2024-05-26T15:39:28.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.759+0000 7f4d52600640 1 -- start start 2024-05-26T15:39:28.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.760+0000 7f4d52600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c0d26a0 0x7f4d4c0b8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.760+0000 7f4d52600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4d4c0b4540 0x7f4d4c0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.760+0000 7f4d52600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c0b4ed0 con 0x7f4d4c15cdb0 2024-05-26T15:39:28.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.760+0000 7f4d52600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0b6c00 con 0x7f4d4c0b4540 2024-05-26T15:39:28.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.760+0000 7f4d52600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0d1600 con 0x7f4d4c0d26a0 2024-05-26T15:39:28.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.760+0000 7f4d4b400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4d4c15cdb0 0x7f4d4c0d0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35214/0 (socket says 172.21.15.8:35214) 2024-05-26T15:39:28.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.760+0000 7f4d4b400640 1 -- 172.21.15.8:0/3299627448 learned_addr learned my addr 172.21.15.8:0/3299627448 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:28.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4aa00640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c0d26a0 0x7f4d4c0b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4be00640 1 --2- 172.21.15.8:0/3299627448 >> v2:172.21.15.47:3300/0 conn(0x7f4d4c0b4540 0x7f4d4c0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874562467 0 0) 0x7f4d3c001490 con 0x7f4d4c15cdb0 2024-05-26T15:39:28.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d30003520 con 0x7f4d4c15cdb0 2024-05-26T15:39:28.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352939813 0 0) 0x7f4d30003520 con 0x7f4d4c15cdb0 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c0d26a0 msgr2=0x7f4d4c0b8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c0d26a0 0x7f4d4c0b8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 >> v2:172.21.15.47:3300/0 conn(0x7f4d4c0b4540 msgr2=0x7f4d4c0b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 --2- 172.21.15.8:0/3299627448 >> v2:172.21.15.47:3300/0 conn(0x7f4d4c0b4540 0x7f4d4c0b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0d18e0 con 0x7f4d4c15cdb0 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f4d3c001b80 con 0x7f4d4c15cdb0 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 >> v1:172.21.15.8:6789/0 conn(0x7f4d4c15cdb0 legacy=0x7f4d4c0d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.761+0000 7f4d4a000640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d300039e0 0x7f4d30003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4a000640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c0d26a0 0x7f4d300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4a000640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 0x7f4d30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0b6c00 con 0x7f4d30004d00 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0d1600 con 0x7f4d300039e0 2024-05-26T15:39:28.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3000b9d0 con 0x7f4d4c0d26a0 2024-05-26T15:39:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4be00640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 0x7f4d30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4b400640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d300039e0 0x7f4d30003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4aa00640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c0d26a0 0x7f4d300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4be00640 1 -- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c0d26a0 msgr2=0x7f4d300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4be00640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c0d26a0 0x7f4d300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4be00640 1 -- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d300039e0 msgr2=0x7f4d30003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4be00640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d300039e0 0x7f4d30003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.762+0000 7f4d4be00640 1 -- 172.21.15.8:0/3299627448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30003520 con 0x7f4d30004d00 2024-05-26T15:39:28.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.763+0000 7f4d4be00640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 0x7f4d30005180 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009ac0 tx=0x7f4d300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140c9d5bc02be6d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:28.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.764+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44031400 con 0x7f4d30004d00 2024-05-26T15:39:28.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.764+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4402d050 con 0x7f4d30004d00 2024-05-26T15:39:28.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.764+0000 7f4d4a000640 1 -- 172.21.15.8:0/3299627448 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44031780 con 0x7f4d30004d00 2024-05-26T15:39:28.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.764+0000 7f4d52600640 1 -- 172.21.15.8:0/3299627448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 msgr2=0x7f4d30005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.764+0000 7f4d52600640 1 --2- 172.21.15.8:0/3299627448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 0x7f4d30005180 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009ac0 tx=0x7f4d300057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.764+0000 7f4d4be00640 1 -- 172.21.15.8:0/3299627448 reap_dead start 2024-05-26T15:39:28.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.765+0000 7f4d52600640 1 -- 172.21.15.8:0/3299627448 shutdown_connections 2024-05-26T15:39:28.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.765+0000 7f4d52600640 1 -- 172.21.15.8:0/3299627448 >> 172.21.15.8:0/3299627448 conn(0x7f4d4c071bd0 msgr2=0x7f4d4c0cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:28.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.765+0000 7f4d52600640 1 -- 172.21.15.8:0/3299627448 shutdown_connections 2024-05-26T15:39:28.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.765+0000 7f4d52600640 1 -- 172.21.15.8:0/3299627448 wait complete. 2024-05-26T15:39:28.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.766+0000 7f4d52600640 1 Processor -- start 2024-05-26T15:39:28.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.767+0000 7f4d52600640 1 -- start start 2024-05-26T15:39:28.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.767+0000 7f4d52600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 0x7f4d4c1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d52600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d4c0cc4f0 0x7f4d4c0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d52600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c1f1b40 0x7f4d4c1f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d52600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c155d80 con 0x7f4d30004d00 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d52600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c1f2510 con 0x7f4d4c0cc4f0 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d52600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c155100 con 0x7f4d4c1f1b40 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 0x7f4d4c1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 0x7f4d4c1548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56366/0 (socket says 172.21.15.8:56366) 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4b400640 1 -- 172.21.15.8:0/3506097071 learned_addr learned my addr 172.21.15.8:0/3506097071 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4be00640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c1f1b40 0x7f4d4c1f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4aa00640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d4c0cc4f0 0x7f4d4c0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4b400640 1 -- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c1f1b40 msgr2=0x7f4d4c1f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4b400640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c1f1b40 0x7f4d4c1f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4b400640 1 -- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d4c0cc4f0 msgr2=0x7f4d4c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4b400640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d4c0cc4f0 0x7f4d4c0c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4b400640 1 -- 172.21.15.8:0/3506097071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c1553e0 con 0x7f4d30004d00 2024-05-26T15:39:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.768+0000 7f4d4be00640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c1f1b40 0x7f4d4c1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:28.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.769+0000 7f4d4b400640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 0x7f4d4c1548b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c007b00 tx=0x7f4d3c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:28.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.769+0000 7f4d43400640 1 -- 172.21.15.8:0/3506097071 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00ee50 con 0x7f4d30004d00 2024-05-26T15:39:28.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.769+0000 7f4d43400640 1 -- 172.21.15.8:0/3506097071 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c013420 con 0x7f4d30004d00 2024-05-26T15:39:28.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.769+0000 7f4d43400640 1 -- 172.21.15.8:0/3506097071 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0137d0 con 0x7f4d30004d00 2024-05-26T15:39:28.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.769+0000 7f4d52600640 1 -- 172.21.15.8:0/3506097071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c1556c0 con 0x7f4d30004d00 2024-05-26T15:39:28.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.769+0000 7f4d52600640 1 -- 172.21.15.8:0/3506097071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c154df0 con 0x7f4d30004d00 2024-05-26T15:39:28.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.770+0000 7f4d52600640 1 -- 172.21.15.8:0/3506097071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c04e210 con 0x7f4d30004d00 2024-05-26T15:39:28.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.771+0000 7f4d43400640 1 -- 172.21.15.8:0/3506097071 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d3c013930 con 0x7f4d30004d00 2024-05-26T15:39:28.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.772+0000 7f4d43400640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4d2806ac30 0x7f4d2806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:28.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.772+0000 7f4d43400640 1 -- 172.21.15.8:0/3506097071 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4d3c089670 con 0x7f4d30004d00 2024-05-26T15:39:28.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.773+0000 7f4d4aa00640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4d2806ac30 0x7f4d2806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:28.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.774+0000 7f4d4aa00640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4d2806ac30 0x7f4d2806d0f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0c61f0 tx=0x7f4d34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:28.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.777+0000 7f4d43400640 1 -- 172.21.15.8:0/3506097071 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4d3c054b90 con 0x7f4d30004d00 2024-05-26T15:39:28.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.977+0000 7f4d52600640 1 -- 172.21.15.8:0/3506097071 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d4c0b4ed0 con 0x7f4d30004d00 2024-05-26T15:39:28.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.978+0000 7f4d43400640 1 -- 172.21.15.8:0/3506097071 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d4c0b4ed0 con 0x7f4d30004d00 2024-05-26T15:39:28.977 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:39:28.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.981+0000 7f4d52600640 1 -- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4d2806ac30 msgr2=0x7f4d2806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.981+0000 7f4d52600640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4d2806ac30 0x7f4d2806d0f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0c61f0 tx=0x7f4d34008040 comp rx=0 tx=0).stop 2024-05-26T15:39:28.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.981+0000 7f4d52600640 1 -- 172.21.15.8:0/3506097071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 msgr2=0x7f4d4c1548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:28.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.981+0000 7f4d52600640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 0x7f4d4c1548b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c007b00 tx=0x7f4d3c00e530 comp rx=0 tx=0).stop 2024-05-26T15:39:28.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.981+0000 7f4d52600640 1 -- 172.21.15.8:0/3506097071 shutdown_connections 2024-05-26T15:39:28.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.981+0000 7f4d52600640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4d4c1f1b40 0x7f4d4c1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.981+0000 7f4d52600640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4d2806ac30 0x7f4d2806d0f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.981+0000 7f4d52600640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4d4c0cc4f0 0x7f4d4c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.981+0000 7f4d52600640 1 --2- 172.21.15.8:0/3506097071 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4d30004d00 0x7f4d4c1548b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:28.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.981+0000 7f4d52600640 1 -- 172.21.15.8:0/3506097071 >> 172.21.15.8:0/3506097071 conn(0x7f4d4c071bd0 msgr2=0x7f4d4c0d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:28.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.982+0000 7f4d52600640 1 -- 172.21.15.8:0/3506097071 shutdown_connections 2024-05-26T15:39:28.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:28.982+0000 7f4d52600640 1 -- 172.21.15.8:0/3506097071 wait complete. 2024-05-26T15:39:28.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:39:29.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.208+0000 7f42c9a00640 1 Processor -- start 2024-05-26T15:39:29.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.209+0000 7f42c9a00640 1 -- start start 2024-05-26T15:39:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.210+0000 7f42c9a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40d00a0 0x7f42c40b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.210+0000 7f42c9a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c40b7eb0 con 0x7f42c40b8720 2024-05-26T15:39:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.210+0000 7f42c9a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c41604b0 con 0x7f42c41600d0 2024-05-26T15:39:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.210+0000 7f42c9a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40d0ef0 con 0x7f42c40d00a0 2024-05-26T15:39:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.211+0000 7f42c9000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f42c40b8720 0x7f42c40b6060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35216/0 (socket says 172.21.15.8:35216) 2024-05-26T15:39:29.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.211+0000 7f42c9000640 1 -- 172.21.15.8:0/3227864895 learned_addr learned my addr 172.21.15.8:0/3227864895 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.211+0000 7f42bb400640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40d00a0 0x7f42c40b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.211+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248318326 0 0) 0x7f42c40b7eb0 con 0x7f42c40b8720 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.211+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42a8003520 con 0x7f42c40b8720 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.211+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676143975 0 0) 0x7f42c41604b0 con 0x7f42c41600d0 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.211+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c40b7eb0 con 0x7f42c41600d0 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1084708950 0 0) 0x7f42a8003520 con 0x7f42c40b8720 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40d00a0 msgr2=0x7f42c40b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40d00a0 0x7f42c40b5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 >> v1:172.21.15.47:6789/0 conn(0x7f42c41600d0 legacy=0x7f42c40cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40b7610 con 0x7f42c40b8720 2024-05-26T15:39:29.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f42bc0019f0 con 0x7f42c40b8720 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 >> v1:172.21.15.8:6789/0 conn(0x7f42c40b8720 legacy=0x7f42c40b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a8003b30 0x7f42a8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a80047c0 0x7f42a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40d00a0 0x7f42a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40d0ef0 con 0x7f42a8003b30 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a800bab0 con 0x7f42a80047c0 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a800bc70 con 0x7f42c40d00a0 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3e00640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a8003b30 0x7f42a8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42bb400640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a80047c0 0x7f42a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3e00640 1 -- 172.21.15.8:0/3227864895 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40d00a0 msgr2=0x7f42a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3e00640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40d00a0 0x7f42a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3e00640 1 -- 172.21.15.8:0/3227864895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a80047c0 msgr2=0x7f42a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3e00640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a80047c0 0x7f42a8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.212+0000 7f42c3e00640 1 -- 172.21.15.8:0/3227864895 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a8003520 con 0x7f42a8003b30 2024-05-26T15:39:29.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.213+0000 7f42c3e00640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a8003b30 0x7f42a8003f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42b40018d0 tx=0x7f42a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e963e2c1957ad4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:29.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.214+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b40052d0 con 0x7f42a8003b30 2024-05-26T15:39:29.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.214+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b4005430 con 0x7f42a8003b30 2024-05-26T15:39:29.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.214+0000 7f42c3400640 1 -- 172.21.15.8:0/3227864895 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b402aca0 con 0x7f42a8003b30 2024-05-26T15:39:29.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.214+0000 7f42c9a00640 1 -- 172.21.15.8:0/3227864895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a8003b30 msgr2=0x7f42a8003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.214+0000 7f42c9a00640 1 --2- 172.21.15.8:0/3227864895 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42a8003b30 0x7f42a8003f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42b40018d0 tx=0x7f42a80057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.214+0000 7f42c9000640 1 -- 172.21.15.8:0/3227864895 reap_dead start 2024-05-26T15:39:29.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.214+0000 7f42c9a00640 1 -- 172.21.15.8:0/3227864895 shutdown_connections 2024-05-26T15:39:29.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.214+0000 7f42c9a00640 1 -- 172.21.15.8:0/3227864895 >> 172.21.15.8:0/3227864895 conn(0x7f42c406b750 msgr2=0x7f42c406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:29.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.214+0000 7f42c9a00640 1 -- 172.21.15.8:0/3227864895 shutdown_connections 2024-05-26T15:39:29.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.215+0000 7f42c9a00640 1 -- 172.21.15.8:0/3227864895 wait complete. 2024-05-26T15:39:29.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.216+0000 7f42c9a00640 1 Processor -- start 2024-05-26T15:39:29.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.216+0000 7f42c9a00640 1 -- start start 2024-05-26T15:39:29.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.217+0000 7f42c9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a8003b30 0x7f42c41f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.217+0000 7f42c9a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42c4152bf0 0x7f42c40cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.217+0000 7f42c9a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40cd960 0x7f42c415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.217+0000 7f42c9a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41f3470 con 0x7f42c4152bf0 2024-05-26T15:39:29.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.217+0000 7f42c9a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40cdde0 con 0x7f42a8003b30 2024-05-26T15:39:29.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.217+0000 7f42c9a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4159c90 con 0x7f42c40cd960 2024-05-26T15:39:29.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.217+0000 7f42bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42c4152bf0 0x7f42c40cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42c4152bf0 0x7f42c40cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56388/0 (socket says 172.21.15.8:56388) 2024-05-26T15:39:29.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42bb400640 1 -- 172.21.15.8:0/3697314294 learned_addr learned my addr 172.21.15.8:0/3697314294 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:29.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42c3e00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a8003b30 0x7f42c41f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42bb400640 1 -- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40cd960 msgr2=0x7f42c415b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42bb400640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40cd960 0x7f42c415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42bb400640 1 -- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a8003b30 msgr2=0x7f42c41f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42bb400640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a8003b30 0x7f42c41f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42bb400640 1 -- 172.21.15.8:0/3697314294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c415c390 con 0x7f42c4152bf0 2024-05-26T15:39:29.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42c3e00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a8003b30 0x7f42c41f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:29.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42bb400640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42c4152bf0 0x7f42c40cd420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f42ac010890 tx=0x7f42ac010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:29.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.218+0000 7f42c0c00640 1 -- 172.21.15.8:0/3697314294 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0095b0 con 0x7f42c4152bf0 2024-05-26T15:39:29.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.219+0000 7f42c0c00640 1 -- 172.21.15.8:0/3697314294 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac00eb80 con 0x7f42c4152bf0 2024-05-26T15:39:29.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.219+0000 7f42c9a00640 1 -- 172.21.15.8:0/3697314294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c4159360 con 0x7f42c4152bf0 2024-05-26T15:39:29.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.219+0000 7f42c0c00640 1 -- 172.21.15.8:0/3697314294 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac01c400 con 0x7f42c4152bf0 2024-05-26T15:39:29.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.219+0000 7f42c9a00640 1 -- 172.21.15.8:0/3697314294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c4159920 con 0x7f42c4152bf0 2024-05-26T15:39:29.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.220+0000 7f42c9a00640 1 -- 172.21.15.8:0/3697314294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4159ab0 con 0x7f42c4152bf0 2024-05-26T15:39:29.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.221+0000 7f42c0c00640 1 -- 172.21.15.8:0/3697314294 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f42ac0143f0 con 0x7f42c4152bf0 2024-05-26T15:39:29.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.222+0000 7f42c0c00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42a006ac00 0x7f42a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.222+0000 7f42c0c00640 1 -- 172.21.15.8:0/3697314294 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f42ac0891d0 con 0x7f42c4152bf0 2024-05-26T15:39:29.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.223+0000 7f42c3e00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42a006ac00 0x7f42a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.224+0000 7f42c3e00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42a006ac00 0x7f42a006d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42b4032000 tx=0x7f42b4009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:29.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.227+0000 7f42c0c00640 1 -- 172.21.15.8:0/3697314294 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f42ac0546f0 con 0x7f42c4152bf0 2024-05-26T15:39:29.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.470+0000 7f42c9a00640 1 -- 172.21.15.8:0/3697314294 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42c4159dd0 con 0x7f42c4152bf0 2024-05-26T15:39:29.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.471+0000 7f42c0c00640 1 -- 172.21.15.8:0/3697314294 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3512 (secure 0 0 0) 0x7f42ac021dd0 con 0x7f42c4152bf0 2024-05-26T15:39:29.470 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:29.470 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-26T15:39:29.470 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2024-05-26T15:39:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 -- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42a006ac00 msgr2=0x7f42a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42a006ac00 0x7f42a006d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42b4032000 tx=0x7f42b4009030 comp rx=0 tx=0).stop 2024-05-26T15:39:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 -- 172.21.15.8:0/3697314294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42c4152bf0 msgr2=0x7f42c40cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42c4152bf0 0x7f42c40cd420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f42ac010890 tx=0x7f42ac010d50 comp rx=0 tx=0).stop 2024-05-26T15:39:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 -- 172.21.15.8:0/3697314294 shutdown_connections 2024-05-26T15:39:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42c40cd960 0x7f42c415b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42c4152bf0 0x7f42c40cd420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42a006ac00 0x7f42a006d0c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 --2- 172.21.15.8:0/3697314294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a8003b30 0x7f42c41f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 -- 172.21.15.8:0/3697314294 >> 172.21.15.8:0/3697314294 conn(0x7f42c406b750 msgr2=0x7f42c40ca130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.474+0000 7f42c9a00640 1 -- 172.21.15.8:0/3697314294 shutdown_connections 2024-05-26T15:39:29.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.475+0000 7f42c9a00640 1 -- 172.21.15.8:0/3697314294 wait complete. 2024-05-26T15:39:29.493 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:29.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.699+0000 7f5e6dc00640 1 Processor -- start 2024-05-26T15:39:29.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.699+0000 7f5e6dc00640 1 -- start start 2024-05-26T15:39:29.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.701+0000 7f5e6dc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5e680b0f60 0x7f5e6815eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.701+0000 7f5e6dc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6815b640 con 0x7f5e6815f0c0 2024-05-26T15:39:29.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.701+0000 7f5e6dc00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6815b920 con 0x7f5e68154f50 2024-05-26T15:39:29.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.701+0000 7f5e6dc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6815bee0 con 0x7f5e680b0f60 2024-05-26T15:39:29.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.701+0000 7f5e67400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5e680b0f60 0x7f5e6815eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.701+0000 7f5e6d200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5e6815f0c0 0x7f5e680c36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35230/0 (socket says 172.21.15.8:35230) 2024-05-26T15:39:29.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.701+0000 7f5e6d200640 1 -- 172.21.15.8:0/398813940 learned_addr learned my addr 172.21.15.8:0/398813940 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:29.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.701+0000 7f5e67400640 1 -- 172.21.15.8:0/398813940 >> v1:172.21.15.47:6789/0 conn(0x7f5e68154f50 legacy=0x7f5e6815ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:29.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.701+0000 7f5e67400640 1 -- 172.21.15.8:0/398813940 >> v1:172.21.15.8:6789/0 conn(0x7f5e6815f0c0 legacy=0x7f5e680c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.701+0000 7f5e67400640 1 -- 172.21.15.8:0/398813940 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6815bc00 con 0x7f5e680b0f60 2024-05-26T15:39:29.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.703+0000 7f5e67400640 1 --2- 172.21.15.8:0/398813940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e680b0f60 0x7f5e6815eb80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e540097a0 tx=0x7f5e5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7c42ebf02cedd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:29.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.703+0000 7f5e66a00640 1 -- 172.21.15.8:0/398813940 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54032440 con 0x7f5e680b0f60 2024-05-26T15:39:29.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.703+0000 7f5e66a00640 1 -- 172.21.15.8:0/398813940 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e540325a0 con 0x7f5e680b0f60 2024-05-26T15:39:29.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.703+0000 7f5e66a00640 1 -- 172.21.15.8:0/398813940 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e54032930 con 0x7f5e680b0f60 2024-05-26T15:39:29.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.704+0000 7f5e6dc00640 1 -- 172.21.15.8:0/398813940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e680b0f60 msgr2=0x7f5e6815eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.704+0000 7f5e6dc00640 1 --2- 172.21.15.8:0/398813940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e680b0f60 0x7f5e6815eb80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e540097a0 tx=0x7f5e5402a1e0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.704+0000 7f5e6dc00640 1 -- 172.21.15.8:0/398813940 shutdown_connections 2024-05-26T15:39:29.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.704+0000 7f5e6dc00640 1 --2- 172.21.15.8:0/398813940 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e680b0f60 0x7f5e6815eb80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.704+0000 7f5e6dc00640 1 -- 172.21.15.8:0/398813940 >> 172.21.15.8:0/398813940 conn(0x7f5e68070480 msgr2=0x7f5e68070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:29.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.704+0000 7f5e6dc00640 1 -- 172.21.15.8:0/398813940 shutdown_connections 2024-05-26T15:39:29.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.704+0000 7f5e6dc00640 1 -- 172.21.15.8:0/398813940 wait complete. 2024-05-26T15:39:29.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.706+0000 7f5e6dc00640 1 Processor -- start 2024-05-26T15:39:29.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.706+0000 7f5e6dc00640 1 -- start start 2024-05-26T15:39:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6dc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5e680b0f60 0x7f5e680b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e68154f50 0x7f5e680c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6dc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e6815f0c0 0x7f5e680c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6dc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e681e6a10 con 0x7f5e6815f0c0 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6dc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e681e5d90 con 0x7f5e68154f50 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6dc00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e681e6070 con 0x7f5e680b0f60 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e6815f0c0 0x7f5e680c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e6815f0c0 0x7f5e680c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56402/0 (socket says 172.21.15.8:56402) 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6d200640 1 -- 172.21.15.8:0/109728133 learned_addr learned my addr 172.21.15.8:0/109728133 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e67400640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e68154f50 0x7f5e680c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e67e00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5e680b0f60 0x7f5e680b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6d200640 1 -- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5e680b0f60 msgr2=0x7f5e680b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6d200640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5e680b0f60 0x7f5e680b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6d200640 1 -- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e68154f50 msgr2=0x7f5e680c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6d200640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e68154f50 0x7f5e680c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e6d200640 1 -- 172.21.15.8:0/109728133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009400 con 0x7f5e6815f0c0 2024-05-26T15:39:29.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.707+0000 7f5e67e00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5e680b0f60 0x7f5e680b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:29.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.708+0000 7f5e6d200640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e6815f0c0 0x7f5e680c9640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000ca80 tx=0x7f5e6000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:29.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.708+0000 7f5e5fe00640 1 -- 172.21.15.8:0/109728133 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000ac30 con 0x7f5e6815f0c0 2024-05-26T15:39:29.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.708+0000 7f5e5fe00640 1 -- 172.21.15.8:0/109728133 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000ad90 con 0x7f5e6815f0c0 2024-05-26T15:39:29.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.708+0000 7f5e5fe00640 1 -- 172.21.15.8:0/109728133 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60012600 con 0x7f5e6815f0c0 2024-05-26T15:39:29.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.708+0000 7f5e6dc00640 1 -- 172.21.15.8:0/109728133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e681e6350 con 0x7f5e6815f0c0 2024-05-26T15:39:29.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.708+0000 7f5e6dc00640 1 -- 172.21.15.8:0/109728133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e68138ae0 con 0x7f5e6815f0c0 2024-05-26T15:39:29.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.709+0000 7f5e6dc00640 1 -- 172.21.15.8:0/109728133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e681e6b50 con 0x7f5e6815f0c0 2024-05-26T15:39:29.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.710+0000 7f5e5fe00640 1 -- 172.21.15.8:0/109728133 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e60007070 con 0x7f5e6815f0c0 2024-05-26T15:39:29.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.711+0000 7f5e5fe00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e4806ac30 0x7f5e4806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:29.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.711+0000 7f5e5fe00640 1 -- 172.21.15.8:0/109728133 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5e60088e90 con 0x7f5e6815f0c0 2024-05-26T15:39:29.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.712+0000 7f5e67e00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e4806ac30 0x7f5e4806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:29.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.713+0000 7f5e67e00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e4806ac30 0x7f5e4806d0f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e58003eb0 tx=0x7f5e58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:29.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.716+0000 7f5e5fe00640 1 -- 172.21.15.8:0/109728133 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5e681e6b50 con 0x7f5e6815f0c0 2024-05-26T15:39:29.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.913+0000 7f5e6dc00640 1 -- 172.21.15.8:0/109728133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e681e6d30 con 0x7f5e6815f0c0 2024-05-26T15:39:29.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.915+0000 7f5e5fe00640 1 -- 172.21.15.8:0/109728133 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12286 (secure 0 0 0) 0x7f5e60017070 con 0x7f5e6815f0c0 2024-05-26T15:39:29.913 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:29.913 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:24.251297+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.917+0000 7f5e6dc00640 1 -- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e4806ac30 msgr2=0x7f5e4806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.917+0000 7f5e6dc00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e4806ac30 0x7f5e4806d0f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e58003eb0 tx=0x7f5e58009040 comp rx=0 tx=0).stop 2024-05-26T15:39:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.917+0000 7f5e6dc00640 1 -- 172.21.15.8:0/109728133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e6815f0c0 msgr2=0x7f5e680c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.917+0000 7f5e6dc00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e6815f0c0 0x7f5e680c9640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e6000ca80 tx=0x7f5e6000cf40 comp rx=0 tx=0).stop 2024-05-26T15:39:29.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.918+0000 7f5e6dc00640 1 -- 172.21.15.8:0/109728133 shutdown_connections 2024-05-26T15:39:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.918+0000 7f5e6dc00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e6815f0c0 0x7f5e680c9640 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.918+0000 7f5e6dc00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e4806ac30 0x7f5e4806d0f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.918+0000 7f5e6dc00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e68154f50 0x7f5e680c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.918+0000 7f5e6dc00640 1 --2- 172.21.15.8:0/109728133 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5e680b0f60 0x7f5e680b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.918+0000 7f5e6dc00640 1 -- 172.21.15.8:0/109728133 >> 172.21.15.8:0/109728133 conn(0x7f5e68070480 msgr2=0x7f5e680c9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.918+0000 7f5e6dc00640 1 -- 172.21.15.8:0/109728133 shutdown_connections 2024-05-26T15:39:29.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:29.918+0000 7f5e6dc00640 1 -- 172.21.15.8:0/109728133 wait complete. 2024-05-26T15:39:29.935 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-26T15:39:29.935 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:39:30.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.151+0000 7fb503200640 1 Processor -- start 2024-05-26T15:39:30.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.152+0000 7fb503200640 1 -- start start 2024-05-26T15:39:30.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.153+0000 7fb503200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb50415a9d0 0x7fb50406dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.153+0000 7fb503200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb5040cdd10 0x7fb5041643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.153+0000 7fb503200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5040cba60 con 0x7fb50406d970 2024-05-26T15:39:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.153+0000 7fb503200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb504071610 con 0x7fb50415a9d0 2024-05-26T15:39:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.153+0000 7fb503200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040cbd00 con 0x7fb5040cdd10 2024-05-26T15:39:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.154+0000 7fb4f9400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb50406d970 0x7fb5040cd600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:33308/0 (socket says 172.21.15.8:33308) 2024-05-26T15:39:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.154+0000 7fb4f9400640 1 -- 172.21.15.8:0/1959726524 learned_addr learned my addr 172.21.15.8:0/1959726524 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:30.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.154+0000 7fb502800640 1 --2- 172.21.15.8:0/1959726524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb5040cdd10 0x7fb5041643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.154+0000 7fb501e00640 1 --2- 172.21.15.8:0/1959726524 >> v2:172.21.15.47:3300/0 conn(0x7fb50415a9d0 0x7fb50406dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.155+0000 7fb502800640 1 -- 172.21.15.8:0/1959726524 >> v2:172.21.15.47:3300/0 conn(0x7fb50415a9d0 msgr2=0x7fb50406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.155+0000 7fb502800640 1 --2- 172.21.15.8:0/1959726524 >> v2:172.21.15.47:3300/0 conn(0x7fb50415a9d0 0x7fb50406dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.155+0000 7fb502800640 1 -- 172.21.15.8:0/1959726524 >> v1:172.21.15.47:6789/0 conn(0x7fb50406d970 legacy=0x7fb5040cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.155+0000 7fb501400640 1 -- 172.21.15.8:0/1959726524 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285189279 0 0) 0x7fb5040cba60 con 0x7fb50406d970 2024-05-26T15:39:30.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.155+0000 7fb502800640 1 -- 172.21.15.8:0/1959726524 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504070e10 con 0x7fb5040cdd10 2024-05-26T15:39:30.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.156+0000 7fb502800640 1 --2- 172.21.15.8:0/1959726524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb5040cdd10 0x7fb5041643b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009d90 tx=0x7fb4fc02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbbb620867596a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:30.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.157+0000 7fb501400640 1 -- 172.21.15.8:0/1959726524 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc031600 con 0x7fb5040cdd10 2024-05-26T15:39:30.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.157+0000 7fb501400640 1 -- 172.21.15.8:0/1959726524 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc02d050 con 0x7fb5040cdd10 2024-05-26T15:39:30.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.157+0000 7fb501400640 1 -- 172.21.15.8:0/1959726524 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc031980 con 0x7fb5040cdd10 2024-05-26T15:39:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.158+0000 7fb503200640 1 -- 172.21.15.8:0/1959726524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb5040cdd10 msgr2=0x7fb5041643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.158+0000 7fb503200640 1 --2- 172.21.15.8:0/1959726524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb5040cdd10 0x7fb5041643b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009d90 tx=0x7fb4fc02a5d0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.158+0000 7fb503200640 1 -- 172.21.15.8:0/1959726524 shutdown_connections 2024-05-26T15:39:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.158+0000 7fb503200640 1 --2- 172.21.15.8:0/1959726524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb5040cdd10 0x7fb5041643b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.158+0000 7fb503200640 1 --2- 172.21.15.8:0/1959726524 >> v2:172.21.15.47:3300/0 conn(0x7fb50415a9d0 0x7fb50406dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.158+0000 7fb503200640 1 -- 172.21.15.8:0/1959726524 >> 172.21.15.8:0/1959726524 conn(0x7fb5040ce4f0 msgr2=0x7fb5040ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:30.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.158+0000 7fb503200640 1 -- 172.21.15.8:0/1959726524 shutdown_connections 2024-05-26T15:39:30.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.158+0000 7fb503200640 1 -- 172.21.15.8:0/1959726524 wait complete. 2024-05-26T15:39:30.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.160+0000 7fb503200640 1 Processor -- start 2024-05-26T15:39:30.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.160+0000 7fb503200640 1 -- start start 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.161+0000 7fb503200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb50406d970 0x7fb504144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.161+0000 7fb503200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5040cdd10 0x7fb504159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.161+0000 7fb503200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb50415a9d0 0x7fb5041459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.161+0000 7fb503200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041454c0 con 0x7fb5040cdd10 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.161+0000 7fb503200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041585e0 con 0x7fb50406d970 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.161+0000 7fb503200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5041588c0 con 0x7fb50415a9d0 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.161+0000 7fb4f9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5040cdd10 0x7fb504159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.161+0000 7fb4f9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5040cdd10 0x7fb504159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56416/0 (socket says 172.21.15.8:56416) 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.161+0000 7fb4f9400640 1 -- 172.21.15.8:0/2822559207 learned_addr learned my addr 172.21.15.8:0/2822559207 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.162+0000 7fb502800640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb50415a9d0 0x7fb5041459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.162+0000 7fb501e00640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb50406d970 0x7fb504144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.162+0000 7fb4f9400640 1 -- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb50415a9d0 msgr2=0x7fb5041459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.162+0000 7fb4f9400640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb50415a9d0 0x7fb5041459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.162+0000 7fb4f9400640 1 -- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb50406d970 msgr2=0x7fb504144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.162+0000 7fb4f9400640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb50406d970 0x7fb504144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.162+0000 7fb4f9400640 1 -- 172.21.15.8:0/2822559207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc009a70 con 0x7fb5040cdd10 2024-05-26T15:39:30.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.162+0000 7fb501e00640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb50406d970 0x7fb504144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:30.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.162+0000 7fb4f9400640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5040cdd10 0x7fb504159680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00c430 tx=0x7fb4ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:30.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.162+0000 7fb4faa00640 1 -- 172.21.15.8:0/2822559207 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec0074e0 con 0x7fb5040cdd10 2024-05-26T15:39:30.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.163+0000 7fb4faa00640 1 -- 172.21.15.8:0/2822559207 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec007660 con 0x7fb5040cdd10 2024-05-26T15:39:30.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.163+0000 7fb503200640 1 -- 172.21.15.8:0/2822559207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb504158ba0 con 0x7fb5040cdd10 2024-05-26T15:39:30.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.163+0000 7fb4faa00640 1 -- 172.21.15.8:0/2822559207 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec004a20 con 0x7fb5040cdd10 2024-05-26T15:39:30.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.163+0000 7fb503200640 1 -- 172.21.15.8:0/2822559207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb504159160 con 0x7fb5040cdd10 2024-05-26T15:39:30.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.164+0000 7fb503200640 1 -- 172.21.15.8:0/2822559207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5040cadb0 con 0x7fb5040cdd10 2024-05-26T15:39:30.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.165+0000 7fb4faa00640 1 -- 172.21.15.8:0/2822559207 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb4ec004b80 con 0x7fb5040cdd10 2024-05-26T15:39:30.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.166+0000 7fb4faa00640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb4e006ac00 0x7fb4e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.166+0000 7fb4faa00640 1 -- 172.21.15.8:0/2822559207 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb4ec088f70 con 0x7fb5040cdd10 2024-05-26T15:39:30.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.166+0000 7fb501e00640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb4e006ac00 0x7fb4e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.168+0000 7fb501e00640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb4e006ac00 0x7fb4e006d0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009b90 tx=0x7fb4f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:30.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.170+0000 7fb4faa00640 1 -- 172.21.15.8:0/2822559207 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb4ec054370 con 0x7fb5040cdd10 2024-05-26T15:39:30.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.372+0000 7fb503200640 1 -- 172.21.15.8:0/2822559207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb504159380 con 0x7fb5040cdd10 2024-05-26T15:39:30.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.373+0000 7fb4faa00640 1 -- 172.21.15.8:0/2822559207 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4ec057990 con 0x7fb5040cdd10 2024-05-26T15:39:30.371 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:39:30.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.375+0000 7fb503200640 1 -- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb4e006ac00 msgr2=0x7fb4e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.375+0000 7fb503200640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb4e006ac00 0x7fb4e006d0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009b90 tx=0x7fb4f4008040 comp rx=0 tx=0).stop 2024-05-26T15:39:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.375+0000 7fb503200640 1 -- 172.21.15.8:0/2822559207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5040cdd10 msgr2=0x7fb504159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.375+0000 7fb503200640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5040cdd10 0x7fb504159680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec00c430 tx=0x7fb4ec00c8f0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.376+0000 7fb503200640 1 -- 172.21.15.8:0/2822559207 shutdown_connections 2024-05-26T15:39:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.376+0000 7fb503200640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb50415a9d0 0x7fb5041459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.376+0000 7fb503200640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5040cdd10 0x7fb504159680 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.376+0000 7fb503200640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb4e006ac00 0x7fb4e006d0c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.376+0000 7fb503200640 1 --2- 172.21.15.8:0/2822559207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb50406d970 0x7fb504144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.376+0000 7fb503200640 1 -- 172.21.15.8:0/2822559207 >> 172.21.15.8:0/2822559207 conn(0x7fb5040ce4f0 msgr2=0x7fb50406c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.376+0000 7fb503200640 1 -- 172.21.15.8:0/2822559207 shutdown_connections 2024-05-26T15:39:30.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.376+0000 7fb503200640 1 -- 172.21.15.8:0/2822559207 wait complete. 2024-05-26T15:39:30.394 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-26T15:39:30.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.597+0000 7ff1c0600640 1 Processor -- start 2024-05-26T15:39:30.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.598+0000 7ff1c0600640 1 -- start start 2024-05-26T15:39:30.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.599+0000 7ff1c0600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff1b8161030 0x7ff1b80cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.599+0000 7ff1c0600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff1b815cf60 0x7ff1b80cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.599+0000 7ff1c0600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b81617e0 con 0x7ff1b815cb80 2024-05-26T15:39:30.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.599+0000 7ff1c0600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b80cce00 con 0x7ff1b8161030 2024-05-26T15:39:30.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.599+0000 7ff1c0600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b8161500 con 0x7ff1b815cf60 2024-05-26T15:39:30.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.600+0000 7ff1bdc00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff1b815cb80 0x7ff1b8160920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35246/0 (socket says 172.21.15.8:35246) 2024-05-26T15:39:30.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.600+0000 7ff1bdc00640 1 -- 172.21.15.8:0/68517421 learned_addr learned my addr 172.21.15.8:0/68517421 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:30.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.600+0000 7ff1bd200640 1 --2- 172.21.15.8:0/68517421 >> v2:172.21.15.8:3300/0 conn(0x7ff1b8161030 0x7ff1b80cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.600+0000 7ff1be600640 1 --2- 172.21.15.8:0/68517421 >> v2:172.21.15.47:3300/0 conn(0x7ff1b815cf60 0x7ff1b80cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.600+0000 7ff1b7e00640 1 -- 172.21.15.8:0/68517421 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463204059 0 0) 0x7ff1b81617e0 con 0x7ff1b815cb80 2024-05-26T15:39:30.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.600+0000 7ff1b7e00640 1 -- 172.21.15.8:0/68517421 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff19c003520 con 0x7ff1b815cb80 2024-05-26T15:39:30.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.600+0000 7ff1bd200640 1 -- 172.21.15.8:0/68517421 >> v2:172.21.15.47:3300/0 conn(0x7ff1b815cf60 msgr2=0x7ff1b80cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:30.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.600+0000 7ff1bd200640 1 --2- 172.21.15.8:0/68517421 >> v2:172.21.15.47:3300/0 conn(0x7ff1b815cf60 0x7ff1b80cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.600+0000 7ff1bd200640 1 -- 172.21.15.8:0/68517421 >> v1:172.21.15.8:6789/0 conn(0x7ff1b815cb80 legacy=0x7ff1b8160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.601+0000 7ff1bd200640 1 -- 172.21.15.8:0/68517421 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80cd470 con 0x7ff1b8161030 2024-05-26T15:39:30.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.602+0000 7ff1bd200640 1 --2- 172.21.15.8:0/68517421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 0x7ff1b80cdf50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff1b806e290 tx=0x7ff1a402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5966b1ad649c86f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:30.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.602+0000 7ff1b7e00640 1 -- 172.21.15.8:0/68517421 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a402add0 con 0x7ff1b8161030 2024-05-26T15:39:30.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.602+0000 7ff1b7e00640 1 -- 172.21.15.8:0/68517421 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4032440 con 0x7ff1b8161030 2024-05-26T15:39:30.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.602+0000 7ff1b7e00640 1 -- 172.21.15.8:0/68517421 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40327b0 con 0x7ff1b8161030 2024-05-26T15:39:30.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.603+0000 7ff1c0600640 1 -- 172.21.15.8:0/68517421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 msgr2=0x7ff1b80cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.603+0000 7ff1c0600640 1 --2- 172.21.15.8:0/68517421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 0x7ff1b80cdf50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff1b806e290 tx=0x7ff1a402a080 comp rx=0 tx=0).stop 2024-05-26T15:39:30.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.603+0000 7ff1c0600640 1 -- 172.21.15.8:0/68517421 shutdown_connections 2024-05-26T15:39:30.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.603+0000 7ff1c0600640 1 --2- 172.21.15.8:0/68517421 >> v2:172.21.15.47:3300/0 conn(0x7ff1b815cf60 0x7ff1b80cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.603+0000 7ff1c0600640 1 --2- 172.21.15.8:0/68517421 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 0x7ff1b80cdf50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.603+0000 7ff1c0600640 1 -- 172.21.15.8:0/68517421 >> 172.21.15.8:0/68517421 conn(0x7ff1b80b0570 msgr2=0x7ff1b80b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:30.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.603+0000 7ff1c0600640 1 -- 172.21.15.8:0/68517421 shutdown_connections 2024-05-26T15:39:30.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.603+0000 7ff1c0600640 1 -- 172.21.15.8:0/68517421 wait complete. 2024-05-26T15:39:30.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.605+0000 7ff1c0600640 1 Processor -- start 2024-05-26T15:39:30.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.605+0000 7ff1c0600640 1 -- start start 2024-05-26T15:39:30.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.606+0000 7ff1c0600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff1b815cb80 0x7ff1b81f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.606+0000 7ff1c0600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1b815cf60 0x7ff1b80ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.606+0000 7ff1c0600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 0x7ff1b80ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.606+0000 7ff1c0600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b80ad260 con 0x7ff1b8161030 2024-05-26T15:39:30.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.606+0000 7ff1c0600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8158060 con 0x7ff1b815cf60 2024-05-26T15:39:30.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.606+0000 7ff1c0600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8157490 con 0x7ff1b815cb80 2024-05-26T15:39:30.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.606+0000 7ff1be600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 0x7ff1b80ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1be600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 0x7ff1b80ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56440/0 (socket says 172.21.15.8:56440) 2024-05-26T15:39:30.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1be600640 1 -- 172.21.15.8:0/365565791 learned_addr learned my addr 172.21.15.8:0/365565791 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:30.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1bd200640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1b815cf60 0x7ff1b80ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1bdc00640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff1b815cb80 0x7ff1b81f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1be600640 1 -- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff1b815cb80 msgr2=0x7ff1b81f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1be600640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff1b815cb80 0x7ff1b81f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1be600640 1 -- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1b815cf60 msgr2=0x7ff1b80ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1be600640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1b815cf60 0x7ff1b80ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1be600640 1 -- 172.21.15.8:0/365565791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a4009400 con 0x7ff1b8161030 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1bdc00640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff1b815cb80 0x7ff1b81f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.607+0000 7ff1be600640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 0x7ff1b80ac7e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000d5d0 tx=0x7ff1b000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.608+0000 7ff1b5600640 1 -- 172.21.15.8:0/365565791 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b00125f0 con 0x7ff1b8161030 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.608+0000 7ff1b5600640 1 -- 172.21.15.8:0/365565791 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b0012750 con 0x7ff1b8161030 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.608+0000 7ff1b5600640 1 -- 172.21.15.8:0/365565791 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0012b00 con 0x7ff1b8161030 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.608+0000 7ff1c0600640 1 -- 172.21.15.8:0/365565791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b8157730 con 0x7ff1b8161030 2024-05-26T15:39:30.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.608+0000 7ff1c0600640 1 -- 172.21.15.8:0/365565791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b8157cf0 con 0x7ff1b8161030 2024-05-26T15:39:30.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.609+0000 7ff1c0600640 1 -- 172.21.15.8:0/365565791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b8157e80 con 0x7ff1b8161030 2024-05-26T15:39:30.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.610+0000 7ff1b5600640 1 -- 172.21.15.8:0/365565791 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff1b0012c60 con 0x7ff1b8161030 2024-05-26T15:39:30.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.611+0000 7ff1b5600640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff19806ac00 0x7ff19806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:30.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.611+0000 7ff1b5600640 1 -- 172.21.15.8:0/365565791 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff1b00895d0 con 0x7ff1b8161030 2024-05-26T15:39:30.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.612+0000 7ff1bdc00640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff19806ac00 0x7ff19806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:30.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.613+0000 7ff1bdc00640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff19806ac00 0x7ff19806d0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8005c00 tx=0x7ff1a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:30.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.615+0000 7ff1b5600640 1 -- 172.21.15.8:0/365565791 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff1b0054a60 con 0x7ff1b8161030 2024-05-26T15:39:30.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.815+0000 7ff1c0600640 1 -- 172.21.15.8:0/365565791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff1b81581d0 con 0x7ff1b8161030 2024-05-26T15:39:30.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.816+0000 7ff1b5600640 1 -- 172.21.15.8:0/365565791 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff1b0058080 con 0x7ff1b8161030 2024-05-26T15:39:30.814 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:30.814 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2024-05-26T15:39:30.814 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:39:30.815 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2024-05-26T15:39:30.815 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2024-05-26T15:39:30.815 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:39:30.815 INFO:teuthology.orchestra.run.smithi008.stdout:] 2024-05-26T15:39:30.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 -- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff19806ac00 msgr2=0x7ff19806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff19806ac00 0x7ff19806d0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8005c00 tx=0x7ff1a8009040 comp rx=0 tx=0).stop 2024-05-26T15:39:30.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 -- 172.21.15.8:0/365565791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 msgr2=0x7ff1b80ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:30.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 0x7ff1b80ac7e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1b000d5d0 tx=0x7ff1b000da90 comp rx=0 tx=0).stop 2024-05-26T15:39:30.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 -- 172.21.15.8:0/365565791 shutdown_connections 2024-05-26T15:39:30.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b8161030 0x7ff1b80ac7e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff19806ac00 0x7ff19806d0c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1b815cf60 0x7ff1b80ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 --2- 172.21.15.8:0/365565791 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff1b815cb80 0x7ff1b81f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:30.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 -- 172.21.15.8:0/365565791 >> 172.21.15.8:0/365565791 conn(0x7ff1b80b0570 msgr2=0x7ff1b8154240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:30.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 -- 172.21.15.8:0/365565791 shutdown_connections 2024-05-26T15:39:30.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:30.819+0000 7ff1c0600640 1 -- 172.21.15.8:0/365565791 wait complete. 2024-05-26T15:39:30.836 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-26T15:39:30.837 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-26T15:39:31.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.051+0000 7f5c71400640 1 Processor -- start 2024-05-26T15:39:31.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.052+0000 7f5c71400640 1 -- start start 2024-05-26T15:39:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.053+0000 7f5c71400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5c6c06b480 0x7f5c6c0d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.053+0000 7f5c71400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6c0d1cb0 con 0x7f5c6c15fbd0 2024-05-26T15:39:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.053+0000 7f5c71400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6c0d10c0 con 0x7f5c6c06b860 2024-05-26T15:39:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.053+0000 7f5c71400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6c0d1380 con 0x7f5c6c06b480 2024-05-26T15:39:31.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.054+0000 7f5c70a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5c6c15fbd0 0x7f5c6c160040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34066/0 (socket says 172.21.15.8:34066) 2024-05-26T15:39:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.054+0000 7f5c70a00640 1 -- 172.21.15.8:0/3627475944 learned_addr learned my addr 172.21.15.8:0/3627475944 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.054+0000 7f5c6be00640 1 --2- 172.21.15.8:0/3627475944 >> v2:172.21.15.8:3300/0 conn(0x7f5c6c06b480 0x7f5c6c0d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.054+0000 7f5c6b400640 1 -- 172.21.15.8:0/3627475944 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550972045 0 0) 0x7f5c6c0d1cb0 con 0x7f5c6c15fbd0 2024-05-26T15:39:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.054+0000 7f5c6b400640 1 -- 172.21.15.8:0/3627475944 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c50003520 con 0x7f5c6c15fbd0 2024-05-26T15:39:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.054+0000 7f5c6be00640 1 -- 172.21.15.8:0/3627475944 >> v1:172.21.15.47:6789/0 conn(0x7f5c6c06b860 legacy=0x7f5c6c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.054+0000 7f5c6be00640 1 -- 172.21.15.8:0/3627475944 >> v1:172.21.15.8:6789/0 conn(0x7f5c6c15fbd0 legacy=0x7f5c6c160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.054+0000 7f5c6be00640 1 -- 172.21.15.8:0/3627475944 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c0d1660 con 0x7f5c6c06b480 2024-05-26T15:39:31.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.056+0000 7f5c6be00640 1 --2- 172.21.15.8:0/3627475944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b480 0x7f5c6c0d2140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0097a0 tx=0x7f5c5c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa7cda104bb774f server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:31.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.056+0000 7f5c6b400640 1 -- 172.21.15.8:0/3627475944 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c032440 con 0x7f5c6c06b480 2024-05-26T15:39:31.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.056+0000 7f5c6b400640 1 -- 172.21.15.8:0/3627475944 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c0325a0 con 0x7f5c6c06b480 2024-05-26T15:39:31.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.056+0000 7f5c6b400640 1 -- 172.21.15.8:0/3627475944 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c032910 con 0x7f5c6c06b480 2024-05-26T15:39:31.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.056+0000 7f5c71400640 1 -- 172.21.15.8:0/3627475944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b480 msgr2=0x7f5c6c0d2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.056+0000 7f5c71400640 1 --2- 172.21.15.8:0/3627475944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b480 0x7f5c6c0d2140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0097a0 tx=0x7f5c5c02a1a0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.057+0000 7f5c71400640 1 -- 172.21.15.8:0/3627475944 shutdown_connections 2024-05-26T15:39:31.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.057+0000 7f5c71400640 1 --2- 172.21.15.8:0/3627475944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b480 0x7f5c6c0d2140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.057+0000 7f5c71400640 1 -- 172.21.15.8:0/3627475944 >> 172.21.15.8:0/3627475944 conn(0x7f5c6c0cfa10 msgr2=0x7f5c6c0d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:31.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.057+0000 7f5c71400640 1 -- 172.21.15.8:0/3627475944 shutdown_connections 2024-05-26T15:39:31.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.057+0000 7f5c71400640 1 -- 172.21.15.8:0/3627475944 wait complete. 2024-05-26T15:39:31.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.058+0000 7f5c71400640 1 Processor -- start 2024-05-26T15:39:31.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.059+0000 7f5c71400640 1 -- start start 2024-05-26T15:39:31.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.059+0000 7f5c71400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c6c06b480 0x7f5c6c159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.060+0000 7f5c71400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b860 0x7f5c6c0acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.060+0000 7f5c71400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5c6c15fbd0 0x7f5c6c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.060+0000 7f5c71400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0ae310 con 0x7f5c6c06b860 2024-05-26T15:39:31.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.060+0000 7f5c71400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0a92d0 con 0x7f5c6c06b480 2024-05-26T15:39:31.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.060+0000 7f5c71400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0a9520 con 0x7f5c6c15fbd0 2024-05-26T15:39:31.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.060+0000 7f5c63e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b860 0x7f5c6c0acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.060+0000 7f5c6be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c6c06b480 0x7f5c6c159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.060+0000 7f5c63e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b860 0x7f5c6c0acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48340/0 (socket says 172.21.15.8:48340) 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.060+0000 7f5c63e00640 1 -- 172.21.15.8:0/282641175 learned_addr learned my addr 172.21.15.8:0/282641175 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.060+0000 7f5c70a00640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5c6c15fbd0 0x7f5c6c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.061+0000 7f5c63e00640 1 -- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5c6c15fbd0 msgr2=0x7f5c6c0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.061+0000 7f5c63e00640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5c6c15fbd0 0x7f5c6c0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.061+0000 7f5c63e00640 1 -- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c6c06b480 msgr2=0x7f5c6c159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.061+0000 7f5c63e00640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c6c06b480 0x7f5c6c159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.061+0000 7f5c63e00640 1 -- 172.21.15.8:0/282641175 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c009400 con 0x7f5c6c06b860 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.061+0000 7f5c63e00640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b860 0x7f5c6c0acd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400c400 tx=0x7f5c5400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.061+0000 7f5c68c00640 1 -- 172.21.15.8:0/282641175 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c540052d0 con 0x7f5c6c06b860 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.061+0000 7f5c68c00640 1 -- 172.21.15.8:0/282641175 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c54005450 con 0x7f5c6c06b860 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.061+0000 7f5c68c00640 1 -- 172.21.15.8:0/282641175 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54007260 con 0x7f5c6c06b860 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.061+0000 7f5c71400640 1 -- 172.21.15.8:0/282641175 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c0a9800 con 0x7f5c6c06b860 2024-05-26T15:39:31.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.062+0000 7f5c71400640 1 -- 172.21.15.8:0/282641175 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c0a9dc0 con 0x7f5c6c06b860 2024-05-26T15:39:31.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.063+0000 7f5c71400640 1 -- 172.21.15.8:0/282641175 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c0d3750 con 0x7f5c6c06b860 2024-05-26T15:39:31.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.064+0000 7f5c68c00640 1 -- 172.21.15.8:0/282641175 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5c540073c0 con 0x7f5c6c06b860 2024-05-26T15:39:31.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.064+0000 7f5c68c00640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5c4806ac00 0x7f5c4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.065+0000 7f5c68c00640 1 -- 172.21.15.8:0/282641175 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5c54088430 con 0x7f5c6c06b860 2024-05-26T15:39:31.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.065+0000 7f5c6be00640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5c4806ac00 0x7f5c4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.066+0000 7f5c6be00640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5c4806ac00 0x7f5c4806d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c034000 tx=0x7f5c5c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:31.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.069+0000 7f5c68c00640 1 -- 172.21.15.8:0/282641175 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5c54053970 con 0x7f5c6c06b860 2024-05-26T15:39:31.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.266+0000 7f5c71400640 1 -- 172.21.15.8:0/282641175 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5c6c04e210 con 0x7f5c6c06b860 2024-05-26T15:39:31.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.377+0000 7f5c68c00640 1 -- 172.21.15.8:0/282641175 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5c54056f90 con 0x7f5c6c06b860 2024-05-26T15:39:31.376 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 -- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5c4806ac00 msgr2=0x7f5c4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5c4806ac00 0x7f5c4806d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c034000 tx=0x7f5c5c02e000 comp rx=0 tx=0).stop 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 -- 172.21.15.8:0/282641175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b860 msgr2=0x7f5c6c0acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b860 0x7f5c6c0acd20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400c400 tx=0x7f5c5400c8c0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 -- 172.21.15.8:0/282641175 shutdown_connections 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5c6c15fbd0 0x7f5c6c0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5c6c06b860 0x7f5c6c0acd20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5c4806ac00 0x7f5c4806d0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 --2- 172.21.15.8:0/282641175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c6c06b480 0x7f5c6c159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 -- 172.21.15.8:0/282641175 >> 172.21.15.8:0/282641175 conn(0x7f5c6c0cfa10 msgr2=0x7f5c6c0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:31.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 -- 172.21.15.8:0/282641175 shutdown_connections 2024-05-26T15:39:31.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.382+0000 7f5c71400640 1 -- 172.21.15.8:0/282641175 wait complete. 2024-05-26T15:39:31.405 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-26T15:39:31.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.609+0000 7f8818a00640 1 Processor -- start 2024-05-26T15:39:31.608 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.610+0000 7f8818a00640 1 -- start start 2024-05-26T15:39:31.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.611+0000 7f8818a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8814070ba0 0x7f88140cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.611+0000 7f8818a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8814144520 con 0x7f88140cd7c0 2024-05-26T15:39:31.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.611+0000 7f8818a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88140cdd80 con 0x7f8814144140 2024-05-26T15:39:31.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.611+0000 7f8818a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88140ce060 con 0x7f8814070ba0 2024-05-26T15:39:31.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.612+0000 7f8812800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f88140cd7c0 0x7f881406cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34080/0 (socket says 172.21.15.8:34080) 2024-05-26T15:39:31.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.612+0000 7f8812800640 1 -- 172.21.15.8:0/3907546879 learned_addr learned my addr 172.21.15.8:0/3907546879 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:31.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.612+0000 7f8809400640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8814070ba0 0x7f88140cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.612+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736936351 0 0) 0x7f8814144520 con 0x7f88140cd7c0 2024-05-26T15:39:31.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.612+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f8003520 con 0x7f88140cd7c0 2024-05-26T15:39:31.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 190839626 0 0) 0x7f87f8003520 con 0x7f88140cd7c0 2024-05-26T15:39:31.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8814070ba0 msgr2=0x7f88140cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:31.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8814070ba0 0x7f88140cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 >> v1:172.21.15.47:6789/0 conn(0x7f8814144140 legacy=0x7f8814070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140ce340 con 0x7f88140cd7c0 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f880c001670 con 0x7f88140cd7c0 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 >> v1:172.21.15.8:6789/0 conn(0x7f88140cd7c0 legacy=0x7f881406cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f8003a10 0x7f87f8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8814070ba0 0x7f87f80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8004d50 0x7f87f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140ce060 con 0x7f87f8004d50 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f800bb90 con 0x7f87f8003a10 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f800bd50 con 0x7f8814070ba0 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8812800640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8004d50 0x7f87f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8811e00640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f8003a10 0x7f87f8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.613+0000 7f8809400640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8814070ba0 0x7f87f80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.614+0000 7f8812800640 1 -- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8814070ba0 msgr2=0x7f87f80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:31.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.614+0000 7f8812800640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8814070ba0 0x7f87f80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.614+0000 7f8812800640 1 -- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f8003a10 msgr2=0x7f87f8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:31.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.614+0000 7f8812800640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f8003a10 0x7f87f8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.614+0000 7f8812800640 1 -- 172.21.15.8:0/3907546879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8003520 con 0x7f87f8004d50 2024-05-26T15:39:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.615+0000 7f8812800640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8004d50 0x7f87f80051d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c240 tx=0x7f87f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41528bca1f660ffe server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.615+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c02e070 con 0x7f87f8004d50 2024-05-26T15:39:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.615+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c0058d0 con 0x7f87f8004d50 2024-05-26T15:39:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.615+0000 7f8811400640 1 -- 172.21.15.8:0/3907546879 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c005cc0 con 0x7f87f8004d50 2024-05-26T15:39:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.615+0000 7f8818a00640 1 -- 172.21.15.8:0/3907546879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8004d50 msgr2=0x7f87f80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.615+0000 7f8818a00640 1 --2- 172.21.15.8:0/3907546879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f87f8004d50 0x7f87f80051d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c240 tx=0x7f87f80057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.615+0000 7f8812800640 1 -- 172.21.15.8:0/3907546879 reap_dead start 2024-05-26T15:39:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.616+0000 7f8818a00640 1 -- 172.21.15.8:0/3907546879 shutdown_connections 2024-05-26T15:39:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.616+0000 7f8818a00640 1 -- 172.21.15.8:0/3907546879 >> 172.21.15.8:0/3907546879 conn(0x7f8814069e70 msgr2=0x7f881406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.616+0000 7f8818a00640 1 -- 172.21.15.8:0/3907546879 shutdown_connections 2024-05-26T15:39:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.616+0000 7f8818a00640 1 -- 172.21.15.8:0/3907546879 wait complete. 2024-05-26T15:39:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.617+0000 7f8818a00640 1 Processor -- start 2024-05-26T15:39:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.618+0000 7f8818a00640 1 -- start start 2024-05-26T15:39:31.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8818a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f8004d50 0x7f881413f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8818a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140a74b0 0x7f881415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8818a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f88140aaca0 0x7f881415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8818a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140a7c70 con 0x7f88140a74b0 2024-05-26T15:39:31.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8818a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140a7f50 con 0x7f87f8004d50 2024-05-26T15:39:31.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8818a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88140a8230 con 0x7f88140aaca0 2024-05-26T15:39:31.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8809400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140a74b0 0x7f881415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8809400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140a74b0 0x7f881415a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48366/0 (socket says 172.21.15.8:48366) 2024-05-26T15:39:31.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8809400640 1 -- 172.21.15.8:0/397439448 learned_addr learned my addr 172.21.15.8:0/397439448 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8812800640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f88140aaca0 0x7f881415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8811e00640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f8004d50 0x7f881413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8809400640 1 -- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f88140aaca0 msgr2=0x7f881415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8809400640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f88140aaca0 0x7f881415cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8809400640 1 -- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f8004d50 msgr2=0x7f881413f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8809400640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f8004d50 0x7f881413f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.619+0000 7f8809400640 1 -- 172.21.15.8:0/397439448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140cefa0 con 0x7f88140a74b0 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.620+0000 7f8809400640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140a74b0 0x7f881415a150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00f580 tx=0x7f87fc00fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.620+0000 7f880aa00640 1 -- 172.21.15.8:0/397439448 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc014870 con 0x7f88140a74b0 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.620+0000 7f880aa00640 1 -- 172.21.15.8:0/397439448 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc0149d0 con 0x7f88140a74b0 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.620+0000 7f880aa00640 1 -- 172.21.15.8:0/397439448 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc014d80 con 0x7f88140a74b0 2024-05-26T15:39:31.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.620+0000 7f8818a00640 1 -- 172.21.15.8:0/397439448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88140a8510 con 0x7f88140a74b0 2024-05-26T15:39:31.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.620+0000 7f8818a00640 1 -- 172.21.15.8:0/397439448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881415a690 con 0x7f88140a74b0 2024-05-26T15:39:31.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.621+0000 7f8818a00640 1 -- 172.21.15.8:0/397439448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881404e210 con 0x7f88140a74b0 2024-05-26T15:39:31.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.622+0000 7f880aa00640 1 -- 172.21.15.8:0/397439448 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f87fc015410 con 0x7f88140a74b0 2024-05-26T15:39:31.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.623+0000 7f880aa00640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f87f006ac30 0x7f87f006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:31.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.623+0000 7f880aa00640 1 -- 172.21.15.8:0/397439448 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f87fc089bf0 con 0x7f88140a74b0 2024-05-26T15:39:31.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.624+0000 7f8811e00640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f87f006ac30 0x7f87f006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:31.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.625+0000 7f8811e00640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f87f006ac30 0x7f87f006d0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8804007fd0 tx=0x7f8804009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:31.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.628+0000 7f880aa00640 1 -- 172.21.15.8:0/397439448 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f87fc054f20 con 0x7f88140a74b0 2024-05-26T15:39:31.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:31.826+0000 7f8818a00640 1 -- 172.21.15.8:0/397439448 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f88140ad5d0 con 0x7f88140a74b0 2024-05-26T15:39:32.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.389+0000 7f880aa00640 1 -- 172.21.15.8:0/397439448 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f87fc058540 con 0x7f88140a74b0 2024-05-26T15:39:32.391 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2024-05-26T15:39:32.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.396+0000 7f8818a00640 1 -- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f87f006ac30 msgr2=0x7f87f006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:32.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.396+0000 7f8818a00640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f87f006ac30 0x7f87f006d0f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8804007fd0 tx=0x7f8804009040 comp rx=0 tx=0).stop 2024-05-26T15:39:32.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.396+0000 7f8818a00640 1 -- 172.21.15.8:0/397439448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140a74b0 msgr2=0x7f881415a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:32.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.396+0000 7f8818a00640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140a74b0 0x7f881415a150 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00f580 tx=0x7f87fc00fa40 comp rx=0 tx=0).stop 2024-05-26T15:39:32.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.397+0000 7f8818a00640 1 -- 172.21.15.8:0/397439448 shutdown_connections 2024-05-26T15:39:32.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.397+0000 7f8818a00640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f88140aaca0 0x7f881415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.397+0000 7f8818a00640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88140a74b0 0x7f881415a150 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.397+0000 7f8818a00640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f87f006ac30 0x7f87f006d0f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.397+0000 7f8818a00640 1 --2- 172.21.15.8:0/397439448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87f8004d50 0x7f881413f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.397+0000 7f8818a00640 1 -- 172.21.15.8:0/397439448 >> 172.21.15.8:0/397439448 conn(0x7f8814069e70 msgr2=0x7f881406dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:32.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.401+0000 7f8818a00640 1 -- 172.21.15.8:0/397439448 shutdown_connections 2024-05-26T15:39:32.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.402+0000 7f8818a00640 1 -- 172.21.15.8:0/397439448 wait complete. 2024-05-26T15:39:32.434 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-26T15:39:32.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.617+0000 7f0764400640 1 Processor -- start 2024-05-26T15:39:32.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.617+0000 7f0764400640 1 -- start start 2024-05-26T15:39:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.618+0000 7f0764400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f075c0b4cd0 0x7f075c06b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.618+0000 7f0764400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f075c0b5d70 0x7f075c06b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.618+0000 7f0764400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075c06bde0 con 0x7f075c15cba0 2024-05-26T15:39:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.618+0000 7f0764400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c06c330 con 0x7f075c0b4cd0 2024-05-26T15:39:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.618+0000 7f0764400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0d1570 con 0x7f075c0b5d70 2024-05-26T15:39:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.619+0000 7f0761a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f075c15cba0 0x7f075c0b45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34092/0 (socket says 172.21.15.8:34092) 2024-05-26T15:39:32.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.619+0000 7f0761a00640 1 -- 172.21.15.8:0/3925884207 learned_addr learned my addr 172.21.15.8:0/3925884207 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.619+0000 7f0762400640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f075c0b5d70 0x7f075c06b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.619+0000 7f0761000640 1 --2- 172.21.15.8:0/3925884207 >> v2:172.21.15.47:3300/0 conn(0x7f075c0b4cd0 0x7f075c06b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.619+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849282022 0 0) 0x7f075c06bde0 con 0x7f075c15cba0 2024-05-26T15:39:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.619+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0740003520 con 0x7f075c15cba0 2024-05-26T15:39:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.619+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2710120096 0 0) 0x7f0740003520 con 0x7f075c15cba0 2024-05-26T15:39:32.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.619+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f075c0b5d70 msgr2=0x7f075c06b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.619+0000 7f075be00640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f075c0b5d70 0x7f075c06b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 >> v2:172.21.15.47:3300/0 conn(0x7f075c0b4cd0 msgr2=0x7f075c06b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 --2- 172.21.15.8:0/3925884207 >> v2:172.21.15.47:3300/0 conn(0x7f075c0b4cd0 0x7f075c06b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c06c050 con 0x7f075c15cba0 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f074c001670 con 0x7f075c15cba0 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 >> v1:172.21.15.8:6789/0 conn(0x7f075c15cba0 legacy=0x7f075c0b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f075c0b5d70 0x7f07400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0740003f60 0x7f07400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0740004d00 0x7f0740005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c06c330 con 0x7f0740004d00 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0d1570 con 0x7f0740003f60 2024-05-26T15:39:32.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074000bae0 con 0x7f075c0b5d70 2024-05-26T15:39:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f0762400640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0740004d00 0x7f0740005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f0761a00640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f075c0b5d70 0x7f07400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f0761000640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0740003f60 0x7f07400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f0762400640 1 -- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f075c0b5d70 msgr2=0x7f07400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f0762400640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f075c0b5d70 0x7f07400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f0762400640 1 -- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0740003f60 msgr2=0x7f07400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f0762400640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0740003f60 0x7f07400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.620+0000 7f0762400640 1 -- 172.21.15.8:0/3925884207 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740003520 con 0x7f0740004d00 2024-05-26T15:39:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.622+0000 7f0762400640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0740004d00 0x7f0740005180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0754009fc0 tx=0x7f07400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0804127e66db3ec server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.622+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754031640 con 0x7f0740004d00 2024-05-26T15:39:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.622+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075402d070 con 0x7f0740004d00 2024-05-26T15:39:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.622+0000 7f075be00640 1 -- 172.21.15.8:0/3925884207 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540319e0 con 0x7f0740004d00 2024-05-26T15:39:32.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.622+0000 7f0764400640 1 -- 172.21.15.8:0/3925884207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0740004d00 msgr2=0x7f0740005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.622+0000 7f0764400640 1 --2- 172.21.15.8:0/3925884207 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0740004d00 0x7f0740005180 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0754009fc0 tx=0x7f07400057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.622+0000 7f0762400640 1 -- 172.21.15.8:0/3925884207 reap_dead start 2024-05-26T15:39:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.623+0000 7f0764400640 1 -- 172.21.15.8:0/3925884207 shutdown_connections 2024-05-26T15:39:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.623+0000 7f0764400640 1 -- 172.21.15.8:0/3925884207 >> 172.21.15.8:0/3925884207 conn(0x7f075c0cf5c0 msgr2=0x7f075c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.623+0000 7f0764400640 1 -- 172.21.15.8:0/3925884207 shutdown_connections 2024-05-26T15:39:32.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.623+0000 7f0764400640 1 -- 172.21.15.8:0/3925884207 wait complete. 2024-05-26T15:39:32.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.624+0000 7f0764400640 1 Processor -- start 2024-05-26T15:39:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.625+0000 7f0764400640 1 -- start start 2024-05-26T15:39:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0764400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0740004d00 0x7f075c15faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0764400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f075c0c91a0 0x7f075c160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0764400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f075c0d1890 0x7f075c0d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0764400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0d2280 con 0x7f075c0c91a0 2024-05-26T15:39:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0764400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c1f5d40 con 0x7f075c0d1890 2024-05-26T15:39:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0764400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c1f6020 con 0x7f0740004d00 2024-05-26T15:39:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0761000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f075c0c91a0 0x7f075c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0761000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f075c0c91a0 0x7f075c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48394/0 (socket says 172.21.15.8:48394) 2024-05-26T15:39:32.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0761000640 1 -- 172.21.15.8:0/2283556073 learned_addr learned my addr 172.21.15.8:0/2283556073 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0761a00640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0740004d00 0x7f075c15faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0762400640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f075c0d1890 0x7f075c0d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0761000640 1 -- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0740004d00 msgr2=0x7f075c15faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0761000640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0740004d00 0x7f075c15faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0761000640 1 -- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f075c0d1890 msgr2=0x7f075c0d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0761000640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f075c0d1890 0x7f075c0d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0761000640 1 -- 172.21.15.8:0/2283556073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c1f6300 con 0x7f075c0c91a0 2024-05-26T15:39:32.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.626+0000 7f0762400640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f075c0d1890 0x7f075c0d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.627+0000 7f0761000640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f075c0c91a0 0x7f075c160030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f074800f650 tx=0x7f074800fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.627+0000 7f0759600640 1 -- 172.21.15.8:0/2283556073 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748004020 con 0x7f075c0c91a0 2024-05-26T15:39:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.627+0000 7f0759600640 1 -- 172.21.15.8:0/2283556073 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480041a0 con 0x7f075c0c91a0 2024-05-26T15:39:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.627+0000 7f0759600640 1 -- 172.21.15.8:0/2283556073 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800d740 con 0x7f075c0c91a0 2024-05-26T15:39:32.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.627+0000 7f0764400640 1 -- 172.21.15.8:0/2283556073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c1f65e0 con 0x7f075c0c91a0 2024-05-26T15:39:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.627+0000 7f0764400640 1 -- 172.21.15.8:0/2283556073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c1f6ba0 con 0x7f075c0c91a0 2024-05-26T15:39:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.629+0000 7f0764400640 1 -- 172.21.15.8:0/2283556073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c0678c0 con 0x7f075c0c91a0 2024-05-26T15:39:32.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.629+0000 7f0759600640 1 -- 172.21.15.8:0/2283556073 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f074800d8a0 con 0x7f075c0c91a0 2024-05-26T15:39:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.630+0000 7f0759600640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f073c06ac00 0x7f073c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.631+0000 7f0759600640 1 -- 172.21.15.8:0/2283556073 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0748089a10 con 0x7f075c0c91a0 2024-05-26T15:39:32.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.631+0000 7f0761a00640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f073c06ac00 0x7f073c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:32.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.632+0000 7f0761a00640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f073c06ac00 0x7f073c06d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f074c000fb0 tx=0x7f074c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:32.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.637+0000 7f0759600640 1 -- 172.21.15.8:0/2283556073 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0748054bb0 con 0x7f075c0c91a0 2024-05-26T15:39:32.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.879+0000 7f0764400640 1 -- 172.21.15.8:0/2283556073 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f075c04e210 con 0x7f075c0c91a0 2024-05-26T15:39:32.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.890+0000 7f0759600640 1 -- 172.21.15.8:0/2283556073 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f07480581d0 con 0x7f075c0c91a0 2024-05-26T15:39:32.888 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 2 and data pool 3 2024-05-26T15:39:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.894+0000 7f0764400640 1 -- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f073c06ac00 msgr2=0x7f073c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.894+0000 7f0764400640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f073c06ac00 0x7f073c06d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f074c000fb0 tx=0x7f074c009040 comp rx=0 tx=0).stop 2024-05-26T15:39:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.895+0000 7f0764400640 1 -- 172.21.15.8:0/2283556073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f075c0c91a0 msgr2=0x7f075c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.895+0000 7f0764400640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f075c0c91a0 0x7f075c160030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f074800f650 tx=0x7f074800fb10 comp rx=0 tx=0).stop 2024-05-26T15:39:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.896+0000 7f0764400640 1 -- 172.21.15.8:0/2283556073 shutdown_connections 2024-05-26T15:39:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.896+0000 7f0764400640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f073c06ac00 0x7f073c06d0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.896+0000 7f0764400640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f075c0d1890 0x7f075c0d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.896+0000 7f0764400640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f075c0c91a0 0x7f075c160030 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.896+0000 7f0764400640 1 --2- 172.21.15.8:0/2283556073 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0740004d00 0x7f075c15faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.896+0000 7f0764400640 1 -- 172.21.15.8:0/2283556073 >> 172.21.15.8:0/2283556073 conn(0x7f075c0cf5c0 msgr2=0x7f075c15aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:32.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.898+0000 7f0764400640 1 -- 172.21.15.8:0/2283556073 shutdown_connections 2024-05-26T15:39:32.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:32.902+0000 7f0764400640 1 -- 172.21.15.8:0/2283556073 wait complete. 2024-05-26T15:39:32.931 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-26T15:39:32.931 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-26T15:39:33.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.116+0000 7fc76b000640 1 Processor -- start 2024-05-26T15:39:33.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.116+0000 7fc76b000640 1 -- start start 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.117+0000 7fc76b000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc7640cc400 0x7fc7640aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.117+0000 7fc76b000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7640af1b0 0x7fc76415af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.117+0000 7fc76b000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc76415b4b0 0x7fc7640b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.117+0000 7fc76b000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7640ae220 con 0x7fc7640cc400 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.117+0000 7fc76b000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76415ba80 con 0x7fc76415b4b0 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.117+0000 7fc76b000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76415bd60 con 0x7fc7640af1b0 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc763e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc7640cc400 0x7fc7640aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc763e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc7640cc400 0x7fc7640aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48402/0 (socket says 172.21.15.8:48402) 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc763e00640 1 -- 172.21.15.8:0/2112144477 learned_addr learned my addr 172.21.15.8:0/2112144477 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc769000640 1 --2- 172.21.15.8:0/2112144477 >> v2:172.21.15.47:3300/0 conn(0x7fc76415b4b0 0x7fc7640b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc75be00640 1 --2- 172.21.15.8:0/2112144477 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7640af1b0 0x7fc76415af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:33.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc763e00640 1 -- 172.21.15.8:0/2112144477 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7640af1b0 msgr2=0x7fc76415af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:33.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc763e00640 1 --2- 172.21.15.8:0/2112144477 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7640af1b0 0x7fc76415af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc763e00640 1 -- 172.21.15.8:0/2112144477 >> v2:172.21.15.47:3300/0 conn(0x7fc76415b4b0 msgr2=0x7fc7640b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:33.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc763e00640 1 --2- 172.21.15.8:0/2112144477 >> v2:172.21.15.47:3300/0 conn(0x7fc76415b4b0 0x7fc7640b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc763e00640 1 -- 172.21.15.8:0/2112144477 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640ae470 con 0x7fc7640cc400 2024-05-26T15:39:33.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.118+0000 7fc769000640 1 --2- 172.21.15.8:0/2112144477 >> v2:172.21.15.47:3300/0 conn(0x7fc76415b4b0 0x7fc7640b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:33.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.120+0000 7fc763e00640 1 --2- 172.21.15.8:0/2112144477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 0x7fc7640aec70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc764158b00 tx=0x7fc75402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e09fc7e6b3ea04 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:33.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.120+0000 7fc763400640 1 -- 172.21.15.8:0/2112144477 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75402ae90 con 0x7fc7640cc400 2024-05-26T15:39:33.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.120+0000 7fc763400640 1 -- 172.21.15.8:0/2112144477 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc754032440 con 0x7fc7640cc400 2024-05-26T15:39:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.120+0000 7fc763400640 1 -- 172.21.15.8:0/2112144477 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540327d0 con 0x7fc7640cc400 2024-05-26T15:39:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.121+0000 7fc76b000640 1 -- 172.21.15.8:0/2112144477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 msgr2=0x7fc7640aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.121+0000 7fc76b000640 1 --2- 172.21.15.8:0/2112144477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 0x7fc7640aec70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc764158b00 tx=0x7fc75402a140 comp rx=0 tx=0).stop 2024-05-26T15:39:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.121+0000 7fc76b000640 1 -- 172.21.15.8:0/2112144477 shutdown_connections 2024-05-26T15:39:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.121+0000 7fc76b000640 1 --2- 172.21.15.8:0/2112144477 >> v2:172.21.15.47:3300/0 conn(0x7fc76415b4b0 0x7fc7640b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.121+0000 7fc76b000640 1 --2- 172.21.15.8:0/2112144477 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7640af1b0 0x7fc76415af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.121+0000 7fc76b000640 1 --2- 172.21.15.8:0/2112144477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 0x7fc7640aec70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.121+0000 7fc76b000640 1 -- 172.21.15.8:0/2112144477 >> 172.21.15.8:0/2112144477 conn(0x7fc76406a660 msgr2=0x7fc7640b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.121+0000 7fc76b000640 1 -- 172.21.15.8:0/2112144477 shutdown_connections 2024-05-26T15:39:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.121+0000 7fc76b000640 1 -- 172.21.15.8:0/2112144477 wait complete. 2024-05-26T15:39:33.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.123+0000 7fc76b000640 1 Processor -- start 2024-05-26T15:39:33.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.123+0000 7fc76b000640 1 -- start start 2024-05-26T15:39:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.124+0000 7fc76b000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 0x7fc76414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.124+0000 7fc76b000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc76415b4b0 0x7fc76414b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.124+0000 7fc76b000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7641f05d0 0x7fc76413e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.124+0000 7fc76b000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7641f0a80 con 0x7fc7640cc400 2024-05-26T15:39:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.124+0000 7fc76b000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76413e760 con 0x7fc76415b4b0 2024-05-26T15:39:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.124+0000 7fc76b000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76414e6a0 con 0x7fc7641f05d0 2024-05-26T15:39:33.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.124+0000 7fc763e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 0x7fc76414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.124+0000 7fc763e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 0x7fc76414e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48410/0 (socket says 172.21.15.8:48410) 2024-05-26T15:39:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.124+0000 7fc763e00640 1 -- 172.21.15.8:0/3242682549 learned_addr learned my addr 172.21.15.8:0/3242682549 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.125+0000 7fc75be00640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc76415b4b0 0x7fc76414b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.125+0000 7fc769000640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7641f05d0 0x7fc76413e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.125+0000 7fc763e00640 1 -- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7641f05d0 msgr2=0x7fc76413e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.125+0000 7fc763e00640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7641f05d0 0x7fc76413e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.125+0000 7fc763e00640 1 -- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc76415b4b0 msgr2=0x7fc76414b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.125+0000 7fc763e00640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc76415b4b0 0x7fc76414b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.125+0000 7fc763e00640 1 -- 172.21.15.8:0/3242682549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540094d0 con 0x7fc7640cc400 2024-05-26T15:39:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.125+0000 7fc769000640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7641f05d0 0x7fc76413e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.125+0000 7fc763e00640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 0x7fc76414e0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc75402a180 tx=0x7fc7540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.125+0000 7fc760c00640 1 -- 172.21.15.8:0/3242682549 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754030850 con 0x7fc7640cc400 2024-05-26T15:39:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.126+0000 7fc760c00640 1 -- 172.21.15.8:0/3242682549 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7540309b0 con 0x7fc7640cc400 2024-05-26T15:39:33.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.126+0000 7fc760c00640 1 -- 172.21.15.8:0/3242682549 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754030d60 con 0x7fc7640cc400 2024-05-26T15:39:33.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.126+0000 7fc76b000640 1 -- 172.21.15.8:0/3242682549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc764149660 con 0x7fc7640cc400 2024-05-26T15:39:33.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.126+0000 7fc76b000640 1 -- 172.21.15.8:0/3242682549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76414a090 con 0x7fc7640cc400 2024-05-26T15:39:33.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.127+0000 7fc76b000640 1 -- 172.21.15.8:0/3242682549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7640681d0 con 0x7fc7640cc400 2024-05-26T15:39:33.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.128+0000 7fc760c00640 1 -- 172.21.15.8:0/3242682549 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc754039040 con 0x7fc7640cc400 2024-05-26T15:39:33.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.129+0000 7fc760c00640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc74006ac00 0x7fc74006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:33.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.129+0000 7fc760c00640 1 -- 172.21.15.8:0/3242682549 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7540a9f90 con 0x7fc7640cc400 2024-05-26T15:39:33.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.130+0000 7fc75be00640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc74006ac00 0x7fc74006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:33.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.131+0000 7fc75be00640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc74006ac00 0x7fc74006d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7641495f0 tx=0x7fc74c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:33.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.134+0000 7fc760c00640 1 -- 172.21.15.8:0/3242682549 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc7540dd900 con 0x7fc7640cc400 2024-05-26T15:39:33.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.347+0000 7fc76b000640 1 -- 172.21.15.8:0/3242682549 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fc7640cdfb0 con 0x7fc7640cc400 2024-05-26T15:39:33.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.892+0000 7fc760c00640 1 -- 172.21.15.8:0/3242682549 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7fc7540750e0 con 0x7fc7640cc400 2024-05-26T15:39:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.896+0000 7fc76b000640 1 -- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc74006ac00 msgr2=0x7fc74006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.896+0000 7fc76b000640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc74006ac00 0x7fc74006d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7641495f0 tx=0x7fc74c008040 comp rx=0 tx=0).stop 2024-05-26T15:39:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.896+0000 7fc76b000640 1 -- 172.21.15.8:0/3242682549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 msgr2=0x7fc76414e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.896+0000 7fc76b000640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 0x7fc76414e0a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc75402a180 tx=0x7fc7540046c0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.896+0000 7fc76b000640 1 -- 172.21.15.8:0/3242682549 shutdown_connections 2024-05-26T15:39:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.896+0000 7fc76b000640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7641f05d0 0x7fc76413e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.896+0000 7fc76b000640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc74006ac00 0x7fc74006d0c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.896+0000 7fc76b000640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc76415b4b0 0x7fc76414b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.896+0000 7fc76b000640 1 --2- 172.21.15.8:0/3242682549 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7640cc400 0x7fc76414e0a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:33.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.896+0000 7fc76b000640 1 -- 172.21.15.8:0/3242682549 >> 172.21.15.8:0/3242682549 conn(0x7fc76406a660 msgr2=0x7fc7640caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:33.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.897+0000 7fc76b000640 1 -- 172.21.15.8:0/3242682549 shutdown_connections 2024-05-26T15:39:33.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:33.897+0000 7fc76b000640 1 -- 172.21.15.8:0/3242682549 wait complete. 2024-05-26T15:39:33.919 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-26T15:39:34.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.146+0000 7fc094c00640 1 Processor -- start 2024-05-26T15:39:34.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.147+0000 7fc094c00640 1 -- start start 2024-05-26T15:39:34.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.148+0000 7fc094c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc0900cdd70 0x7fc0900ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:34.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.148+0000 7fc094c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0900ce150 0x7fc09015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:34.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.148+0000 7fc094c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0900704d0 con 0x7fc09006c7d0 2024-05-26T15:39:34.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.148+0000 7fc094c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0900707b0 con 0x7fc0900ce150 2024-05-26T15:39:34.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.148+0000 7fc094c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09015b840 con 0x7fc0900cdd70 2024-05-26T15:39:34.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.148+0000 7fc087e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0900ce150 0x7fc09015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:34.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.149+0000 7fc087e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0900ce150 0x7fc09015afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48422/0 (socket says 172.21.15.8:48422) 2024-05-26T15:39:34.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.149+0000 7fc087e00640 1 -- 172.21.15.8:0/3242196411 learned_addr learned my addr 172.21.15.8:0/3242196411 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:34.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.149+0000 7fc087e00640 1 -- 172.21.15.8:0/3242196411 >> v2:172.21.15.47:3300/0 conn(0x7fc0900cdd70 msgr2=0x7fc0900ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:34.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.149+0000 7fc087e00640 1 --2- 172.21.15.8:0/3242196411 >> v2:172.21.15.47:3300/0 conn(0x7fc0900cdd70 0x7fc0900ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:34.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.149+0000 7fc087e00640 1 -- 172.21.15.8:0/3242196411 >> v1:172.21.15.47:6789/0 conn(0x7fc09006c7d0 legacy=0x7fc090070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:34.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.149+0000 7fc087e00640 1 -- 172.21.15.8:0/3242196411 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09015bb20 con 0x7fc0900ce150 2024-05-26T15:39:34.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.150+0000 7fc087e00640 1 --2- 172.21.15.8:0/3242196411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0900ce150 0x7fc09015afc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc09006acf0 tx=0x7fc07802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dac769c148e27e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:34.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.150+0000 7fc08ea00640 1 -- 172.21.15.8:0/3242196411 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078032440 con 0x7fc0900ce150 2024-05-26T15:39:34.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.150+0000 7fc08ea00640 1 -- 172.21.15.8:0/3242196411 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0780325a0 con 0x7fc0900ce150 2024-05-26T15:39:34.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.151+0000 7fc08ea00640 1 -- 172.21.15.8:0/3242196411 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078032930 con 0x7fc0900ce150 2024-05-26T15:39:34.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.151+0000 7fc094c00640 1 -- 172.21.15.8:0/3242196411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0900ce150 msgr2=0x7fc09015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:34.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.151+0000 7fc094c00640 1 --2- 172.21.15.8:0/3242196411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0900ce150 0x7fc09015afc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc09006acf0 tx=0x7fc07802a230 comp rx=0 tx=0).stop 2024-05-26T15:39:34.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.151+0000 7fc094c00640 1 -- 172.21.15.8:0/3242196411 shutdown_connections 2024-05-26T15:39:34.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.151+0000 7fc094c00640 1 --2- 172.21.15.8:0/3242196411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0900ce150 0x7fc09015afc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:34.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.151+0000 7fc094c00640 1 --2- 172.21.15.8:0/3242196411 >> v2:172.21.15.47:3300/0 conn(0x7fc0900cdd70 0x7fc0900ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:34.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.151+0000 7fc094c00640 1 -- 172.21.15.8:0/3242196411 >> 172.21.15.8:0/3242196411 conn(0x7fc090069e70 msgr2=0x7fc09006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:34.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.152+0000 7fc094c00640 1 -- 172.21.15.8:0/3242196411 shutdown_connections 2024-05-26T15:39:34.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.152+0000 7fc094c00640 1 -- 172.21.15.8:0/3242196411 wait complete. 2024-05-26T15:39:34.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.153+0000 7fc094c00640 1 Processor -- start 2024-05-26T15:39:34.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.153+0000 7fc094c00640 1 -- start start 2024-05-26T15:39:34.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.154+0000 7fc094c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc09006c7d0 0x7fc090150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:34.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.154+0000 7fc094c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0900cdd70 0x7fc09014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.154+0000 7fc094c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0900ce150 0x7fc090157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.154+0000 7fc094c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0901f3230 con 0x7fc09006c7d0 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.154+0000 7fc094c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0901f26b0 con 0x7fc0900cdd70 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.154+0000 7fc094c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0901f2990 con 0x7fc0900ce150 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.155+0000 7fc08f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc09006c7d0 0x7fc090150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.155+0000 7fc08f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc09006c7d0 0x7fc090150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48438/0 (socket says 172.21.15.8:48438) 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.155+0000 7fc08f400640 1 -- 172.21.15.8:0/996428376 learned_addr learned my addr 172.21.15.8:0/996428376 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.155+0000 7fc08fe00640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0900ce150 0x7fc090157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.155+0000 7fc087e00640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0900cdd70 0x7fc09014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.155+0000 7fc08f400640 1 -- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0900ce150 msgr2=0x7fc090157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.155+0000 7fc08f400640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0900ce150 0x7fc090157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.155+0000 7fc08f400640 1 -- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0900cdd70 msgr2=0x7fc09014b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:34.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.155+0000 7fc08f400640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0900cdd70 0x7fc09014b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:34.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.155+0000 7fc08f400640 1 -- 172.21.15.8:0/996428376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780094d0 con 0x7fc09006c7d0 2024-05-26T15:39:34.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.156+0000 7fc08f400640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc09006c7d0 0x7fc090150570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc08000b4a0 tx=0x7fc08000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:34.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.156+0000 7fc087400640 1 -- 172.21.15.8:0/996428376 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080010610 con 0x7fc09006c7d0 2024-05-26T15:39:34.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.156+0000 7fc087400640 1 -- 172.21.15.8:0/996428376 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc080010770 con 0x7fc09006c7d0 2024-05-26T15:39:34.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.156+0000 7fc087400640 1 -- 172.21.15.8:0/996428376 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080010b20 con 0x7fc09006c7d0 2024-05-26T15:39:34.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.156+0000 7fc094c00640 1 -- 172.21.15.8:0/996428376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0901f2c70 con 0x7fc09006c7d0 2024-05-26T15:39:34.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.156+0000 7fc094c00640 1 -- 172.21.15.8:0/996428376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09014b570 con 0x7fc09006c7d0 2024-05-26T15:39:34.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.157+0000 7fc094c00640 1 -- 172.21.15.8:0/996428376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09004e210 con 0x7fc09006c7d0 2024-05-26T15:39:34.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.158+0000 7fc087400640 1 -- 172.21.15.8:0/996428376 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc080010c80 con 0x7fc09006c7d0 2024-05-26T15:39:34.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.159+0000 7fc087400640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc06c06ac00 0x7fc06c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:34.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.159+0000 7fc087400640 1 -- 172.21.15.8:0/996428376 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fc080089080 con 0x7fc09006c7d0 2024-05-26T15:39:34.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.160+0000 7fc087e00640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc06c06ac00 0x7fc06c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:34.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.161+0000 7fc087e00640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc06c06ac00 0x7fc06c06d0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc078034000 tx=0x7fc07802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:34.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.164+0000 7fc087400640 1 -- 172.21.15.8:0/996428376 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc0800bc900 con 0x7fc09006c7d0 2024-05-26T15:39:34.277 INFO:tasks.ceph.mds.b.smithi047.stderr:2024-05-26T15:39:34.279+0000 7f0978600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-26T15:39:34.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:34.369+0000 7fc094c00640 1 -- 172.21.15.8:0/996428376 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc09006b4b0 con 0x7fc09006c7d0 2024-05-26T15:39:36.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.363+0000 7fc087400640 1 -- 172.21.15.8:0/996428376 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fc080014100 con 0x7fc09006c7d0 2024-05-26T15:39:36.386 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data_ec' created 2024-05-26T15:39:36.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.367+0000 7fc094c00640 1 -- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc06c06ac00 msgr2=0x7fc06c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:36.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.367+0000 7fc094c00640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc06c06ac00 0x7fc06c06d0c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc078034000 tx=0x7fc07802e000 comp rx=0 tx=0).stop 2024-05-26T15:39:36.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.367+0000 7fc094c00640 1 -- 172.21.15.8:0/996428376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc09006c7d0 msgr2=0x7fc090150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:36.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.367+0000 7fc094c00640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc09006c7d0 0x7fc090150570 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc08000b4a0 tx=0x7fc08000b960 comp rx=0 tx=0).stop 2024-05-26T15:39:36.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.368+0000 7fc094c00640 1 -- 172.21.15.8:0/996428376 shutdown_connections 2024-05-26T15:39:36.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.368+0000 7fc094c00640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0900ce150 0x7fc090157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:36.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.368+0000 7fc094c00640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc06c06ac00 0x7fc06c06d0c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:36.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.368+0000 7fc094c00640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0900cdd70 0x7fc09014b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:36.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.368+0000 7fc094c00640 1 --2- 172.21.15.8:0/996428376 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc09006c7d0 0x7fc090150570 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:36.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.368+0000 7fc094c00640 1 -- 172.21.15.8:0/996428376 >> 172.21.15.8:0/996428376 conn(0x7fc090069e70 msgr2=0x7fc09006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:36.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.368+0000 7fc094c00640 1 -- 172.21.15.8:0/996428376 shutdown_connections 2024-05-26T15:39:36.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.368+0000 7fc094c00640 1 -- 172.21.15.8:0/996428376 wait complete. 2024-05-26T15:39:36.398 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-26T15:39:36.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.590+0000 7f398be00640 1 Processor -- start 2024-05-26T15:39:36.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.590+0000 7f398be00640 1 -- start start 2024-05-26T15:39:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.592+0000 7f398be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c0b3430 0x7f398c06db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:36.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.592+0000 7f398be00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0b2030 con 0x7f398c06e040 2024-05-26T15:39:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.592+0000 7f398be00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0b1700 con 0x7f398c1594e0 2024-05-26T15:39:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.592+0000 7f398be00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0b19e0 con 0x7f398c0b3430 2024-05-26T15:39:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.592+0000 7f398b400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f398c06e040 0x7f398c0cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34102/0 (socket says 172.21.15.8:34102) 2024-05-26T15:39:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.592+0000 7f398b400640 1 -- 172.21.15.8:0/4168635172 learned_addr learned my addr 172.21.15.8:0/4168635172 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:36.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.592+0000 7f398a000640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c0b3430 0x7f398c06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477197789 0 0) 0x7f398c0b2030 con 0x7f398c06e040 2024-05-26T15:39:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3970005730 con 0x7f398c06e040 2024-05-26T15:39:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887948885 0 0) 0x7f398c0b1700 con 0x7f398c1594e0 2024-05-26T15:39:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c0b2030 con 0x7f398c1594e0 2024-05-26T15:39:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141705408 0 0) 0x7f3970005730 con 0x7f398c06e040 2024-05-26T15:39:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c0b3430 msgr2=0x7f398c06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c0b3430 0x7f398c06db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 >> v1:172.21.15.47:6789/0 conn(0x7f398c1594e0 legacy=0x7f398c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:36.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c0b1cc0 con 0x7f398c06e040 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f39840019f0 con 0x7f398c06e040 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 >> v1:172.21.15.8:6789/0 conn(0x7f398c06e040 legacy=0x7f398c0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c0b3430 0x7f3970005d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 0x7f39700069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3970006f10 0x7f3970007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0b19e0 con 0x7f39700062a0 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397000dc70 con 0x7f3970006f10 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.593+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397000de30 con 0x7f398c0b3430 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.594+0000 7f398a000640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 0x7f39700069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.594+0000 7f398aa00640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c0b3430 0x7f3970005d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:36.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.594+0000 7f398b400640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3970006f10 0x7f3970007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.594+0000 7f398a000640 1 -- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c0b3430 msgr2=0x7f3970005d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.594+0000 7f398a000640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c0b3430 0x7f3970005d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.594+0000 7f398a000640 1 -- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3970006f10 msgr2=0x7f3970007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.594+0000 7f398a000640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3970006f10 0x7f3970007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:36.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.594+0000 7f398a000640 1 -- 172.21.15.8:0/4168635172 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970005730 con 0x7f39700062a0 2024-05-26T15:39:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.596+0000 7f398a000640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 0x7f39700069d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3978009ac0 tx=0x7f3970007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1d813a99aaa5ad server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.596+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978031400 con 0x7f39700062a0 2024-05-26T15:39:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.596+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397802d050 con 0x7f39700062a0 2024-05-26T15:39:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.596+0000 7f3989600640 1 -- 172.21.15.8:0/4168635172 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3978031780 con 0x7f39700062a0 2024-05-26T15:39:36.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.596+0000 7f398be00640 1 -- 172.21.15.8:0/4168635172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 msgr2=0x7f39700069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.596+0000 7f398be00640 1 --2- 172.21.15.8:0/4168635172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 0x7f39700069d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3978009ac0 tx=0x7f3970007a00 comp rx=0 tx=0).stop 2024-05-26T15:39:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.596+0000 7f398b400640 1 -- 172.21.15.8:0/4168635172 reap_dead start 2024-05-26T15:39:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.596+0000 7f398be00640 1 -- 172.21.15.8:0/4168635172 shutdown_connections 2024-05-26T15:39:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.596+0000 7f398be00640 1 -- 172.21.15.8:0/4168635172 >> 172.21.15.8:0/4168635172 conn(0x7f398c069e70 msgr2=0x7f398c06a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.597+0000 7f398be00640 1 -- 172.21.15.8:0/4168635172 shutdown_connections 2024-05-26T15:39:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.597+0000 7f398be00640 1 -- 172.21.15.8:0/4168635172 wait complete. 2024-05-26T15:39:36.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.599+0000 7f398be00640 1 Processor -- start 2024-05-26T15:39:36.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.599+0000 7f398be00640 1 -- start start 2024-05-26T15:39:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.600+0000 7f398be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 0x7f398c1f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.600+0000 7f398be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c14c9c0 0x7f398c14aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.600+0000 7f398be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c14b410 0x7f398c0afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.600+0000 7f398be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c14c5a0 con 0x7f39700062a0 2024-05-26T15:39:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.600+0000 7f398be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c1448b0 con 0x7f398c14b410 2024-05-26T15:39:36.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.600+0000 7f398be00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c14ce40 con 0x7f398c14c9c0 2024-05-26T15:39:36.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.600+0000 7f398aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 0x7f398c1f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:36.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.600+0000 7f398aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 0x7f398c1f26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48448/0 (socket says 172.21.15.8:48448) 2024-05-26T15:39:36.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.600+0000 7f398aa00640 1 -- 172.21.15.8:0/4120007341 learned_addr learned my addr 172.21.15.8:0/4120007341 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:36.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.600+0000 7f398b400640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c14b410 0x7f398c0afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:36.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f398aa00640 1 -- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c14c9c0 msgr2=0x7f398c14aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:36.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f398a000640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c14c9c0 0x7f398c14aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:36.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f398aa00640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c14c9c0 0x7f398c14aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:36.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f398aa00640 1 -- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c14b410 msgr2=0x7f398c0afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:36.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f398aa00640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c14b410 0x7f398c0afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:36.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f398aa00640 1 -- 172.21.15.8:0/4120007341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c14b920 con 0x7f39700062a0 2024-05-26T15:39:36.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f398b400640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c14b410 0x7f398c0afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:36.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f398aa00640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 0x7f398c1f26c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f397c00f800 tx=0x7f397c00fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:36.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f3982a00640 1 -- 172.21.15.8:0/4120007341 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00feb0 con 0x7f39700062a0 2024-05-26T15:39:36.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f3982a00640 1 -- 172.21.15.8:0/4120007341 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c0052e0 con 0x7f39700062a0 2024-05-26T15:39:36.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f3982a00640 1 -- 172.21.15.8:0/4120007341 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00d930 con 0x7f39700062a0 2024-05-26T15:39:36.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.601+0000 7f398be00640 1 -- 172.21.15.8:0/4120007341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c14bc00 con 0x7f39700062a0 2024-05-26T15:39:36.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.602+0000 7f398be00640 1 -- 172.21.15.8:0/4120007341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c14c1c0 con 0x7f39700062a0 2024-05-26T15:39:36.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.603+0000 7f398be00640 1 -- 172.21.15.8:0/4120007341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c14c350 con 0x7f39700062a0 2024-05-26T15:39:36.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.604+0000 7f3982a00640 1 -- 172.21.15.8:0/4120007341 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f397c00da90 con 0x7f39700062a0 2024-05-26T15:39:36.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.605+0000 7f3982a00640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f396c06ac00 0x7f396c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:36.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.605+0000 7f3982a00640 1 -- 172.21.15.8:0/4120007341 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f397c089700 con 0x7f39700062a0 2024-05-26T15:39:36.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.606+0000 7f398a000640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f396c06ac00 0x7f396c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:36.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.607+0000 7f398a000640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f396c06ac00 0x7f396c06d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3978033000 tx=0x7f3978008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:36.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.611+0000 7f3982a00640 1 -- 172.21.15.8:0/4120007341 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f397c054570 con 0x7f39700062a0 2024-05-26T15:39:36.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:36.807+0000 7f398be00640 1 -- 172.21.15.8:0/4120007341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f398c06db00 con 0x7f39700062a0 2024-05-26T15:39:37.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.374+0000 7f3982a00640 1 -- 172.21.15.8:0/4120007341 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f397c057b90 con 0x7f39700062a0 2024-05-26T15:39:37.376 INFO:teuthology.orchestra.run.smithi008.stderr:set pool 4 allow_ec_overwrites to true 2024-05-26T15:39:37.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.380+0000 7f398be00640 1 -- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f396c06ac00 msgr2=0x7f396c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:37.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.380+0000 7f398be00640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f396c06ac00 0x7f396c06d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3978033000 tx=0x7f3978008030 comp rx=0 tx=0).stop 2024-05-26T15:39:37.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.380+0000 7f398be00640 1 -- 172.21.15.8:0/4120007341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 msgr2=0x7f398c1f26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:37.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.380+0000 7f398be00640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 0x7f398c1f26c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f397c00f800 tx=0x7f397c00fcc0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.381+0000 7f398be00640 1 -- 172.21.15.8:0/4120007341 shutdown_connections 2024-05-26T15:39:37.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.381+0000 7f398be00640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f396c06ac00 0x7f396c06d0c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.381+0000 7f398be00640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f398c14b410 0x7f398c0afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.381+0000 7f398be00640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f398c14c9c0 0x7f398c14aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.381+0000 7f398be00640 1 --2- 172.21.15.8:0/4120007341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f39700062a0 0x7f398c1f26c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.382+0000 7f398be00640 1 -- 172.21.15.8:0/4120007341 >> 172.21.15.8:0/4120007341 conn(0x7f398c069e70 msgr2=0x7f398c15a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:37.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.383+0000 7f398be00640 1 -- 172.21.15.8:0/4120007341 shutdown_connections 2024-05-26T15:39:37.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.383+0000 7f398be00640 1 -- 172.21.15.8:0/4120007341 wait complete. 2024-05-26T15:39:37.423 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-26T15:39:37.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.607+0000 7fe442e00640 1 Processor -- start 2024-05-26T15:39:37.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.607+0000 7fe442e00640 1 -- start start 2024-05-26T15:39:37.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.608+0000 7fe442e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43c0b05e0 0x7fe43c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:37.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.608+0000 7fe442e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe43c0ca200 0x7fe43c0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:37.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.609+0000 7fe442e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43c0b0f00 con 0x7fe43c0caba0 2024-05-26T15:39:37.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.609+0000 7fe442e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43c0c9db0 con 0x7fe43c0ca200 2024-05-26T15:39:37.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.609+0000 7fe442e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c06a010 con 0x7fe43c0b05e0 2024-05-26T15:39:37.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.609+0000 7fe440e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe43c0caba0 0x7fe43c0cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34104/0 (socket says 172.21.15.8:34104) 2024-05-26T15:39:37.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.609+0000 7fe440e00640 1 -- 172.21.15.8:0/3729089489 learned_addr learned my addr 172.21.15.8:0/3729089489 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:37.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.609+0000 7fe43b400640 1 --2- 172.21.15.8:0/3729089489 >> v2:172.21.15.47:3300/0 conn(0x7fe43c0ca200 0x7fe43c0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:37.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.609+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166111446 0 0) 0x7fe43c0b0f00 con 0x7fe43c0caba0 2024-05-26T15:39:37.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.609+0000 7fe43be00640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43c0b05e0 0x7fe43c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:37.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.609+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe420003520 con 0x7fe43c0caba0 2024-05-26T15:39:37.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2775272050 0 0) 0x7fe420003520 con 0x7fe43c0caba0 2024-05-26T15:39:37.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43c0b05e0 msgr2=0x7fe43c0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:37.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43c0b05e0 0x7fe43c0b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 >> v2:172.21.15.47:3300/0 conn(0x7fe43c0ca200 msgr2=0x7fe43c0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:37.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 --2- 172.21.15.8:0/3729089489 >> v2:172.21.15.47:3300/0 conn(0x7fe43c0ca200 0x7fe43c0ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c06a2f0 con 0x7fe43c0caba0 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fe4340019f0 con 0x7fe43c0caba0 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 >> v1:172.21.15.8:6789/0 conn(0x7fe43c0caba0 legacy=0x7fe43c0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43c0b05e0 0x7fe4200039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe420004010 0x7fe4200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe420004d00 0x7fe420005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0c9db0 con 0x7fe420004010 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c06a010 con 0x7fe420004d00 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42000bb10 con 0x7fe43c0b05e0 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43b400640 1 --2- 172.21.15.8:0/3729089489 >> v2:172.21.15.47:3300/0 conn(0x7fe43c0ca200 0x7fe43c0ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43b400640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe420004010 0x7fe4200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:37.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.610+0000 7fe43be00640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43c0b05e0 0x7fe4200039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:37.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.611+0000 7fe440e00640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe420004d00 0x7fe420005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:37.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.611+0000 7fe43b400640 1 -- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43c0b05e0 msgr2=0x7fe4200039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:37.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.611+0000 7fe43b400640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe43c0b05e0 0x7fe4200039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.611+0000 7fe43b400640 1 -- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe420004d00 msgr2=0x7fe420005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:37.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.611+0000 7fe43b400640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe420004d00 0x7fe420005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.611+0000 7fe43b400640 1 -- 172.21.15.8:0/3729089489 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420003520 con 0x7fe420004010 2024-05-26T15:39:37.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.611+0000 7fe440e00640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe420004d00 0x7fe420005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:37.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.612+0000 7fe43b400640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe420004010 0x7fe4200047c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe428006fd0 tx=0x7fe4200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a359d67a331d76 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:37.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.612+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42802ad00 con 0x7fe420004010 2024-05-26T15:39:37.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.612+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42802ae60 con 0x7fe420004010 2024-05-26T15:39:37.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.612+0000 7fe43aa00640 1 -- 172.21.15.8:0/3729089489 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428032640 con 0x7fe420004010 2024-05-26T15:39:37.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.613+0000 7fe442e00640 1 -- 172.21.15.8:0/3729089489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe420004010 msgr2=0x7fe4200047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.613+0000 7fe442e00640 1 --2- 172.21.15.8:0/3729089489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe420004010 0x7fe4200047c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe428006fd0 tx=0x7fe4200057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.613+0000 7fe440e00640 1 -- 172.21.15.8:0/3729089489 reap_dead start 2024-05-26T15:39:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.613+0000 7fe442e00640 1 -- 172.21.15.8:0/3729089489 shutdown_connections 2024-05-26T15:39:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.613+0000 7fe442e00640 1 -- 172.21.15.8:0/3729089489 >> 172.21.15.8:0/3729089489 conn(0x7fe43c0b1330 msgr2=0x7fe43c0b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.613+0000 7fe442e00640 1 -- 172.21.15.8:0/3729089489 shutdown_connections 2024-05-26T15:39:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.613+0000 7fe442e00640 1 -- 172.21.15.8:0/3729089489 wait complete. 2024-05-26T15:39:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.615+0000 7fe442e00640 1 Processor -- start 2024-05-26T15:39:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.615+0000 7fe442e00640 1 -- start start 2024-05-26T15:39:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.616+0000 7fe442e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe420004010 0x7fe43c0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:37.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.616+0000 7fe442e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe43c0aef30 0x7fe43c0b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.616+0000 7fe442e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43c1580a0 0x7fe43c0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.616+0000 7fe442e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0c75a0 con 0x7fe43c0aef30 2024-05-26T15:39:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.616+0000 7fe442e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0b4ae0 con 0x7fe43c1580a0 2024-05-26T15:39:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.616+0000 7fe442e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0ac6b0 con 0x7fe420004010 2024-05-26T15:39:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.616+0000 7fe43b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe43c0aef30 0x7fe43c0b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.616+0000 7fe43b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe43c0aef30 0x7fe43c0b45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48470/0 (socket says 172.21.15.8:48470) 2024-05-26T15:39:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.616+0000 7fe43b400640 1 -- 172.21.15.8:0/1064887725 learned_addr learned my addr 172.21.15.8:0/1064887725 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:37.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.616+0000 7fe440e00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43c1580a0 0x7fe43c0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe43be00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe420004010 0x7fe43c0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe43b400640 1 -- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe420004010 msgr2=0x7fe43c0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe43b400640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe420004010 0x7fe43c0c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe43b400640 1 -- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43c1580a0 msgr2=0x7fe43c0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe43b400640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43c1580a0 0x7fe43c0b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe43b400640 1 -- 172.21.15.8:0/1064887725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c0ac990 con 0x7fe43c0aef30 2024-05-26T15:39:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe43b400640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe43c0aef30 0x7fe43c0b45a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe4280097f0 tx=0x7fe428004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe433e00640 1 -- 172.21.15.8:0/1064887725 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42803b600 con 0x7fe43c0aef30 2024-05-26T15:39:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe433e00640 1 -- 172.21.15.8:0/1064887725 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42803b760 con 0x7fe43c0aef30 2024-05-26T15:39:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe433e00640 1 -- 172.21.15.8:0/1064887725 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42803baf0 con 0x7fe43c0aef30 2024-05-26T15:39:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.617+0000 7fe442e00640 1 -- 172.21.15.8:0/1064887725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c0acc70 con 0x7fe43c0aef30 2024-05-26T15:39:37.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.618+0000 7fe442e00640 1 -- 172.21.15.8:0/1064887725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c0af4f0 con 0x7fe43c0aef30 2024-05-26T15:39:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.619+0000 7fe442e00640 1 -- 172.21.15.8:0/1064887725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c0b0eb0 con 0x7fe43c0aef30 2024-05-26T15:39:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.620+0000 7fe433e00640 1 -- 172.21.15.8:0/1064887725 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe428039040 con 0x7fe43c0aef30 2024-05-26T15:39:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.620+0000 7fe433e00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe41c06ac30 0x7fe41c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:37.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.621+0000 7fe433e00640 1 -- 172.21.15.8:0/1064887725 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fe4280a97b0 con 0x7fe43c0aef30 2024-05-26T15:39:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.621+0000 7fe43be00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe41c06ac30 0x7fe41c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.622+0000 7fe43be00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe41c06ac30 0x7fe41c06d0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe42c006fd0 tx=0x7fe42c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:37.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.625+0000 7fe433e00640 1 -- 172.21.15.8:0/1064887725 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe428074770 con 0x7fe43c0aef30 2024-05-26T15:39:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.868+0000 7fe442e00640 1 -- 172.21.15.8:0/1064887725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fe43c0c75a0 con 0x7fe43c0aef30 2024-05-26T15:39:37.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.877+0000 7fe433e00640 1 -- 172.21.15.8:0/1064887725 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7fe42804b0b0 con 0x7fe43c0aef30 2024-05-26T15:39:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:added data pool 4 to fsmap 2024-05-26T15:39:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 -- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe41c06ac30 msgr2=0x7fe41c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe41c06ac30 0x7fe41c06d0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe42c006fd0 tx=0x7fe42c008040 comp rx=0 tx=0).stop 2024-05-26T15:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 -- 172.21.15.8:0/1064887725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe43c0aef30 msgr2=0x7fe43c0b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe43c0aef30 0x7fe43c0b45a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe4280097f0 tx=0x7fe428004730 comp rx=0 tx=0).stop 2024-05-26T15:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 -- 172.21.15.8:0/1064887725 shutdown_connections 2024-05-26T15:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe41c06ac30 0x7fe41c06d0f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe43c1580a0 0x7fe43c0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe43c0aef30 0x7fe43c0b45a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 --2- 172.21.15.8:0/1064887725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe420004010 0x7fe43c0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 -- 172.21.15.8:0/1064887725 >> 172.21.15.8:0/1064887725 conn(0x7fe43c0b1330 msgr2=0x7fe43c0ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 -- 172.21.15.8:0/1064887725 shutdown_connections 2024-05-26T15:39:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:37.880+0000 7fe442e00640 1 -- 172.21.15.8:0/1064887725 wait complete. 2024-05-26T15:39:37.896 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:39:38.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.101+0000 7ffb84a00640 1 Processor -- start 2024-05-26T15:39:38.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.101+0000 7ffb84a00640 1 -- start start 2024-05-26T15:39:38.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.103+0000 7ffb84a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffb80154f50 0x7ffb800b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.103+0000 7ffb84a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb800c36c0 0x7ffb800c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.103+0000 7ffb84a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8015b640 con 0x7ffb8015ae70 2024-05-26T15:39:38.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.103+0000 7ffb84a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8015bee0 con 0x7ffb80154f50 2024-05-26T15:39:38.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.103+0000 7ffb84a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800b0ba0 con 0x7ffb800c36c0 2024-05-26T15:39:38.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.103+0000 7ffb7f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffb80154f50 0x7ffb800b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.103+0000 7ffb7f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffb80154f50 0x7ffb800b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48472/0 (socket says 172.21.15.8:48472) 2024-05-26T15:39:38.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.103+0000 7ffb7f400640 1 -- 172.21.15.8:0/994965728 learned_addr learned my addr 172.21.15.8:0/994965728 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:38.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.104+0000 7ffb7f400640 1 -- 172.21.15.8:0/994965728 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb800c36c0 msgr2=0x7ffb800c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:38.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.104+0000 7ffb7fe00640 1 --2- 172.21.15.8:0/994965728 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb800c36c0 0x7ffb800c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.104+0000 7ffb7f400640 1 --2- 172.21.15.8:0/994965728 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb800c36c0 0x7ffb800c3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.104+0000 7ffb7f400640 1 -- 172.21.15.8:0/994965728 >> v1:172.21.15.47:6789/0 conn(0x7ffb8015ae70 legacy=0x7ffb8015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:38.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.104+0000 7ffb7f400640 1 -- 172.21.15.8:0/994965728 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8015b920 con 0x7ffb80154f50 2024-05-26T15:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.105+0000 7ffb7f400640 1 --2- 172.21.15.8:0/994965728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb80154f50 0x7ffb800b0f60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb700098a0 tx=0x7ffb7002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96709634196a6ce3 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.105+0000 7ffb7e000640 1 -- 172.21.15.8:0/994965728 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70032440 con 0x7ffb80154f50 2024-05-26T15:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.105+0000 7ffb7e000640 1 -- 172.21.15.8:0/994965728 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb700325a0 con 0x7ffb80154f50 2024-05-26T15:39:38.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.105+0000 7ffb7e000640 1 -- 172.21.15.8:0/994965728 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70032930 con 0x7ffb80154f50 2024-05-26T15:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.106+0000 7ffb84a00640 1 -- 172.21.15.8:0/994965728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb80154f50 msgr2=0x7ffb800b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.106+0000 7ffb84a00640 1 --2- 172.21.15.8:0/994965728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb80154f50 0x7ffb800b0f60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ffb700098a0 tx=0x7ffb7002a250 comp rx=0 tx=0).stop 2024-05-26T15:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.106+0000 7ffb84a00640 1 -- 172.21.15.8:0/994965728 shutdown_connections 2024-05-26T15:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.106+0000 7ffb84a00640 1 --2- 172.21.15.8:0/994965728 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb800c36c0 0x7ffb800c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.106+0000 7ffb84a00640 1 --2- 172.21.15.8:0/994965728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb80154f50 0x7ffb800b0f60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.106+0000 7ffb84a00640 1 -- 172.21.15.8:0/994965728 >> 172.21.15.8:0/994965728 conn(0x7ffb80070480 msgr2=0x7ffb80070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.106+0000 7ffb84a00640 1 -- 172.21.15.8:0/994965728 shutdown_connections 2024-05-26T15:39:38.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.106+0000 7ffb84a00640 1 -- 172.21.15.8:0/994965728 wait complete. 2024-05-26T15:39:38.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.108+0000 7ffb84a00640 1 Processor -- start 2024-05-26T15:39:38.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.109+0000 7ffb84a00640 1 -- start start 2024-05-26T15:39:38.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.110+0000 7ffb84a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb800c36c0 0x7ffb80144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.110+0000 7ffb84a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb80154f50 0x7ffb800cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.110+0000 7ffb84a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8015ae70 0x7ffb800c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.110+0000 7ffb84a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800cc540 con 0x7ffb8015ae70 2024-05-26T15:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.110+0000 7ffb84a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800cb610 con 0x7ffb800c36c0 2024-05-26T15:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.110+0000 7ffb84a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800cb8f0 con 0x7ffb80154f50 2024-05-26T15:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.110+0000 7ffb7fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8015ae70 0x7ffb800c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.110+0000 7ffb7fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8015ae70 0x7ffb800c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48478/0 (socket says 172.21.15.8:48478) 2024-05-26T15:39:38.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.110+0000 7ffb7fe00640 1 -- 172.21.15.8:0/1348718684 learned_addr learned my addr 172.21.15.8:0/1348718684 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:38.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb7f400640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb800c36c0 0x7ffb80144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb7ea00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb80154f50 0x7ffb800cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb7fe00640 1 -- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb80154f50 msgr2=0x7ffb800cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb7fe00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb80154f50 0x7ffb800cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb7fe00640 1 -- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb800c36c0 msgr2=0x7ffb80144e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb7fe00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb800c36c0 0x7ffb80144e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb7fe00640 1 -- 172.21.15.8:0/1348718684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700094d0 con 0x7ffb8015ae70 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb7ea00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb80154f50 0x7ffb800cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb7fe00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8015ae70 0x7ffb800c8d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800cc30 tx=0x7ffb7800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb77400640 1 -- 172.21.15.8:0/1348718684 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800ce40 con 0x7ffb8015ae70 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb77400640 1 -- 172.21.15.8:0/1348718684 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb78003990 con 0x7ffb8015ae70 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb77400640 1 -- 172.21.15.8:0/1348718684 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb78003d20 con 0x7ffb8015ae70 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.111+0000 7ffb84a00640 1 -- 172.21.15.8:0/1348718684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb800cbbd0 con 0x7ffb8015ae70 2024-05-26T15:39:38.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.112+0000 7ffb84a00640 1 -- 172.21.15.8:0/1348718684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb801453c0 con 0x7ffb8015ae70 2024-05-26T15:39:38.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.113+0000 7ffb84a00640 1 -- 172.21.15.8:0/1348718684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8015b300 con 0x7ffb8015ae70 2024-05-26T15:39:38.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.114+0000 7ffb77400640 1 -- 172.21.15.8:0/1348718684 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffb78003e80 con 0x7ffb8015ae70 2024-05-26T15:39:38.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.114+0000 7ffb77400640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffb6006ac00 0x7ffb6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.115+0000 7ffb77400640 1 -- 172.21.15.8:0/1348718684 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffb780899e0 con 0x7ffb8015ae70 2024-05-26T15:39:38.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.115+0000 7ffb7f400640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffb6006ac00 0x7ffb6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.116+0000 7ffb7f400640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffb6006ac00 0x7ffb6006d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb70034000 tx=0x7ffb7002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:38.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.119+0000 7ffb77400640 1 -- 172.21.15.8:0/1348718684 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ffb8015b300 con 0x7ffb8015ae70 2024-05-26T15:39:38.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.359+0000 7ffb84a00640 1 -- 172.21.15.8:0/1348718684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb800cc680 con 0x7ffb8015ae70 2024-05-26T15:39:38.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.360+0000 7ffb77400640 1 -- 172.21.15.8:0/1348718684 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4718 (secure 0 0 0) 0x7ffb800cc680 con 0x7ffb8015ae70 2024-05-26T15:39:38.359 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:38.359 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:39:32.881224+0000","modified":"2024-05-26T15:39:37.870016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-26T15:39:38.359 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 6 2024-05-26T15:39:38.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.363+0000 7ffb84a00640 1 -- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffb6006ac00 msgr2=0x7ffb6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.363+0000 7ffb84a00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffb6006ac00 0x7ffb6006d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb70034000 tx=0x7ffb7002e000 comp rx=0 tx=0).stop 2024-05-26T15:39:38.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.363+0000 7ffb84a00640 1 -- 172.21.15.8:0/1348718684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8015ae70 msgr2=0x7ffb800c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.363+0000 7ffb84a00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8015ae70 0x7ffb800c8d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800cc30 tx=0x7ffb7800a5c0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.363+0000 7ffb84a00640 1 -- 172.21.15.8:0/1348718684 shutdown_connections 2024-05-26T15:39:38.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.363+0000 7ffb84a00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffb8015ae70 0x7ffb800c8d50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.363+0000 7ffb84a00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffb80154f50 0x7ffb800cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.363+0000 7ffb84a00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffb6006ac00 0x7ffb6006d0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.363+0000 7ffb84a00640 1 --2- 172.21.15.8:0/1348718684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb800c36c0 0x7ffb80144e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.363+0000 7ffb84a00640 1 -- 172.21.15.8:0/1348718684 >> 172.21.15.8:0/1348718684 conn(0x7ffb80070480 msgr2=0x7ffb800b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:38.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.364+0000 7ffb84a00640 1 -- 172.21.15.8:0/1348718684 shutdown_connections 2024-05-26T15:39:38.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.364+0000 7ffb84a00640 1 -- 172.21.15.8:0/1348718684 wait complete. 2024-05-26T15:39:38.383 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.588+0000 7f2654a00640 1 Processor -- start 2024-05-26T15:39:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.589+0000 7f2654a00640 1 -- start start 2024-05-26T15:39:38.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.590+0000 7f2654a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f26500cbe30 0x7f265015db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.590+0000 7f2654a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26501608c0 con 0x7f265015a5e0 2024-05-26T15:39:38.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.590+0000 7f2654a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2650160ba0 con 0x7f265006f100 2024-05-26T15:39:38.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.590+0000 7f2654a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2650161260 con 0x7f26500cbe30 2024-05-26T15:39:38.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.590+0000 7f264e800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f265015a5e0 0x7f265006e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34106/0 (socket says 172.21.15.8:34106) 2024-05-26T15:39:38.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.590+0000 7f264e800640 1 -- 172.21.15.8:0/1321919035 learned_addr learned my addr 172.21.15.8:0/1321919035 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.591+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690144261 0 0) 0x7f26501608c0 con 0x7f265015a5e0 2024-05-26T15:39:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.591+0000 7f264f200640 1 --2- 172.21.15.8:0/1321919035 >> v2:172.21.15.47:3300/0 conn(0x7f26500cbe30 0x7f265015db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.591+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2634003520 con 0x7f265015a5e0 2024-05-26T15:39:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.591+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2856607271 0 0) 0x7f2634003520 con 0x7f265015a5e0 2024-05-26T15:39:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.591+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 >> v2:172.21.15.47:3300/0 conn(0x7f26500cbe30 msgr2=0x7f265015db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.591+0000 7f264de00640 1 --2- 172.21.15.8:0/1321919035 >> v2:172.21.15.47:3300/0 conn(0x7f26500cbe30 0x7f265015db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.591+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 >> v1:172.21.15.47:6789/0 conn(0x7f265006f100 legacy=0x7f265015d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.591+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2650160e80 con 0x7f265015a5e0 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.591+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f26400019f0 con 0x7f265015a5e0 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 >> v1:172.21.15.8:6789/0 conn(0x7f265015a5e0 legacy=0x7f265006e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264de00640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26340039c0 0x7f2634003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264de00640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26340047c0 0x7f2634004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264de00640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2634005180 0x7f263400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2650161260 con 0x7f26340039c0 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263400c080 con 0x7f26340047c0 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263400c240 con 0x7f2634005180 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264e800640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26340039c0 0x7f2634003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f2645e00640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26340047c0 0x7f2634004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264f200640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2634005180 0x7f263400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264e800640 1 -- 172.21.15.8:0/1321919035 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2634005180 msgr2=0x7f263400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264e800640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2634005180 0x7f263400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264e800640 1 -- 172.21.15.8:0/1321919035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26340047c0 msgr2=0x7f2634004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264e800640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26340047c0 0x7f2634004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264e800640 1 -- 172.21.15.8:0/1321919035 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2634003520 con 0x7f26340039c0 2024-05-26T15:39:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.592+0000 7f264f200640 1 -- 172.21.15.8:0/1321919035 reap_dead start 2024-05-26T15:39:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.594+0000 7f264e800640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26340039c0 0x7f2634003de0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f26400013d0 tx=0x7f26340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa14e005d8d89dc server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.594+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264002b8f0 con 0x7f26340039c0 2024-05-26T15:39:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.594+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264002ba50 con 0x7f26340039c0 2024-05-26T15:39:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.594+0000 7f264de00640 1 -- 172.21.15.8:0/1321919035 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264002be40 con 0x7f26340039c0 2024-05-26T15:39:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.594+0000 7f2654a00640 1 -- 172.21.15.8:0/1321919035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26340039c0 msgr2=0x7f2634003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.594+0000 7f2654a00640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26340039c0 0x7f2634003de0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f26400013d0 tx=0x7f26340057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.595+0000 7f2654a00640 1 -- 172.21.15.8:0/1321919035 shutdown_connections 2024-05-26T15:39:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.595+0000 7f2654a00640 1 --2- 172.21.15.8:0/1321919035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26340039c0 0x7f2634003de0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.595+0000 7f2654a00640 1 -- 172.21.15.8:0/1321919035 >> 172.21.15.8:0/1321919035 conn(0x7f265006a050 msgr2=0x7f265006a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.595+0000 7f2654a00640 1 -- 172.21.15.8:0/1321919035 shutdown_connections 2024-05-26T15:39:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.595+0000 7f2654a00640 1 -- 172.21.15.8:0/1321919035 wait complete. 2024-05-26T15:39:38.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.597+0000 7f2654a00640 1 Processor -- start 2024-05-26T15:39:38.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.597+0000 7f2654a00640 1 -- start start 2024-05-26T15:39:38.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f2654a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26340039c0 0x7f2650157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f2654a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26500b3360 0x7f26500b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f2654a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26500b0150 0x7f26500b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f2654a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26500b3d00 con 0x7f26500b0150 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f2654a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2650147a50 con 0x7f26500b3360 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f2654a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26500b1a40 con 0x7f26340039c0 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f264f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26500b0150 0x7f26500b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f264f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26500b0150 0x7f26500b05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48506/0 (socket says 172.21.15.8:48506) 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f264f200640 1 -- 172.21.15.8:0/3915486484 learned_addr learned my addr 172.21.15.8:0/3915486484 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f2645e00640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26500b3360 0x7f26500b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f264e800640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26340039c0 0x7f2650157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f264f200640 1 -- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26340039c0 msgr2=0x7f2650157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f264f200640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26340039c0 0x7f2650157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f264f200640 1 -- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26500b3360 msgr2=0x7f26500b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f264f200640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26500b3360 0x7f26500b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.598+0000 7f264f200640 1 -- 172.21.15.8:0/3915486484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26500b0ec0 con 0x7f26500b0150 2024-05-26T15:39:38.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.599+0000 7f264f200640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26500b0150 0x7f26500b05d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f26501605f0 tx=0x7f2648010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:38.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.599+0000 7f2647400640 1 -- 172.21.15.8:0/3915486484 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264800e870 con 0x7f26500b0150 2024-05-26T15:39:38.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.599+0000 7f2647400640 1 -- 172.21.15.8:0/3915486484 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264800e9f0 con 0x7f26500b0150 2024-05-26T15:39:38.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.599+0000 7f2647400640 1 -- 172.21.15.8:0/3915486484 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264800eda0 con 0x7f26500b0150 2024-05-26T15:39:38.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.599+0000 7f2654a00640 1 -- 172.21.15.8:0/3915486484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26500b11a0 con 0x7f26500b0150 2024-05-26T15:39:38.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.599+0000 7f2654a00640 1 -- 172.21.15.8:0/3915486484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26500b1760 con 0x7f26500b0150 2024-05-26T15:39:38.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.601+0000 7f2654a00640 1 -- 172.21.15.8:0/3915486484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265004e280 con 0x7f26500b0150 2024-05-26T15:39:38.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.601+0000 7f2647400640 1 -- 172.21.15.8:0/3915486484 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2648021460 con 0x7f26500b0150 2024-05-26T15:39:38.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.602+0000 7f2647400640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f262c06ac00 0x7f262c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:38.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.602+0000 7f2647400640 1 -- 172.21.15.8:0/3915486484 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2648089540 con 0x7f26500b0150 2024-05-26T15:39:38.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.603+0000 7f264e800640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f262c06ac00 0x7f262c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:38.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.604+0000 7f264e800640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f262c06ac00 0x7f262c06d0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2640033000 tx=0x7f2640007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:38.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.607+0000 7f2647400640 1 -- 172.21.15.8:0/3915486484 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2648054430 con 0x7f26500b0150 2024-05-26T15:39:38.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.806+0000 7f2654a00640 1 -- 172.21.15.8:0/3915486484 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26500cf1c0 con 0x7f26500b0150 2024-05-26T15:39:38.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.810+0000 7f2647400640 1 -- 172.21.15.8:0/3915486484 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7f2648000e60 con 0x7f26500b0150 2024-05-26T15:39:38.809 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:38.809 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:38.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 -- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f262c06ac00 msgr2=0x7f262c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f262c06ac00 0x7f262c06d0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2640033000 tx=0x7f2640007000 comp rx=0 tx=0).stop 2024-05-26T15:39:38.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 -- 172.21.15.8:0/3915486484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26500b0150 msgr2=0x7f26500b05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26500b0150 0x7f26500b05d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f26501605f0 tx=0x7f2648010c20 comp rx=0 tx=0).stop 2024-05-26T15:39:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 -- 172.21.15.8:0/3915486484 shutdown_connections 2024-05-26T15:39:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26500b0150 0x7f26500b05d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f262c06ac00 0x7f262c06d0c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26500b3360 0x7f26500b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 --2- 172.21.15.8:0/3915486484 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26340039c0 0x7f2650157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 -- 172.21.15.8:0/3915486484 >> 172.21.15.8:0/3915486484 conn(0x7f265006a050 msgr2=0x7f265015d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 -- 172.21.15.8:0/3915486484 shutdown_connections 2024-05-26T15:39:38.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:38.813+0000 7f2654a00640 1 -- 172.21.15.8:0/3915486484 wait complete. 2024-05-26T15:39:38.830 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:39.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.041+0000 7f597b200640 1 Processor -- start 2024-05-26T15:39:39.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.041+0000 7f597b200640 1 -- start start 2024-05-26T15:39:39.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.043+0000 7f597b200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f597c1585c0 0x7f597c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.043+0000 7f597b200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c15be30 con 0x7f597c0b5ff0 2024-05-26T15:39:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.043+0000 7f597b200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c15b360 con 0x7f597c06f130 2024-05-26T15:39:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.043+0000 7f597b200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c15b590 con 0x7f597c1585c0 2024-05-26T15:39:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.043+0000 7f5979e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f597c1585c0 0x7f597c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.043+0000 7f5979400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f597c0b5ff0 0x7f597c06ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34110/0 (socket says 172.21.15.8:34110) 2024-05-26T15:39:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.043+0000 7f5979400640 1 -- 172.21.15.8:0/3956368263 learned_addr learned my addr 172.21.15.8:0/3956368263 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.044+0000 7f5978a00640 1 -- 172.21.15.8:0/3956368263 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147032878 0 0) 0x7f597c15be30 con 0x7f597c0b5ff0 2024-05-26T15:39:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.044+0000 7f5978a00640 1 -- 172.21.15.8:0/3956368263 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5960003520 con 0x7f597c0b5ff0 2024-05-26T15:39:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.044+0000 7f5979e00640 1 -- 172.21.15.8:0/3956368263 >> v1:172.21.15.47:6789/0 conn(0x7f597c06f130 legacy=0x7f597c15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.044+0000 7f5979e00640 1 -- 172.21.15.8:0/3956368263 >> v1:172.21.15.8:6789/0 conn(0x7f597c0b5ff0 legacy=0x7f597c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.044+0000 7f5979e00640 1 -- 172.21.15.8:0/3956368263 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c15b870 con 0x7f597c1585c0 2024-05-26T15:39:39.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.045+0000 7f5979e00640 1 --2- 172.21.15.8:0/3956368263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 0x7f597c15ae20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f596c0097a0 tx=0x7f596c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2ac763f2668089 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:39.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.045+0000 7f5978a00640 1 -- 172.21.15.8:0/3956368263 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c032440 con 0x7f597c1585c0 2024-05-26T15:39:39.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.045+0000 7f5978a00640 1 -- 172.21.15.8:0/3956368263 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c0325a0 con 0x7f597c1585c0 2024-05-26T15:39:39.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.045+0000 7f5978a00640 1 -- 172.21.15.8:0/3956368263 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c032930 con 0x7f597c1585c0 2024-05-26T15:39:39.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.046+0000 7f597b200640 1 -- 172.21.15.8:0/3956368263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 msgr2=0x7f597c15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.046+0000 7f597b200640 1 --2- 172.21.15.8:0/3956368263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 0x7f597c15ae20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f596c0097a0 tx=0x7f596c02a1a0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.046+0000 7f597b200640 1 -- 172.21.15.8:0/3956368263 shutdown_connections 2024-05-26T15:39:39.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.046+0000 7f597b200640 1 --2- 172.21.15.8:0/3956368263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 0x7f597c15ae20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.046+0000 7f597b200640 1 -- 172.21.15.8:0/3956368263 >> 172.21.15.8:0/3956368263 conn(0x7f597c06a050 msgr2=0x7f597c06a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:39.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.046+0000 7f597b200640 1 -- 172.21.15.8:0/3956368263 shutdown_connections 2024-05-26T15:39:39.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.046+0000 7f597b200640 1 -- 172.21.15.8:0/3956368263 wait complete. 2024-05-26T15:39:39.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.048+0000 7f597b200640 1 Processor -- start 2024-05-26T15:39:39.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.048+0000 7f597b200640 1 -- start start 2024-05-26T15:39:39.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.049+0000 7f597b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f597c06f130 0x7f597c1f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.049+0000 7f597b200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f597c0b5ff0 0x7f597c159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.049+0000 7f597b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 0x7f597c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.049+0000 7f597b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c154030 con 0x7f597c1585c0 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.049+0000 7f597b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c153420 con 0x7f597c06f130 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.049+0000 7f597b200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c153700 con 0x7f597c0b5ff0 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.049+0000 7f597a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 0x7f597c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.049+0000 7f597a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 0x7f597c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48520/0 (socket says 172.21.15.8:48520) 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.050+0000 7f597a800640 1 -- 172.21.15.8:0/3811054221 learned_addr learned my addr 172.21.15.8:0/3811054221 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.050+0000 7f5979400640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f597c0b5ff0 0x7f597c159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.050+0000 7f5979e00640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f597c06f130 0x7f597c1f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.050+0000 7f597a800640 1 -- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f597c0b5ff0 msgr2=0x7f597c159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.050+0000 7f597a800640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f597c0b5ff0 0x7f597c159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.050+0000 7f597a800640 1 -- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f597c06f130 msgr2=0x7f597c1f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.050+0000 7f597a800640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f597c06f130 0x7f597c1f2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.050+0000 7f597a800640 1 -- 172.21.15.8:0/3811054221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c009400 con 0x7f597c1585c0 2024-05-26T15:39:39.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.050+0000 7f597a800640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 0x7f597c15a360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f597400c730 tx=0x7f597400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:39.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.051+0000 7f5972000640 1 -- 172.21.15.8:0/3811054221 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974003b70 con 0x7f597c1585c0 2024-05-26T15:39:39.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.051+0000 7f5972000640 1 -- 172.21.15.8:0/3811054221 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5974003cd0 con 0x7f597c1585c0 2024-05-26T15:39:39.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.051+0000 7f5972000640 1 -- 172.21.15.8:0/3811054221 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400aa90 con 0x7f597c1585c0 2024-05-26T15:39:39.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.051+0000 7f597b200640 1 -- 172.21.15.8:0/3811054221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c1539e0 con 0x7f597c1585c0 2024-05-26T15:39:39.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.051+0000 7f597b200640 1 -- 172.21.15.8:0/3811054221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c1f3460 con 0x7f597c1585c0 2024-05-26T15:39:39.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.052+0000 7f597b200640 1 -- 172.21.15.8:0/3811054221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c1541e0 con 0x7f597c1585c0 2024-05-26T15:39:39.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.053+0000 7f5972000640 1 -- 172.21.15.8:0/3811054221 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f597400abf0 con 0x7f597c1585c0 2024-05-26T15:39:39.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.054+0000 7f5972000640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f595c06ac00 0x7f595c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.054+0000 7f5972000640 1 -- 172.21.15.8:0/3811054221 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f59740894d0 con 0x7f597c1585c0 2024-05-26T15:39:39.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.055+0000 7f5979e00640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f595c06ac00 0x7f595c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.056+0000 7f5979e00640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f595c06ac00 0x7f595c06d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f596c034000 tx=0x7f596c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:39.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.059+0000 7f5972000640 1 -- 172.21.15.8:0/3811054221 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f597c1541e0 con 0x7f597c1585c0 2024-05-26T15:39:39.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.261+0000 7f597b200640 1 -- 172.21.15.8:0/3811054221 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f597c04e280 con 0x7f597c1585c0 2024-05-26T15:39:39.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.263+0000 7f5972000640 1 -- 172.21.15.8:0/3811054221 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7f5974054320 con 0x7f597c1585c0 2024-05-26T15:39:39.262 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:39.262 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:39.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 -- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f595c06ac00 msgr2=0x7f595c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f595c06ac00 0x7f595c06d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f596c034000 tx=0x7f596c02e000 comp rx=0 tx=0).stop 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 -- 172.21.15.8:0/3811054221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 msgr2=0x7f597c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 0x7f597c15a360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f597400c730 tx=0x7f597400cbf0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 -- 172.21.15.8:0/3811054221 shutdown_connections 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f597c1585c0 0x7f597c15a360 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f597c0b5ff0 0x7f597c159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f595c06ac00 0x7f595c06d0c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 --2- 172.21.15.8:0/3811054221 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f597c06f130 0x7f597c1f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 -- 172.21.15.8:0/3811054221 >> 172.21.15.8:0/3811054221 conn(0x7f597c06a050 msgr2=0x7f597c151c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 -- 172.21.15.8:0/3811054221 shutdown_connections 2024-05-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.266+0000 7f597b200640 1 -- 172.21.15.8:0/3811054221 wait complete. 2024-05-26T15:39:39.304 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:39:39.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.521+0000 7fb265200640 1 Processor -- start 2024-05-26T15:39:39.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.521+0000 7fb265200640 1 -- start start 2024-05-26T15:39:39.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.523+0000 7fb265200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb2600c36c0 0x7fb2600c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.523+0000 7fb265200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26015b640 con 0x7fb260154f50 2024-05-26T15:39:39.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.523+0000 7fb265200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26015b920 con 0x7fb2600b0f60 2024-05-26T15:39:39.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.523+0000 7fb265200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26015bee0 con 0x7fb2600c36c0 2024-05-26T15:39:39.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.523+0000 7fb25f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb260154f50 0x7fb26015ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34120/0 (socket says 172.21.15.8:34120) 2024-05-26T15:39:39.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.523+0000 7fb25f400640 1 -- 172.21.15.8:0/4270477882 learned_addr learned my addr 172.21.15.8:0/4270477882 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:39.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882394447 0 0) 0x7fb26015b640 con 0x7fb260154f50 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb244003520 con 0x7fb260154f50 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25fe00640 1 --2- 172.21.15.8:0/4270477882 >> v2:172.21.15.47:3300/0 conn(0x7fb2600c36c0 0x7fb2600c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4047514125 0 0) 0x7fb244003520 con 0x7fb260154f50 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 >> v2:172.21.15.47:3300/0 conn(0x7fb2600c36c0 msgr2=0x7fb2600c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 --2- 172.21.15.8:0/4270477882 >> v2:172.21.15.47:3300/0 conn(0x7fb2600c36c0 0x7fb2600c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 >> v1:172.21.15.47:6789/0 conn(0x7fb2600b0f60 legacy=0x7fb26015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26015bc00 con 0x7fb260154f50 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fb250001670 con 0x7fb260154f50 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 >> v1:172.21.15.8:6789/0 conn(0x7fb260154f50 legacy=0x7fb26015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2440039c0 0x7fb244003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2440047c0 0x7fb244004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2440051d0 0x7fb24400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26015bee0 con 0x7fb2440047c0 2024-05-26T15:39:39.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24400c120 con 0x7fb2440039c0 2024-05-26T15:39:39.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.524+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24400c2e0 con 0x7fb2440051d0 2024-05-26T15:39:39.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.525+0000 7fb25ea00640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2440047c0 0x7fb244004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.525+0000 7fb25f400640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2440039c0 0x7fb244003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.525+0000 7fb25fe00640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2440051d0 0x7fb24400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.525+0000 7fb25ea00640 1 -- 172.21.15.8:0/4270477882 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2440051d0 msgr2=0x7fb24400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:39.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.525+0000 7fb25ea00640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2440051d0 0x7fb24400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.525+0000 7fb25ea00640 1 -- 172.21.15.8:0/4270477882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2440039c0 msgr2=0x7fb244003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:39.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.525+0000 7fb25ea00640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2440039c0 0x7fb244003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.525+0000 7fb25ea00640 1 -- 172.21.15.8:0/4270477882 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244003520 con 0x7fb2440047c0 2024-05-26T15:39:39.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.525+0000 7fb25fe00640 1 -- 172.21.15.8:0/4270477882 reap_dead start 2024-05-26T15:39:39.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.526+0000 7fb25ea00640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2440047c0 0x7fb244004c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb24c001750 tx=0x7fb2440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56203c71646b3c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:39.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.526+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0052d0 con 0x7fb2440047c0 2024-05-26T15:39:39.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.526+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c005430 con 0x7fb2440047c0 2024-05-26T15:39:39.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.526+0000 7fb25e000640 1 -- 172.21.15.8:0/4270477882 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c02abc0 con 0x7fb2440047c0 2024-05-26T15:39:39.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.527+0000 7fb265200640 1 -- 172.21.15.8:0/4270477882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2440047c0 msgr2=0x7fb244004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.527+0000 7fb265200640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2440047c0 0x7fb244004c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb24c001750 tx=0x7fb2440057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.527+0000 7fb265200640 1 -- 172.21.15.8:0/4270477882 shutdown_connections 2024-05-26T15:39:39.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.527+0000 7fb265200640 1 --2- 172.21.15.8:0/4270477882 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2440047c0 0x7fb244004c40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.527+0000 7fb265200640 1 -- 172.21.15.8:0/4270477882 >> 172.21.15.8:0/4270477882 conn(0x7fb260070480 msgr2=0x7fb260070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:39.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.527+0000 7fb265200640 1 -- 172.21.15.8:0/4270477882 shutdown_connections 2024-05-26T15:39:39.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.527+0000 7fb265200640 1 -- 172.21.15.8:0/4270477882 wait complete. 2024-05-26T15:39:39.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.529+0000 7fb265200640 1 Processor -- start 2024-05-26T15:39:39.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.529+0000 7fb265200640 1 -- start start 2024-05-26T15:39:39.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.530+0000 7fb265200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2440047c0 0x7fb2601456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.530+0000 7fb265200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb260145be0 0x7fb2600c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.530+0000 7fb265200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb260144090 0x7fb2600c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.530+0000 7fb265200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb260145210 con 0x7fb260145be0 2024-05-26T15:39:39.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.530+0000 7fb265200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb260144600 con 0x7fb260144090 2024-05-26T15:39:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.530+0000 7fb265200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601448e0 con 0x7fb2440047c0 2024-05-26T15:39:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.531+0000 7fb25ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb260145be0 0x7fb2600c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.531+0000 7fb25ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb260145be0 0x7fb2600c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48548/0 (socket says 172.21.15.8:48548) 2024-05-26T15:39:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.531+0000 7fb25ea00640 1 -- 172.21.15.8:0/1382366469 learned_addr learned my addr 172.21.15.8:0/1382366469 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.531+0000 7fb25f400640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2440047c0 0x7fb2601456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.531+0000 7fb25ea00640 1 -- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2440047c0 msgr2=0x7fb2601456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.531+0000 7fb25ea00640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2440047c0 0x7fb2601456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.531+0000 7fb25ea00640 1 -- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb260144090 msgr2=0x7fb2600c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.531+0000 7fb25ea00640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb260144090 0x7fb2600c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.531+0000 7fb25ea00640 1 -- 172.21.15.8:0/1382366469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260144bc0 con 0x7fb260145be0 2024-05-26T15:39:39.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.531+0000 7fb25ea00640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb260145be0 0x7fb2600c6b80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb24c02a4a0 tx=0x7fb24c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:39.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.532+0000 7fb257400640 1 -- 172.21.15.8:0/1382366469 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c007300 con 0x7fb260145be0 2024-05-26T15:39:39.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.532+0000 7fb257400640 1 -- 172.21.15.8:0/1382366469 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c007460 con 0x7fb260145be0 2024-05-26T15:39:39.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.532+0000 7fb257400640 1 -- 172.21.15.8:0/1382366469 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0067d0 con 0x7fb260145be0 2024-05-26T15:39:39.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.532+0000 7fb265200640 1 -- 172.21.15.8:0/1382366469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb260144ea0 con 0x7fb260145be0 2024-05-26T15:39:39.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.532+0000 7fb265200640 1 -- 172.21.15.8:0/1382366469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2600b3680 con 0x7fb260145be0 2024-05-26T15:39:39.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.534+0000 7fb265200640 1 -- 172.21.15.8:0/1382366469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2600b3680 con 0x7fb260145be0 2024-05-26T15:39:39.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.534+0000 7fb257400640 1 -- 172.21.15.8:0/1382366469 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb24c006930 con 0x7fb260145be0 2024-05-26T15:39:39.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.535+0000 7fb257400640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb24006ac80 0x7fb24006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:39.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.536+0000 7fb257400640 1 -- 172.21.15.8:0/1382366469 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb24c0a9540 con 0x7fb260145be0 2024-05-26T15:39:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.536+0000 7fb25f400640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb24006ac80 0x7fb24006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:39.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.537+0000 7fb25f400640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb24006ac80 0x7fb24006d140 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb250001eb0 tx=0x7fb250009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:39.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.540+0000 7fb257400640 1 -- 172.21.15.8:0/1382366469 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb24c074410 con 0x7fb260145be0 2024-05-26T15:39:39.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.780+0000 7fb265200640 1 -- 172.21.15.8:0/1382366469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2600b3680 con 0x7fb260145be0 2024-05-26T15:39:39.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.781+0000 7fb257400640 1 -- 172.21.15.8:0/1382366469 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4718 (secure 0 0 0) 0x7fb24c077a30 con 0x7fb260145be0 2024-05-26T15:39:39.780 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:39.780 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:39:32.881224+0000","modified":"2024-05-26T15:39:37.870016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-26T15:39:39.780 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 6 2024-05-26T15:39:39.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 -- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb24006ac80 msgr2=0x7fb24006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb24006ac80 0x7fb24006d140 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb250001eb0 tx=0x7fb250009040 comp rx=0 tx=0).stop 2024-05-26T15:39:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 -- 172.21.15.8:0/1382366469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb260145be0 msgr2=0x7fb2600c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb260145be0 0x7fb2600c6b80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb24c02a4a0 tx=0x7fb24c001120 comp rx=0 tx=0).stop 2024-05-26T15:39:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 -- 172.21.15.8:0/1382366469 shutdown_connections 2024-05-26T15:39:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb24006ac80 0x7fb24006d140 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb260144090 0x7fb2600c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb260145be0 0x7fb2600c6b80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 --2- 172.21.15.8:0/1382366469 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2440047c0 0x7fb2601456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 -- 172.21.15.8:0/1382366469 >> 172.21.15.8:0/1382366469 conn(0x7fb260070480 msgr2=0x7fb260152a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 -- 172.21.15.8:0/1382366469 shutdown_connections 2024-05-26T15:39:39.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:39.784+0000 7fb265200640 1 -- 172.21.15.8:0/1382366469 wait complete. 2024-05-26T15:39:39.803 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:40.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.012+0000 7fb012800640 1 Processor -- start 2024-05-26T15:39:40.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.012+0000 7fb012800640 1 -- start start 2024-05-26T15:39:40.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.014+0000 7fb012800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb00c1571a0 0x7fb00c0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.014+0000 7fb012800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb00c15cfe0 0x7fb00c0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.014+0000 7fb012800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb00c0b0d20 0x7fb00c160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.014+0000 7fb012800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c15e090 con 0x7fb00c1571a0 2024-05-26T15:39:40.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.014+0000 7fb012800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c0b11d0 con 0x7fb00c0b0d20 2024-05-26T15:39:40.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.014+0000 7fb012800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c157580 con 0x7fb00c15cfe0 2024-05-26T15:39:40.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.014+0000 7fb011400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb00c1571a0 0x7fb00c0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.014+0000 7fb011400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb00c1571a0 0x7fb00c0caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48562/0 (socket says 172.21.15.8:48562) 2024-05-26T15:39:40.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.014+0000 7fb011400640 1 -- 172.21.15.8:0/383386492 learned_addr learned my addr 172.21.15.8:0/383386492 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:40.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.015+0000 7fb010a00640 1 --2- 172.21.15.8:0/383386492 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb00c15cfe0 0x7fb00c0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.015+0000 7fb011e00640 1 --2- 172.21.15.8:0/383386492 >> v2:172.21.15.47:3300/0 conn(0x7fb00c0b0d20 0x7fb00c160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.015+0000 7fb011400640 1 -- 172.21.15.8:0/383386492 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb00c15cfe0 msgr2=0x7fb00c0b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.015+0000 7fb011400640 1 --2- 172.21.15.8:0/383386492 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb00c15cfe0 0x7fb00c0b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.015+0000 7fb011400640 1 -- 172.21.15.8:0/383386492 >> v2:172.21.15.47:3300/0 conn(0x7fb00c0b0d20 msgr2=0x7fb00c160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.015+0000 7fb011400640 1 --2- 172.21.15.8:0/383386492 >> v2:172.21.15.47:3300/0 conn(0x7fb00c0b0d20 0x7fb00c160620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.015+0000 7fb011400640 1 -- 172.21.15.8:0/383386492 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c15d480 con 0x7fb00c1571a0 2024-05-26T15:39:40.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.016+0000 7fb011400640 1 --2- 172.21.15.8:0/383386492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 0x7fb00c0caaf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb00c1576c0 tx=0x7fb00002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5be30821c1849 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:40.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.017+0000 7fb00be00640 1 -- 172.21.15.8:0/383386492 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000032440 con 0x7fb00c1571a0 2024-05-26T15:39:40.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.017+0000 7fb00be00640 1 -- 172.21.15.8:0/383386492 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0000325a0 con 0x7fb00c1571a0 2024-05-26T15:39:40.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.017+0000 7fb00be00640 1 -- 172.21.15.8:0/383386492 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000032930 con 0x7fb00c1571a0 2024-05-26T15:39:40.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.018+0000 7fb012800640 1 -- 172.21.15.8:0/383386492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 msgr2=0x7fb00c0caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.018+0000 7fb012800640 1 --2- 172.21.15.8:0/383386492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 0x7fb00c0caaf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb00c1576c0 tx=0x7fb00002a1c0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.018+0000 7fb012800640 1 -- 172.21.15.8:0/383386492 shutdown_connections 2024-05-26T15:39:40.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.018+0000 7fb012800640 1 --2- 172.21.15.8:0/383386492 >> v2:172.21.15.47:3300/0 conn(0x7fb00c0b0d20 0x7fb00c160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.018+0000 7fb012800640 1 --2- 172.21.15.8:0/383386492 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb00c15cfe0 0x7fb00c0b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.018+0000 7fb012800640 1 --2- 172.21.15.8:0/383386492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 0x7fb00c0caaf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.018+0000 7fb012800640 1 -- 172.21.15.8:0/383386492 >> 172.21.15.8:0/383386492 conn(0x7fb00c070480 msgr2=0x7fb00c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:40.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.018+0000 7fb012800640 1 -- 172.21.15.8:0/383386492 shutdown_connections 2024-05-26T15:39:40.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.018+0000 7fb012800640 1 -- 172.21.15.8:0/383386492 wait complete. 2024-05-26T15:39:40.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.020+0000 7fb012800640 1 Processor -- start 2024-05-26T15:39:40.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.020+0000 7fb012800640 1 -- start start 2024-05-26T15:39:40.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.021+0000 7fb012800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb00c0b0d20 0x7fb00c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.021+0000 7fb012800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 0x7fb00c0a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.021+0000 7fb012800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c15cfe0 0x7fb00c0a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.021+0000 7fb012800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c0a8070 con 0x7fb00c1571a0 2024-05-26T15:39:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.021+0000 7fb012800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c144f10 con 0x7fb00c15cfe0 2024-05-26T15:39:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.021+0000 7fb012800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c159130 con 0x7fb00c0b0d20 2024-05-26T15:39:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.021+0000 7fb010a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 0x7fb00c0a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.021+0000 7fb010a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 0x7fb00c0a74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48566/0 (socket says 172.21.15.8:48566) 2024-05-26T15:39:40.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.021+0000 7fb010a00640 1 -- 172.21.15.8:0/1172671173 learned_addr learned my addr 172.21.15.8:0/1172671173 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:40.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb011400640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb00c0b0d20 0x7fb00c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb010a00640 1 -- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb00c0b0d20 msgr2=0x7fb00c1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb010a00640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb00c0b0d20 0x7fb00c1588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb010a00640 1 -- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c15cfe0 msgr2=0x7fb00c0a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb010a00640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c15cfe0 0x7fb00c0a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb010a00640 1 -- 172.21.15.8:0/1172671173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000094d0 con 0x7fb00c1571a0 2024-05-26T15:39:40.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb010a00640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 0x7fb00c0a74b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faff800d5f0 tx=0x7faff800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:40.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb009600640 1 -- 172.21.15.8:0/1172671173 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80125f0 con 0x7fb00c1571a0 2024-05-26T15:39:40.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb009600640 1 -- 172.21.15.8:0/1172671173 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff8012750 con 0x7fb00c1571a0 2024-05-26T15:39:40.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb009600640 1 -- 172.21.15.8:0/1172671173 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8012b00 con 0x7fb00c1571a0 2024-05-26T15:39:40.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb012800640 1 -- 172.21.15.8:0/1172671173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c159410 con 0x7fb00c1571a0 2024-05-26T15:39:40.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.022+0000 7fb012800640 1 -- 172.21.15.8:0/1172671173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c158df0 con 0x7fb00c1571a0 2024-05-26T15:39:40.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.024+0000 7fb012800640 1 -- 172.21.15.8:0/1172671173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00c159930 con 0x7fb00c1571a0 2024-05-26T15:39:40.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.025+0000 7fb009600640 1 -- 172.21.15.8:0/1172671173 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faff8012c60 con 0x7fb00c1571a0 2024-05-26T15:39:40.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.026+0000 7fb009600640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fafec06ac00 0x7fafec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.026+0000 7fb009600640 1 -- 172.21.15.8:0/1172671173 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faff8089b40 con 0x7fb00c1571a0 2024-05-26T15:39:40.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.026+0000 7fb011400640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fafec06ac00 0x7fafec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.027+0000 7fb011400640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fafec06ac00 0x7fafec06d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb000034000 tx=0x7fb00002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:40.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.030+0000 7fb009600640 1 -- 172.21.15.8:0/1172671173 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb00c159930 con 0x7fb00c1571a0 2024-05-26T15:39:40.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.234+0000 7fb012800640 1 -- 172.21.15.8:0/1172671173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb00c145050 con 0x7fb00c1571a0 2024-05-26T15:39:40.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.236+0000 7fb009600640 1 -- 172.21.15.8:0/1172671173 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7fb00c145050 con 0x7fb00c1571a0 2024-05-26T15:39:40.235 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:40.235 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.239+0000 7fb012800640 1 -- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fafec06ac00 msgr2=0x7fafec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.239+0000 7fb012800640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fafec06ac00 0x7fafec06d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb000034000 tx=0x7fb00002e000 comp rx=0 tx=0).stop 2024-05-26T15:39:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.239+0000 7fb012800640 1 -- 172.21.15.8:0/1172671173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 msgr2=0x7fb00c0a74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.239+0000 7fb012800640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 0x7fb00c0a74b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faff800d5f0 tx=0x7faff800dab0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.239+0000 7fb012800640 1 -- 172.21.15.8:0/1172671173 shutdown_connections 2024-05-26T15:39:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.239+0000 7fb012800640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fafec06ac00 0x7fafec06d0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.239+0000 7fb012800640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c15cfe0 0x7fb00c0a79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.239+0000 7fb012800640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb00c1571a0 0x7fb00c0a74b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.239+0000 7fb012800640 1 --2- 172.21.15.8:0/1172671173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb00c0b0d20 0x7fb00c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.239+0000 7fb012800640 1 -- 172.21.15.8:0/1172671173 >> 172.21.15.8:0/1172671173 conn(0x7fb00c070480 msgr2=0x7fb00c1563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.240+0000 7fb012800640 1 -- 172.21.15.8:0/1172671173 shutdown_connections 2024-05-26T15:39:40.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.240+0000 7fb012800640 1 -- 172.21.15.8:0/1172671173 wait complete. 2024-05-26T15:39:40.660 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-26T15:39:32.881224+0000', 'modified': '2024-05-26T15:39:37.870016+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.47:6837/1464782370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6835', 'nonce': 1464782370}, {'type': 'v1', 'addr': '172.21.15.47:6837', 'nonce': 1464782370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-05-26T15:39:40.660 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-26T15:39:40.661 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-26T15:39:40.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.883+0000 7fbc96800640 1 Processor -- start 2024-05-26T15:39:40.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.884+0000 7fbc96800640 1 -- start start 2024-05-26T15:39:40.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.885+0000 7fbc96800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc901430f0 0x7fbc9015d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.885+0000 7fbc96800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbc900b1950 0x7fbc900cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.885+0000 7fbc96800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc900cb790 0x7fbc900cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.885+0000 7fbc96800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc900cbbc0 con 0x7fbc901430f0 2024-05-26T15:39:40.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.885+0000 7fbc96800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9006c760 con 0x7fbc900b1950 2024-05-26T15:39:40.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.885+0000 7fbc96800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9015dc40 con 0x7fbc900cb790 2024-05-26T15:39:40.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.886+0000 7fbc8f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc901430f0 0x7fbc9015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.886+0000 7fbc8f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc901430f0 0x7fbc9015d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:48580/0 (socket says 172.21.15.8:48580) 2024-05-26T15:39:40.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.886+0000 7fbc8f400640 1 -- 172.21.15.8:0/1450884041 learned_addr learned my addr 172.21.15.8:0/1450884041 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:40.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.886+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/1450884041 >> v2:172.21.15.47:3300/0 conn(0x7fbc900b1950 0x7fbc900cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.886+0000 7fbc8fe00640 1 --2- 172.21.15.8:0/1450884041 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc900cb790 0x7fbc900cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.886+0000 7fbc8f400640 1 -- 172.21.15.8:0/1450884041 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc900cb790 msgr2=0x7fbc900cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.886+0000 7fbc8f400640 1 --2- 172.21.15.8:0/1450884041 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc900cb790 0x7fbc900cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.886+0000 7fbc8f400640 1 -- 172.21.15.8:0/1450884041 >> v2:172.21.15.47:3300/0 conn(0x7fbc900b1950 msgr2=0x7fbc900cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.886+0000 7fbc8f400640 1 --2- 172.21.15.8:0/1450884041 >> v2:172.21.15.47:3300/0 conn(0x7fbc900b1950 0x7fbc900cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.886+0000 7fbc8f400640 1 -- 172.21.15.8:0/1450884041 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9015df20 con 0x7fbc901430f0 2024-05-26T15:39:40.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.887+0000 7fbc8f400640 1 --2- 172.21.15.8:0/1450884041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc901430f0 0x7fbc9015d640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbc900cb1e0 tx=0x7fbc8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f24e50c0229a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:40.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.887+0000 7fbc8e000640 1 -- 172.21.15.8:0/1450884041 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80032440 con 0x7fbc901430f0 2024-05-26T15:39:40.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc8e000640 1 -- 172.21.15.8:0/1450884041 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc800325a0 con 0x7fbc901430f0 2024-05-26T15:39:40.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc8e000640 1 -- 172.21.15.8:0/1450884041 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80032930 con 0x7fbc901430f0 2024-05-26T15:39:40.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc96800640 1 -- 172.21.15.8:0/1450884041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc901430f0 msgr2=0x7fbc9015d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc96800640 1 --2- 172.21.15.8:0/1450884041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc901430f0 0x7fbc9015d640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbc900cb1e0 tx=0x7fbc8002a1e0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc96800640 1 -- 172.21.15.8:0/1450884041 shutdown_connections 2024-05-26T15:39:40.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc96800640 1 --2- 172.21.15.8:0/1450884041 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc900cb790 0x7fbc900cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc96800640 1 --2- 172.21.15.8:0/1450884041 >> v2:172.21.15.47:3300/0 conn(0x7fbc900b1950 0x7fbc900cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc96800640 1 --2- 172.21.15.8:0/1450884041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc901430f0 0x7fbc9015d640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc96800640 1 -- 172.21.15.8:0/1450884041 >> 172.21.15.8:0/1450884041 conn(0x7fbc900b0570 msgr2=0x7fbc900b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:40.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc96800640 1 -- 172.21.15.8:0/1450884041 shutdown_connections 2024-05-26T15:39:40.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.888+0000 7fbc96800640 1 -- 172.21.15.8:0/1450884041 wait complete. 2024-05-26T15:39:40.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.890+0000 7fbc96800640 1 Processor -- start 2024-05-26T15:39:40.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.890+0000 7fbc96800640 1 -- start start 2024-05-26T15:39:40.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.891+0000 7fbc96800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc900b1950 0x7fbc900c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.891+0000 7fbc96800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900cb790 0x7fbc9015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.891+0000 7fbc96800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc901430f0 0x7fbc9015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.891+0000 7fbc96800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9013f7b0 con 0x7fbc900cb790 2024-05-26T15:39:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.891+0000 7fbc96800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc900c4260 con 0x7fbc901430f0 2024-05-26T15:39:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.891+0000 7fbc96800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc900c4540 con 0x7fbc900b1950 2024-05-26T15:39:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.891+0000 7fbc8ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900cb790 0x7fbc9015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.891+0000 7fbc8ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900cb790 0x7fbc9015a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43510/0 (socket says 172.21.15.8:43510) 2024-05-26T15:39:40.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.891+0000 7fbc8ea00640 1 -- 172.21.15.8:0/565733076 learned_addr learned my addr 172.21.15.8:0/565733076 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:40.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.892+0000 7fbc8f400640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc900b1950 0x7fbc900c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.892+0000 7fbc8ea00640 1 -- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc900b1950 msgr2=0x7fbc900c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.892+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc900b1950 0x7fbc900c37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.892+0000 7fbc8ea00640 1 -- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc901430f0 msgr2=0x7fbc9015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.892+0000 7fbc8fe00640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc901430f0 0x7fbc9015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.892+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc901430f0 0x7fbc9015a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.892+0000 7fbc8ea00640 1 -- 172.21.15.8:0/565733076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800094d0 con 0x7fbc900cb790 2024-05-26T15:39:40.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.892+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900cb790 0x7fbc9015a2e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00d5f0 tx=0x7fbc7c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:40.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.892+0000 7fbc87400640 1 -- 172.21.15.8:0/565733076 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0125f0 con 0x7fbc900cb790 2024-05-26T15:39:40.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.893+0000 7fbc87400640 1 -- 172.21.15.8:0/565733076 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c012750 con 0x7fbc900cb790 2024-05-26T15:39:40.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.893+0000 7fbc96800640 1 -- 172.21.15.8:0/565733076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc900c4820 con 0x7fbc900cb790 2024-05-26T15:39:40.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.893+0000 7fbc87400640 1 -- 172.21.15.8:0/565733076 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c012b00 con 0x7fbc900cb790 2024-05-26T15:39:40.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.893+0000 7fbc96800640 1 -- 172.21.15.8:0/565733076 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc900c4de0 con 0x7fbc900cb790 2024-05-26T15:39:40.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.895+0000 7fbc87400640 1 -- 172.21.15.8:0/565733076 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc7c012c60 con 0x7fbc900cb790 2024-05-26T15:39:40.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.896+0000 7fbc87400640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc7006ac50 0x7fbc7006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.896+0000 7fbc87400640 1 -- 172.21.15.8:0/565733076 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc7c089b00 con 0x7fbc900cb790 2024-05-26T15:39:40.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.897+0000 7fbc995c0740 1 Processor -- start 2024-05-26T15:39:40.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.897+0000 7fbc995c0740 1 -- start start 2024-05-26T15:39:40.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.897+0000 7fbc8f400640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc7006ac50 0x7fbc7006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d34190 0x555f79d13c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d347a0 0x555f79cea430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79cea970 0x555f79ceba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc995c0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79c55a70 con 0x555f79d34190 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc995c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79c53200 con 0x555f79cea970 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc995c0740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f79c4eaf0 con 0x555f79d347a0 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc8f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d34190 0x555f79d13c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc8f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d34190 0x555f79d13c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43518/0 (socket says 172.21.15.8:43518) 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc8f400640 1 -- 172.21.15.8:0/867427470 learned_addr learned my addr 172.21.15.8:0/867427470 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc8f400640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc7006ac50 0x7fbc7006d110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc80034000 tx=0x7fbc8002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/867427470 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d347a0 0x555f79cea430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc8fe00640 1 --2- 172.21.15.8:0/867427470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79cea970 0x555f79ceba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc8f400640 1 -- 172.21.15.8:0/867427470 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d347a0 msgr2=0x555f79cea430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc8f400640 1 --2- 172.21.15.8:0/867427470 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d347a0 0x555f79cea430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc8f400640 1 -- 172.21.15.8:0/867427470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79cea970 msgr2=0x555f79ceba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.898+0000 7fbc8f400640 1 --2- 172.21.15.8:0/867427470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79cea970 0x555f79ceba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.899+0000 7fbc8f400640 1 -- 172.21.15.8:0/867427470 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f79c19b90 con 0x555f79d34190 2024-05-26T15:39:40.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.899+0000 7fbc8f400640 1 --2- 172.21.15.8:0/867427470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d34190 0x555f79d13c00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009930 tx=0x7fbc80009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deaaadf0b45c0f8e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:40.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.899+0000 7fbc7be00640 1 -- 172.21.15.8:0/867427470 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80043040 con 0x555f79d34190 2024-05-26T15:39:40.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.899+0000 7fbc7be00640 1 -- 172.21.15.8:0/867427470 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8003b6c0 con 0x555f79d34190 2024-05-26T15:39:40.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.899+0000 7fbc7be00640 1 -- 172.21.15.8:0/867427470 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8003ba30 con 0x555f79d34190 2024-05-26T15:39:40.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.900+0000 7fbc995c0740 1 -- 172.21.15.8:0/867427470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d34190 msgr2=0x555f79d13c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.900+0000 7fbc995c0740 1 --2- 172.21.15.8:0/867427470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d34190 0x555f79d13c00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009930 tx=0x7fbc80009240 comp rx=0 tx=0).stop 2024-05-26T15:39:40.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.900+0000 7fbc995c0740 1 -- 172.21.15.8:0/867427470 shutdown_connections 2024-05-26T15:39:40.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.900+0000 7fbc995c0740 1 --2- 172.21.15.8:0/867427470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79cea970 0x555f79ceba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.900+0000 7fbc995c0740 1 --2- 172.21.15.8:0/867427470 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d347a0 0x555f79cea430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.900+0000 7fbc995c0740 1 --2- 172.21.15.8:0/867427470 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d34190 0x555f79d13c00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.900+0000 7fbc995c0740 1 -- 172.21.15.8:0/867427470 >> 172.21.15.8:0/867427470 conn(0x555f79ce8e90 msgr2=0x555f79d31730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:40.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.900+0000 7fbc995c0740 1 -- 172.21.15.8:0/867427470 shutdown_connections 2024-05-26T15:39:40.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.900+0000 7fbc995c0740 1 -- 172.21.15.8:0/867427470 wait complete. 2024-05-26T15:39:40.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.901+0000 7fbc995c0740 1 -- start start 2024-05-26T15:39:40.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.901+0000 7fbc995c0740 1 Processor -- start 2024-05-26T15:39:40.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.902+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d34190 0x555f79d098d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.902+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d07350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.902+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d08410 0x555f79d32750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.902+0000 7fbc995c0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79bf0220 con 0x555f79d347a0 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.902+0000 7fbc995c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79befec0 con 0x555f79d34190 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.902+0000 7fbc995c0740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f799b5f20 con 0x555f79d08410 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.902+0000 7fbc995c0740 10 client.0 _ll_register_callbacks cb 0x555f79c48160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.902+0000 7fbc8ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d07350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.902+0000 7fbc8ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d07350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43534/0 (socket says 172.21.15.8:43534) 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.902+0000 7fbc8ea00640 1 -- 172.21.15.8:0/3985340385 learned_addr learned my addr 172.21.15.8:0/3985340385 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.903+0000 7fbc8ea00640 1 -- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d08410 msgr2=0x555f79d32750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.903+0000 7fbc8fe00640 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d08410 0x555f79d32750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.903+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d08410 0x555f79d32750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.903+0000 7fbc8ea00640 1 -- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d34190 msgr2=0x555f79d098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.903+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d34190 0x555f79d098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.903+0000 7fbc8ea00640 1 -- 172.21.15.8:0/3985340385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9015df20 con 0x555f79d347a0 2024-05-26T15:39:40.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.903+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d07350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00dfb0 tx=0x7fbc7c058690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fbecae8ef00f2b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:40.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.903+0000 7fbc78c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:39:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc78c00640 1 -- 172.21.15.8:0/3985340385 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c054da0 con 0x555f79d347a0 2024-05-26T15:39:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc78c00640 1 -- 172.21.15.8:0/3985340385 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc7c054f00 con 0x555f79d347a0 2024-05-26T15:39:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc995c0740 1 -- 172.21.15.8:0/3985340385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f79c78c90 con 0x555f79d347a0 2024-05-26T15:39:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc78c00640 1 -- 172.21.15.8:0/3985340385 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc7c057b80 con 0x555f79d347a0 2024-05-26T15:39:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc995c0740 10 client.4389 fetch_fsmap learned FSMap version 6 2024-05-26T15:39:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc995c0740 1 -- 172.21.15.8:0/3985340385 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x555f79c4d170 con 0x555f79d347a0 2024-05-26T15:39:40.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc78c00640 1 -- 172.21.15.8:0/3985340385 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f79c78c90 con 0x555f79d347a0 2024-05-26T15:39:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc78c00640 1 -- 172.21.15.8:0/3985340385 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fbc7c0605f0 con 0x555f79d347a0 2024-05-26T15:39:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc995c0740 10 client.4389 fetch_fsmap finished waiting for FSMap version 6 2024-05-26T15:39:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc995c0740 10 client.4389 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-26T15:39:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc995c0740 20 client.4389 populate_metadata read hostname 'smithi008' 2024-05-26T15:39:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc995c0740 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x555f79ceb6e0 0x555f79cebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc995c0740 4 client.4389 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-26T15:39:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.904+0000 7fbc995c0740 1 -- 172.21.15.8:0/3985340385 --> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f799423c0 con 0x555f79ceb6e0 2024-05-26T15:39:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.905+0000 7fbc8f400640 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x555f79ceb6e0 0x555f79cebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.906+0000 7fbc8f400640 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x555f79ceb6e0 0x555f79cebae0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eea844ac17cba4a8 server_cookie=60b96013d1c16b98 in_seq=0 out_seq=0 2024-05-26T15:39:40.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.906+0000 7fbc78c00640 10 client.4389 ms_handle_connect on v2:172.21.15.47:6835/1464782370 2024-05-26T15:39:40.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.909+0000 7fbc78c00640 1 -- 172.21.15.8:0/3985340385 <== mds.0 v2:172.21.15.47:6835/1464782370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555f799423c0 con 0x555f79ceb6e0 2024-05-26T15:39:40.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.909+0000 7fbc78c00640 10 client.4389 handle_command_reply: tid=0 2024-05-26T15:39:40.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.909+0000 7fbc995c0740 1 client.4389 shutdown 2024-05-26T15:39:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.909+0000 7fbc995c0740 1 -- 172.21.15.8:0/3985340385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 msgr2=0x555f79d07350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.909+0000 7fbc995c0740 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d07350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00dfb0 tx=0x7fbc7c058690 comp rx=0 tx=0).stop 2024-05-26T15:39:40.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.910+0000 7fbc995c0740 1 -- 172.21.15.8:0/3985340385 shutdown_connections 2024-05-26T15:39:40.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.910+0000 7fbc995c0740 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x555f79ceb6e0 0x555f79cebae0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.910+0000 7fbc995c0740 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d08410 0x555f79d32750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.910+0000 7fbc995c0740 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d07350 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.910+0000 7fbc995c0740 1 --2- 172.21.15.8:0/3985340385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d34190 0x555f79d098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.910+0000 7fbc995c0740 1 -- 172.21.15.8:0/3985340385 >> 172.21.15.8:0/3985340385 conn(0x555f79cea970 msgr2=0x555f79ce7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:40.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.910+0000 7fbc78c00640 0 client.4389 ms_handle_reset on v2:172.21.15.47:6835/1464782370 2024-05-26T15:39:40.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.910+0000 7fbc995c0740 1 -- 172.21.15.8:0/3985340385 shutdown_connections 2024-05-26T15:39:40.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.910+0000 7fbc995c0740 1 -- 172.21.15.8:0/3985340385 wait complete. 2024-05-26T15:39:40.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.910+0000 7fbc995c0740 20 client.4389 trim_cache size 0 max 16384 2024-05-26T15:39:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.930+0000 7fbc995c0740 1 Processor -- start 2024-05-26T15:39:40.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.930+0000 7fbc995c0740 1 -- start start 2024-05-26T15:39:40.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.931+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d08410 0x555f79ce24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.931+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d34190 0x555f79d12c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.931+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d959c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.931+0000 7fbc995c0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79d15f90 con 0x555f79d347a0 2024-05-26T15:39:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.931+0000 7fbc995c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79d30c90 con 0x555f79d34190 2024-05-26T15:39:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.931+0000 7fbc995c0740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f79d15680 con 0x555f79d08410 2024-05-26T15:39:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.931+0000 7fbc8fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.931+0000 7fbc8fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43550/0 (socket says 172.21.15.8:43550) 2024-05-26T15:39:40.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.931+0000 7fbc8fe00640 1 -- 172.21.15.8:0/1379503729 learned_addr learned my addr 172.21.15.8:0/1379503729 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:40.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc8f400640 1 --2- 172.21.15.8:0/1379503729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d08410 0x555f79ce24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/1379503729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d34190 0x555f79d12c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc8fe00640 1 -- 172.21.15.8:0/1379503729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d08410 msgr2=0x555f79ce24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc8fe00640 1 --2- 172.21.15.8:0/1379503729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d08410 0x555f79ce24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc8fe00640 1 -- 172.21.15.8:0/1379503729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d34190 msgr2=0x555f79d12c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc8fe00640 1 --2- 172.21.15.8:0/1379503729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d34190 0x555f79d12c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc8fe00640 1 -- 172.21.15.8:0/1379503729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f79c82130 con 0x555f79d347a0 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc8fe00640 1 --2- 172.21.15.8:0/1379503729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d959c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbc88008e90 tx=0x7fbc880107e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29690d9d3a55f428 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc84c00640 1 -- 172.21.15.8:0/1379503729 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800d620 con 0x555f79d347a0 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc84c00640 1 -- 172.21.15.8:0/1379503729 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800d780 con 0x555f79d347a0 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.932+0000 7fbc84c00640 1 -- 172.21.15.8:0/1379503729 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800db30 con 0x555f79d347a0 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.933+0000 7fbc995c0740 1 -- 172.21.15.8:0/1379503729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 msgr2=0x555f79d959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.933+0000 7fbc995c0740 1 --2- 172.21.15.8:0/1379503729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d959c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbc88008e90 tx=0x7fbc880107e0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.933+0000 7fbc995c0740 1 -- 172.21.15.8:0/1379503729 shutdown_connections 2024-05-26T15:39:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.933+0000 7fbc995c0740 1 --2- 172.21.15.8:0/1379503729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d347a0 0x555f79d959c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.933+0000 7fbc995c0740 1 --2- 172.21.15.8:0/1379503729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d34190 0x555f79d12c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.933+0000 7fbc995c0740 1 --2- 172.21.15.8:0/1379503729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d08410 0x555f79ce24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.933+0000 7fbc995c0740 1 -- 172.21.15.8:0/1379503729 >> 172.21.15.8:0/1379503729 conn(0x555f79cea970 msgr2=0x555f79d34f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.933+0000 7fbc995c0740 1 -- 172.21.15.8:0/1379503729 shutdown_connections 2024-05-26T15:39:40.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.933+0000 7fbc995c0740 1 -- 172.21.15.8:0/1379503729 wait complete. 2024-05-26T15:39:40.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.934+0000 7fbc995c0740 1 -- start start 2024-05-26T15:39:40.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.934+0000 7fbc995c0740 1 Processor -- start 2024-05-26T15:39:40.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.935+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d08410 0x555f79d8d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.935+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d34190 0x555f79d27ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.935+0000 7fbc995c0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d347a0 0x555f79ced6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.935+0000 7fbc995c0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79d91780 con 0x555f79d08410 2024-05-26T15:39:40.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.935+0000 7fbc995c0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f79d0e330 con 0x555f79d347a0 2024-05-26T15:39:40.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.935+0000 7fbc995c0740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f79d91250 con 0x555f79d34190 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.935+0000 7fbc995c0740 10 client.0 _ll_register_callbacks cb 0x555f79cea8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d08410 0x555f79d8d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d08410 0x555f79d8d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43552/0 (socket says 172.21.15.8:43552) 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8f400640 1 -- 172.21.15.8:0/137957744 learned_addr learned my addr 172.21.15.8:0/137957744 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8fe00640 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d347a0 0x555f79ced6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8f400640 1 -- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d34190 msgr2=0x555f79d27ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d34190 0x555f79d27ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8f400640 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d34190 0x555f79d27ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8f400640 1 -- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d347a0 msgr2=0x555f79ced6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8f400640 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d347a0 0x555f79ced6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8f400640 1 -- 172.21.15.8:0/137957744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc88008a90 con 0x555f79d08410 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc8f400640 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d08410 0x555f79d8d6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009960 tx=0x7fbc80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385f68809e0eb3c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:40.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc78c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.936+0000 7fbc78c00640 1 -- 172.21.15.8:0/137957744 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80043040 con 0x555f79d08410 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc78c00640 1 -- 172.21.15.8:0/137957744 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc80004450 con 0x555f79d08410 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc995c0740 1 -- 172.21.15.8:0/137957744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc8003b6c0 con 0x555f79d08410 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc78c00640 1 -- 172.21.15.8:0/137957744 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc800523c0 con 0x555f79d08410 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc995c0740 10 client.4395 fetch_fsmap learned FSMap version 6 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc995c0740 1 -- 172.21.15.8:0/137957744 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x555f79bef430 con 0x555f79d08410 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc78c00640 1 -- 172.21.15.8:0/137957744 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8003b6c0 con 0x555f79d08410 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc78c00640 1 -- 172.21.15.8:0/137957744 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fbc8004f070 con 0x555f79d08410 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc995c0740 10 client.4395 fetch_fsmap finished waiting for FSMap version 6 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc995c0740 10 client.4395 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc995c0740 20 client.4395 populate_metadata read hostname 'smithi008' 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc995c0740 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x555f79d0d410 0x555f79d0d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc995c0740 4 client.4395 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-26T15:39:40.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.937+0000 7fbc995c0740 1 -- 172.21.15.8:0/137957744 --> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555f799536c0 con 0x555f79d0d410 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.938+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x555f79d0d410 0x555f79d0d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.939+0000 7fbc8ea00640 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x555f79d0d410 0x555f79d0d7f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2108210f3544e084 server_cookie=42810e5943a6fb8a in_seq=0 out_seq=0 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.939+0000 7fbc78c00640 10 client.4395 ms_handle_connect on v2:172.21.15.47:6835/1464782370 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc78c00640 1 -- 172.21.15.8:0/137957744 <== mds.0 v2:172.21.15.47:6835/1464782370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x555f799536c0 con 0x555f79d0d410 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc78c00640 10 client.4395 handle_command_reply: tid=0 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc995c0740 1 client.4395 shutdown 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc995c0740 1 -- 172.21.15.8:0/137957744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d08410 msgr2=0x555f79d8d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc995c0740 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d08410 0x555f79d8d6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009960 tx=0x7fbc80004730 comp rx=0 tx=0).stop 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc995c0740 1 -- 172.21.15.8:0/137957744 shutdown_connections 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc995c0740 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x555f79d0d410 0x555f79d0d7f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc995c0740 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x555f79d347a0 0x555f79ced6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc995c0740 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x555f79d34190 0x555f79d27ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc995c0740 1 --2- 172.21.15.8:0/137957744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x555f79d08410 0x555f79d8d6e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc78c00640 0 client.4395 ms_handle_reset on v2:172.21.15.47:6835/1464782370 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.940+0000 7fbc995c0740 1 -- 172.21.15.8:0/137957744 >> 172.21.15.8:0/137957744 conn(0x555f79cea970 msgr2=0x555f79d07840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.941+0000 7fbc995c0740 1 -- 172.21.15.8:0/137957744 shutdown_connections 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.941+0000 7fbc995c0740 1 -- 172.21.15.8:0/137957744 wait complete. 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.941+0000 7fbc995c0740 20 client.4395 trim_cache size 0 max 16384 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "03132396-4584-4cf0-b2e0-b5ae6040045e", 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4273, 2024-05-26T15:39:40.944 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-05-26T15:39:40.945 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-05-26T15:39:40.945 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-05-26T15:39:40.945 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 8.0529473159999991, 2024-05-26T15:39:40.945 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 6, 2024-05-26T15:39:40.945 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 24, 2024-05-26T15:39:40.945 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 23, 2024-05-26T15:39:40.945 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 12.661577612 2024-05-26T15:39:40.945 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.941+0000 7fbc96800640 1 -- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc7006ac50 msgr2=0x7fbc7006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.941+0000 7fbc96800640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc7006ac50 0x7fbc7006d110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc80034000 tx=0x7fbc8002e000 comp rx=0 tx=0).stop 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.941+0000 7fbc96800640 1 -- 172.21.15.8:0/565733076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900cb790 msgr2=0x7fbc9015a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.941+0000 7fbc96800640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900cb790 0x7fbc9015a2e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00d5f0 tx=0x7fbc7c00dab0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.942+0000 7fbc96800640 1 -- 172.21.15.8:0/565733076 shutdown_connections 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.942+0000 7fbc96800640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc7006ac50 0x7fbc7006d110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.942+0000 7fbc96800640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc901430f0 0x7fbc9015a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.942+0000 7fbc96800640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc900cb790 0x7fbc9015a2e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.942+0000 7fbc96800640 1 --2- 172.21.15.8:0/565733076 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc900b1950 0x7fbc900c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.942+0000 7fbc96800640 1 -- 172.21.15.8:0/565733076 >> 172.21.15.8:0/565733076 conn(0x7fbc900b0570 msgr2=0x7fbc9006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:40.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.942+0000 7fbc96800640 1 -- 172.21.15.8:0/565733076 shutdown_connections 2024-05-26T15:39:40.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:40.942+0000 7fbc96800640 1 -- 172.21.15.8:0/565733076 wait complete. 2024-05-26T15:39:40.958 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-26T15:39:40.958 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-26T15:39:40.959 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-26T15:39:41.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.150+0000 7f165a400640 1 Processor -- start 2024-05-26T15:39:41.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.150+0000 7f165a400640 1 -- start start 2024-05-26T15:39:41.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.152+0000 7f165a400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1654154f50 0x7f16540b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:41.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.152+0000 7f165a400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f165415ae70 0x7f165415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:41.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.152+0000 7f165a400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f165415f0c0 0x7f16540c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:41.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.152+0000 7f165a400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165415bee0 con 0x7f1654154f50 2024-05-26T15:39:41.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.152+0000 7f165a400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16540b0ba0 con 0x7f165415ae70 2024-05-26T15:39:41.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.152+0000 7f165a400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165415b640 con 0x7f165415f0c0 2024-05-26T15:39:41.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.152+0000 7f1659000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1654154f50 0x7f16540b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:41.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.152+0000 7f1659000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1654154f50 0x7f16540b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43562/0 (socket says 172.21.15.8:43562) 2024-05-26T15:39:41.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.152+0000 7f1659000640 1 -- 172.21.15.8:0/911502423 learned_addr learned my addr 172.21.15.8:0/911502423 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:41.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.153+0000 7f1659a00640 1 --2- 172.21.15.8:0/911502423 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f165415f0c0 0x7f16540c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:41.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.153+0000 7f1653e00640 1 --2- 172.21.15.8:0/911502423 >> v2:172.21.15.47:3300/0 conn(0x7f165415ae70 0x7f165415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:41.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.153+0000 7f1659000640 1 -- 172.21.15.8:0/911502423 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f165415f0c0 msgr2=0x7f16540c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:41.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.153+0000 7f1659000640 1 --2- 172.21.15.8:0/911502423 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f165415f0c0 0x7f16540c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.153+0000 7f1659000640 1 -- 172.21.15.8:0/911502423 >> v2:172.21.15.47:3300/0 conn(0x7f165415ae70 msgr2=0x7f165415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:41.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.153+0000 7f1659000640 1 --2- 172.21.15.8:0/911502423 >> v2:172.21.15.47:3300/0 conn(0x7f165415ae70 0x7f165415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.153+0000 7f1659000640 1 -- 172.21.15.8:0/911502423 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165415b920 con 0x7f1654154f50 2024-05-26T15:39:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.154+0000 7f1659000640 1 --2- 172.21.15.8:0/911502423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654154f50 0x7f16540b0f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1654067880 tx=0x7f164402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03f2d53c677d842 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f1653400640 1 -- 172.21.15.8:0/911502423 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164402ae90 con 0x7f1654154f50 2024-05-26T15:39:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f1653400640 1 -- 172.21.15.8:0/911502423 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1644032440 con 0x7f1654154f50 2024-05-26T15:39:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f1653400640 1 -- 172.21.15.8:0/911502423 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16440327d0 con 0x7f1654154f50 2024-05-26T15:39:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f165a400640 1 -- 172.21.15.8:0/911502423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654154f50 msgr2=0x7f16540b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:41.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f165a400640 1 --2- 172.21.15.8:0/911502423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654154f50 0x7f16540b0f60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1654067880 tx=0x7f164402a140 comp rx=0 tx=0).stop 2024-05-26T15:39:41.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f165a400640 1 -- 172.21.15.8:0/911502423 shutdown_connections 2024-05-26T15:39:41.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f165a400640 1 --2- 172.21.15.8:0/911502423 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f165415f0c0 0x7f16540c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f165a400640 1 --2- 172.21.15.8:0/911502423 >> v2:172.21.15.47:3300/0 conn(0x7f165415ae70 0x7f165415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f165a400640 1 --2- 172.21.15.8:0/911502423 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1654154f50 0x7f16540b0f60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f165a400640 1 -- 172.21.15.8:0/911502423 >> 172.21.15.8:0/911502423 conn(0x7f1654070480 msgr2=0x7f1654070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:41.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f165a400640 1 -- 172.21.15.8:0/911502423 shutdown_connections 2024-05-26T15:39:41.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.155+0000 7f165a400640 1 -- 172.21.15.8:0/911502423 wait complete. 2024-05-26T15:39:41.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.157+0000 7f165a400640 1 Processor -- start 2024-05-26T15:39:41.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.157+0000 7f165a400640 1 -- start start 2024-05-26T15:39:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.158+0000 7f165a400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1654154f50 0x7f16541f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.158+0000 7f165a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f165415ae70 0x7f16541f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.158+0000 7f165a400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165415f0c0 0x7f165414ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f165a400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165414d5c0 con 0x7f165415f0c0 2024-05-26T15:39:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f165a400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16540cac50 con 0x7f165415ae70 2024-05-26T15:39:41.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f165a400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16540caf30 con 0x7f1654154f50 2024-05-26T15:39:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f1659a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165415f0c0 0x7f165414ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f1659a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165415f0c0 0x7f165414ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43570/0 (socket says 172.21.15.8:43570) 2024-05-26T15:39:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f1659a00640 1 -- 172.21.15.8:0/3127627933 learned_addr learned my addr 172.21.15.8:0/3127627933 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f1659000640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1654154f50 0x7f16541f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:41.158 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f1653e00640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f165415ae70 0x7f16541f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f1659a00640 1 -- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1654154f50 msgr2=0x7f16541f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f1659a00640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1654154f50 0x7f16541f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f1659a00640 1 -- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f165415ae70 msgr2=0x7f16541f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f1659a00640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f165415ae70 0x7f16541f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.159+0000 7f1659a00640 1 -- 172.21.15.8:0/3127627933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16440094d0 con 0x7f165415f0c0 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.160+0000 7f1659a00640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165415f0c0 0x7f165414ca90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f164c00d800 tx=0x7f164c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.160+0000 7f1650c00640 1 -- 172.21.15.8:0/3127627933 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00b6c0 con 0x7f165415f0c0 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.160+0000 7f1650c00640 1 -- 172.21.15.8:0/3127627933 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c00b840 con 0x7f165415f0c0 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.160+0000 7f1650c00640 1 -- 172.21.15.8:0/3127627933 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00bbf0 con 0x7f165415f0c0 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.160+0000 7f165a400640 1 -- 172.21.15.8:0/3127627933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16540cb210 con 0x7f165415f0c0 2024-05-26T15:39:41.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.160+0000 7f165a400640 1 -- 172.21.15.8:0/3127627933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16541f3e50 con 0x7f165415f0c0 2024-05-26T15:39:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.161+0000 7f165a400640 1 -- 172.21.15.8:0/3127627933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16540cb730 con 0x7f165415f0c0 2024-05-26T15:39:41.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.162+0000 7f1650c00640 1 -- 172.21.15.8:0/3127627933 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f164c00bd50 con 0x7f165415f0c0 2024-05-26T15:39:41.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.163+0000 7f1650c00640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f163406ac30 0x7f163406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:41.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.163+0000 7f1650c00640 1 -- 172.21.15.8:0/3127627933 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f164c089ac0 con 0x7f165415f0c0 2024-05-26T15:39:41.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.164+0000 7f1659000640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f163406ac30 0x7f163406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:41.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.165+0000 7f1659000640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f163406ac30 0x7f163406d0f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1644034000 tx=0x7f164402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:41.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.168+0000 7f1650c00640 1 -- 172.21.15.8:0/3127627933 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f16540cb730 con 0x7f165415f0c0 2024-05-26T15:39:41.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.410+0000 7f165a400640 1 -- 172.21.15.8:0/3127627933 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f16540cb730 con 0x7f165415f0c0 2024-05-26T15:39:41.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.410+0000 7f1650c00640 1 -- 172.21.15.8:0/3127627933 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f16540cb730 con 0x7f165415f0c0 2024-05-26T15:39:41.409 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-26T15:39:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 -- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f163406ac30 msgr2=0x7f163406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f163406ac30 0x7f163406d0f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1644034000 tx=0x7f164402e000 comp rx=0 tx=0).stop 2024-05-26T15:39:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 -- 172.21.15.8:0/3127627933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165415f0c0 msgr2=0x7f165414ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:41.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165415f0c0 0x7f165414ca90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f164c00d800 tx=0x7f164c00dcc0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 -- 172.21.15.8:0/3127627933 shutdown_connections 2024-05-26T15:39:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f165415f0c0 0x7f165414ca90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f163406ac30 0x7f163406d0f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f165415ae70 0x7f16541f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 --2- 172.21.15.8:0/3127627933 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1654154f50 0x7f16541f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 -- 172.21.15.8:0/3127627933 >> 172.21.15.8:0/3127627933 conn(0x7f1654070480 msgr2=0x7f16540c36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 -- 172.21.15.8:0/3127627933 shutdown_connections 2024-05-26T15:39:41.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:41.413+0000 7f165a400640 1 -- 172.21.15.8:0/3127627933 wait complete. 2024-05-26T15:39:41.431 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-26T15:39:41.431 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-26T15:39:41.431 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2024-05-26T15:39:41.431 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-26T15:39:41.431 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-26T15:39:41.431 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-26T15:39:41.431 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-26T15:39:41.431 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-26T15:39:41.431 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-26T15:39:41.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:41.432 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2024-05-26T15:39:41.485 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:39:41.485 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:39:41.485 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:39:41.485 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42618sec preferred_lft 42618sec 2024-05-26T15:39:41.486 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2024-05-26T15:39:41.487 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:39:41.487 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:39:41.487 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2024-05-26T15:39:41.487 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2024-05-26T15:39:41.488 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-26T15:39:41.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:41.488 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:39:41.488 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:39:41.488 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2024-05-26T15:39:41.489 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2024-05-26T15:39:41.489 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2024-05-26T15:39:41.489 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-26T15:39:41.489 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:39:41.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:41.941 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-26T15:39:42.026 INFO:teuthology.orchestra.run.smithi008.stdout:1 2024-05-26T15:39:42.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:42.030 DEBUG:teuthology.orchestra.run.smithi008:> route 2024-05-26T15:39:42.091 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2024-05-26T15:39:42.092 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-26T15:39:42.092 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-26T15:39:42.092 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-26T15:39:42.092 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-26T15:39:42.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:42.093 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:39:42.093 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:39:42.093 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-26T15:39:42.093 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-26T15:39:42.093 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-26T15:39:42.094 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:39:42.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:42.765 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-05-26T15:39:42.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:42.823 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2024-05-26T15:39:42.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:42.880 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:39:42.880 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:39:42.881 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-26T15:39:42.881 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-26T15:39:42.881 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:39:43.010 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-26T15:39:43.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:43.010 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:39:43.011 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:39:43.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-26T15:39:43.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-26T15:39:43.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-26T15:39:43.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-26T15:39:43.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-26T15:39:43.011 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:39:43.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:43.256 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:39:43.256 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:39:43.256 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2024-05-26T15:39:43.256 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2024-05-26T15:39:43.257 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:39:43.400 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-26T15:39:43.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:39:43.401 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-26T15:39:43.446 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-26T15:39:43.446 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:39:43.446 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-26T15:39:43.541 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2024-05-26T15:39:43.625 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-26T15:39:43.626 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-26T15:39:43.708 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-26T15:39:43.712 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-26T15:39:43.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:43.712 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2024-05-26T15:39:43.763 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-26T15:39:43.763 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-26T15:39:43.767 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2024-05-26T15:39:43.837 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-26T15:39:43.838 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-26T15:39:43.900 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-26T15:39:43.903 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-26T15:39:43.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:43.904 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2024-05-26T15:39:43.990 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:2024-05-26T15:39:43.991+0000 7efc66ddf480 -1 init, newargv = 0x55e1f28c9c70 newargc=15 2024-05-26T15:39:43.990 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:ceph-fuse[42111]: starting ceph client 2024-05-26T15:39:44.004 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:ceph-fuse[42111]: starting fuse 2024-05-26T15:39:45.048 DEBUG:teuthology.orchestra.run.smithi008:> sudo modprobe fuse 2024-05-26T15:39:45.146 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-26T15:39:45.146 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-26T15:39:45.235 INFO:teuthology.orchestra.run.smithi008.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-26T15:39:45.239 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-26T15:39:45.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:45.239 DEBUG:teuthology.orchestra.run.smithi008:> ls /sys/fs/fuse/connections 2024-05-26T15:39:45.299 INFO:teuthology.orchestra.run.smithi008.stdout:40 2024-05-26T15:39:45.299 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-05-26T15:39:45.299 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-26T15:39:45.300 DEBUG:teuthology.orchestra.run.smithi008:> import glob 2024-05-26T15:39:45.300 DEBUG:teuthology.orchestra.run.smithi008:> import re 2024-05-26T15:39:45.300 DEBUG:teuthology.orchestra.run.smithi008:> import os 2024-05-26T15:39:45.300 DEBUG:teuthology.orchestra.run.smithi008:> import subprocess 2024-05-26T15:39:45.300 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:39:45.300 DEBUG:teuthology.orchestra.run.smithi008:> def _find_admin_socket(client_name): 2024-05-26T15:39:45.301 DEBUG:teuthology.orchestra.run.smithi008:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-26T15:39:45.301 DEBUG:teuthology.orchestra.run.smithi008:> files = glob.glob(asok_path) 2024-05-26T15:39:45.301 DEBUG:teuthology.orchestra.run.smithi008:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-26T15:39:45.301 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:39:45.301 DEBUG:teuthology.orchestra.run.smithi008:> # Given a non-glob path, it better be there 2024-05-26T15:39:45.301 DEBUG:teuthology.orchestra.run.smithi008:> if "*" not in asok_path: 2024-05-26T15:39:45.302 DEBUG:teuthology.orchestra.run.smithi008:> assert(len(files) == 1) 2024-05-26T15:39:45.302 DEBUG:teuthology.orchestra.run.smithi008:> return files[0] 2024-05-26T15:39:45.302 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:39:45.302 DEBUG:teuthology.orchestra.run.smithi008:> for f in files: 2024-05-26T15:39:45.302 DEBUG:teuthology.orchestra.run.smithi008:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-26T15:39:45.302 DEBUG:teuthology.orchestra.run.smithi008:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-26T15:39:45.303 DEBUG:teuthology.orchestra.run.smithi008:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-26T15:39:45.303 DEBUG:teuthology.orchestra.run.smithi008:> contents = proc_f.read() 2024-05-26T15:39:45.303 DEBUG:teuthology.orchestra.run.smithi008:> if mountpoint in contents: 2024-05-26T15:39:45.303 DEBUG:teuthology.orchestra.run.smithi008:> return f 2024-05-26T15:39:45.303 DEBUG:teuthology.orchestra.run.smithi008:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-26T15:39:45.303 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:39:45.304 DEBUG:teuthology.orchestra.run.smithi008:> print(_find_admin_socket("client.admin")) 2024-05-26T15:39:45.304 DEBUG:teuthology.orchestra.run.smithi008:> ' 2024-05-26T15:39:45.487 INFO:teuthology.orchestra.run.smithi008.stdout:/var/run/ceph/ceph-client.admin.42111.asok 2024-05-26T15:39:45.667 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42111.asok 2024-05-26T15:39:45.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:45.667 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42111.asok status 2024-05-26T15:39:45.906 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:39:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "metadata": { 2024-05-26T15:39:45.906 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_sha1": "70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08", 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 18.2.2-1353-g70bbb060 (70bbb0607bb90dffa9c9e6460b6fc8ae9ee77f08) reef (stable)", 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "entity_id": "admin", 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "hostname": "smithi008", 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "pid": "42111", 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "root": "/" 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_count": 0, 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "dentry_pinned_count": 0, 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4407, 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "inst": { 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "name": { 2024-05-26T15:39:45.907 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "client", 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "num": 4407 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.1:0", 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 1647924266 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": { 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "type": "v1", 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "addr": "192.168.0.1:0", 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "nonce": 1647924266 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:39:45.908 INFO:teuthology.orchestra.run.smithi008.stdout: "inst_str": "client.4407 192.168.0.1:0/1647924266", 2024-05-26T15:39:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "addr_str": "192.168.0.1:0/1647924266", 2024-05-26T15:39:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "inode_count": 1, 2024-05-26T15:39:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "mds_epoch": 6, 2024-05-26T15:39:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch": 24, 2024-05-26T15:39:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "osd_epoch_barrier": 0, 2024-05-26T15:39:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "blocklisted": false, 2024-05-26T15:39:45.909 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs" 2024-05-26T15:39:45.909 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:39:45.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:45.922 DEBUG:teuthology.orchestra.run.smithi008:> stat --file-system '--printf=%T 2024-05-26T15:39:45.922 DEBUG:teuthology.orchestra.run.smithi008:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-26T15:39:45.979 INFO:teuthology.orchestra.run.smithi008.stdout:fuseblk 2024-05-26T15:39:45.979 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-26T15:39:45.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:45.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-26T15:39:46.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:46.074 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-26T15:39:46.179 INFO:teuthology.orchestra.run.smithi008.stdout:# file: . 2024-05-26T15:39:46.179 INFO:teuthology.orchestra.run.smithi008.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-26T15:39:46.180 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:46.181 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:46.181 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:39:46.238 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:46.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.439+0000 7f433ae00640 1 Processor -- start 2024-05-26T15:39:46.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.439+0000 7f433ae00640 1 -- start start 2024-05-26T15:39:46.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.441+0000 7f433ae00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4334154f50 0x7f43340b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:46.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.441+0000 7f433ae00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f433415ae70 0x7f433415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:46.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.441+0000 7f433ae00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433415b640 con 0x7f433415f0c0 2024-05-26T15:39:46.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.441+0000 7f433ae00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433415bee0 con 0x7f4334154f50 2024-05-26T15:39:46.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.441+0000 7f433ae00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43340b0ba0 con 0x7f433415ae70 2024-05-26T15:39:46.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.441+0000 7f4339000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f433415ae70 0x7f433415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:46.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.442+0000 7f4339000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f433415ae70 0x7f433415eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:50212/0 (socket says 172.21.15.8:50212) 2024-05-26T15:39:46.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.442+0000 7f4339000640 1 -- 172.21.15.8:0/744301874 learned_addr learned my addr 172.21.15.8:0/744301874 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:46.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.442+0000 7f4339a00640 1 --2- 172.21.15.8:0/744301874 >> v2:172.21.15.47:3300/0 conn(0x7f4334154f50 0x7f43340b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:46.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.442+0000 7f4339000640 1 -- 172.21.15.8:0/744301874 >> v2:172.21.15.47:3300/0 conn(0x7f4334154f50 msgr2=0x7f43340b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:46.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.442+0000 7f4339000640 1 --2- 172.21.15.8:0/744301874 >> v2:172.21.15.47:3300/0 conn(0x7f4334154f50 0x7f43340b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.442+0000 7f4339000640 1 -- 172.21.15.8:0/744301874 >> v1:172.21.15.47:6789/0 conn(0x7f433415f0c0 legacy=0x7f43340c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:46.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.442+0000 7f4339000640 1 -- 172.21.15.8:0/744301874 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433415b920 con 0x7f433415ae70 2024-05-26T15:39:46.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.442+0000 7f4333e00640 1 -- 172.21.15.8:0/744301874 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133135947 0 0) 0x7f433415b640 con 0x7f433415f0c0 2024-05-26T15:39:46.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.444+0000 7f4339000640 1 --2- 172.21.15.8:0/744301874 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f433415ae70 0x7f433415eb80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4320009870 tx=0x7f432002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad39c60a230d1bc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:46.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.444+0000 7f4333e00640 1 -- 172.21.15.8:0/744301874 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320032440 con 0x7f433415ae70 2024-05-26T15:39:46.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.444+0000 7f4333e00640 1 -- 172.21.15.8:0/744301874 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43200325a0 con 0x7f433415ae70 2024-05-26T15:39:46.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.444+0000 7f4333e00640 1 -- 172.21.15.8:0/744301874 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320032930 con 0x7f433415ae70 2024-05-26T15:39:46.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.445+0000 7f433ae00640 1 -- 172.21.15.8:0/744301874 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f433415ae70 msgr2=0x7f433415eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:46.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.445+0000 7f433ae00640 1 --2- 172.21.15.8:0/744301874 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f433415ae70 0x7f433415eb80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4320009870 tx=0x7f432002a1c0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.445+0000 7f433ae00640 1 -- 172.21.15.8:0/744301874 shutdown_connections 2024-05-26T15:39:46.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.445+0000 7f433ae00640 1 --2- 172.21.15.8:0/744301874 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f433415ae70 0x7f433415eb80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.445+0000 7f433ae00640 1 --2- 172.21.15.8:0/744301874 >> v2:172.21.15.47:3300/0 conn(0x7f4334154f50 0x7f43340b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.445+0000 7f433ae00640 1 -- 172.21.15.8:0/744301874 >> 172.21.15.8:0/744301874 conn(0x7f4334070480 msgr2=0x7f4334070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:46.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.445+0000 7f433ae00640 1 -- 172.21.15.8:0/744301874 shutdown_connections 2024-05-26T15:39:46.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.445+0000 7f433ae00640 1 -- 172.21.15.8:0/744301874 wait complete. 2024-05-26T15:39:46.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.448+0000 7f433ae00640 1 Processor -- start 2024-05-26T15:39:46.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.448+0000 7f433ae00640 1 -- start start 2024-05-26T15:39:46.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.449+0000 7f433ae00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4334154f50 0x7f4334151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:46.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.449+0000 7f433ae00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f433415ae70 0x7f43341450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:46.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.449+0000 7f433ae00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f433415f0c0 0x7f43340cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.449+0000 7f433ae00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43341524a0 con 0x7f433415ae70 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.449+0000 7f433ae00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4334151890 con 0x7f433415f0c0 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.449+0000 7f433ae00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4334151b70 con 0x7f4334154f50 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.449+0000 7f4339000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f433415ae70 0x7f43341450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.450+0000 7f4339000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f433415ae70 0x7f43341450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43572/0 (socket says 172.21.15.8:43572) 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.450+0000 7f4339000640 1 -- 172.21.15.8:0/2249104852 learned_addr learned my addr 172.21.15.8:0/2249104852 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.450+0000 7f4339a00640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4334154f50 0x7f4334151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.450+0000 7f433a400640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f433415f0c0 0x7f43340cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.450+0000 7f4339000640 1 -- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4334154f50 msgr2=0x7f4334151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.450+0000 7f4339000640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4334154f50 0x7f4334151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.450+0000 7f4339000640 1 -- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f433415f0c0 msgr2=0x7f43340cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.450+0000 7f4339000640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f433415f0c0 0x7f43340cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.450+0000 7f4339000640 1 -- 172.21.15.8:0/2249104852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200094d0 con 0x7f433415ae70 2024-05-26T15:39:46.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.450+0000 7f433a400640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f433415f0c0 0x7f43340cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:46.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.451+0000 7f4339000640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f433415ae70 0x7f43341450f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f432002a200 tx=0x7f43200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:46.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.451+0000 7f4331600640 1 -- 172.21.15.8:0/2249104852 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320032440 con 0x7f433415ae70 2024-05-26T15:39:46.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.451+0000 7f4331600640 1 -- 172.21.15.8:0/2249104852 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4320030980 con 0x7f433415ae70 2024-05-26T15:39:46.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.451+0000 7f4331600640 1 -- 172.21.15.8:0/2249104852 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320030d10 con 0x7f433415ae70 2024-05-26T15:39:46.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.451+0000 7f433ae00640 1 -- 172.21.15.8:0/2249104852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4334151e50 con 0x7f433415ae70 2024-05-26T15:39:46.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.451+0000 7f433ae00640 1 -- 172.21.15.8:0/2249104852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43341599a0 con 0x7f433415ae70 2024-05-26T15:39:46.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.453+0000 7f433ae00640 1 -- 172.21.15.8:0/2249104852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433404e280 con 0x7f433415ae70 2024-05-26T15:39:46.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.454+0000 7f4331600640 1 -- 172.21.15.8:0/2249104852 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4320039040 con 0x7f433415ae70 2024-05-26T15:39:46.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.455+0000 7f4331600640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f431406ac00 0x7f431406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:46.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.455+0000 7f4331600640 1 -- 172.21.15.8:0/2249104852 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f43200a9fe0 con 0x7f433415ae70 2024-05-26T15:39:46.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.456+0000 7f4339a00640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f431406ac00 0x7f431406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:46.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.457+0000 7f4339a00640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f431406ac00 0x7f431406d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4328009aa0 tx=0x7f4328009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:46.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.461+0000 7f4331600640 1 -- 172.21.15.8:0/2249104852 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4320074e70 con 0x7f433415ae70 2024-05-26T15:39:46.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.665+0000 7f433ae00640 1 -- 172.21.15.8:0/2249104852 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4334151cb0 con 0x7f433415ae70 2024-05-26T15:39:46.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.668+0000 7f4331600640 1 -- 172.21.15.8:0/2249104852 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7f4334151cb0 con 0x7f433415ae70 2024-05-26T15:39:46.835 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:46.836 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 -- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f431406ac00 msgr2=0x7f431406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f431406ac00 0x7f431406d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4328009aa0 tx=0x7f4328009190 comp rx=0 tx=0).stop 2024-05-26T15:39:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 -- 172.21.15.8:0/2249104852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f433415ae70 msgr2=0x7f43341450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f433415ae70 0x7f43341450f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f432002a200 tx=0x7f43200046c0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 -- 172.21.15.8:0/2249104852 shutdown_connections 2024-05-26T15:39:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f431406ac00 0x7f431406d0c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f433415f0c0 0x7f43340cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f433415ae70 0x7f43341450f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 --2- 172.21.15.8:0/2249104852 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4334154f50 0x7f4334151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:46.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 -- 172.21.15.8:0/2249104852 >> 172.21.15.8:0/2249104852 conn(0x7f4334070480 msgr2=0x7f433415c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:46.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 -- 172.21.15.8:0/2249104852 shutdown_connections 2024-05-26T15:39:46.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:46.671+0000 7f433ae00640 1 -- 172.21.15.8:0/2249104852 wait complete. 2024-05-26T15:39:46.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:39:46.839 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:39:47.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.058+0000 7fe0f1e00640 1 Processor -- start 2024-05-26T15:39:47.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.058+0000 7fe0f1e00640 1 -- start start 2024-05-26T15:39:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0f1e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe0ec15cb00 0x7fe0ec0acc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0f1e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0ec0ad5a0 0x7fe0ec070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0f1e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0ec0b1560 0x7fe0ec0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0f1e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec0adff0 con 0x7fe0ec0b1560 2024-05-26T15:39:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0f1e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec15cee0 con 0x7fe0ec15cb00 2024-05-26T15:39:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0f1e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0ad1b0 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0f1400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0ec0b1560 0x7fe0ec0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0f1400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe0ec0b1560 0x7fe0ec0708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43580/0 (socket says 172.21.15.8:43580) 2024-05-26T15:39:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0f1400640 1 -- 172.21.15.8:0/455086973 learned_addr learned my addr 172.21.15.8:0/455086973 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0ebe00640 1 --2- 172.21.15.8:0/455086973 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0ec0ad5a0 0x7fe0ec070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.060+0000 7fe0f0a00640 1 --2- 172.21.15.8:0/455086973 >> v2:172.21.15.47:3300/0 conn(0x7fe0ec15cb00 0x7fe0ec0acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.061+0000 7fe0f1400640 1 -- 172.21.15.8:0/455086973 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0ec0ad5a0 msgr2=0x7fe0ec070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:47.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.061+0000 7fe0f1400640 1 --2- 172.21.15.8:0/455086973 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0ec0ad5a0 0x7fe0ec070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.061+0000 7fe0f1400640 1 -- 172.21.15.8:0/455086973 >> v2:172.21.15.47:3300/0 conn(0x7fe0ec15cb00 msgr2=0x7fe0ec0acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:47.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.061+0000 7fe0f1400640 1 --2- 172.21.15.8:0/455086973 >> v2:172.21.15.47:3300/0 conn(0x7fe0ec15cb00 0x7fe0ec0acc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.061+0000 7fe0f1400640 1 -- 172.21.15.8:0/455086973 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0ac7e0 con 0x7fe0ec0b1560 2024-05-26T15:39:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.062+0000 7fe0f1400640 1 --2- 172.21.15.8:0/455086973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0b1560 0x7fe0ec0708a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec04e7a0 tx=0x7fe0e402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd10c96cddf47dc server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.062+0000 7fe0eb400640 1 -- 172.21.15.8:0/455086973 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e402ae90 con 0x7fe0ec0b1560 2024-05-26T15:39:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.062+0000 7fe0eb400640 1 -- 172.21.15.8:0/455086973 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e4032440 con 0x7fe0ec0b1560 2024-05-26T15:39:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.062+0000 7fe0eb400640 1 -- 172.21.15.8:0/455086973 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40327d0 con 0x7fe0ec0b1560 2024-05-26T15:39:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.063+0000 7fe0f1e00640 1 -- 172.21.15.8:0/455086973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0b1560 msgr2=0x7fe0ec0708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.063+0000 7fe0f1e00640 1 --2- 172.21.15.8:0/455086973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0b1560 0x7fe0ec0708a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec04e7a0 tx=0x7fe0e402a180 comp rx=0 tx=0).stop 2024-05-26T15:39:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.063+0000 7fe0f1e00640 1 -- 172.21.15.8:0/455086973 shutdown_connections 2024-05-26T15:39:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.063+0000 7fe0f1e00640 1 --2- 172.21.15.8:0/455086973 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0b1560 0x7fe0ec0708a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.063+0000 7fe0f1e00640 1 --2- 172.21.15.8:0/455086973 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0ec0ad5a0 0x7fe0ec070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.063+0000 7fe0f1e00640 1 --2- 172.21.15.8:0/455086973 >> v2:172.21.15.47:3300/0 conn(0x7fe0ec15cb00 0x7fe0ec0acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.063+0000 7fe0f1e00640 1 -- 172.21.15.8:0/455086973 >> 172.21.15.8:0/455086973 conn(0x7fe0ec0ce4f0 msgr2=0x7fe0ec0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:47.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.063+0000 7fe0f1e00640 1 -- 172.21.15.8:0/455086973 shutdown_connections 2024-05-26T15:39:47.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.063+0000 7fe0f1e00640 1 -- 172.21.15.8:0/455086973 wait complete. 2024-05-26T15:39:47.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.065+0000 7fe0f1e00640 1 Processor -- start 2024-05-26T15:39:47.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.065+0000 7fe0f1e00640 1 -- start start 2024-05-26T15:39:47.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.066+0000 7fe0f1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0ad5a0 0x7fe0ec1e5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.066+0000 7fe0f1e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0b1560 0x7fe0ec14ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.066+0000 7fe0f1e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0ec15cb00 0x7fe0ec0c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.066+0000 7fe0f1e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec14b0c0 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.066+0000 7fe0f1e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0c3cb0 con 0x7fe0ec0b1560 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.066+0000 7fe0f1e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec145540 con 0x7fe0ec15cb00 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.066+0000 7fe0f0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0ad5a0 0x7fe0ec1e5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.066+0000 7fe0f0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0ad5a0 0x7fe0ec1e5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43586/0 (socket says 172.21.15.8:43586) 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.066+0000 7fe0f0a00640 1 -- 172.21.15.8:0/701787899 learned_addr learned my addr 172.21.15.8:0/701787899 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0ebe00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0b1560 0x7fe0ec14ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0f1400640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0ec15cb00 0x7fe0ec0c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0f0a00640 1 -- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0ec15cb00 msgr2=0x7fe0ec0c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0f0a00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0ec15cb00 0x7fe0ec0c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0f0a00640 1 -- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0b1560 msgr2=0x7fe0ec14ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0f0a00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0b1560 0x7fe0ec14ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0f0a00640 1 -- 172.21.15.8:0/701787899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40094d0 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0ebe00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0b1560 0x7fe0ec14ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0f0a00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0ad5a0 0x7fe0ec1e5e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00d800 tx=0x7fe0dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0e8c00640 1 -- 172.21.15.8:0/701787899 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00b6c0 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0e8c00640 1 -- 172.21.15.8:0/701787899 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc00b820 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0e8c00640 1 -- 172.21.15.8:0/701787899 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00bbb0 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.067+0000 7fe0f1e00640 1 -- 172.21.15.8:0/701787899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec0c3a10 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.068+0000 7fe0f1e00640 1 -- 172.21.15.8:0/701787899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec144ef0 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.069+0000 7fe0f1e00640 1 -- 172.21.15.8:0/701787899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec04e210 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.070+0000 7fe0e8c00640 1 -- 172.21.15.8:0/701787899 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe0dc00bd10 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.071+0000 7fe0e8c00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe0c806ac00 0x7fe0c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.071+0000 7fe0e8c00640 1 -- 172.21.15.8:0/701787899 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe0dc089bd0 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.072+0000 7fe0ebe00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe0c806ac00 0x7fe0c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.073+0000 7fe0ebe00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe0c806ac00 0x7fe0c806d0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0c4f40 tx=0x7fe0d400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:47.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.075+0000 7fe0e8c00640 1 -- 172.21.15.8:0/701787899 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe0dc054ab0 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.283+0000 7fe0f1e00640 1 -- 172.21.15.8:0/701787899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0ec0cf120 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.284+0000 7fe0e8c00640 1 -- 172.21.15.8:0/701787899 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0dc0580d0 con 0x7fe0ec0ad5a0 2024-05-26T15:39:47.282 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:39:47.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.287+0000 7fe0f1e00640 1 -- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe0c806ac00 msgr2=0x7fe0c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.287+0000 7fe0f1e00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe0c806ac00 0x7fe0c806d0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0c4f40 tx=0x7fe0d400b040 comp rx=0 tx=0).stop 2024-05-26T15:39:47.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.287+0000 7fe0f1e00640 1 -- 172.21.15.8:0/701787899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0ad5a0 msgr2=0x7fe0ec1e5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.287+0000 7fe0f1e00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0ad5a0 0x7fe0ec1e5e20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00d800 tx=0x7fe0dc00dcc0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.287+0000 7fe0f1e00640 1 -- 172.21.15.8:0/701787899 shutdown_connections 2024-05-26T15:39:47.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.287+0000 7fe0f1e00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe0ec15cb00 0x7fe0ec0c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.287+0000 7fe0f1e00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe0c806ac00 0x7fe0c806d0c0 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec0c4f40 tx=0x7fe0d400b040 comp rx=0 tx=0).stop 2024-05-26T15:39:47.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.287+0000 7fe0f1e00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0ec0b1560 0x7fe0ec14ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.287+0000 7fe0f1e00640 1 --2- 172.21.15.8:0/701787899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0ec0ad5a0 0x7fe0ec1e5e20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.287+0000 7fe0f1e00640 1 -- 172.21.15.8:0/701787899 >> 172.21.15.8:0/701787899 conn(0x7fe0ec0ce4f0 msgr2=0x7fe0ec0ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:47.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.288+0000 7fe0f1e00640 1 -- 172.21.15.8:0/701787899 shutdown_connections 2024-05-26T15:39:47.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.288+0000 7fe0f1e00640 1 -- 172.21.15.8:0/701787899 wait complete. 2024-05-26T15:39:47.306 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:39:47.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.525+0000 7f6428a00640 1 Processor -- start 2024-05-26T15:39:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.525+0000 7f6428a00640 1 -- start start 2024-05-26T15:39:47.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.527+0000 7f6428a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 0x7f642406dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.527+0000 7f6428a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f642406d970 0x7f64240cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.527+0000 7f6428a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64240cba60 con 0x7f64240cdb40 2024-05-26T15:39:47.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.527+0000 7f6428a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64240cdfd0 con 0x7f642406d970 2024-05-26T15:39:47.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.527+0000 7f6428a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6424071610 con 0x7f642415a9d0 2024-05-26T15:39:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.528+0000 7f6422800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 0x7f642406dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.528+0000 7f6421e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f642406d970 0x7f64240cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.528+0000 7f6423200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f64240cdb40 0x7f642406c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:46632/0 (socket says 172.21.15.8:46632) 2024-05-26T15:39:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.528+0000 7f6423200640 1 -- 172.21.15.8:0/991956631 learned_addr learned my addr 172.21.15.8:0/991956631 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:47.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.529+0000 7f6421e00640 1 -- 172.21.15.8:0/991956631 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 msgr2=0x7f642406dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:47.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.529+0000 7f6421e00640 1 --2- 172.21.15.8:0/991956631 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 0x7f642406dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.529+0000 7f6421e00640 1 -- 172.21.15.8:0/991956631 >> v1:172.21.15.47:6789/0 conn(0x7f64240cdb40 legacy=0x7f642406c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.529+0000 7f6421e00640 1 -- 172.21.15.8:0/991956631 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64240cbd00 con 0x7f642406d970 2024-05-26T15:39:47.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.529+0000 7f6421400640 1 -- 172.21.15.8:0/991956631 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743840473 0 0) 0x7f64240cba60 con 0x7f64240cdb40 2024-05-26T15:39:47.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.529+0000 7f6422800640 1 --2- 172.21.15.8:0/991956631 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 0x7f642406dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:39:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.531+0000 7f6421e00640 1 --2- 172.21.15.8:0/991956631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642406d970 0x7f64240cd600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64100097a0 tx=0x7f641002a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3be9580ab981d4ef server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.531+0000 7f6421400640 1 -- 172.21.15.8:0/991956631 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641002ae40 con 0x7f642406d970 2024-05-26T15:39:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.531+0000 7f6421400640 1 -- 172.21.15.8:0/991956631 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6410032440 con 0x7f642406d970 2024-05-26T15:39:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.531+0000 7f6421400640 1 -- 172.21.15.8:0/991956631 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64100327d0 con 0x7f642406d970 2024-05-26T15:39:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.532+0000 7f6428a00640 1 -- 172.21.15.8:0/991956631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642406d970 msgr2=0x7f64240cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.532+0000 7f6428a00640 1 --2- 172.21.15.8:0/991956631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642406d970 0x7f64240cd600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64100097a0 tx=0x7f641002a0f0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.532+0000 7f6428a00640 1 -- 172.21.15.8:0/991956631 shutdown_connections 2024-05-26T15:39:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.532+0000 7f6428a00640 1 --2- 172.21.15.8:0/991956631 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642406d970 0x7f64240cd600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.532+0000 7f6428a00640 1 --2- 172.21.15.8:0/991956631 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 0x7f642406dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.532+0000 7f6428a00640 1 -- 172.21.15.8:0/991956631 >> 172.21.15.8:0/991956631 conn(0x7f64240ce4f0 msgr2=0x7f64240ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.532+0000 7f6428a00640 1 -- 172.21.15.8:0/991956631 shutdown_connections 2024-05-26T15:39:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.532+0000 7f6428a00640 1 -- 172.21.15.8:0/991956631 wait complete. 2024-05-26T15:39:47.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.535+0000 7f6428a00640 1 Processor -- start 2024-05-26T15:39:47.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.535+0000 7f6428a00640 1 -- start start 2024-05-26T15:39:47.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.536+0000 7f6428a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f642406d970 0x7f6424158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.536+0000 7f6428a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64240cdb40 0x7f64240c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.536+0000 7f6428a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 0x7f64240c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.536+0000 7f6428a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64240ad380 con 0x7f642406d970 2024-05-26T15:39:47.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.536+0000 7f6428a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64240ac770 con 0x7f64240cdb40 2024-05-26T15:39:47.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.536+0000 7f6428a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64240aca50 con 0x7f642415a9d0 2024-05-26T15:39:47.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.537+0000 7f6422800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f642406d970 0x7f6424158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.537+0000 7f6422800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f642406d970 0x7f6424158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43592/0 (socket says 172.21.15.8:43592) 2024-05-26T15:39:47.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.537+0000 7f6422800640 1 -- 172.21.15.8:0/4181978524 learned_addr learned my addr 172.21.15.8:0/4181978524 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:47.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.537+0000 7f6421e00640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64240cdb40 0x7f64240c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.537+0000 7f6423200640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 0x7f64240c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.537+0000 7f6422800640 1 -- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 msgr2=0x7f64240c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.537+0000 7f6422800640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 0x7f64240c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.537+0000 7f6422800640 1 -- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64240cdb40 msgr2=0x7f64240c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.537+0000 7f6422800640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64240cdb40 0x7f64240c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.537+0000 7f6422800640 1 -- 172.21.15.8:0/4181978524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6414009400 con 0x7f642406d970 2024-05-26T15:39:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.538+0000 7f6422800640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f642406d970 0x7f6424158990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f641400ebe0 tx=0x7f641400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.538+0000 7f641aa00640 1 -- 172.21.15.8:0/4181978524 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414009760 con 0x7f642406d970 2024-05-26T15:39:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.538+0000 7f641aa00640 1 -- 172.21.15.8:0/4181978524 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641400cc30 con 0x7f642406d970 2024-05-26T15:39:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.538+0000 7f641aa00640 1 -- 172.21.15.8:0/4181978524 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641400eee0 con 0x7f642406d970 2024-05-26T15:39:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.538+0000 7f6428a00640 1 -- 172.21.15.8:0/4181978524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6410009400 con 0x7f642406d970 2024-05-26T15:39:47.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.538+0000 7f6428a00640 1 -- 172.21.15.8:0/4181978524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64240ad010 con 0x7f642406d970 2024-05-26T15:39:47.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.539+0000 7f6428a00640 1 -- 172.21.15.8:0/4181978524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642404e210 con 0x7f642406d970 2024-05-26T15:39:47.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.540+0000 7f641aa00640 1 -- 172.21.15.8:0/4181978524 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6414013470 con 0x7f642406d970 2024-05-26T15:39:47.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.541+0000 7f641aa00640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f640406ac30 0x7f640406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.541+0000 7f641aa00640 1 -- 172.21.15.8:0/4181978524 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6414089d10 con 0x7f642406d970 2024-05-26T15:39:47.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.542+0000 7f6421e00640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f640406ac30 0x7f640406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.543+0000 7f6421e00640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f640406ac30 0x7f640406d0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6410034000 tx=0x7f641002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:47.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.546+0000 7f641aa00640 1 -- 172.21.15.8:0/4181978524 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f641408f020 con 0x7f642406d970 2024-05-26T15:39:47.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.746+0000 7f6428a00640 1 -- 172.21.15.8:0/4181978524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6424157a40 con 0x7f642406d970 2024-05-26T15:39:47.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.746+0000 7f641aa00640 1 -- 172.21.15.8:0/4181978524 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6414021020 con 0x7f642406d970 2024-05-26T15:39:47.745 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 -- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f640406ac30 msgr2=0x7f640406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f640406ac30 0x7f640406d0f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6410034000 tx=0x7f641002e000 comp rx=0 tx=0).stop 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 -- 172.21.15.8:0/4181978524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f642406d970 msgr2=0x7f6424158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f642406d970 0x7f6424158990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f641400ebe0 tx=0x7f641400c520 comp rx=0 tx=0).stop 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 -- 172.21.15.8:0/4181978524 shutdown_connections 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f642415a9d0 0x7f64240c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f640406ac30 0x7f640406d0f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64240cdb40 0x7f64240c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 --2- 172.21.15.8:0/4181978524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f642406d970 0x7f6424158990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 -- 172.21.15.8:0/4181978524 >> 172.21.15.8:0/4181978524 conn(0x7f64240ce4f0 msgr2=0x7f6424070360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:47.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.749+0000 7f6428a00640 1 -- 172.21.15.8:0/4181978524 shutdown_connections 2024-05-26T15:39:47.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.750+0000 7f6428a00640 1 -- 172.21.15.8:0/4181978524 wait complete. 2024-05-26T15:39:47.768 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:39:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.988+0000 7f24dbe00640 1 Processor -- start 2024-05-26T15:39:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.988+0000 7f24dbe00640 1 -- start start 2024-05-26T15:39:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.989+0000 7f24dbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f24dc15d0b0 0x7f24dc0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.989+0000 7f24dbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f24dc0cfb10 0x7f24dc0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.989+0000 7f24dbe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24dc0b21d0 con 0x7f24dc0cdef0 2024-05-26T15:39:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.989+0000 7f24dbe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24dc1615a0 con 0x7f24dc15d0b0 2024-05-26T15:39:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.989+0000 7f24dbe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24dc15d490 con 0x7f24dc0cfb10 2024-05-26T15:39:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.990+0000 7f24daa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f24dc15d0b0 0x7f24dc0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.990+0000 7f24daa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f24dc15d0b0 0x7f24dc0b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43606/0 (socket says 172.21.15.8:43606) 2024-05-26T15:39:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.990+0000 7f24daa00640 1 -- 172.21.15.8:0/791238253 learned_addr learned my addr 172.21.15.8:0/791238253 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.990+0000 7f24da000640 1 --2- 172.21.15.8:0/791238253 >> v2:172.21.15.47:3300/0 conn(0x7f24dc0cfb10 0x7f24dc0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.990+0000 7f24daa00640 1 -- 172.21.15.8:0/791238253 >> v2:172.21.15.47:3300/0 conn(0x7f24dc0cfb10 msgr2=0x7f24dc0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.990+0000 7f24daa00640 1 --2- 172.21.15.8:0/791238253 >> v2:172.21.15.47:3300/0 conn(0x7f24dc0cfb10 0x7f24dc0cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.990+0000 7f24daa00640 1 -- 172.21.15.8:0/791238253 >> v1:172.21.15.47:6789/0 conn(0x7f24dc0cdef0 legacy=0x7f24dc0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:47.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.990+0000 7f24daa00640 1 -- 172.21.15.8:0/791238253 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24dc0ce300 con 0x7f24dc15d0b0 2024-05-26T15:39:47.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.990+0000 7f24da000640 1 --2- 172.21.15.8:0/791238253 >> v2:172.21.15.47:3300/0 conn(0x7f24dc0cfb10 0x7f24dc0cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.992+0000 7f24daa00640 1 --2- 172.21.15.8:0/791238253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc15d0b0 0x7f24dc0b1570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0b8aa0 tx=0x7f24cc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc3745e8b0f70ba server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.992+0000 7f24d9600640 1 -- 172.21.15.8:0/791238253 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc032440 con 0x7f24dc15d0b0 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.992+0000 7f24d9600640 1 -- 172.21.15.8:0/791238253 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc0325a0 con 0x7f24dc15d0b0 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.992+0000 7f24d9600640 1 -- 172.21.15.8:0/791238253 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc032930 con 0x7f24dc15d0b0 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.993+0000 7f24dbe00640 1 -- 172.21.15.8:0/791238253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc15d0b0 msgr2=0x7f24dc0b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.993+0000 7f24dbe00640 1 --2- 172.21.15.8:0/791238253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc15d0b0 0x7f24dc0b1570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0b8aa0 tx=0x7f24cc02a1a0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.993+0000 7f24dbe00640 1 -- 172.21.15.8:0/791238253 shutdown_connections 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.993+0000 7f24dbe00640 1 --2- 172.21.15.8:0/791238253 >> v2:172.21.15.47:3300/0 conn(0x7f24dc0cfb10 0x7f24dc0cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.993+0000 7f24dbe00640 1 --2- 172.21.15.8:0/791238253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc15d0b0 0x7f24dc0b1570 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.993+0000 7f24dbe00640 1 -- 172.21.15.8:0/791238253 >> 172.21.15.8:0/791238253 conn(0x7f24dc06b160 msgr2=0x7f24dc06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.993+0000 7f24dbe00640 1 -- 172.21.15.8:0/791238253 shutdown_connections 2024-05-26T15:39:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.993+0000 7f24dbe00640 1 -- 172.21.15.8:0/791238253 wait complete. 2024-05-26T15:39:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.995+0000 7f24dbe00640 1 Processor -- start 2024-05-26T15:39:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.995+0000 7f24dbe00640 1 -- start start 2024-05-26T15:39:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24dbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc0cdef0 0x7f24dc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24dbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f24dc0cfb10 0x7f24dc0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24dbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24dc15d0b0 0x7f24dc0c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24dbe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc1e7700 con 0x7f24dc0cdef0 2024-05-26T15:39:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24dbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc0c9340 con 0x7f24dc15d0b0 2024-05-26T15:39:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24dbe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc1e78e0 con 0x7f24dc0cfb10 2024-05-26T15:39:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24daa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc0cdef0 0x7f24dc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24daa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc0cdef0 0x7f24dc0c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43612/0 (socket says 172.21.15.8:43612) 2024-05-26T15:39:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24daa00640 1 -- 172.21.15.8:0/1100855330 learned_addr learned my addr 172.21.15.8:0/1100855330 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24daa00640 1 -- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f24dc0cfb10 msgr2=0x7f24dc0c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24da000640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f24dc0cfb10 0x7f24dc0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24daa00640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f24dc0cfb10 0x7f24dc0c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24db400640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24dc15d0b0 0x7f24dc0c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.996+0000 7f24daa00640 1 -- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24dc15d0b0 msgr2=0x7f24dc0c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.997+0000 7f24daa00640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24dc15d0b0 0x7f24dc0c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.997+0000 7f24daa00640 1 -- 172.21.15.8:0/1100855330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc0094d0 con 0x7f24dc0cdef0 2024-05-26T15:39:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.997+0000 7f24db400640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24dc15d0b0 0x7f24dc0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.997+0000 7f24daa00640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc0cdef0 0x7f24dc0c8e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f24cc000c00 tx=0x7f24cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.997+0000 7f24d2a00640 1 -- 172.21.15.8:0/1100855330 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc032440 con 0x7f24dc0cdef0 2024-05-26T15:39:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.997+0000 7f24d2a00640 1 -- 172.21.15.8:0/1100855330 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc030b80 con 0x7f24dc0cdef0 2024-05-26T15:39:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.997+0000 7f24dbe00640 1 -- 172.21.15.8:0/1100855330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24dc1e7bc0 con 0x7f24dc0cdef0 2024-05-26T15:39:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.997+0000 7f24d2a00640 1 -- 172.21.15.8:0/1100855330 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc03d420 con 0x7f24dc0cdef0 2024-05-26T15:39:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.997+0000 7f24dbe00640 1 -- 172.21.15.8:0/1100855330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc1e8180 con 0x7f24dc0cdef0 2024-05-26T15:39:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:47.999+0000 7f24dbe00640 1 -- 172.21.15.8:0/1100855330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24dc04e210 con 0x7f24dc0cdef0 2024-05-26T15:39:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.000+0000 7f24d2a00640 1 -- 172.21.15.8:0/1100855330 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f24cc039040 con 0x7f24dc0cdef0 2024-05-26T15:39:47.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.001+0000 7f24d2a00640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f24bc06ac00 0x7f24bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:47.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.001+0000 7f24d2a00640 1 -- 172.21.15.8:0/1100855330 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f24cc0aa340 con 0x7f24dc0cdef0 2024-05-26T15:39:48.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.001+0000 7f24da000640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f24bc06ac00 0x7f24bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.002+0000 7f24da000640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f24bc06ac00 0x7f24bc06d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f24dc14f7c0 tx=0x7f24c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:48.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.005+0000 7f24d2a00640 1 -- 172.21.15.8:0/1100855330 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f24cc075230 con 0x7f24dc0cdef0 2024-05-26T15:39:48.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.204+0000 7f24dbe00640 1 -- 172.21.15.8:0/1100855330 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f24dc0b14f0 con 0x7f24dc0cdef0 2024-05-26T15:39:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.205+0000 7f24d2a00640 1 -- 172.21.15.8:0/1100855330 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f24cc078850 con 0x7f24dc0cdef0 2024-05-26T15:39:48.203 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:39:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.208+0000 7f24dbe00640 1 -- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f24bc06ac00 msgr2=0x7f24bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.208+0000 7f24dbe00640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f24bc06ac00 0x7f24bc06d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f24dc14f7c0 tx=0x7f24c8008040 comp rx=0 tx=0).stop 2024-05-26T15:39:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.208+0000 7f24dbe00640 1 -- 172.21.15.8:0/1100855330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc0cdef0 msgr2=0x7f24dc0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.208+0000 7f24dbe00640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc0cdef0 0x7f24dc0c8e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f24cc000c00 tx=0x7f24cc0046c0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.209+0000 7f24dbe00640 1 -- 172.21.15.8:0/1100855330 shutdown_connections 2024-05-26T15:39:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.209+0000 7f24dbe00640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f24bc06ac00 0x7f24bc06d0c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.209+0000 7f24dbe00640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24dc15d0b0 0x7f24dc0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.209+0000 7f24dbe00640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f24dc0cfb10 0x7f24dc0c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.209+0000 7f24dbe00640 1 --2- 172.21.15.8:0/1100855330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24dc0cdef0 0x7f24dc0c8e00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.209+0000 7f24dbe00640 1 -- 172.21.15.8:0/1100855330 >> 172.21.15.8:0/1100855330 conn(0x7f24dc06b160 msgr2=0x7f24dc0b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.209+0000 7f24dbe00640 1 -- 172.21.15.8:0/1100855330 shutdown_connections 2024-05-26T15:39:48.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.209+0000 7f24dbe00640 1 -- 172.21.15.8:0/1100855330 wait complete. 2024-05-26T15:39:48.225 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:39:48.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.427+0000 7f85bce00640 1 Processor -- start 2024-05-26T15:39:48.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.427+0000 7f85bce00640 1 -- start start 2024-05-26T15:39:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.429+0000 7f85bce00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f85b815a9d0 0x7f85b806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.429+0000 7f85bce00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85b806d970 0x7f85b80cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.429+0000 7f85bce00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b80cba60 con 0x7f85b80cdb40 2024-05-26T15:39:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.429+0000 7f85bce00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b80cdfd0 con 0x7f85b815a9d0 2024-05-26T15:39:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.429+0000 7f85bce00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8071610 con 0x7f85b806d970 2024-05-26T15:39:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.430+0000 7f85b7e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f85b80cdb40 0x7f85b806c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35316/0 (socket says 172.21.15.8:35316) 2024-05-26T15:39:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.430+0000 7f85b7e00640 1 -- 172.21.15.8:0/2708888986 learned_addr learned my addr 172.21.15.8:0/2708888986 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.430+0000 7f85b7400640 1 --2- 172.21.15.8:0/2708888986 >> v2:172.21.15.47:3300/0 conn(0x7f85b815a9d0 0x7f85b806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.430+0000 7f85b6a00640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85b806d970 0x7f85b80cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986374935 0 0) 0x7f85b80cba60 con 0x7f85b80cdb40 2024-05-26T15:39:48.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f859c003520 con 0x7f85b80cdb40 2024-05-26T15:39:48.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4263270404 0 0) 0x7f859c003520 con 0x7f85b80cdb40 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85b806d970 msgr2=0x7f85b80cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85b806d970 0x7f85b80cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 >> v2:172.21.15.47:3300/0 conn(0x7f85b815a9d0 msgr2=0x7f85b806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 --2- 172.21.15.8:0/2708888986 >> v2:172.21.15.47:3300/0 conn(0x7f85b815a9d0 0x7f85b806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b80cbd00 con 0x7f85b80cdb40 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f85b00019f0 con 0x7f85b80cdb40 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 >> v1:172.21.15.8:6789/0 conn(0x7f85b80cdb40 legacy=0x7f85b806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f859c003970 0x7f859c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f859c0047c0 0x7f859c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85b806d970 0x7f859c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b80cdfd0 con 0x7f859c003970 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8071610 con 0x7f859c0047c0 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.431+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859c00b980 con 0x7f85b806d970 2024-05-26T15:39:48.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.432+0000 7f85b7400640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f859c003970 0x7f859c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.432+0000 7f85b7400640 1 -- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85b806d970 msgr2=0x7f859c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:48.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.432+0000 7f85b7e00640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85b806d970 0x7f859c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.432+0000 7f85b6a00640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f859c0047c0 0x7f859c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.432+0000 7f85b7400640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f85b806d970 0x7f859c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.432+0000 7f85b7400640 1 -- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f859c0047c0 msgr2=0x7f859c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:48.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.432+0000 7f85b7400640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f859c0047c0 0x7f859c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.432+0000 7f85b7400640 1 -- 172.21.15.8:0/2708888986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c003520 con 0x7f859c003970 2024-05-26T15:39:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.433+0000 7f85b7400640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f859c003970 0x7f859c003d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009af0 tx=0x7f859c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e69aadd7cfc347 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.433+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8031400 con 0x7f859c003970 2024-05-26T15:39:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.433+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a802d050 con 0x7f859c003970 2024-05-26T15:39:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.433+0000 7f85b6000640 1 -- 172.21.15.8:0/2708888986 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8031580 con 0x7f859c003970 2024-05-26T15:39:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.434+0000 7f85bce00640 1 -- 172.21.15.8:0/2708888986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f859c003970 msgr2=0x7f859c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.434+0000 7f85bce00640 1 --2- 172.21.15.8:0/2708888986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f859c003970 0x7f859c003d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009af0 tx=0x7f859c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.434+0000 7f85b7e00640 1 -- 172.21.15.8:0/2708888986 reap_dead start 2024-05-26T15:39:48.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.434+0000 7f85bce00640 1 -- 172.21.15.8:0/2708888986 shutdown_connections 2024-05-26T15:39:48.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.434+0000 7f85bce00640 1 -- 172.21.15.8:0/2708888986 >> 172.21.15.8:0/2708888986 conn(0x7f85b80ce4f0 msgr2=0x7f85b80ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:48.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.434+0000 7f85bce00640 1 -- 172.21.15.8:0/2708888986 shutdown_connections 2024-05-26T15:39:48.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.434+0000 7f85bce00640 1 -- 172.21.15.8:0/2708888986 wait complete. 2024-05-26T15:39:48.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.436+0000 7f85bce00640 1 Processor -- start 2024-05-26T15:39:48.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.436+0000 7f85bce00640 1 -- start start 2024-05-26T15:39:48.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.437+0000 7f85bce00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f859c003970 0x7f85b80ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.437+0000 7f85bce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b8154020 0x7f85b81e0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.437+0000 7f85bce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b8153440 0x7f85b81538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.437+0000 7f85bce00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b80acc80 con 0x7f85b8153440 2024-05-26T15:39:48.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.437+0000 7f85bce00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8153e30 con 0x7f85b8154020 2024-05-26T15:39:48.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.437+0000 7f85bce00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b80ac070 con 0x7f859c003970 2024-05-26T15:39:48.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.437+0000 7f85b7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b8153440 0x7f85b81538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.437+0000 7f85b7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b8153440 0x7f85b81538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43630/0 (socket says 172.21.15.8:43630) 2024-05-26T15:39:48.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.437+0000 7f85b7e00640 1 -- 172.21.15.8:0/3700172356 learned_addr learned my addr 172.21.15.8:0/3700172356 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:48.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.438+0000 7f85b7e00640 1 -- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f859c003970 msgr2=0x7f85b80ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.438+0000 7f85b7e00640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f859c003970 0x7f85b80ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.438+0000 7f85b7e00640 1 -- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b8154020 msgr2=0x7f85b81e0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.438+0000 7f85b7e00640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b8154020 0x7f85b81e0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.438+0000 7f85b7e00640 1 -- 172.21.15.8:0/3700172356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b80ac350 con 0x7f85b8153440 2024-05-26T15:39:48.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.438+0000 7f85b7e00640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b8153440 0x7f85b81538f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000f80 tx=0x7f85b000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:48.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.438+0000 7f85af400640 1 -- 172.21.15.8:0/3700172356 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b000de90 con 0x7f85b8153440 2024-05-26T15:39:48.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.438+0000 7f85af400640 1 -- 172.21.15.8:0/3700172356 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b000bb80 con 0x7f85b8153440 2024-05-26T15:39:48.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.438+0000 7f85af400640 1 -- 172.21.15.8:0/3700172356 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0007070 con 0x7f85b8153440 2024-05-26T15:39:48.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.438+0000 7f85bce00640 1 -- 172.21.15.8:0/3700172356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b80ac630 con 0x7f85b8153440 2024-05-26T15:39:48.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.439+0000 7f85bce00640 1 -- 172.21.15.8:0/3700172356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b80abd60 con 0x7f85b8153440 2024-05-26T15:39:48.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.440+0000 7f85bce00640 1 -- 172.21.15.8:0/3700172356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b806ed00 con 0x7f85b8153440 2024-05-26T15:39:48.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.441+0000 7f85af400640 1 -- 172.21.15.8:0/3700172356 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85b00071d0 con 0x7f85b8153440 2024-05-26T15:39:48.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.442+0000 7f85af400640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f859806ac00 0x7f859806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.442+0000 7f85af400640 1 -- 172.21.15.8:0/3700172356 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f85b0089970 con 0x7f85b8153440 2024-05-26T15:39:48.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.442+0000 7f85b7400640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f859806ac00 0x7f859806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.444+0000 7f85b7400640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f859806ac00 0x7f859806d0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f85a8033000 tx=0x7f85a802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:48.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.446+0000 7f85af400640 1 -- 172.21.15.8:0/3700172356 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f85b00547c0 con 0x7f85b8153440 2024-05-26T15:39:48.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.645+0000 7f85bce00640 1 -- 172.21.15.8:0/3700172356 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f85b804e210 con 0x7f85b8153440 2024-05-26T15:39:48.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.646+0000 7f85af400640 1 -- 172.21.15.8:0/3700172356 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f85b0057de0 con 0x7f85b8153440 2024-05-26T15:39:48.644 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:39:48.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.648+0000 7f85bce00640 1 -- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f859806ac00 msgr2=0x7f859806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.648+0000 7f85bce00640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f859806ac00 0x7f859806d0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f85a8033000 tx=0x7f85a802e000 comp rx=0 tx=0).stop 2024-05-26T15:39:48.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.648+0000 7f85bce00640 1 -- 172.21.15.8:0/3700172356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b8153440 msgr2=0x7f85b81538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.648+0000 7f85bce00640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b8153440 0x7f85b81538f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85b0000f80 tx=0x7f85b000b4a0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.648+0000 7f85bce00640 1 -- 172.21.15.8:0/3700172356 shutdown_connections 2024-05-26T15:39:48.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.648+0000 7f85bce00640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f85b8153440 0x7f85b81538f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.648+0000 7f85bce00640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f859806ac00 0x7f859806d0c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.648+0000 7f85bce00640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f85b8154020 0x7f85b81e0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.648+0000 7f85bce00640 1 --2- 172.21.15.8:0/3700172356 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f859c003970 0x7f85b80ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.648+0000 7f85bce00640 1 -- 172.21.15.8:0/3700172356 >> 172.21.15.8:0/3700172356 conn(0x7f85b80ce4f0 msgr2=0x7f85b8156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:48.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.649+0000 7f85bce00640 1 -- 172.21.15.8:0/3700172356 shutdown_connections 2024-05-26T15:39:48.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.649+0000 7f85bce00640 1 -- 172.21.15.8:0/3700172356 wait complete. 2024-05-26T15:39:48.665 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-26T15:39:48.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.867+0000 7fa772600640 1 Processor -- start 2024-05-26T15:39:48.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.868+0000 7fa772600640 1 -- start start 2024-05-26T15:39:48.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.869+0000 7fa772600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa76c15cb30 0x7fa76c0b8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.869+0000 7fa772600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0050 0x7fa76c0b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.869+0000 7fa772600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0d14a0 con 0x7fa76c0d0d30 2024-05-26T15:39:48.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.869+0000 7fa772600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c0d2120 con 0x7fa76c15cb30 2024-05-26T15:39:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.869+0000 7fa772600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0d1780 con 0x7fa76c0d0050 2024-05-26T15:39:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.870+0000 7fa771c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0050 0x7fa76c0b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.870+0000 7fa771200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa76c15cb30 0x7fa76c0b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.870+0000 7fa771c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0050 0x7fa76c0b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:50292/0 (socket says 172.21.15.8:50292) 2024-05-26T15:39:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.870+0000 7fa771c00640 1 -- 172.21.15.8:0/877340555 learned_addr learned my addr 172.21.15.8:0/877340555 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.871+0000 7fa771c00640 1 -- 172.21.15.8:0/877340555 >> v2:172.21.15.47:3300/0 conn(0x7fa76c15cb30 msgr2=0x7fa76c0b8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.871+0000 7fa771c00640 1 --2- 172.21.15.8:0/877340555 >> v2:172.21.15.47:3300/0 conn(0x7fa76c15cb30 0x7fa76c0b8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.871+0000 7fa771c00640 1 -- 172.21.15.8:0/877340555 >> v1:172.21.15.47:6789/0 conn(0x7fa76c0d0d30 legacy=0x7fa76c0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.871+0000 7fa771c00640 1 -- 172.21.15.8:0/877340555 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0d1a60 con 0x7fa76c0d0050 2024-05-26T15:39:48.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.872+0000 7fa771c00640 1 --2- 172.21.15.8:0/877340555 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0050 0x7fa76c0b5b00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa764009e50 tx=0x7fa76402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a942cbda9ba27778 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:48.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.873+0000 7fa76b400640 1 -- 172.21.15.8:0/877340555 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76402aea0 con 0x7fa76c0d0050 2024-05-26T15:39:48.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.873+0000 7fa76b400640 1 -- 172.21.15.8:0/877340555 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76402d050 con 0x7fa76c0d0050 2024-05-26T15:39:48.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.873+0000 7fa76b400640 1 -- 172.21.15.8:0/877340555 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764031820 con 0x7fa76c0d0050 2024-05-26T15:39:48.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.874+0000 7fa772600640 1 -- 172.21.15.8:0/877340555 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0050 msgr2=0x7fa76c0b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.874+0000 7fa772600640 1 --2- 172.21.15.8:0/877340555 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0050 0x7fa76c0b5b00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa764009e50 tx=0x7fa76402a680 comp rx=0 tx=0).stop 2024-05-26T15:39:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.874+0000 7fa772600640 1 -- 172.21.15.8:0/877340555 shutdown_connections 2024-05-26T15:39:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.874+0000 7fa772600640 1 --2- 172.21.15.8:0/877340555 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0050 0x7fa76c0b5b00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.874+0000 7fa772600640 1 --2- 172.21.15.8:0/877340555 >> v2:172.21.15.47:3300/0 conn(0x7fa76c15cb30 0x7fa76c0b8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.874+0000 7fa772600640 1 -- 172.21.15.8:0/877340555 >> 172.21.15.8:0/877340555 conn(0x7fa76c06b720 msgr2=0x7fa76c06bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.874+0000 7fa772600640 1 -- 172.21.15.8:0/877340555 shutdown_connections 2024-05-26T15:39:48.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.874+0000 7fa772600640 1 -- 172.21.15.8:0/877340555 wait complete. 2024-05-26T15:39:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.876+0000 7fa772600640 1 Processor -- start 2024-05-26T15:39:48.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.876+0000 7fa772600640 1 -- start start 2024-05-26T15:39:48.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.877+0000 7fa772600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa76c0d0050 0x7fa76c0c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.877+0000 7fa772600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0d30 0x7fa76c0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.877+0000 7fa772600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c15cb30 0x7fa76c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.877+0000 7fa772600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0c77a0 con 0x7fa76c0d0050 2024-05-26T15:39:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.877+0000 7fa772600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c15e0f0 con 0x7fa76c15cb30 2024-05-26T15:39:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.877+0000 7fa772600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c154200 con 0x7fa76c0d0d30 2024-05-26T15:39:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.877+0000 7fa771200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa76c0d0050 0x7fa76c0c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.878+0000 7fa771200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa76c0d0050 0x7fa76c0c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43640/0 (socket says 172.21.15.8:43640) 2024-05-26T15:39:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.878+0000 7fa771200640 1 -- 172.21.15.8:0/921994055 learned_addr learned my addr 172.21.15.8:0/921994055 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.878+0000 7fa771c00640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c15cb30 0x7fa76c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.878+0000 7fa76be00640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0d30 0x7fa76c0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.878+0000 7fa771200640 1 -- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0d30 msgr2=0x7fa76c0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.878+0000 7fa771200640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0d30 0x7fa76c0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.878+0000 7fa771200640 1 -- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c15cb30 msgr2=0x7fa76c153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:48.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.878+0000 7fa771200640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c15cb30 0x7fa76c153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:48.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.878+0000 7fa771200640 1 -- 172.21.15.8:0/921994055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764009b30 con 0x7fa76c0d0050 2024-05-26T15:39:48.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.878+0000 7fa771200640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa76c0d0050 0x7fa76c0c7c30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa76000e9b0 tx=0x7fa76000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:48.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.879+0000 7fa768c00640 1 -- 172.21.15.8:0/921994055 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760009670 con 0x7fa76c0d0050 2024-05-26T15:39:48.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.879+0000 7fa768c00640 1 -- 172.21.15.8:0/921994055 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76000c9a0 con 0x7fa76c0d0050 2024-05-26T15:39:48.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.879+0000 7fa768c00640 1 -- 172.21.15.8:0/921994055 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76000cd50 con 0x7fa76c0d0050 2024-05-26T15:39:48.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.879+0000 7fa772600640 1 -- 172.21.15.8:0/921994055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c0d26c0 con 0x7fa76c0d0050 2024-05-26T15:39:48.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.879+0000 7fa772600640 1 -- 172.21.15.8:0/921994055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c0c6e70 con 0x7fa76c0d0050 2024-05-26T15:39:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.880+0000 7fa772600640 1 -- 172.21.15.8:0/921994055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c04e280 con 0x7fa76c0d0050 2024-05-26T15:39:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.881+0000 7fa768c00640 1 -- 172.21.15.8:0/921994055 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa760013470 con 0x7fa76c0d0050 2024-05-26T15:39:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.882+0000 7fa768c00640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa74c06ac00 0x7fa74c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:48.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.882+0000 7fa768c00640 1 -- 172.21.15.8:0/921994055 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7600899c0 con 0x7fa76c0d0050 2024-05-26T15:39:48.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.883+0000 7fa76be00640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa74c06ac00 0x7fa74c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:48.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.884+0000 7fa76be00640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa74c06ac00 0x7fa74c06d0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa76c1f59c0 tx=0x7fa758009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:48.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:48.887+0000 7fa768c00640 1 -- 172.21.15.8:0/921994055 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa760054780 con 0x7fa76c0d0050 2024-05-26T15:39:49.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.106+0000 7fa772600640 1 -- 172.21.15.8:0/921994055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa76c0cefa0 con 0x7fa76c0d0050 2024-05-26T15:39:49.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.106+0000 7fa768c00640 1 -- 172.21.15.8:0/921994055 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa760017080 con 0x7fa76c0d0050 2024-05-26T15:39:49.105 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2024-05-26T15:39:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.109+0000 7fa772600640 1 -- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa74c06ac00 msgr2=0x7fa74c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.109+0000 7fa772600640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa74c06ac00 0x7fa74c06d0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa76c1f59c0 tx=0x7fa758009040 comp rx=0 tx=0).stop 2024-05-26T15:39:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.109+0000 7fa772600640 1 -- 172.21.15.8:0/921994055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa76c0d0050 msgr2=0x7fa76c0c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.109+0000 7fa772600640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa76c0d0050 0x7fa76c0c7c30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa76000e9b0 tx=0x7fa76000ee70 comp rx=0 tx=0).stop 2024-05-26T15:39:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.110+0000 7fa772600640 1 -- 172.21.15.8:0/921994055 shutdown_connections 2024-05-26T15:39:49.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.110+0000 7fa772600640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa74c06ac00 0x7fa74c06d0c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.110+0000 7fa772600640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa76c15cb30 0x7fa76c153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.110+0000 7fa772600640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa76c0d0d30 0x7fa76c0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.110+0000 7fa772600640 1 --2- 172.21.15.8:0/921994055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa76c0d0050 0x7fa76c0c7c30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.110+0000 7fa772600640 1 -- 172.21.15.8:0/921994055 >> 172.21.15.8:0/921994055 conn(0x7fa76c06b720 msgr2=0x7fa76c15bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:49.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.110+0000 7fa772600640 1 -- 172.21.15.8:0/921994055 shutdown_connections 2024-05-26T15:39:49.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.110+0000 7fa772600640 1 -- 172.21.15.8:0/921994055 wait complete. 2024-05-26T15:39:49.127 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:39:49.127 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:39:49.179 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:49.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.390+0000 7f3062a00640 1 Processor -- start 2024-05-26T15:39:49.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.390+0000 7f3062a00640 1 -- start start 2024-05-26T15:39:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.392+0000 7f3062a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f305c163600 0x7f305c0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.392+0000 7f3062a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c161540 con 0x7f305c0b03d0 2024-05-26T15:39:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.392+0000 7f3062a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c161820 con 0x7f305c157ff0 2024-05-26T15:39:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.392+0000 7f3062a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305c1621c0 con 0x7f305c163600 2024-05-26T15:39:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.393+0000 7f3060c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f305c0b03d0 0x7f305c0cc040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35332/0 (socket says 172.21.15.8:35332) 2024-05-26T15:39:49.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.393+0000 7f3060c00640 1 -- 172.21.15.8:0/2295659733 learned_addr learned my addr 172.21.15.8:0/2295659733 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:49.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.393+0000 7f3062000640 1 --2- 172.21.15.8:0/2295659733 >> v2:172.21.15.47:3300/0 conn(0x7f305c163600 0x7f305c0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.393+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640547376 0 0) 0x7f305c161540 con 0x7f305c0b03d0 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.393+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3044003520 con 0x7f305c0b03d0 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 434920063 0 0) 0x7f3044003520 con 0x7f305c0b03d0 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 >> v2:172.21.15.47:3300/0 conn(0x7f305c163600 msgr2=0x7f305c0cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 --2- 172.21.15.8:0/2295659733 >> v2:172.21.15.47:3300/0 conn(0x7f305c163600 0x7f305c0cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 >> v1:172.21.15.47:6789/0 conn(0x7f305c157ff0 legacy=0x7f305c0afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c161b00 con 0x7f305c0b03d0 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f3048001670 con 0x7f305c0b03d0 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 >> v1:172.21.15.8:6789/0 conn(0x7f305c0b03d0 legacy=0x7f305c0cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30440039c0 0x7f3044003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30440047c0 0x7f3044004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3044005180 0x7f304400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c1621c0 con 0x7f30440039c0 2024-05-26T15:39:49.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304400c080 con 0x7f3044005180 2024-05-26T15:39:49.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304400c240 con 0x7f30440047c0 2024-05-26T15:39:49.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f3061600640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30440039c0 0x7f3044003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f3060c00640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30440047c0 0x7f3044004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.394+0000 7f3062000640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3044005180 0x7f304400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.395+0000 7f3061600640 1 -- 172.21.15.8:0/2295659733 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30440047c0 msgr2=0x7f3044004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:49.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.395+0000 7f3061600640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30440047c0 0x7f3044004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.395+0000 7f3061600640 1 -- 172.21.15.8:0/2295659733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3044005180 msgr2=0x7f304400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:49.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.395+0000 7f3061600640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3044005180 0x7f304400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.395+0000 7f3062000640 1 -- 172.21.15.8:0/2295659733 reap_dead start 2024-05-26T15:39:49.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.395+0000 7f3061600640 1 -- 172.21.15.8:0/2295659733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044003520 con 0x7f30440039c0 2024-05-26T15:39:49.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.396+0000 7f3061600640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30440039c0 0x7f3044003de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3050001750 tx=0x7f30440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea1cbbca606fcb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:49.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.397+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30500052d0 con 0x7f30440039c0 2024-05-26T15:39:49.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.397+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050005430 con 0x7f30440039c0 2024-05-26T15:39:49.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.397+0000 7f305be00640 1 -- 172.21.15.8:0/2295659733 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305002abc0 con 0x7f30440039c0 2024-05-26T15:39:49.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.397+0000 7f3062a00640 1 -- 172.21.15.8:0/2295659733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30440039c0 msgr2=0x7f3044003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.397+0000 7f3062a00640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30440039c0 0x7f3044003de0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3050001750 tx=0x7f30440057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.397+0000 7f3062a00640 1 -- 172.21.15.8:0/2295659733 shutdown_connections 2024-05-26T15:39:49.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.397+0000 7f3062a00640 1 --2- 172.21.15.8:0/2295659733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30440039c0 0x7f3044003de0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.397+0000 7f3062a00640 1 -- 172.21.15.8:0/2295659733 >> 172.21.15.8:0/2295659733 conn(0x7f305c070480 msgr2=0x7f305c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:49.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.397+0000 7f3062a00640 1 -- 172.21.15.8:0/2295659733 shutdown_connections 2024-05-26T15:39:49.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.398+0000 7f3062a00640 1 -- 172.21.15.8:0/2295659733 wait complete. 2024-05-26T15:39:49.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.399+0000 7f3062a00640 1 Processor -- start 2024-05-26T15:39:49.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.400+0000 7f3062a00640 1 -- start start 2024-05-26T15:39:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.400+0000 7f3062a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30440039c0 0x7f305c156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.400+0000 7f3062a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f305c1555e0 0x7f305c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3062a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f305c155a60 0x7f305c13f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3062a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c156bd0 con 0x7f305c1555e0 2024-05-26T15:39:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3062a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c152340 con 0x7f30440039c0 2024-05-26T15:39:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3062a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c151730 con 0x7f305c155a60 2024-05-26T15:39:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3060c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f305c1555e0 0x7f305c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3060c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f305c1555e0 0x7f305c13eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43650/0 (socket says 172.21.15.8:43650) 2024-05-26T15:39:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3060c00640 1 -- 172.21.15.8:0/4111124867 learned_addr learned my addr 172.21.15.8:0/4111124867 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:49.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3061600640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30440039c0 0x7f305c156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3062000640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f305c155a60 0x7f305c13f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3060c00640 1 -- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f305c155a60 msgr2=0x7f305c13f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3060c00640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f305c155a60 0x7f305c13f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3060c00640 1 -- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30440039c0 msgr2=0x7f305c156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3060c00640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30440039c0 0x7f305c156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3060c00640 1 -- 172.21.15.8:0/4111124867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c151a10 con 0x7f305c1555e0 2024-05-26T15:39:49.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.401+0000 7f3062000640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f305c155a60 0x7f305c13f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:49.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.402+0000 7f3060c00640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f305c1555e0 0x7f305c13eb60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f304800e760 tx=0x7f304800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.402+0000 7f3059600640 1 -- 172.21.15.8:0/4111124867 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800c6c0 con 0x7f305c1555e0 2024-05-26T15:39:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.402+0000 7f3059600640 1 -- 172.21.15.8:0/4111124867 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800c840 con 0x7f305c1555e0 2024-05-26T15:39:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.402+0000 7f3059600640 1 -- 172.21.15.8:0/4111124867 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304800cbf0 con 0x7f305c1555e0 2024-05-26T15:39:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.402+0000 7f3062a00640 1 -- 172.21.15.8:0/4111124867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c151cf0 con 0x7f305c1555e0 2024-05-26T15:39:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.402+0000 7f3062a00640 1 -- 172.21.15.8:0/4111124867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c1513e0 con 0x7f305c1555e0 2024-05-26T15:39:49.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.403+0000 7f3062a00640 1 -- 172.21.15.8:0/4111124867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c04e280 con 0x7f305c1555e0 2024-05-26T15:39:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.404+0000 7f3059600640 1 -- 172.21.15.8:0/4111124867 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f304800cd50 con 0x7f305c1555e0 2024-05-26T15:39:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.405+0000 7f3059600640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f303c06ac50 0x7f303c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.405+0000 7f3059600640 1 -- 172.21.15.8:0/4111124867 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f30480894c0 con 0x7f305c1555e0 2024-05-26T15:39:49.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.406+0000 7f3061600640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f303c06ac50 0x7f303c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.407+0000 7f3061600640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f303c06ac50 0x7f303c06d110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3050032000 tx=0x7f305002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:49.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.410+0000 7f3059600640 1 -- 172.21.15.8:0/4111124867 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3048054450 con 0x7f305c1555e0 2024-05-26T15:39:49.609 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.611+0000 7f3062a00640 1 -- 172.21.15.8:0/4111124867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f305c152480 con 0x7f305c1555e0 2024-05-26T15:39:49.611 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.613+0000 7f3059600640 1 -- 172.21.15.8:0/4111124867 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7f304805ce60 con 0x7f305c1555e0 2024-05-26T15:39:49.612 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:49.612 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:49.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 -- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f303c06ac50 msgr2=0x7f303c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f303c06ac50 0x7f303c06d110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3050032000 tx=0x7f305002e000 comp rx=0 tx=0).stop 2024-05-26T15:39:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 -- 172.21.15.8:0/4111124867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f305c1555e0 msgr2=0x7f305c13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f305c1555e0 0x7f305c13eb60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f304800e760 tx=0x7f304800ec20 comp rx=0 tx=0).stop 2024-05-26T15:39:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 -- 172.21.15.8:0/4111124867 shutdown_connections 2024-05-26T15:39:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f305c155a60 0x7f305c13f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f305c1555e0 0x7f305c13eb60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f303c06ac50 0x7f303c06d110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 --2- 172.21.15.8:0/4111124867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30440039c0 0x7f305c156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 -- 172.21.15.8:0/4111124867 >> 172.21.15.8:0/4111124867 conn(0x7f305c070480 msgr2=0x7f305c154960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:49.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.615+0000 7f3062a00640 1 -- 172.21.15.8:0/4111124867 shutdown_connections 2024-05-26T15:39:49.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.616+0000 7f3062a00640 1 -- 172.21.15.8:0/4111124867 wait complete. 2024-05-26T15:39:49.633 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:39:49.633 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:39:49.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.847+0000 7f7b92000640 1 Processor -- start 2024-05-26T15:39:49.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.848+0000 7f7b92000640 1 -- start start 2024-05-26T15:39:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.850+0000 7f7b92000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7b8c0ce090 0x7f7b8c06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.850+0000 7f7b92000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c06cab0 con 0x7f7b8c070360 2024-05-26T15:39:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.850+0000 7f7b92000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c0b18d0 con 0x7f7b8c0ad830 2024-05-26T15:39:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.850+0000 7f7b92000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8c0ae080 con 0x7f7b8c0ce090 2024-05-26T15:39:49.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.850+0000 7f7b90c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7b8c070360 0x7f7b8c070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35340/0 (socket says 172.21.15.8:35340) 2024-05-26T15:39:49.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.850+0000 7f7b90c00640 1 -- 172.21.15.8:0/2702456904 learned_addr learned my addr 172.21.15.8:0/2702456904 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:49.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158236312 0 0) 0x7f7b8c06cab0 con 0x7f7b8c070360 2024-05-26T15:39:49.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b74003520 con 0x7f7b8c070360 2024-05-26T15:39:49.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8be00640 1 --2- 172.21.15.8:0/2702456904 >> v2:172.21.15.47:3300/0 conn(0x7f7b8c0ce090 0x7f7b8c06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1565287625 0 0) 0x7f7b74003520 con 0x7f7b8c070360 2024-05-26T15:39:49.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 >> v2:172.21.15.47:3300/0 conn(0x7f7b8c0ce090 msgr2=0x7f7b8c06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:49.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 --2- 172.21.15.8:0/2702456904 >> v2:172.21.15.47:3300/0 conn(0x7f7b8c0ce090 0x7f7b8c06cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 >> v1:172.21.15.47:6789/0 conn(0x7f7b8c0ad830 legacy=0x7f7b8c06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c06c460 con 0x7f7b8c070360 2024-05-26T15:39:49.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f7b80001670 con 0x7f7b8c070360 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 >> v1:172.21.15.8:6789/0 conn(0x7f7b8c070360 legacy=0x7f7b8c070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b740039c0 0x7f7b74003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b740047c0 0x7f7b74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7b740051d0 0x7f7b7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7400c0f0 con 0x7f7b740047c0 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7400c260 con 0x7f7b740039c0 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.851+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7400c420 con 0x7f7b740051d0 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.852+0000 7f7b8be00640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b740047c0 0x7f7b74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.852+0000 7f7b91600640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7b740051d0 0x7f7b7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.852+0000 7f7b8be00640 1 -- 172.21.15.8:0/2702456904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7b740051d0 msgr2=0x7f7b7400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.852+0000 7f7b8be00640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7b740051d0 0x7f7b7400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.852+0000 7f7b8be00640 1 -- 172.21.15.8:0/2702456904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b740039c0 msgr2=0x7f7b74003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.852+0000 7f7b8be00640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b740039c0 0x7f7b74003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.852+0000 7f7b8be00640 1 -- 172.21.15.8:0/2702456904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74003520 con 0x7f7b740047c0 2024-05-26T15:39:49.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.852+0000 7f7b91600640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7b740051d0 0x7f7b7400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:49.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.852+0000 7f7b91600640 1 -- 172.21.15.8:0/2702456904 reap_dead start 2024-05-26T15:39:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.853+0000 7f7b8be00640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b740047c0 0x7f7b74004c40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009a90 tx=0x7f7b740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da865bfbebebfb7c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.853+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78031400 con 0x7f7b740047c0 2024-05-26T15:39:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.853+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7802d050 con 0x7f7b740047c0 2024-05-26T15:39:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.853+0000 7f7b8b400640 1 -- 172.21.15.8:0/2702456904 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78031780 con 0x7f7b740047c0 2024-05-26T15:39:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.854+0000 7f7b92000640 1 -- 172.21.15.8:0/2702456904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b740047c0 msgr2=0x7f7b74004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.854+0000 7f7b92000640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b740047c0 0x7f7b74004c40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009a90 tx=0x7f7b740057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.854+0000 7f7b92000640 1 -- 172.21.15.8:0/2702456904 shutdown_connections 2024-05-26T15:39:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.854+0000 7f7b92000640 1 --2- 172.21.15.8:0/2702456904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b740047c0 0x7f7b74004c40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.854+0000 7f7b92000640 1 -- 172.21.15.8:0/2702456904 >> 172.21.15.8:0/2702456904 conn(0x7f7b8c0ce4f0 msgr2=0x7f7b8c0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:49.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.854+0000 7f7b92000640 1 -- 172.21.15.8:0/2702456904 shutdown_connections 2024-05-26T15:39:49.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.854+0000 7f7b92000640 1 -- 172.21.15.8:0/2702456904 wait complete. 2024-05-26T15:39:49.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.856+0000 7f7b92000640 1 Processor -- start 2024-05-26T15:39:49.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.856+0000 7f7b92000640 1 -- start start 2024-05-26T15:39:49.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.857+0000 7f7b92000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b740047c0 0x7f7b8c153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.857+0000 7f7b92000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b8c15b680 0x7f7b8c161d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.857+0000 7f7b92000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7b8c1622d0 0x7f7b8c1f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.857+0000 7f7b92000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c162a50 con 0x7f7b8c15b680 2024-05-26T15:39:49.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.857+0000 7f7b92000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c162770 con 0x7f7b740047c0 2024-05-26T15:39:49.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.857+0000 7f7b92000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c152870 con 0x7f7b8c1622d0 2024-05-26T15:39:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b8be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b8c15b680 0x7f7b8c161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b8be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b8c15b680 0x7f7b8c161d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43660/0 (socket says 172.21.15.8:43660) 2024-05-26T15:39:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b8be00640 1 -- 172.21.15.8:0/2954668472 learned_addr learned my addr 172.21.15.8:0/2954668472 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b90c00640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b740047c0 0x7f7b8c153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b91600640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7b8c1622d0 0x7f7b8c1f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b8be00640 1 -- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7b8c1622d0 msgr2=0x7f7b8c1f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b8be00640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7b8c1622d0 0x7f7b8c1f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b8be00640 1 -- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b740047c0 msgr2=0x7f7b8c153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b8be00640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b740047c0 0x7f7b8c153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:49.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b8be00640 1 -- 172.21.15.8:0/2954668472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c152b50 con 0x7f7b8c15b680 2024-05-26T15:39:49.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.858+0000 7f7b8be00640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b8c15b680 0x7f7b8c161d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000c00 tx=0x7f7b78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:49.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.859+0000 7f7b88c00640 1 -- 172.21.15.8:0/2954668472 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78003e90 con 0x7f7b8c15b680 2024-05-26T15:39:49.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.859+0000 7f7b88c00640 1 -- 172.21.15.8:0/2954668472 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b780044e0 con 0x7f7b8c15b680 2024-05-26T15:39:49.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.859+0000 7f7b88c00640 1 -- 172.21.15.8:0/2954668472 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7803b600 con 0x7f7b8c15b680 2024-05-26T15:39:49.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.859+0000 7f7b92000640 1 -- 172.21.15.8:0/2954668472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c152e30 con 0x7f7b8c15b680 2024-05-26T15:39:49.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.859+0000 7f7b92000640 1 -- 172.21.15.8:0/2954668472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c15bce0 con 0x7f7b8c15b680 2024-05-26T15:39:49.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.860+0000 7f7b92000640 1 -- 172.21.15.8:0/2954668472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c04e210 con 0x7f7b8c15b680 2024-05-26T15:39:49.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.861+0000 7f7b88c00640 1 -- 172.21.15.8:0/2954668472 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7b7803b760 con 0x7f7b8c15b680 2024-05-26T15:39:49.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.862+0000 7f7b88c00640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7b6c06ac80 0x7f7b6c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:49.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.862+0000 7f7b88c00640 1 -- 172.21.15.8:0/2954668472 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b780a9c10 con 0x7f7b8c15b680 2024-05-26T15:39:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.863+0000 7f7b90c00640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7b6c06ac80 0x7f7b6c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:49.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.864+0000 7f7b90c00640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7b6c06ac80 0x7f7b6c06d140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7b800017a0 tx=0x7f7b80001630 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:49.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:49.867+0000 7f7b88c00640 1 -- 172.21.15.8:0/2954668472 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7b780786b0 con 0x7f7b8c15b680 2024-05-26T15:39:50.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.066+0000 7f7b92000640 1 -- 172.21.15.8:0/2954668472 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b8c162a50 con 0x7f7b8c15b680 2024-05-26T15:39:50.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.067+0000 7f7b88c00640 1 -- 172.21.15.8:0/2954668472 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b78078240 con 0x7f7b8c15b680 2024-05-26T15:39:50.066 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:39:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.070+0000 7f7b92000640 1 -- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7b6c06ac80 msgr2=0x7f7b6c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.070+0000 7f7b92000640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7b6c06ac80 0x7f7b6c06d140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7b800017a0 tx=0x7f7b80001630 comp rx=0 tx=0).stop 2024-05-26T15:39:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.070+0000 7f7b92000640 1 -- 172.21.15.8:0/2954668472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b8c15b680 msgr2=0x7f7b8c161d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.070+0000 7f7b92000640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b8c15b680 0x7f7b8c161d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000c00 tx=0x7f7b78004730 comp rx=0 tx=0).stop 2024-05-26T15:39:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.071+0000 7f7b92000640 1 -- 172.21.15.8:0/2954668472 shutdown_connections 2024-05-26T15:39:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.071+0000 7f7b92000640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7b8c1622d0 0x7f7b8c1f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.071+0000 7f7b92000640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7b8c15b680 0x7f7b8c161d90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.071+0000 7f7b92000640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7b6c06ac80 0x7f7b6c06d140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.071+0000 7f7b92000640 1 --2- 172.21.15.8:0/2954668472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b740047c0 0x7f7b8c153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.071+0000 7f7b92000640 1 -- 172.21.15.8:0/2954668472 >> 172.21.15.8:0/2954668472 conn(0x7f7b8c0ce4f0 msgr2=0x7f7b8c0af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:50.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.071+0000 7f7b92000640 1 -- 172.21.15.8:0/2954668472 shutdown_connections 2024-05-26T15:39:50.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.071+0000 7f7b92000640 1 -- 172.21.15.8:0/2954668472 wait complete. 2024-05-26T15:39:50.089 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:39:50.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.312+0000 7f3ecea00640 1 Processor -- start 2024-05-26T15:39:50.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.312+0000 7f3ecea00640 1 -- start start 2024-05-26T15:39:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.313+0000 7f3ecea00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec80d0020 0x7f3ec80d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.313+0000 7f3ecea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3ec80b82c0 0x7f3ec80b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.313+0000 7f3ecea00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80d20d0 con 0x7f3ec815ca00 2024-05-26T15:39:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.313+0000 7f3ecea00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80d06b0 con 0x7f3ec80b82c0 2024-05-26T15:39:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.313+0000 7f3ecea00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80d12b0 con 0x7f3ec80d0020 2024-05-26T15:39:50.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.314+0000 7f3eccc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec80d0020 0x7f3ec80d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:50.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.314+0000 7f3ece000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3ec80b82c0 0x7f3ec80b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:50.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.314+0000 7f3ecd600640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3ec815ca00 0x7f3ec80cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:46680/0 (socket says 172.21.15.8:46680) 2024-05-26T15:39:50.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.314+0000 7f3ecd600640 1 -- 172.21.15.8:0/3052532239 learned_addr learned my addr 172.21.15.8:0/3052532239 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:50.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.315+0000 7f3eccc00640 1 -- 172.21.15.8:0/3052532239 >> v2:172.21.15.47:3300/0 conn(0x7f3ec80b82c0 msgr2=0x7f3ec80b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:50.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.315+0000 7f3eccc00640 1 --2- 172.21.15.8:0/3052532239 >> v2:172.21.15.47:3300/0 conn(0x7f3ec80b82c0 0x7f3ec80b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.315+0000 7f3eccc00640 1 -- 172.21.15.8:0/3052532239 >> v1:172.21.15.47:6789/0 conn(0x7f3ec815ca00 legacy=0x7f3ec80cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.315+0000 7f3eccc00640 1 -- 172.21.15.8:0/3052532239 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80d14c0 con 0x7f3ec80d0020 2024-05-26T15:39:50.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.315+0000 7f3ece000640 1 --2- 172.21.15.8:0/3052532239 >> v2:172.21.15.47:3300/0 conn(0x7f3ec80b82c0 0x7f3ec80b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:39:50.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.316+0000 7f3eccc00640 1 --2- 172.21.15.8:0/3052532239 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec80d0020 0x7f3ec80d0d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40097d0 tx=0x7f3eb402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c395a9451ee4960e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:50.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.317+0000 7f3ec7e00640 1 -- 172.21.15.8:0/3052532239 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4032440 con 0x7f3ec80d0020 2024-05-26T15:39:50.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.317+0000 7f3ec7e00640 1 -- 172.21.15.8:0/3052532239 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb40325a0 con 0x7f3ec80d0020 2024-05-26T15:39:50.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.317+0000 7f3ec7e00640 1 -- 172.21.15.8:0/3052532239 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4032930 con 0x7f3ec80d0020 2024-05-26T15:39:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.318+0000 7f3ecea00640 1 -- 172.21.15.8:0/3052532239 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec80d0020 msgr2=0x7f3ec80d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.318+0000 7f3ecea00640 1 --2- 172.21.15.8:0/3052532239 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec80d0020 0x7f3ec80d0d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40097d0 tx=0x7f3eb402a1c0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.318+0000 7f3ecea00640 1 -- 172.21.15.8:0/3052532239 shutdown_connections 2024-05-26T15:39:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.318+0000 7f3ecea00640 1 --2- 172.21.15.8:0/3052532239 >> v2:172.21.15.47:3300/0 conn(0x7f3ec80b82c0 0x7f3ec80b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.318+0000 7f3ecea00640 1 --2- 172.21.15.8:0/3052532239 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec80d0020 0x7f3ec80d0d70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.318+0000 7f3ecea00640 1 -- 172.21.15.8:0/3052532239 >> 172.21.15.8:0/3052532239 conn(0x7f3ec806b640 msgr2=0x7f3ec806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.318+0000 7f3ecea00640 1 -- 172.21.15.8:0/3052532239 shutdown_connections 2024-05-26T15:39:50.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.318+0000 7f3ecea00640 1 -- 172.21.15.8:0/3052532239 wait complete. 2024-05-26T15:39:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.320+0000 7f3ecea00640 1 Processor -- start 2024-05-26T15:39:50.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.320+0000 7f3ecea00640 1 -- start start 2024-05-26T15:39:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.321+0000 7f3ecea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ec80b82c0 0x7f3ec81f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.321+0000 7f3ecea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec80d0020 0x7f3ec80cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.321+0000 7f3ecea00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec815ca00 0x7f3ec815f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.321+0000 7f3ecea00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80cc1b0 con 0x7f3ec80d0020 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.321+0000 7f3ecea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec815d4f0 con 0x7f3ec80b82c0 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.321+0000 7f3ecea00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80cbbf0 con 0x7f3ec815ca00 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.321+0000 7f3eccc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec80d0020 0x7f3ec80cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.322+0000 7f3eccc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec80d0020 0x7f3ec80cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43670/0 (socket says 172.21.15.8:43670) 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.322+0000 7f3eccc00640 1 -- 172.21.15.8:0/4113458964 learned_addr learned my addr 172.21.15.8:0/4113458964 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.322+0000 7f3ece000640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec815ca00 0x7f3ec815f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.322+0000 7f3ecd600640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ec80b82c0 0x7f3ec81f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.322+0000 7f3eccc00640 1 -- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec815ca00 msgr2=0x7f3ec815f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.322+0000 7f3eccc00640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec815ca00 0x7f3ec815f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.322+0000 7f3eccc00640 1 -- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ec80b82c0 msgr2=0x7f3ec81f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.322+0000 7f3eccc00640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ec80b82c0 0x7f3ec81f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.322+0000 7f3eccc00640 1 -- 172.21.15.8:0/4113458964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0009a70 con 0x7f3ec80d0020 2024-05-26T15:39:50.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.322+0000 7f3eccc00640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec80d0020 0x7f3ec80cb170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40098f0 tx=0x7f3eb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:50.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.323+0000 7f3ec5600640 1 -- 172.21.15.8:0/4113458964 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4030b80 con 0x7f3ec80d0020 2024-05-26T15:39:50.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.323+0000 7f3ec5600640 1 -- 172.21.15.8:0/4113458964 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb4032e90 con 0x7f3ec80d0020 2024-05-26T15:39:50.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.323+0000 7f3ecea00640 1 -- 172.21.15.8:0/4113458964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb4009400 con 0x7f3ec80d0020 2024-05-26T15:39:50.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.323+0000 7f3ec5600640 1 -- 172.21.15.8:0/4113458964 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4006e10 con 0x7f3ec80d0020 2024-05-26T15:39:50.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.323+0000 7f3ecea00640 1 -- 172.21.15.8:0/4113458964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec815d180 con 0x7f3ec80d0020 2024-05-26T15:39:50.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.324+0000 7f3ecea00640 1 -- 172.21.15.8:0/4113458964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec815d6a0 con 0x7f3ec80d0020 2024-05-26T15:39:50.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.325+0000 7f3ec5600640 1 -- 172.21.15.8:0/4113458964 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3eb4039040 con 0x7f3ec80d0020 2024-05-26T15:39:50.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.326+0000 7f3ec5600640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3ea806ac00 0x7f3ea806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.326+0000 7f3ec5600640 1 -- 172.21.15.8:0/4113458964 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3eb40a9fe0 con 0x7f3ec80d0020 2024-05-26T15:39:50.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.327+0000 7f3ecd600640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3ea806ac00 0x7f3ea806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:50.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.328+0000 7f3ecd600640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3ea806ac00 0x7f3ea806d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc005880 tx=0x7f3ebc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:50.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.330+0000 7f3ec5600640 1 -- 172.21.15.8:0/4113458964 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3ec815d6a0 con 0x7f3ec80d0020 2024-05-26T15:39:50.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.529+0000 7f3ecea00640 1 -- 172.21.15.8:0/4113458964 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ec815d660 con 0x7f3ec80d0020 2024-05-26T15:39:50.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.530+0000 7f3ec5600640 1 -- 172.21.15.8:0/4113458964 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3eb4074ee0 con 0x7f3ec80d0020 2024-05-26T15:39:50.529 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:39:50.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 -- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3ea806ac00 msgr2=0x7f3ea806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3ea806ac00 0x7f3ea806d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc005880 tx=0x7f3ebc009040 comp rx=0 tx=0).stop 2024-05-26T15:39:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 -- 172.21.15.8:0/4113458964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec80d0020 msgr2=0x7f3ec80cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec80d0020 0x7f3ec80cb170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40098f0 tx=0x7f3eb40046c0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 -- 172.21.15.8:0/4113458964 shutdown_connections 2024-05-26T15:39:50.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ec815ca00 0x7f3ec815f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ec80d0020 0x7f3ec80cb170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3ea806ac00 0x7f3ea806d0c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 --2- 172.21.15.8:0/4113458964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3ec80b82c0 0x7f3ec81f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 -- 172.21.15.8:0/4113458964 >> 172.21.15.8:0/4113458964 conn(0x7f3ec806b640 msgr2=0x7f3ec80d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:50.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 -- 172.21.15.8:0/4113458964 shutdown_connections 2024-05-26T15:39:50.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.533+0000 7f3ecea00640 1 -- 172.21.15.8:0/4113458964 wait complete. 2024-05-26T15:39:50.551 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:39:50.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.766+0000 7fc196c00640 1 Processor -- start 2024-05-26T15:39:50.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.766+0000 7fc196c00640 1 -- start start 2024-05-26T15:39:50.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.768+0000 7fc196c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc19006c3d0 0x7fc1900703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.768+0000 7fc196c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc1900708f0 0x7fc19013ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.768+0000 7fc196c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19015f140 con 0x7fc19013d860 2024-05-26T15:39:50.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.768+0000 7fc196c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc190070d60 con 0x7fc1900708f0 2024-05-26T15:39:50.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.768+0000 7fc196c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015e550 con 0x7fc19006c3d0 2024-05-26T15:39:50.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.768+0000 7fc196200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc1900708f0 0x7fc19013ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:50.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.768+0000 7fc196200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc1900708f0 0x7fc19013ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43686/0 (socket says 172.21.15.8:43686) 2024-05-26T15:39:50.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.768+0000 7fc196200640 1 -- 172.21.15.8:0/2453355489 learned_addr learned my addr 172.21.15.8:0/2453355489 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:50.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.768+0000 7fc195800640 1 --1- 172.21.15.8:0/2453355489 >> v1:172.21.15.8:6789/0 conn(0x7fc19013d860 0x7fc1900ccb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:35350/0 (socket says 172.21.15.8:35350) 2024-05-26T15:39:50.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.769+0000 7fc194e00640 1 --2- 172.21.15.8:0/2453355489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc19006c3d0 0x7fc1900703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.769+0000 7fc196200640 1 -- 172.21.15.8:0/2453355489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc19006c3d0 msgr2=0x7fc1900703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.769+0000 7fc196200640 1 --2- 172.21.15.8:0/2453355489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc19006c3d0 0x7fc1900703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.769+0000 7fc196200640 1 -- 172.21.15.8:0/2453355489 >> v1:172.21.15.8:6789/0 conn(0x7fc19013d860 legacy=0x7fc1900ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.769+0000 7fc196200640 1 -- 172.21.15.8:0/2453355489 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1900cd240 con 0x7fc1900708f0 2024-05-26T15:39:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.770+0000 7fc196200640 1 --2- 172.21.15.8:0/2453355489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 0x7fc19013ffa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc188009e50 tx=0x7fc18802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ea7fc4bf2b2784 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.770+0000 7fc18fe00640 1 -- 172.21.15.8:0/2453355489 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188031600 con 0x7fc1900708f0 2024-05-26T15:39:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.770+0000 7fc18fe00640 1 -- 172.21.15.8:0/2453355489 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18802d050 con 0x7fc1900708f0 2024-05-26T15:39:50.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.770+0000 7fc18fe00640 1 -- 172.21.15.8:0/2453355489 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188031980 con 0x7fc1900708f0 2024-05-26T15:39:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.771+0000 7fc196c00640 1 -- 172.21.15.8:0/2453355489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 msgr2=0x7fc19013ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.771+0000 7fc196c00640 1 --2- 172.21.15.8:0/2453355489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 0x7fc19013ffa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc188009e50 tx=0x7fc18802a730 comp rx=0 tx=0).stop 2024-05-26T15:39:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.771+0000 7fc196c00640 1 -- 172.21.15.8:0/2453355489 shutdown_connections 2024-05-26T15:39:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.771+0000 7fc196c00640 1 --2- 172.21.15.8:0/2453355489 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 0x7fc19013ffa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.771+0000 7fc196c00640 1 --2- 172.21.15.8:0/2453355489 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc19006c3d0 0x7fc1900703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.771+0000 7fc196c00640 1 -- 172.21.15.8:0/2453355489 >> 172.21.15.8:0/2453355489 conn(0x7fc190069e70 msgr2=0x7fc19006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.771+0000 7fc196c00640 1 -- 172.21.15.8:0/2453355489 shutdown_connections 2024-05-26T15:39:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.771+0000 7fc196c00640 1 -- 172.21.15.8:0/2453355489 wait complete. 2024-05-26T15:39:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.773+0000 7fc196c00640 1 Processor -- start 2024-05-26T15:39:50.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.773+0000 7fc196c00640 1 -- start start 2024-05-26T15:39:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.774+0000 7fc196c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc19006c3d0 0x7fc190137120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.774+0000 7fc196c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 0x7fc19015a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.774+0000 7fc196c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc19013d860 0x7fc1900b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.774+0000 7fc196c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015b160 con 0x7fc1900708f0 2024-05-26T15:39:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.774+0000 7fc196c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc190153340 con 0x7fc19006c3d0 2024-05-26T15:39:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.774+0000 7fc196c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015aba0 con 0x7fc19013d860 2024-05-26T15:39:50.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.774+0000 7fc194e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 0x7fc19015a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.774+0000 7fc194e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 0x7fc19015a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43698/0 (socket says 172.21.15.8:43698) 2024-05-26T15:39:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.774+0000 7fc194e00640 1 -- 172.21.15.8:0/3015221453 learned_addr learned my addr 172.21.15.8:0/3015221453 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.775+0000 7fc194e00640 1 -- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc19013d860 msgr2=0x7fc1900b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.775+0000 7fc194e00640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc19013d860 0x7fc1900b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.775+0000 7fc194e00640 1 -- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc19006c3d0 msgr2=0x7fc190137120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.775+0000 7fc194e00640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc19006c3d0 0x7fc190137120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.775+0000 7fc194e00640 1 -- 172.21.15.8:0/3015221453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188009b30 con 0x7fc1900708f0 2024-05-26T15:39:50.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.775+0000 7fc194e00640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 0x7fc19015a230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00d800 tx=0x7fc17c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:50.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.775+0000 7fc18d600640 1 -- 172.21.15.8:0/3015221453 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00b6c0 con 0x7fc1900708f0 2024-05-26T15:39:50.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.775+0000 7fc18d600640 1 -- 172.21.15.8:0/3015221453 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c00b820 con 0x7fc1900708f0 2024-05-26T15:39:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.775+0000 7fc18d600640 1 -- 172.21.15.8:0/3015221453 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00bbb0 con 0x7fc1900708f0 2024-05-26T15:39:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.775+0000 7fc196c00640 1 -- 172.21.15.8:0/3015221453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19015ae80 con 0x7fc1900708f0 2024-05-26T15:39:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.776+0000 7fc196c00640 1 -- 172.21.15.8:0/3015221453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19015a770 con 0x7fc1900708f0 2024-05-26T15:39:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.777+0000 7fc196c00640 1 -- 172.21.15.8:0/3015221453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc190066770 con 0x7fc1900708f0 2024-05-26T15:39:50.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.778+0000 7fc18d600640 1 -- 172.21.15.8:0/3015221453 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc17c00bd10 con 0x7fc1900708f0 2024-05-26T15:39:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.779+0000 7fc18d600640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc17006ac00 0x7fc17006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.779+0000 7fc18d600640 1 -- 172.21.15.8:0/3015221453 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc17c089ba0 con 0x7fc1900708f0 2024-05-26T15:39:50.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.779+0000 7fc195800640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc17006ac00 0x7fc17006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:50.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.780+0000 7fc195800640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc17006ac00 0x7fc17006d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc184001540 tx=0x7fc1840079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:50.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.783+0000 7fc18d600640 1 -- 172.21.15.8:0/3015221453 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc17c054a80 con 0x7fc1900708f0 2024-05-26T15:39:50.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.982+0000 7fc196c00640 1 -- 172.21.15.8:0/3015221453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1901534b0 con 0x7fc1900708f0 2024-05-26T15:39:50.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.983+0000 7fc18d600640 1 -- 172.21.15.8:0/3015221453 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc17c0580a0 con 0x7fc1900708f0 2024-05-26T15:39:50.982 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:39:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 -- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc17006ac00 msgr2=0x7fc17006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc17006ac00 0x7fc17006d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc184001540 tx=0x7fc1840079c0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 -- 172.21.15.8:0/3015221453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 msgr2=0x7fc19015a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 0x7fc19015a230 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00d800 tx=0x7fc17c00dcc0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 -- 172.21.15.8:0/3015221453 shutdown_connections 2024-05-26T15:39:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc19013d860 0x7fc1900b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1900708f0 0x7fc19015a230 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc17006ac00 0x7fc17006d0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 --2- 172.21.15.8:0/3015221453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc19006c3d0 0x7fc190137120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 -- 172.21.15.8:0/3015221453 >> 172.21.15.8:0/3015221453 conn(0x7fc190069e70 msgr2=0x7fc190151720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 -- 172.21.15.8:0/3015221453 shutdown_connections 2024-05-26T15:39:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:50.986+0000 7fc196c00640 1 -- 172.21.15.8:0/3015221453 wait complete. 2024-05-26T15:39:51.004 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:39:51.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.213+0000 7f21e7200640 1 Processor -- start 2024-05-26T15:39:51.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.214+0000 7f21e7200640 1 -- start start 2024-05-26T15:39:51.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.215+0000 7f21e7200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e00d0020 0x7f21e00d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.215+0000 7f21e7200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e00d20d0 con 0x7f21e015ca00 2024-05-26T15:39:51.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.215+0000 7f21e7200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e00d14c0 con 0x7f21e00b82c0 2024-05-26T15:39:51.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.215+0000 7f21e7200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00d06b0 con 0x7f21e00d0020 2024-05-26T15:39:51.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.216+0000 7f21e5e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f21e015ca00 0x7f21e00cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53344/0 (socket says 172.21.15.8:53344) 2024-05-26T15:39:51.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.216+0000 7f21e5e00640 1 -- 172.21.15.8:0/2058759444 learned_addr learned my addr 172.21.15.8:0/2058759444 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:51.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.216+0000 7f21e5400640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e00d0020 0x7f21e00d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.216+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297177010 0 0) 0x7f21e00d20d0 con 0x7f21e015ca00 2024-05-26T15:39:51.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.216+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21c8003520 con 0x7f21e015ca00 2024-05-26T15:39:51.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095311455 0 0) 0x7f21e00d14c0 con 0x7f21e00b82c0 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e00d20d0 con 0x7f21e00b82c0 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2255204331 0 0) 0x7f21c8003520 con 0x7f21e015ca00 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e00d0020 msgr2=0x7f21e00d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e00d0020 0x7f21e00d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 >> v1:172.21.15.47:6789/0 conn(0x7f21e00b82c0 legacy=0x7f21e00b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00d17a0 con 0x7f21e015ca00 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f21cc001670 con 0x7f21e015ca00 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 >> v1:172.21.15.8:6789/0 conn(0x7f21e015ca00 legacy=0x7f21e00cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e00d0020 0x7f21c8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c8004090 0x7f21c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00d06b0 con 0x7f21c8004090 2024-05-26T15:39:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c800ba60 con 0x7f21c8004d00 2024-05-26T15:39:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c800bc20 con 0x7f21e00d0020 2024-05-26T15:39:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.217+0000 7f21e5400640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c8004090 0x7f21c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.218+0000 7f21e5e00640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e00d0020 0x7f21c8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.218+0000 7f21e6800640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.218+0000 7f21e5400640 1 -- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e00d0020 msgr2=0x7f21c8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.218+0000 7f21e5400640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e00d0020 0x7f21c8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.218+0000 7f21e5400640 1 -- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c8004d00 msgr2=0x7f21c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.218+0000 7f21e5400640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.218+0000 7f21e5400640 1 -- 172.21.15.8:0/2058759444 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8003520 con 0x7f21c8004090 2024-05-26T15:39:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.218+0000 7f21e6800640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c8004d00 0x7f21c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:51.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.219+0000 7f21e5400640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c8004090 0x7f21c80047c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009ac0 tx=0x7f21c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80a6cf148c68067 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:51.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.219+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4031400 con 0x7f21c8004090 2024-05-26T15:39:51.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.219+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d402d050 con 0x7f21c8004090 2024-05-26T15:39:51.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.219+0000 7f21e4a00640 1 -- 172.21.15.8:0/2058759444 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4031780 con 0x7f21c8004090 2024-05-26T15:39:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.220+0000 7f21e7200640 1 -- 172.21.15.8:0/2058759444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c8004090 msgr2=0x7f21c80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.220+0000 7f21e7200640 1 --2- 172.21.15.8:0/2058759444 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21c8004090 0x7f21c80047c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009ac0 tx=0x7f21c80057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.220+0000 7f21e6800640 1 -- 172.21.15.8:0/2058759444 reap_dead start 2024-05-26T15:39:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.220+0000 7f21e7200640 1 -- 172.21.15.8:0/2058759444 shutdown_connections 2024-05-26T15:39:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.220+0000 7f21e7200640 1 -- 172.21.15.8:0/2058759444 >> 172.21.15.8:0/2058759444 conn(0x7f21e006b640 msgr2=0x7f21e006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.220+0000 7f21e7200640 1 -- 172.21.15.8:0/2058759444 shutdown_connections 2024-05-26T15:39:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.220+0000 7f21e7200640 1 -- 172.21.15.8:0/2058759444 wait complete. 2024-05-26T15:39:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.222+0000 7f21e7200640 1 Processor -- start 2024-05-26T15:39:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.223+0000 7f21e7200640 1 -- start start 2024-05-26T15:39:51.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.224+0000 7f21e7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c8004090 0x7f21e015f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.224+0000 7f21e7200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21e01f59d0 0x7f21e0152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.224+0000 7f21e7200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e01547c0 0x7f21e00d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.224+0000 7f21e7200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00c7650 con 0x7f21e01f59d0 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.224+0000 7f21e7200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015fdc0 con 0x7f21c8004090 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.224+0000 7f21e7200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00c9010 con 0x7f21e01547c0 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.224+0000 7f21e5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21e01f59d0 0x7f21e0152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.224+0000 7f21e5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21e01f59d0 0x7f21e0152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52148/0 (socket says 172.21.15.8:52148) 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.224+0000 7f21e5400640 1 -- 172.21.15.8:0/3589750061 learned_addr learned my addr 172.21.15.8:0/3589750061 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.225+0000 7f21e5e00640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c8004090 0x7f21e015f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.225+0000 7f21e6800640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e01547c0 0x7f21e00d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.225+0000 7f21e5400640 1 -- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e01547c0 msgr2=0x7f21e00d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.225+0000 7f21e5400640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e01547c0 0x7f21e00d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.225+0000 7f21e5400640 1 -- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c8004090 msgr2=0x7f21e015f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.225+0000 7f21e5400640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c8004090 0x7f21e015f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.225+0000 7f21e5400640 1 -- 172.21.15.8:0/3589750061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e01f5f20 con 0x7f21e01f59d0 2024-05-26T15:39:51.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.225+0000 7f21e5400640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21e01f59d0 0x7f21e0152dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f21d402aae0 tx=0x7f21d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:51.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.226+0000 7f21da000640 1 -- 172.21.15.8:0/3589750061 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4003c50 con 0x7f21e01f59d0 2024-05-26T15:39:51.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.226+0000 7f21da000640 1 -- 172.21.15.8:0/3589750061 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4003db0 con 0x7f21e01f59d0 2024-05-26T15:39:51.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.226+0000 7f21da000640 1 -- 172.21.15.8:0/3589750061 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d4044630 con 0x7f21e01f59d0 2024-05-26T15:39:51.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.226+0000 7f21e7200640 1 -- 172.21.15.8:0/3589750061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e01f6200 con 0x7f21e01f59d0 2024-05-26T15:39:51.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.226+0000 7f21e7200640 1 -- 172.21.15.8:0/3589750061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e01f67c0 con 0x7f21e01f59d0 2024-05-26T15:39:51.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.228+0000 7f21e7200640 1 -- 172.21.15.8:0/3589750061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e004e210 con 0x7f21e01f59d0 2024-05-26T15:39:51.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.229+0000 7f21da000640 1 -- 172.21.15.8:0/3589750061 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f21d4038070 con 0x7f21e01f59d0 2024-05-26T15:39:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.230+0000 7f21da000640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f21c006ac00 0x7f21c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.230+0000 7f21da000640 1 -- 172.21.15.8:0/3589750061 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21d40a9640 con 0x7f21e01f59d0 2024-05-26T15:39:51.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.230+0000 7f21e5e00640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f21c006ac00 0x7f21c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.231+0000 7f21e5e00640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f21c006ac00 0x7f21c006d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21cc001eb0 tx=0x7f21cc007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:51.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.234+0000 7f21da000640 1 -- 172.21.15.8:0/3589750061 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f21d40745d0 con 0x7f21e01f59d0 2024-05-26T15:39:51.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.430+0000 7f21e7200640 1 -- 172.21.15.8:0/3589750061 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f21e00b3f50 con 0x7f21e01f59d0 2024-05-26T15:39:51.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.431+0000 7f21da000640 1 -- 172.21.15.8:0/3589750061 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f21d4077bf0 con 0x7f21e01f59d0 2024-05-26T15:39:51.430 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:39:51.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.433+0000 7f21e7200640 1 -- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f21c006ac00 msgr2=0x7f21c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.433+0000 7f21e7200640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f21c006ac00 0x7f21c006d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f21cc001eb0 tx=0x7f21cc007040 comp rx=0 tx=0).stop 2024-05-26T15:39:51.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.433+0000 7f21e7200640 1 -- 172.21.15.8:0/3589750061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21e01f59d0 msgr2=0x7f21e0152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.433+0000 7f21e7200640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21e01f59d0 0x7f21e0152dd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f21d402aae0 tx=0x7f21d4004730 comp rx=0 tx=0).stop 2024-05-26T15:39:51.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.434+0000 7f21e7200640 1 -- 172.21.15.8:0/3589750061 shutdown_connections 2024-05-26T15:39:51.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.434+0000 7f21e7200640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f21e01547c0 0x7f21e00d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.434+0000 7f21e7200640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f21e01f59d0 0x7f21e0152dd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.434+0000 7f21e7200640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f21c006ac00 0x7f21c006d0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.434+0000 7f21e7200640 1 --2- 172.21.15.8:0/3589750061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c8004090 0x7f21e015f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.434+0000 7f21e7200640 1 -- 172.21.15.8:0/3589750061 >> 172.21.15.8:0/3589750061 conn(0x7f21e006b640 msgr2=0x7f21e0159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:51.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.434+0000 7f21e7200640 1 -- 172.21.15.8:0/3589750061 shutdown_connections 2024-05-26T15:39:51.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.434+0000 7f21e7200640 1 -- 172.21.15.8:0/3589750061 wait complete. 2024-05-26T15:39:51.453 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-26T15:39:51.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.660+0000 7fb8baa00640 1 Processor -- start 2024-05-26T15:39:51.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.661+0000 7fb8baa00640 1 -- start start 2024-05-26T15:39:51.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.662+0000 7fb8baa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb8b40cdac0 0x7fb8b40c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.662+0000 7fb8baa00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b40c5840 con 0x7fb8b406d940 2024-05-26T15:39:51.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.662+0000 7fb8baa00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b406aa20 con 0x7fb8b41550f0 2024-05-26T15:39:51.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.663+0000 7fb8baa00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b415ae80 con 0x7fb8b40cdac0 2024-05-26T15:39:51.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.663+0000 7fb8b8c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb8b406d940 0x7fb8b40cd3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53358/0 (socket says 172.21.15.8:53358) 2024-05-26T15:39:51.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.663+0000 7fb8b8c00640 1 -- 172.21.15.8:0/1267286278 learned_addr learned my addr 172.21.15.8:0/1267286278 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:51.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.663+0000 7fb8ba000640 1 --2- 172.21.15.8:0/1267286278 >> v2:172.21.15.8:3300/0 conn(0x7fb8b40cdac0 0x7fb8b40c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.663+0000 7fb8b3e00640 1 -- 172.21.15.8:0/1267286278 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693061336 0 0) 0x7fb8a4001490 con 0x7fb8b406d940 2024-05-26T15:39:51.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.664+0000 7fb8b3e00640 1 -- 172.21.15.8:0/1267286278 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb89c003520 con 0x7fb8b406d940 2024-05-26T15:39:51.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.664+0000 7fb8ba000640 1 -- 172.21.15.8:0/1267286278 >> v1:172.21.15.47:6789/0 conn(0x7fb8b41550f0 legacy=0x7fb8b415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.664+0000 7fb8ba000640 1 -- 172.21.15.8:0/1267286278 >> v1:172.21.15.8:6789/0 conn(0x7fb8b406d940 legacy=0x7fb8b40cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.664+0000 7fb8ba000640 1 -- 172.21.15.8:0/1267286278 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40c5280 con 0x7fb8b40cdac0 2024-05-26T15:39:51.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.665+0000 7fb8ba000640 1 --2- 172.21.15.8:0/1267286278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b40cdac0 0x7fb8b40c4b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0097a0 tx=0x7fb8ac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f328f7f440e17c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:51.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.665+0000 7fb8b3e00640 1 -- 172.21.15.8:0/1267286278 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac032440 con 0x7fb8b40cdac0 2024-05-26T15:39:51.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.665+0000 7fb8b3e00640 1 -- 172.21.15.8:0/1267286278 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac0325a0 con 0x7fb8b40cdac0 2024-05-26T15:39:51.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.665+0000 7fb8b3e00640 1 -- 172.21.15.8:0/1267286278 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac032930 con 0x7fb8b40cdac0 2024-05-26T15:39:51.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.666+0000 7fb8baa00640 1 -- 172.21.15.8:0/1267286278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b40cdac0 msgr2=0x7fb8b40c4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.666+0000 7fb8baa00640 1 --2- 172.21.15.8:0/1267286278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b40cdac0 0x7fb8b40c4b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0097a0 tx=0x7fb8ac02a230 comp rx=0 tx=0).stop 2024-05-26T15:39:51.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.666+0000 7fb8baa00640 1 -- 172.21.15.8:0/1267286278 shutdown_connections 2024-05-26T15:39:51.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.666+0000 7fb8baa00640 1 --2- 172.21.15.8:0/1267286278 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b40cdac0 0x7fb8b40c4b30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.666+0000 7fb8baa00640 1 -- 172.21.15.8:0/1267286278 >> 172.21.15.8:0/1267286278 conn(0x7fb8b40662e0 msgr2=0x7fb8b4069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:51.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.666+0000 7fb8baa00640 1 -- 172.21.15.8:0/1267286278 shutdown_connections 2024-05-26T15:39:51.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.666+0000 7fb8baa00640 1 -- 172.21.15.8:0/1267286278 wait complete. 2024-05-26T15:39:51.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.668+0000 7fb8baa00640 1 Processor -- start 2024-05-26T15:39:51.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.668+0000 7fb8baa00640 1 -- start start 2024-05-26T15:39:51.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.669+0000 7fb8baa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b406d940 0x7fb8b4141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.669+0000 7fb8baa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8b40cdac0 0x7fb8b414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.669+0000 7fb8baa00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8b41550f0 0x7fb8b415dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.669+0000 7fb8baa00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b41f4a40 con 0x7fb8b406d940 2024-05-26T15:39:51.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.669+0000 7fb8baa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4140970 con 0x7fb8b40cdac0 2024-05-26T15:39:51.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.669+0000 7fb8baa00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4140c50 con 0x7fb8b41550f0 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.669+0000 7fb8b9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b406d940 0x7fb8b4141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.669+0000 7fb8b9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b406d940 0x7fb8b4141730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52160/0 (socket says 172.21.15.8:52160) 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.669+0000 7fb8b9600640 1 -- 172.21.15.8:0/2340490688 learned_addr learned my addr 172.21.15.8:0/2340490688 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b8c00640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8b40cdac0 0x7fb8b414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8ba000640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8b41550f0 0x7fb8b415dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b9600640 1 -- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8b41550f0 msgr2=0x7fb8b415dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b9600640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8b41550f0 0x7fb8b415dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b9600640 1 -- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8b40cdac0 msgr2=0x7fb8b414f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b9600640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8b40cdac0 0x7fb8b414f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b9600640 1 -- 172.21.15.8:0/2340490688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac009400 con 0x7fb8b406d940 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b8c00640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8b40cdac0 0x7fb8b414f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:51.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b9600640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b406d940 0x7fb8b4141730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c400 tx=0x7fb8a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:51.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b1600640 1 -- 172.21.15.8:0/2340490688 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80052d0 con 0x7fb8b406d940 2024-05-26T15:39:51.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b1600640 1 -- 172.21.15.8:0/2340490688 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8005430 con 0x7fb8b406d940 2024-05-26T15:39:51.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8b1600640 1 -- 172.21.15.8:0/2340490688 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8003830 con 0x7fb8b406d940 2024-05-26T15:39:51.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.670+0000 7fb8baa00640 1 -- 172.21.15.8:0/2340490688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b4140f30 con 0x7fb8b406d940 2024-05-26T15:39:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.671+0000 7fb8baa00640 1 -- 172.21.15.8:0/2340490688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b415e940 con 0x7fb8b406d940 2024-05-26T15:39:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.672+0000 7fb8baa00640 1 -- 172.21.15.8:0/2340490688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b4141450 con 0x7fb8b406d940 2024-05-26T15:39:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.673+0000 7fb8b1600640 1 -- 172.21.15.8:0/2340490688 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb8a8003990 con 0x7fb8b406d940 2024-05-26T15:39:51.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.674+0000 7fb8b1600640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb89806ac00 0x7fb89806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:51.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.674+0000 7fb8b1600640 1 -- 172.21.15.8:0/2340490688 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb8a8088b30 con 0x7fb8b406d940 2024-05-26T15:39:51.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.675+0000 7fb8b8c00640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb89806ac00 0x7fb89806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.676+0000 7fb8b8c00640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb89806ac00 0x7fb89806d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb8b41f3a20 tx=0x7fb8a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:51.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.679+0000 7fb8b1600640 1 -- 172.21.15.8:0/2340490688 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb8b4141450 con 0x7fb8b406d940 2024-05-26T15:39:51.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.893+0000 7fb8baa00640 1 -- 172.21.15.8:0/2340490688 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb8b404e280 con 0x7fb8b406d940 2024-05-26T15:39:51.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.894+0000 7fb8b1600640 1 -- 172.21.15.8:0/2340490688 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb8a8017080 con 0x7fb8b406d940 2024-05-26T15:39:51.893 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2024-05-26T15:39:51.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 -- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb89806ac00 msgr2=0x7fb89806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb89806ac00 0x7fb89806d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb8b41f3a20 tx=0x7fb8a4009040 comp rx=0 tx=0).stop 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 -- 172.21.15.8:0/2340490688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b406d940 msgr2=0x7fb8b4141730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b406d940 0x7fb8b4141730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800c400 tx=0x7fb8a800c8c0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 -- 172.21.15.8:0/2340490688 shutdown_connections 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb8b41550f0 0x7fb8b415dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb89806ac00 0x7fb89806d0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8b40cdac0 0x7fb8b414f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 --2- 172.21.15.8:0/2340490688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb8b406d940 0x7fb8b4141730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 -- 172.21.15.8:0/2340490688 >> 172.21.15.8:0/2340490688 conn(0x7fb8b40662e0 msgr2=0x7fb8b40b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 -- 172.21.15.8:0/2340490688 shutdown_connections 2024-05-26T15:39:51.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:51.897+0000 7fb8baa00640 1 -- 172.21.15.8:0/2340490688 wait complete. 2024-05-26T15:39:51.915 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi008.front.sepia.ceph.com... 2024-05-26T15:39:51.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:51.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-26T15:39:51.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi008.stderr:ceph-fuse[42111]: fuse finished with error 0 and tester_r 0 2024-05-26T15:39:51.990 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:39:58.037 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:39:58.045 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:39:58.091 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:39:58.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:39:58.092 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-26T15:39:58.176 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:58.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.436+0000 7fcfc0c00640 1 Processor -- start 2024-05-26T15:39:58.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.436+0000 7fcfc0c00640 1 -- start start 2024-05-26T15:39:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.438+0000 7fcfc0c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcfbc144530 0x7fcfbc0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.438+0000 7fcfc0c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcfbc070d70 0x7fcfbc0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.438+0000 7fcfc0c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfbc0b1db0 con 0x7fcfbc144150 2024-05-26T15:39:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.438+0000 7fcfc0c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc0cc8f0 con 0x7fcfbc070d70 2024-05-26T15:39:58.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.438+0000 7fcfc0c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc0cbac0 con 0x7fcfbc144530 2024-05-26T15:39:58.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.438+0000 7fcfba800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcfbc070d70 0x7fcfbc0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.438+0000 7fcfba800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcfbc070d70 0x7fcfbc0cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52162/0 (socket says 172.21.15.8:52162) 2024-05-26T15:39:58.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.438+0000 7fcfba800640 1 -- 172.21.15.8:0/4085763390 learned_addr learned my addr 172.21.15.8:0/4085763390 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:58.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.439+0000 7fcfb9400640 1 --2- 172.21.15.8:0/4085763390 >> v2:172.21.15.47:3300/0 conn(0x7fcfbc144530 0x7fcfbc0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.439+0000 7fcfba800640 1 -- 172.21.15.8:0/4085763390 >> v2:172.21.15.47:3300/0 conn(0x7fcfbc144530 msgr2=0x7fcfbc0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.439+0000 7fcfba800640 1 --2- 172.21.15.8:0/4085763390 >> v2:172.21.15.47:3300/0 conn(0x7fcfbc144530 0x7fcfbc0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.439+0000 7fcfba800640 1 -- 172.21.15.8:0/4085763390 >> v1:172.21.15.47:6789/0 conn(0x7fcfbc144150 legacy=0x7fcfbc070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.439+0000 7fcfba800640 1 -- 172.21.15.8:0/4085763390 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc0ccb90 con 0x7fcfbc070d70 2024-05-26T15:39:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.439+0000 7fcfb9400640 1 --2- 172.21.15.8:0/4085763390 >> v2:172.21.15.47:3300/0 conn(0x7fcfbc144530 0x7fcfbc0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:58.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.440+0000 7fcfba800640 1 --2- 172.21.15.8:0/4085763390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 0x7fcfbc0cad90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc071ab0 tx=0x7fcfb402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463bac195651d8dd server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:58.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.440+0000 7fcfb8a00640 1 -- 172.21.15.8:0/4085763390 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4031600 con 0x7fcfbc070d70 2024-05-26T15:39:58.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.440+0000 7fcfb8a00640 1 -- 172.21.15.8:0/4085763390 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb402d050 con 0x7fcfbc070d70 2024-05-26T15:39:58.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.440+0000 7fcfb8a00640 1 -- 172.21.15.8:0/4085763390 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4031980 con 0x7fcfbc070d70 2024-05-26T15:39:58.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.441+0000 7fcfc0c00640 1 -- 172.21.15.8:0/4085763390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 msgr2=0x7fcfbc0cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:58.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.441+0000 7fcfc0c00640 1 --2- 172.21.15.8:0/4085763390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 0x7fcfbc0cad90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc071ab0 tx=0x7fcfb402a6f0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.441+0000 7fcfc0c00640 1 -- 172.21.15.8:0/4085763390 shutdown_connections 2024-05-26T15:39:58.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.441+0000 7fcfc0c00640 1 --2- 172.21.15.8:0/4085763390 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 0x7fcfbc0cad90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.441+0000 7fcfc0c00640 1 --2- 172.21.15.8:0/4085763390 >> v2:172.21.15.47:3300/0 conn(0x7fcfbc144530 0x7fcfbc0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.441+0000 7fcfc0c00640 1 -- 172.21.15.8:0/4085763390 >> 172.21.15.8:0/4085763390 conn(0x7fcfbc0b0570 msgr2=0x7fcfbc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:58.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.441+0000 7fcfc0c00640 1 -- 172.21.15.8:0/4085763390 shutdown_connections 2024-05-26T15:39:58.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.441+0000 7fcfc0c00640 1 -- 172.21.15.8:0/4085763390 wait complete. 2024-05-26T15:39:58.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.443+0000 7fcfc0c00640 1 Processor -- start 2024-05-26T15:39:58.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.443+0000 7fcfc0c00640 1 -- start start 2024-05-26T15:39:58.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.444+0000 7fcfc0c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 0x7fcfbc0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.444+0000 7fcfc0c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfbc144150 0x7fcfbc13cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.444+0000 7fcfc0c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcfbc144530 0x7fcfbc157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.444+0000 7fcfc0c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc13dc80 con 0x7fcfbc070d70 2024-05-26T15:39:58.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.444+0000 7fcfc0c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc13d6c0 con 0x7fcfbc144150 2024-05-26T15:39:58.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.444+0000 7fcfc0c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc13d9a0 con 0x7fcfbc144530 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.444+0000 7fcfb9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 0x7fcfbc0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.444+0000 7fcfb9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 0x7fcfbc0af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52178/0 (socket says 172.21.15.8:52178) 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.445+0000 7fcfb9e00640 1 -- 172.21.15.8:0/3583674809 learned_addr learned my addr 172.21.15.8:0/3583674809 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.445+0000 7fcfb9400640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfbc144150 0x7fcfbc13cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.445+0000 7fcfba800640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcfbc144530 0x7fcfbc157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.445+0000 7fcfb9e00640 1 -- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcfbc144530 msgr2=0x7fcfbc157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.445+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcfbc144530 0x7fcfbc157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.445+0000 7fcfb9e00640 1 -- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfbc144150 msgr2=0x7fcfbc13cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.445+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfbc144150 0x7fcfbc13cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.445+0000 7fcfb9e00640 1 -- 172.21.15.8:0/3583674809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4009b30 con 0x7fcfbc070d70 2024-05-26T15:39:58.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.445+0000 7fcfb9400640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfbc144150 0x7fcfbc13cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:39:58.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.445+0000 7fcfb9e00640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 0x7fcfbc0af8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c430 tx=0x7fcfac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:58.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.446+0000 7fcfb2000640 1 -- 172.21.15.8:0/3583674809 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac011790 con 0x7fcfbc070d70 2024-05-26T15:39:58.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.446+0000 7fcfb2000640 1 -- 172.21.15.8:0/3583674809 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac0118f0 con 0x7fcfbc070d70 2024-05-26T15:39:58.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.446+0000 7fcfb2000640 1 -- 172.21.15.8:0/3583674809 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac011ce0 con 0x7fcfbc070d70 2024-05-26T15:39:58.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.446+0000 7fcfc0c00640 1 -- 172.21.15.8:0/3583674809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc1e45e0 con 0x7fcfbc070d70 2024-05-26T15:39:58.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.446+0000 7fcfc0c00640 1 -- 172.21.15.8:0/3583674809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc158ea0 con 0x7fcfbc070d70 2024-05-26T15:39:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.447+0000 7fcfc0c00640 1 -- 172.21.15.8:0/3583674809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc1e4b00 con 0x7fcfbc070d70 2024-05-26T15:39:58.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.448+0000 7fcfb2000640 1 -- 172.21.15.8:0/3583674809 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcfac01c460 con 0x7fcfbc070d70 2024-05-26T15:39:58.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.449+0000 7fcfb2000640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcf9c06ac00 0x7fcf9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.449+0000 7fcfb2000640 1 -- 172.21.15.8:0/3583674809 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcfac089680 con 0x7fcfbc070d70 2024-05-26T15:39:58.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.450+0000 7fcfb9400640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcf9c06ac00 0x7fcf9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.451+0000 7fcfb9400640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcf9c06ac00 0x7fcf9c06d0c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0b03a0 tx=0x7fcfa8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:58.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.454+0000 7fcfb2000640 1 -- 172.21.15.8:0/3583674809 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcfac0544d0 con 0x7fcfbc070d70 2024-05-26T15:39:58.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.656+0000 7fcfc0c00640 1 -- 172.21.15.8:0/3583674809 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfbc0681d0 con 0x7fcfbc070d70 2024-05-26T15:39:58.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.659+0000 7fcfb2000640 1 -- 172.21.15.8:0/3583674809 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7fcfac057af0 con 0x7fcfbc070d70 2024-05-26T15:39:58.657 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:58.658 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:58.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.661+0000 7fcfc0c00640 1 -- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcf9c06ac00 msgr2=0x7fcf9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:58.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.661+0000 7fcfc0c00640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcf9c06ac00 0x7fcf9c06d0c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0b03a0 tx=0x7fcfa8008040 comp rx=0 tx=0).stop 2024-05-26T15:39:58.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.661+0000 7fcfc0c00640 1 -- 172.21.15.8:0/3583674809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 msgr2=0x7fcfbc0af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:58.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.661+0000 7fcfc0c00640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 0x7fcfbc0af8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c430 tx=0x7fcfac00c8f0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.661+0000 7fcfc0c00640 1 -- 172.21.15.8:0/3583674809 shutdown_connections 2024-05-26T15:39:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.661+0000 7fcfc0c00640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcfbc144530 0x7fcfbc157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.661+0000 7fcfc0c00640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcf9c06ac00 0x7fcf9c06d0c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.662+0000 7fcfc0c00640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfbc144150 0x7fcfbc13cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.662+0000 7fcfc0c00640 1 --2- 172.21.15.8:0/3583674809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcfbc070d70 0x7fcfbc0af8f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.662+0000 7fcfc0c00640 1 -- 172.21.15.8:0/3583674809 >> 172.21.15.8:0/3583674809 conn(0x7fcfbc0b0570 msgr2=0x7fcfbc15a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.662+0000 7fcfc0c00640 1 -- 172.21.15.8:0/3583674809 shutdown_connections 2024-05-26T15:39:58.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.662+0000 7fcfc0c00640 1 -- 172.21.15.8:0/3583674809 wait complete. 2024-05-26T15:39:58.679 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:39:58.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.877+0000 7fc8fac00640 1 Processor -- start 2024-05-26T15:39:58.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.877+0000 7fc8fac00640 1 -- start start 2024-05-26T15:39:58.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8fac00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f41600d0 0x7fc8f40cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8fac00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc8f40b8720 0x7fc8f40cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8fac00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f40b7eb0 con 0x7fc8f40d1310 2024-05-26T15:39:58.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8fac00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f40d0ef0 con 0x7fc8f40b8720 2024-05-26T15:39:58.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8fac00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f41604b0 con 0x7fc8f41600d0 2024-05-26T15:39:58.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8fa200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc8f40d1310 0x7fc8f40d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53364/0 (socket says 172.21.15.8:53364) 2024-05-26T15:39:58.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8fa200640 1 -- 172.21.15.8:0/2904585840 learned_addr learned my addr 172.21.15.8:0/2904585840 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:58.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8f8e00640 1 --2- 172.21.15.8:0/2904585840 >> v2:172.21.15.47:3300/0 conn(0x7fc8f40b8720 0x7fc8f40cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8f9800640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f41600d0 0x7fc8f40cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086522124 0 0) 0x7fc8f40b7eb0 con 0x7fc8f40d1310 2024-05-26T15:39:58.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.879+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8dc003520 con 0x7fc8f40d1310 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3475218501 0 0) 0x7fc8dc003520 con 0x7fc8f40d1310 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f41600d0 msgr2=0x7fc8f40cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f41600d0 0x7fc8f40cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 >> v2:172.21.15.47:3300/0 conn(0x7fc8f40b8720 msgr2=0x7fc8f40cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 --2- 172.21.15.8:0/2904585840 >> v2:172.21.15.47:3300/0 conn(0x7fc8f40b8720 0x7fc8f40cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40b7610 con 0x7fc8f40d1310 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fc8ec0019f0 con 0x7fc8f40d1310 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 >> v1:172.21.15.8:6789/0 conn(0x7fc8f40d1310 legacy=0x7fc8f40d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f41600d0 0x7fc8dc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc003ef0 0x7fc8dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8dc004d00 0x7fc8dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40d0ef0 con 0x7fc8dc004d00 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f41604b0 con 0x7fc8dc003ef0 2024-05-26T15:39:58.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc00b980 con 0x7fc8f41600d0 2024-05-26T15:39:58.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.880+0000 7fc8fa200640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8dc004d00 0x7fc8dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.881+0000 7fc8f8e00640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc003ef0 0x7fc8dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.881+0000 7fc8f9800640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f41600d0 0x7fc8dc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.881+0000 7fc8fa200640 1 -- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f41600d0 msgr2=0x7fc8dc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:58.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.881+0000 7fc8fa200640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f41600d0 0x7fc8dc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.881+0000 7fc8fa200640 1 -- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc003ef0 msgr2=0x7fc8dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:58.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.881+0000 7fc8fa200640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8dc003ef0 0x7fc8dc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.881+0000 7fc8fa200640 1 -- 172.21.15.8:0/2904585840 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc003520 con 0x7fc8dc004d00 2024-05-26T15:39:58.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.882+0000 7fc8fa200640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8dc004d00 0x7fc8dc005180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00a860 tx=0x7fc8dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1d3d75ece9e2d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:58.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.883+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec02ba70 con 0x7fc8dc004d00 2024-05-26T15:39:58.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.883+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec02bbd0 con 0x7fc8dc004d00 2024-05-26T15:39:58.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.883+0000 7fc8f3e00640 1 -- 172.21.15.8:0/2904585840 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec034470 con 0x7fc8dc004d00 2024-05-26T15:39:58.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.883+0000 7fc8fac00640 1 -- 172.21.15.8:0/2904585840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8dc004d00 msgr2=0x7fc8dc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:58.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.883+0000 7fc8fac00640 1 --2- 172.21.15.8:0/2904585840 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8dc004d00 0x7fc8dc005180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec00a860 tx=0x7fc8dc0057f0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.883+0000 7fc8fa200640 1 -- 172.21.15.8:0/2904585840 reap_dead start 2024-05-26T15:39:58.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.883+0000 7fc8fac00640 1 -- 172.21.15.8:0/2904585840 shutdown_connections 2024-05-26T15:39:58.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.883+0000 7fc8fac00640 1 -- 172.21.15.8:0/2904585840 >> 172.21.15.8:0/2904585840 conn(0x7fc8f406b750 msgr2=0x7fc8f406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:58.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.883+0000 7fc8fac00640 1 -- 172.21.15.8:0/2904585840 shutdown_connections 2024-05-26T15:39:58.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.883+0000 7fc8fac00640 1 -- 172.21.15.8:0/2904585840 wait complete. 2024-05-26T15:39:58.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.885+0000 7fc8fac00640 1 Processor -- start 2024-05-26T15:39:58.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.885+0000 7fc8fac00640 1 -- start start 2024-05-26T15:39:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.886+0000 7fc8fac00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f40b40b0 0x7fc8f41f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.886+0000 7fc8fac00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8f4157730 0x7fc8f415bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.886+0000 7fc8fac00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8f415c090 0x7fc8f4147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.886+0000 7fc8fac00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f4145bb0 con 0x7fc8f4157730 2024-05-26T15:39:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.886+0000 7fc8fac00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f415c540 con 0x7fc8f415c090 2024-05-26T15:39:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.886+0000 7fc8fac00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40b4490 con 0x7fc8f40b40b0 2024-05-26T15:39:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.886+0000 7fc8f8e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8f4157730 0x7fc8f415bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.886+0000 7fc8f8e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8f4157730 0x7fc8f415bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52186/0 (socket says 172.21.15.8:52186) 2024-05-26T15:39:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f8e00640 1 -- 172.21.15.8:0/1976281979 learned_addr learned my addr 172.21.15.8:0/1976281979 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:58.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f9800640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f40b40b0 0x7fc8f41f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8fa200640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8f415c090 0x7fc8f4147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f8e00640 1 -- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f40b40b0 msgr2=0x7fc8f41f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f8e00640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f40b40b0 0x7fc8f41f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f8e00640 1 -- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8f415c090 msgr2=0x7fc8f4147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f8e00640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8f415c090 0x7fc8f4147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f8e00640 1 -- 172.21.15.8:0/1976281979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f4157ea0 con 0x7fc8f4157730 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f9800640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f40b40b0 0x7fc8f41f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f8e00640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8f4157730 0x7fc8f415bb50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0011560 tx=0x7fc8e0011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f1600640 1 -- 172.21.15.8:0/1976281979 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0004220 con 0x7fc8f4157730 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.888+0000 7fc8fac00640 1 -- 172.21.15.8:0/1976281979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f4158180 con 0x7fc8f4157730 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.887+0000 7fc8f1600640 1 -- 172.21.15.8:0/1976281979 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0004380 con 0x7fc8f4157730 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.888+0000 7fc8f1600640 1 -- 172.21.15.8:0/1976281979 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0015870 con 0x7fc8f4157730 2024-05-26T15:39:58.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.888+0000 7fc8fac00640 1 -- 172.21.15.8:0/1976281979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f4158740 con 0x7fc8f4157730 2024-05-26T15:39:58.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.889+0000 7fc8fac00640 1 -- 172.21.15.8:0/1976281979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f4145d60 con 0x7fc8f4157730 2024-05-26T15:39:58.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.890+0000 7fc8f1600640 1 -- 172.21.15.8:0/1976281979 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc8e00159d0 con 0x7fc8f4157730 2024-05-26T15:39:58.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.891+0000 7fc8f1600640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc8d406ac00 0x7fc8d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:58.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.891+0000 7fc8f1600640 1 -- 172.21.15.8:0/1976281979 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc8e00898d0 con 0x7fc8f4157730 2024-05-26T15:39:58.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.892+0000 7fc8f9800640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc8d406ac00 0x7fc8d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:58.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.893+0000 7fc8f9800640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc8d406ac00 0x7fc8d406d0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009a00 tx=0x7fc8e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:58.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:58.896+0000 7fc8f1600640 1 -- 172.21.15.8:0/1976281979 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc8f4145d60 con 0x7fc8f4157730 2024-05-26T15:39:59.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.097+0000 7fc8fac00640 1 -- 172.21.15.8:0/1976281979 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8f4145d60 con 0x7fc8f4157730 2024-05-26T15:39:59.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.099+0000 7fc8f1600640 1 -- 172.21.15.8:0/1976281979 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7fc8f4145d60 con 0x7fc8f4157730 2024-05-26T15:39:59.098 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:39:59.098 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:39:59.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 -- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc8d406ac00 msgr2=0x7fc8d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc8d406ac00 0x7fc8d406d0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009a00 tx=0x7fc8e8008040 comp rx=0 tx=0).stop 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 -- 172.21.15.8:0/1976281979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8f4157730 msgr2=0x7fc8f415bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8f4157730 0x7fc8f415bb50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0011560 tx=0x7fc8e0011a20 comp rx=0 tx=0).stop 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 -- 172.21.15.8:0/1976281979 shutdown_connections 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc8d406ac00 0x7fc8d406d0c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8f415c090 0x7fc8f4147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc8f4157730 0x7fc8f415bb50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 --2- 172.21.15.8:0/1976281979 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8f40b40b0 0x7fc8f41f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 -- 172.21.15.8:0/1976281979 >> 172.21.15.8:0/1976281979 conn(0x7fc8f406b750 msgr2=0x7fc8f40d31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 -- 172.21.15.8:0/1976281979 shutdown_connections 2024-05-26T15:39:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.102+0000 7fc8fac00640 1 -- 172.21.15.8:0/1976281979 wait complete. 2024-05-26T15:39:59.122 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-26T15:39:59.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.305+0000 7fab65600640 1 Processor -- start 2024-05-26T15:39:59.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.305+0000 7fab65600640 1 -- start start 2024-05-26T15:39:59.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.306+0000 7fab65600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fab600d0020 0x7fab600d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:59.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.307+0000 7fab65600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600b82c0 0x7fab600b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:59.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.307+0000 7fab65600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab600d20d0 con 0x7fab6015ca00 2024-05-26T15:39:59.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.307+0000 7fab65600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab600d06b0 con 0x7fab600d0020 2024-05-26T15:39:59.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.307+0000 7fab65600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600d12b0 con 0x7fab600b82c0 2024-05-26T15:39:59.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.307+0000 7fab64c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600b82c0 0x7fab600b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:59.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.307+0000 7fab5fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fab6015ca00 0x7fab600cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:52330/0 (socket says 172.21.15.8:52330) 2024-05-26T15:39:59.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.307+0000 7fab5f400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fab600d0020 0x7fab600d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:59.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.307+0000 7fab5fe00640 1 -- 172.21.15.8:0/2551024873 learned_addr learned my addr 172.21.15.8:0/2551024873 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:39:59.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.308+0000 7fab64c00640 1 -- 172.21.15.8:0/2551024873 >> v2:172.21.15.47:3300/0 conn(0x7fab600d0020 msgr2=0x7fab600d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:39:59.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.308+0000 7fab64c00640 1 --2- 172.21.15.8:0/2551024873 >> v2:172.21.15.47:3300/0 conn(0x7fab600d0020 0x7fab600d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:59.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.308+0000 7fab64c00640 1 -- 172.21.15.8:0/2551024873 >> v1:172.21.15.47:6789/0 conn(0x7fab6015ca00 legacy=0x7fab600cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:59.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.308+0000 7fab64c00640 1 -- 172.21.15.8:0/2551024873 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab600d14c0 con 0x7fab600b82c0 2024-05-26T15:39:59.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.309+0000 7fab64c00640 1 --2- 172.21.15.8:0/2551024873 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600b82c0 0x7fab600b5ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab58009d90 tx=0x7fab5802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15ac59fd75e01a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:59.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.310+0000 7fab5ea00640 1 -- 172.21.15.8:0/2551024873 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58007740 con 0x7fab600b82c0 2024-05-26T15:39:59.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.310+0000 7fab5ea00640 1 -- 172.21.15.8:0/2551024873 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5802d050 con 0x7fab600b82c0 2024-05-26T15:39:59.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.310+0000 7fab5ea00640 1 -- 172.21.15.8:0/2551024873 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58007ac0 con 0x7fab600b82c0 2024-05-26T15:39:59.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.310+0000 7fab65600640 1 -- 172.21.15.8:0/2551024873 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600b82c0 msgr2=0x7fab600b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:59.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.310+0000 7fab65600640 1 --2- 172.21.15.8:0/2551024873 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600b82c0 0x7fab600b5ad0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab58009d90 tx=0x7fab5802a660 comp rx=0 tx=0).stop 2024-05-26T15:39:59.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.310+0000 7fab65600640 1 -- 172.21.15.8:0/2551024873 shutdown_connections 2024-05-26T15:39:59.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.310+0000 7fab65600640 1 --2- 172.21.15.8:0/2551024873 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600b82c0 0x7fab600b5ad0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:59.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.310+0000 7fab65600640 1 --2- 172.21.15.8:0/2551024873 >> v2:172.21.15.47:3300/0 conn(0x7fab600d0020 0x7fab600d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:59.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.310+0000 7fab65600640 1 -- 172.21.15.8:0/2551024873 >> 172.21.15.8:0/2551024873 conn(0x7fab6006b640 msgr2=0x7fab6006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:39:59.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.311+0000 7fab65600640 1 -- 172.21.15.8:0/2551024873 shutdown_connections 2024-05-26T15:39:59.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.311+0000 7fab65600640 1 -- 172.21.15.8:0/2551024873 wait complete. 2024-05-26T15:39:59.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.312+0000 7fab65600640 1 Processor -- start 2024-05-26T15:39:59.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.312+0000 7fab65600640 1 -- start start 2024-05-26T15:39:59.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.313+0000 7fab65600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab600b82c0 0x7fab6014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:59.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.313+0000 7fab65600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600d0020 0x7fab60154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:59.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.313+0000 7fab65600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab6015ca00 0x7fab6015da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:59.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.313+0000 7fab65600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c65e0 con 0x7fab600b82c0 2024-05-26T15:39:59.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.313+0000 7fab65600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c68c0 con 0x7fab6015ca00 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.313+0000 7fab65600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c6ba0 con 0x7fab600d0020 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.313+0000 7fab5fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab600b82c0 0x7fab6014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.314+0000 7fab5fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab600b82c0 0x7fab6014ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52190/0 (socket says 172.21.15.8:52190) 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.314+0000 7fab5fe00640 1 -- 172.21.15.8:0/3868630518 learned_addr learned my addr 172.21.15.8:0/3868630518 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.314+0000 7fab5f400640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600d0020 0x7fab60154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.314+0000 7fab64c00640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab6015ca00 0x7fab6015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.314+0000 7fab5fe00640 1 -- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600d0020 msgr2=0x7fab60154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.314+0000 7fab5fe00640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600d0020 0x7fab60154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.314+0000 7fab5fe00640 1 -- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab6015ca00 msgr2=0x7fab6015da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.314+0000 7fab5fe00640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab6015ca00 0x7fab6015da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:39:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.314+0000 7fab5fe00640 1 -- 172.21.15.8:0/3868630518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab58009a70 con 0x7fab600b82c0 2024-05-26T15:39:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.314+0000 7fab5fe00640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab600b82c0 0x7fab6014ddf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c480 tx=0x7fab5000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.315+0000 7fab57e00640 1 -- 172.21.15.8:0/3868630518 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50005ce0 con 0x7fab600b82c0 2024-05-26T15:39:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.315+0000 7fab57e00640 1 -- 172.21.15.8:0/3868630518 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab50005e40 con 0x7fab600b82c0 2024-05-26T15:39:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.315+0000 7fab65600640 1 -- 172.21.15.8:0/3868630518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab600c6e80 con 0x7fab600b82c0 2024-05-26T15:39:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.315+0000 7fab57e00640 1 -- 172.21.15.8:0/3868630518 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab500072f0 con 0x7fab600b82c0 2024-05-26T15:39:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.315+0000 7fab65600640 1 -- 172.21.15.8:0/3868630518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab60154cc0 con 0x7fab600b82c0 2024-05-26T15:39:59.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.316+0000 7fab65600640 1 -- 172.21.15.8:0/3868630518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6004e210 con 0x7fab600b82c0 2024-05-26T15:39:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.318+0000 7fab57e00640 1 -- 172.21.15.8:0/3868630518 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab50007510 con 0x7fab600b82c0 2024-05-26T15:39:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.319+0000 7fab57e00640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab4006ac00 0x7fab4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:39:59.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.319+0000 7fab57e00640 1 -- 172.21.15.8:0/3868630518 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab50088b60 con 0x7fab600b82c0 2024-05-26T15:39:59.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.320+0000 7fab5f400640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab4006ac00 0x7fab4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:39:59.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.321+0000 7fab5f400640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab4006ac00 0x7fab4006d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab600c9480 tx=0x7fab4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:39:59.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.324+0000 7fab57e00640 1 -- 172.21.15.8:0/3868630518 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fab50053af0 con 0x7fab600b82c0 2024-05-26T15:39:59.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:39:59.562+0000 7fab65600640 1 -- 172.21.15.8:0/3868630518 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fab601579e0 con 0x7fab600b82c0 2024-05-26T15:40:00.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.488+0000 7fab57e00640 1 -- 172.21.15.8:0/3868630518 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fab50017020 con 0x7fab600b82c0 2024-05-26T15:40:00.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 -- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab4006ac00 msgr2=0x7fab4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab4006ac00 0x7fab4006d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab600c9480 tx=0x7fab4c008040 comp rx=0 tx=0).stop 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 -- 172.21.15.8:0/3868630518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab600b82c0 msgr2=0x7fab6014ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab600b82c0 0x7fab6014ddf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c480 tx=0x7fab5000c940 comp rx=0 tx=0).stop 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 -- 172.21.15.8:0/3868630518 shutdown_connections 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab4006ac00 0x7fab4006d0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab6015ca00 0x7fab6015da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab600d0020 0x7fab60154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 --2- 172.21.15.8:0/3868630518 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab600b82c0 0x7fab6014ddf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 -- 172.21.15.8:0/3868630518 >> 172.21.15.8:0/3868630518 conn(0x7fab6006b640 msgr2=0x7fab6015b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 -- 172.21.15.8:0/3868630518 shutdown_connections 2024-05-26T15:40:00.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.492+0000 7fab65600640 1 -- 172.21.15.8:0/3868630518 wait complete. 2024-05-26T15:40:00.512 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-26T15:40:00.512 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-26T15:40:00.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.727+0000 7fab3ec00640 1 Processor -- start 2024-05-26T15:40:00.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.727+0000 7fab3ec00640 1 -- start start 2024-05-26T15:40:00.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.728+0000 7fab3ec00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab380d0020 0x7fab380d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:00.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.728+0000 7fab3ec00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab380d20d0 con 0x7fab3815ca00 2024-05-26T15:40:00.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.728+0000 7fab3ec00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab380d14c0 con 0x7fab380b82c0 2024-05-26T15:40:00.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.728+0000 7fab3ec00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab380d06b0 con 0x7fab380d0020 2024-05-26T15:40:00.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.729+0000 7fab3d800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fab3815ca00 0x7fab380cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53374/0 (socket says 172.21.15.8:53374) 2024-05-26T15:40:00.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.729+0000 7fab3d800640 1 -- 172.21.15.8:0/1564494114 learned_addr learned my addr 172.21.15.8:0/1564494114 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:00.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.729+0000 7fab3ce00640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab380d0020 0x7fab380d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:00.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.729+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054023953 0 0) 0x7fab380d20d0 con 0x7fab3815ca00 2024-05-26T15:40:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.729+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab1c003520 con 0x7fab3815ca00 2024-05-26T15:40:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1444442468 0 0) 0x7fab1c003520 con 0x7fab3815ca00 2024-05-26T15:40:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab380d0020 msgr2=0x7fab380d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab380d0020 0x7fab380d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 >> v1:172.21.15.47:6789/0 conn(0x7fab380b82c0 legacy=0x7fab380b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab380d17a0 con 0x7fab3815ca00 2024-05-26T15:40:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fab28001670 con 0x7fab3815ca00 2024-05-26T15:40:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 >> v1:172.21.15.8:6789/0 conn(0x7fab3815ca00 legacy=0x7fab380cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab380d0020 0x7fab1c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab1c003fd0 0x7fab1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab380d06b0 con 0x7fab1c004d00 2024-05-26T15:40:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c00bb40 con 0x7fab1c003fd0 2024-05-26T15:40:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c00bd00 con 0x7fab380d0020 2024-05-26T15:40:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab3e200640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.730+0000 7fab3d800640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab380d0020 0x7fab1c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.731+0000 7fab3ce00640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab1c003fd0 0x7fab1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.731+0000 7fab3e200640 1 -- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab380d0020 msgr2=0x7fab1c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.731+0000 7fab3e200640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab380d0020 0x7fab1c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.731+0000 7fab3e200640 1 -- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab1c003fd0 msgr2=0x7fab1c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.731+0000 7fab3e200640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab1c003fd0 0x7fab1c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.731+0000 7fab3e200640 1 -- 172.21.15.8:0/1564494114 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c003520 con 0x7fab1c004d00 2024-05-26T15:40:00.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.731+0000 7fab3ce00640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab1c003fd0 0x7fab1c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:00.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.732+0000 7fab3e200640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab1c005180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fab30001e20 tx=0x7fab1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63571cf24b01adb server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:00.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.732+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3002ae40 con 0x7fab1c004d00 2024-05-26T15:40:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.732+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab30003970 con 0x7fab1c004d00 2024-05-26T15:40:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.732+0000 7fab37e00640 1 -- 172.21.15.8:0/1564494114 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30003d20 con 0x7fab1c004d00 2024-05-26T15:40:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.733+0000 7fab3ec00640 1 -- 172.21.15.8:0/1564494114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 msgr2=0x7fab1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.733+0000 7fab3ec00640 1 --2- 172.21.15.8:0/1564494114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab1c004d00 0x7fab1c005180 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fab30001e20 tx=0x7fab1c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.733+0000 7fab3e200640 1 -- 172.21.15.8:0/1564494114 reap_dead start 2024-05-26T15:40:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.733+0000 7fab3ec00640 1 -- 172.21.15.8:0/1564494114 shutdown_connections 2024-05-26T15:40:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.733+0000 7fab3ec00640 1 -- 172.21.15.8:0/1564494114 >> 172.21.15.8:0/1564494114 conn(0x7fab3806b640 msgr2=0x7fab3806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.733+0000 7fab3ec00640 1 -- 172.21.15.8:0/1564494114 shutdown_connections 2024-05-26T15:40:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.733+0000 7fab3ec00640 1 -- 172.21.15.8:0/1564494114 wait complete. 2024-05-26T15:40:00.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.735+0000 7fab3ec00640 1 Processor -- start 2024-05-26T15:40:00.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.735+0000 7fab3ec00640 1 -- start start 2024-05-26T15:40:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.736+0000 7fab3ec00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab1c004d00 0x7fab380cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.736+0000 7fab3ec00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab380c8e10 0x7fab38150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:00.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.736+0000 7fab3ec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab380c9e20 0x7fab380ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.736+0000 7fab3ec00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38150c50 con 0x7fab380c9e20 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.736+0000 7fab3ec00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab380ca810 con 0x7fab380c8e10 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.736+0000 7fab3ec00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab380c9290 con 0x7fab1c004d00 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.736+0000 7fab3e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab380c9e20 0x7fab380ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab380c9e20 0x7fab380ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52198/0 (socket says 172.21.15.8:52198) 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3e200640 1 -- 172.21.15.8:0/1079601314 learned_addr learned my addr 172.21.15.8:0/1079601314 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3d800640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab1c004d00 0x7fab380cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3ce00640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab380c8e10 0x7fab38150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3e200640 1 -- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab1c004d00 msgr2=0x7fab380cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3e200640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab1c004d00 0x7fab380cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3e200640 1 -- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab380c8e10 msgr2=0x7fab38150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3e200640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab380c8e10 0x7fab38150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:00.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3e200640 1 -- 172.21.15.8:0/1079601314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3815ec40 con 0x7fab380c9e20 2024-05-26T15:40:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3ce00640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab380c8e10 0x7fab38150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.737+0000 7fab3e200640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab380c9e20 0x7fab380ca2d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab30001f40 tx=0x7fab300014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.738+0000 7fab35600640 1 -- 172.21.15.8:0/1079601314 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3003f070 con 0x7fab380c9e20 2024-05-26T15:40:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.738+0000 7fab35600640 1 -- 172.21.15.8:0/1079601314 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab30003ba0 con 0x7fab380c9e20 2024-05-26T15:40:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.738+0000 7fab3ec00640 1 -- 172.21.15.8:0/1079601314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3815eee0 con 0x7fab380c9e20 2024-05-26T15:40:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.738+0000 7fab35600640 1 -- 172.21.15.8:0/1079601314 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab300050d0 con 0x7fab380c9e20 2024-05-26T15:40:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.738+0000 7fab3ec00640 1 -- 172.21.15.8:0/1079601314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3815f4a0 con 0x7fab380c9e20 2024-05-26T15:40:00.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.739+0000 7fab3ec00640 1 -- 172.21.15.8:0/1079601314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3804e210 con 0x7fab380c9e20 2024-05-26T15:40:00.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.740+0000 7fab35600640 1 -- 172.21.15.8:0/1079601314 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab30005230 con 0x7fab380c9e20 2024-05-26T15:40:00.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.741+0000 7fab35600640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab1806ac00 0x7fab1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:00.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.741+0000 7fab35600640 1 -- 172.21.15.8:0/1079601314 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab300a8de0 con 0x7fab380c9e20 2024-05-26T15:40:00.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.742+0000 7fab3d800640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab1806ac00 0x7fab1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:00.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.743+0000 7fab3d800640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab1806ac00 0x7fab1806d0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab380caef0 tx=0x7fab28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:00.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.745+0000 7fab35600640 1 -- 172.21.15.8:0/1079601314 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fab30073d40 con 0x7fab380c9e20 2024-05-26T15:40:00.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:00.979+0000 7fab3ec00640 1 -- 172.21.15.8:0/1079601314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fab3804e210 con 0x7fab380c9e20 2024-05-26T15:40:01.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.493+0000 7fab35600640 1 -- 172.21.15.8:0/1079601314 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fab30077360 con 0x7fab380c9e20 2024-05-26T15:40:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.497+0000 7fab3ec00640 1 -- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab1806ac00 msgr2=0x7fab1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.497+0000 7fab3ec00640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab1806ac00 0x7fab1806d0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fab380caef0 tx=0x7fab28009040 comp rx=0 tx=0).stop 2024-05-26T15:40:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.498+0000 7fab3ec00640 1 -- 172.21.15.8:0/1079601314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab380c9e20 msgr2=0x7fab380ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.498+0000 7fab3ec00640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab380c9e20 0x7fab380ca2d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab30001f40 tx=0x7fab300014a0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.498+0000 7fab3ec00640 1 -- 172.21.15.8:0/1079601314 shutdown_connections 2024-05-26T15:40:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.498+0000 7fab3ec00640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab380c9e20 0x7fab380ca2d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.498+0000 7fab3ec00640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab1806ac00 0x7fab1806d0c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.498+0000 7fab3ec00640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab380c8e10 0x7fab38150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.498+0000 7fab3ec00640 1 --2- 172.21.15.8:0/1079601314 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab1c004d00 0x7fab380cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.498+0000 7fab3ec00640 1 -- 172.21.15.8:0/1079601314 >> 172.21.15.8:0/1079601314 conn(0x7fab3806b640 msgr2=0x7fab3815a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:01.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.498+0000 7fab3ec00640 1 -- 172.21.15.8:0/1079601314 shutdown_connections 2024-05-26T15:40:01.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.499+0000 7fab3ec00640 1 -- 172.21.15.8:0/1079601314 wait complete. 2024-05-26T15:40:01.518 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-26T15:40:01.518 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:40:01.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.723+0000 7f8cb3200640 1 Processor -- start 2024-05-26T15:40:01.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.723+0000 7f8cb3200640 1 -- start start 2024-05-26T15:40:01.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.725+0000 7f8cb3200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8cb40b0f60 0x7f8cb415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:01.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.725+0000 7f8cb3200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8cb415f0c0 0x7f8cb40c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:01.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.725+0000 7f8cb3200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb415b640 con 0x7f8cb4154f50 2024-05-26T15:40:01.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.725+0000 7f8cb3200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb415bee0 con 0x7f8cb415f0c0 2024-05-26T15:40:01.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.725+0000 7f8cb3200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40b0ba0 con 0x7f8cb40b0f60 2024-05-26T15:40:01.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.725+0000 7f8cb2800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8cb415f0c0 0x7f8cb40c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:01.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.725+0000 7f8cb2800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8cb415f0c0 0x7f8cb40c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47366/0 (socket says 172.21.15.8:47366) 2024-05-26T15:40:01.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.725+0000 7f8cb2800640 1 -- 172.21.15.8:0/124776261 learned_addr learned my addr 172.21.15.8:0/124776261 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:01.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.725+0000 7f8cb1e00640 1 --1- 172.21.15.8:0/124776261 >> v1:172.21.15.8:6789/0 conn(0x7f8cb4154f50 0x7f8cb415ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60348/0 (socket says 172.21.15.8:60348) 2024-05-26T15:40:01.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.726+0000 7f8cabe00640 1 --2- 172.21.15.8:0/124776261 >> v2:172.21.15.47:3300/0 conn(0x7f8cb40b0f60 0x7f8cb415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:01.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.726+0000 7f8cb2800640 1 -- 172.21.15.8:0/124776261 >> v2:172.21.15.47:3300/0 conn(0x7f8cb40b0f60 msgr2=0x7f8cb415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:01.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.726+0000 7f8cb2800640 1 --2- 172.21.15.8:0/124776261 >> v2:172.21.15.47:3300/0 conn(0x7f8cb40b0f60 0x7f8cb415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.726+0000 7f8cb2800640 1 -- 172.21.15.8:0/124776261 >> v1:172.21.15.8:6789/0 conn(0x7f8cb4154f50 legacy=0x7f8cb415ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:01.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.726+0000 7f8cb2800640 1 -- 172.21.15.8:0/124776261 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb415b920 con 0x7f8cb415f0c0 2024-05-26T15:40:01.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.727+0000 7f8cb2800640 1 --2- 172.21.15.8:0/124776261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 0x7f8cb40c36c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4067880 tx=0x7f8cac02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f78710efae27d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:01.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.727+0000 7f8cb1400640 1 -- 172.21.15.8:0/124776261 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac031600 con 0x7f8cb415f0c0 2024-05-26T15:40:01.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.727+0000 7f8cb1400640 1 -- 172.21.15.8:0/124776261 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac02d050 con 0x7f8cb415f0c0 2024-05-26T15:40:01.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.727+0000 7f8cb1400640 1 -- 172.21.15.8:0/124776261 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac031980 con 0x7f8cb415f0c0 2024-05-26T15:40:01.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.728+0000 7f8cb3200640 1 -- 172.21.15.8:0/124776261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 msgr2=0x7f8cb40c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:01.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.728+0000 7f8cb3200640 1 --2- 172.21.15.8:0/124776261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 0x7f8cb40c36c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4067880 tx=0x7f8cac02a730 comp rx=0 tx=0).stop 2024-05-26T15:40:01.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.728+0000 7f8cb3200640 1 -- 172.21.15.8:0/124776261 shutdown_connections 2024-05-26T15:40:01.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.728+0000 7f8cb3200640 1 --2- 172.21.15.8:0/124776261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 0x7f8cb40c36c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.728+0000 7f8cb3200640 1 --2- 172.21.15.8:0/124776261 >> v2:172.21.15.47:3300/0 conn(0x7f8cb40b0f60 0x7f8cb415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.728+0000 7f8cb3200640 1 -- 172.21.15.8:0/124776261 >> 172.21.15.8:0/124776261 conn(0x7f8cb4070480 msgr2=0x7f8cb4070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:01.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.728+0000 7f8cb3200640 1 -- 172.21.15.8:0/124776261 shutdown_connections 2024-05-26T15:40:01.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.728+0000 7f8cb3200640 1 -- 172.21.15.8:0/124776261 wait complete. 2024-05-26T15:40:01.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.730+0000 7f8cb3200640 1 Processor -- start 2024-05-26T15:40:01.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.730+0000 7f8cb3200640 1 -- start start 2024-05-26T15:40:01.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.731+0000 7f8cb3200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8cb40b0f60 0x7f8cb40b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:01.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.731+0000 7f8cb3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cb4154f50 0x7f8cb41512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:01.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.731+0000 7f8cb3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 0x7f8cb413da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:01.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.731+0000 7f8cb3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40b22c0 con 0x7f8cb415f0c0 2024-05-26T15:40:01.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.731+0000 7f8cb3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40b4070 con 0x7f8cb4154f50 2024-05-26T15:40:01.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.731+0000 7f8cb3200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40b4350 con 0x7f8cb40b0f60 2024-05-26T15:40:01.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.731+0000 7f8cb2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 0x7f8cb413da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:01.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.731+0000 7f8cb2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 0x7f8cb413da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47374/0 (socket says 172.21.15.8:47374) 2024-05-26T15:40:01.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.731+0000 7f8cb2800640 1 -- 172.21.15.8:0/776454131 learned_addr learned my addr 172.21.15.8:0/776454131 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8cb2800640 1 -- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8cb40b0f60 msgr2=0x7f8cb40b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8cb2800640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8cb40b0f60 0x7f8cb40b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8cb2800640 1 -- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cb4154f50 msgr2=0x7f8cb41512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8cb2800640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cb4154f50 0x7f8cb41512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8cb2800640 1 -- 172.21.15.8:0/776454131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac009b30 con 0x7f8cb415f0c0 2024-05-26T15:40:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8cb2800640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 0x7f8cb413da50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8cac034040 tx=0x7f8cac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8caa000640 1 -- 172.21.15.8:0/776454131 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac03d860 con 0x7f8cb415f0c0 2024-05-26T15:40:01.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8caa000640 1 -- 172.21.15.8:0/776454131 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac03d9c0 con 0x7f8cb415f0c0 2024-05-26T15:40:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8caa000640 1 -- 172.21.15.8:0/776454131 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac03dd70 con 0x7f8cb415f0c0 2024-05-26T15:40:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8cb3200640 1 -- 172.21.15.8:0/776454131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb40b2560 con 0x7f8cb415f0c0 2024-05-26T15:40:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.732+0000 7f8cb3200640 1 -- 172.21.15.8:0/776454131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb40b4630 con 0x7f8cb415f0c0 2024-05-26T15:40:01.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.734+0000 7f8cb3200640 1 -- 172.21.15.8:0/776454131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb40b2a80 con 0x7f8cb415f0c0 2024-05-26T15:40:01.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.735+0000 7f8caa000640 1 -- 172.21.15.8:0/776454131 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8cac03b400 con 0x7f8cb415f0c0 2024-05-26T15:40:01.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.735+0000 7f8caa000640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8c9006ac00 0x7f8c9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:01.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.736+0000 7f8caa000640 1 -- 172.21.15.8:0/776454131 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8cac0aa5c0 con 0x7f8cb415f0c0 2024-05-26T15:40:01.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.736+0000 7f8cb1e00640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8c9006ac00 0x7f8c9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:01.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.737+0000 7f8cb1e00640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8c9006ac00 0x7f8c9006d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40015e0 tx=0x7f8ca40079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:01.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.740+0000 7f8caa000640 1 -- 172.21.15.8:0/776454131 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8cb40b2a80 con 0x7f8cb415f0c0 2024-05-26T15:40:01.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.968+0000 7f8cb3200640 1 -- 172.21.15.8:0/776454131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cb40b2a80 con 0x7f8cb415f0c0 2024-05-26T15:40:01.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.969+0000 7f8caa000640 1 -- 172.21.15.8:0/776454131 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4718 (secure 0 0 0) 0x7f8cb40b2a80 con 0x7f8cb415f0c0 2024-05-26T15:40:01.968 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:01.968 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:39:32.881224+0000","modified":"2024-05-26T15:40:01.486240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-26T15:40:01.969 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2024-05-26T15:40:01.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 -- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8c9006ac00 msgr2=0x7f8c9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:01.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8c9006ac00 0x7f8c9006d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40015e0 tx=0x7f8ca40079c0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 -- 172.21.15.8:0/776454131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 msgr2=0x7f8cb413da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:01.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 0x7f8cb413da50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8cac034040 tx=0x7f8cac004a40 comp rx=0 tx=0).stop 2024-05-26T15:40:01.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 -- 172.21.15.8:0/776454131 shutdown_connections 2024-05-26T15:40:01.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8cb415f0c0 0x7f8cb413da50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8c9006ac00 0x7f8c9006d0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8cb4154f50 0x7f8cb41512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 --2- 172.21.15.8:0/776454131 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8cb40b0f60 0x7f8cb40b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:01.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 -- 172.21.15.8:0/776454131 >> 172.21.15.8:0/776454131 conn(0x7f8cb4070480 msgr2=0x7f8cb415c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:01.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 -- 172.21.15.8:0/776454131 shutdown_connections 2024-05-26T15:40:01.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:01.972+0000 7f8cb3200640 1 -- 172.21.15.8:0/776454131 wait complete. 2024-05-26T15:40:01.989 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.196+0000 7fdd7e200640 1 Processor -- start 2024-05-26T15:40:02.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.196+0000 7fdd7e200640 1 -- start start 2024-05-26T15:40:02.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.198+0000 7fdd7e200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdd780d00a0 0x7fdd780b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.198+0000 7fdd7e200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd780b7eb0 con 0x7fdd781600d0 2024-05-26T15:40:02.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.198+0000 7fdd7e200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd781604b0 con 0x7fdd780b8720 2024-05-26T15:40:02.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.198+0000 7fdd7e200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd780d0ef0 con 0x7fdd780d00a0 2024-05-26T15:40:02.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.198+0000 7fdd7ce00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fdd781600d0 0x7fdd780cf990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60360/0 (socket says 172.21.15.8:60360) 2024-05-26T15:40:02.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.198+0000 7fdd7ce00640 1 -- 172.21.15.8:0/1577922997 learned_addr learned my addr 172.21.15.8:0/1577922997 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:02.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77e00640 1 --2- 172.21.15.8:0/1577922997 >> v2:172.21.15.47:3300/0 conn(0x7fdd780d00a0 0x7fdd780b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45939365 0 0) 0x7fdd780b7eb0 con 0x7fdd781600d0 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd60003520 con 0x7fdd781600d0 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2168601236 0 0) 0x7fdd60003520 con 0x7fdd781600d0 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 >> v2:172.21.15.47:3300/0 conn(0x7fdd780d00a0 msgr2=0x7fdd780b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 --2- 172.21.15.8:0/1577922997 >> v2:172.21.15.47:3300/0 conn(0x7fdd780d00a0 0x7fdd780b5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 >> v1:172.21.15.47:6789/0 conn(0x7fdd780b8720 legacy=0x7fdd780b6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd780b7610 con 0x7fdd781600d0 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fdd6c001670 con 0x7fdd781600d0 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 >> v1:172.21.15.8:6789/0 conn(0x7fdd781600d0 legacy=0x7fdd780cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdd600039c0 0x7fdd60003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd600047c0 0x7fdd60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd600051d0 0x7fdd6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780d0ef0 con 0x7fdd600051d0 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6000c120 con 0x7fdd600047c0 2024-05-26T15:40:02.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.199+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6000c2e0 con 0x7fdd600039c0 2024-05-26T15:40:02.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.200+0000 7fdd7d800640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd600051d0 0x7fdd6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.200+0000 7fdd7ce00640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdd600039c0 0x7fdd60003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.200+0000 7fdd77e00640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd600047c0 0x7fdd60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.200+0000 7fdd7d800640 1 -- 172.21.15.8:0/1577922997 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdd600039c0 msgr2=0x7fdd60003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:02.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.200+0000 7fdd7d800640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdd600039c0 0x7fdd60003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.200+0000 7fdd7d800640 1 -- 172.21.15.8:0/1577922997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd600047c0 msgr2=0x7fdd60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:02.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.200+0000 7fdd7d800640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd600047c0 0x7fdd60004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.200+0000 7fdd7d800640 1 -- 172.21.15.8:0/1577922997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60003520 con 0x7fdd600051d0 2024-05-26T15:40:02.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.200+0000 7fdd77e00640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd600047c0 0x7fdd60004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:02.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.201+0000 7fdd7d800640 1 -- 172.21.15.8:0/1577922997 reap_dead start 2024-05-26T15:40:02.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.201+0000 7fdd7d800640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd600051d0 0x7fdd6000b980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdd70001e20 tx=0x7fdd600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bffbf23d6c4289 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:02.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.202+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7002ae40 con 0x7fdd600051d0 2024-05-26T15:40:02.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.202+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd70003970 con 0x7fdd600051d0 2024-05-26T15:40:02.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.202+0000 7fdd77400640 1 -- 172.21.15.8:0/1577922997 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70003d20 con 0x7fdd600051d0 2024-05-26T15:40:02.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.202+0000 7fdd7e200640 1 -- 172.21.15.8:0/1577922997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd600051d0 msgr2=0x7fdd6000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.202+0000 7fdd7e200640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd600051d0 0x7fdd6000b980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdd70001e20 tx=0x7fdd600057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.202+0000 7fdd7e200640 1 -- 172.21.15.8:0/1577922997 shutdown_connections 2024-05-26T15:40:02.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.202+0000 7fdd7e200640 1 --2- 172.21.15.8:0/1577922997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd600051d0 0x7fdd6000b980 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.202+0000 7fdd7e200640 1 -- 172.21.15.8:0/1577922997 >> 172.21.15.8:0/1577922997 conn(0x7fdd7806b750 msgr2=0x7fdd7806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:02.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.202+0000 7fdd7e200640 1 -- 172.21.15.8:0/1577922997 shutdown_connections 2024-05-26T15:40:02.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.202+0000 7fdd7e200640 1 -- 172.21.15.8:0/1577922997 wait complete. 2024-05-26T15:40:02.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.204+0000 7fdd7e200640 1 Processor -- start 2024-05-26T15:40:02.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.204+0000 7fdd7e200640 1 -- start start 2024-05-26T15:40:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.205+0000 7fdd7e200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdd600051d0 0x7fdd7814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.205+0000 7fdd7e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd780ae9c0 0x7fdd780aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.205+0000 7fdd7e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780a9870 0x7fdd780a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.205+0000 7fdd7e200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd781f35c0 con 0x7fdd780a9870 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.205+0000 7fdd7e200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780af380 con 0x7fdd780ae9c0 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.205+0000 7fdd7e200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd780aa5a0 con 0x7fdd600051d0 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd7d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780a9870 0x7fdd780a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd7d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780a9870 0x7fdd780a9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47392/0 (socket says 172.21.15.8:47392) 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd7d800640 1 -- 172.21.15.8:0/457537746 learned_addr learned my addr 172.21.15.8:0/457537746 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd7ce00640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdd600051d0 0x7fdd7814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd7d800640 1 -- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdd600051d0 msgr2=0x7fdd7814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd7d800640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdd600051d0 0x7fdd7814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd77e00640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd780ae9c0 0x7fdd780aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd7d800640 1 -- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd780ae9c0 msgr2=0x7fdd780aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd7d800640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd780ae9c0 0x7fdd780aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd7d800640 1 -- 172.21.15.8:0/457537746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd780aa880 con 0x7fdd780a9870 2024-05-26T15:40:02.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.206+0000 7fdd7d800640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780a9870 0x7fdd780a9cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd70001f40 tx=0x7fdd70001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.207+0000 7fdd74c00640 1 -- 172.21.15.8:0/457537746 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70006d50 con 0x7fdd780a9870 2024-05-26T15:40:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.207+0000 7fdd74c00640 1 -- 172.21.15.8:0/457537746 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd70001250 con 0x7fdd780a9870 2024-05-26T15:40:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.207+0000 7fdd74c00640 1 -- 172.21.15.8:0/457537746 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70007250 con 0x7fdd780a9870 2024-05-26T15:40:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.207+0000 7fdd7e200640 1 -- 172.21.15.8:0/457537746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd780aab60 con 0x7fdd780a9870 2024-05-26T15:40:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.207+0000 7fdd7e200640 1 -- 172.21.15.8:0/457537746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd780aa230 con 0x7fdd780a9870 2024-05-26T15:40:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.208+0000 7fdd7e200640 1 -- 172.21.15.8:0/457537746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd781f3700 con 0x7fdd780a9870 2024-05-26T15:40:02.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.209+0000 7fdd74c00640 1 -- 172.21.15.8:0/457537746 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdd700073b0 con 0x7fdd780a9870 2024-05-26T15:40:02.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.210+0000 7fdd74c00640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd5806ac30 0x7fdd5806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.210+0000 7fdd74c00640 1 -- 172.21.15.8:0/457537746 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdd700a8e20 con 0x7fdd780a9870 2024-05-26T15:40:02.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.211+0000 7fdd7ce00640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd5806ac30 0x7fdd5806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.212+0000 7fdd7ce00640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd5806ac30 0x7fdd5806d0f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c001eb0 tx=0x7fdd6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:02.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.214+0000 7fdd74c00640 1 -- 172.21.15.8:0/457537746 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdd781f3700 con 0x7fdd780a9870 2024-05-26T15:40:02.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.415+0000 7fdd7e200640 1 -- 172.21.15.8:0/457537746 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd7804e280 con 0x7fdd780a9870 2024-05-26T15:40:02.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.419+0000 7fdd74c00640 1 -- 172.21.15.8:0/457537746 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7fdd70073cf0 con 0x7fdd780a9870 2024-05-26T15:40:02.418 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:02.418 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:02.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.421+0000 7fdd7e200640 1 -- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd5806ac30 msgr2=0x7fdd5806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.421+0000 7fdd7e200640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd5806ac30 0x7fdd5806d0f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c001eb0 tx=0x7fdd6c009040 comp rx=0 tx=0).stop 2024-05-26T15:40:02.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.421+0000 7fdd7e200640 1 -- 172.21.15.8:0/457537746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780a9870 msgr2=0x7fdd780a9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.421+0000 7fdd7e200640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780a9870 0x7fdd780a9cf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd70001f40 tx=0x7fdd70001510 comp rx=0 tx=0).stop 2024-05-26T15:40:02.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.422+0000 7fdd7e200640 1 -- 172.21.15.8:0/457537746 shutdown_connections 2024-05-26T15:40:02.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.422+0000 7fdd7e200640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdd780a9870 0x7fdd780a9cf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.422+0000 7fdd7e200640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd5806ac30 0x7fdd5806d0f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.422+0000 7fdd7e200640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdd780ae9c0 0x7fdd780aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.422+0000 7fdd7e200640 1 --2- 172.21.15.8:0/457537746 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdd600051d0 0x7fdd7814ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.422+0000 7fdd7e200640 1 -- 172.21.15.8:0/457537746 >> 172.21.15.8:0/457537746 conn(0x7fdd7806b750 msgr2=0x7fdd780cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:02.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.422+0000 7fdd7e200640 1 -- 172.21.15.8:0/457537746 shutdown_connections 2024-05-26T15:40:02.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.422+0000 7fdd7e200640 1 -- 172.21.15.8:0/457537746 wait complete. 2024-05-26T15:40:02.439 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-26T15:40:02.439 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:40:02.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.649+0000 7f8857200640 1 Processor -- start 2024-05-26T15:40:02.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.649+0000 7f8857200640 1 -- start start 2024-05-26T15:40:02.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.650+0000 7f8857200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f88580cdbc0 0x7f885815c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.650+0000 7f8857200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580d2900 con 0x7f88580b4820 2024-05-26T15:40:02.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.650+0000 7f8857200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580ce0e0 con 0x7f88580b4c00 2024-05-26T15:40:02.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.650+0000 7f8857200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580d0e10 con 0x7f88580cdbc0 2024-05-26T15:40:02.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.651+0000 7f8855e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f88580b4820 0x7f88580cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60362/0 (socket says 172.21.15.8:60362) 2024-05-26T15:40:02.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.651+0000 7f8855e00640 1 -- 172.21.15.8:0/3970602591 learned_addr learned my addr 172.21.15.8:0/3970602591 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:02.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.651+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329794784 0 0) 0x7f88580d2900 con 0x7f88580b4820 2024-05-26T15:40:02.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.651+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f883c003520 con 0x7f88580b4820 2024-05-26T15:40:02.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.651+0000 7f8855400640 1 --2- 172.21.15.8:0/3970602591 >> v2:172.21.15.47:3300/0 conn(0x7f88580cdbc0 0x7f885815c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.651+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1929720987 0 0) 0x7f883c003520 con 0x7f88580b4820 2024-05-26T15:40:02.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.651+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 >> v2:172.21.15.47:3300/0 conn(0x7f88580cdbc0 msgr2=0x7f885815c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:02.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.651+0000 7f8854a00640 1 --2- 172.21.15.8:0/3970602591 >> v2:172.21.15.47:3300/0 conn(0x7f88580cdbc0 0x7f885815c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 >> v1:172.21.15.47:6789/0 conn(0x7f88580b4c00 legacy=0x7f885815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580d10f0 con 0x7f88580b4820 2024-05-26T15:40:02.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f8848001670 con 0x7f88580b4820 2024-05-26T15:40:02.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 >> v1:172.21.15.8:6789/0 conn(0x7f88580b4820 legacy=0x7f88580cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8854a00640 1 --2- 172.21.15.8:0/3970602591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f883c0039c0 0x7f883c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8854a00640 1 --2- 172.21.15.8:0/3970602591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f883c0047c0 0x7f883c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8854a00640 1 --2- 172.21.15.8:0/3970602591 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f883c0051d0 0x7f883c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580d0e10 con 0x7f883c0047c0 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c00c120 con 0x7f883c0039c0 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c00c2e0 con 0x7f883c0051d0 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8855400640 1 --2- 172.21.15.8:0/3970602591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f883c0047c0 0x7f883c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8856800640 1 --2- 172.21.15.8:0/3970602591 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f883c0051d0 0x7f883c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8855400640 1 -- 172.21.15.8:0/3970602591 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f883c0051d0 msgr2=0x7f883c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.652+0000 7f8855400640 1 --2- 172.21.15.8:0/3970602591 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f883c0051d0 0x7f883c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.653+0000 7f8855400640 1 -- 172.21.15.8:0/3970602591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f883c0039c0 msgr2=0x7f883c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.653+0000 7f8855400640 1 --2- 172.21.15.8:0/3970602591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f883c0039c0 0x7f883c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.653+0000 7f8855400640 1 -- 172.21.15.8:0/3970602591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c003520 con 0x7f883c0047c0 2024-05-26T15:40:02.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.653+0000 7f8856800640 1 -- 172.21.15.8:0/3970602591 reap_dead start 2024-05-26T15:40:02.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.654+0000 7f8855400640 1 --2- 172.21.15.8:0/3970602591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f883c0047c0 0x7f883c004c40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f88580ce010 tx=0x7f883c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a78c237325fcdc server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:02.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.654+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844031400 con 0x7f883c0047c0 2024-05-26T15:40:02.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.654+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884402d050 con 0x7f883c0047c0 2024-05-26T15:40:02.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.654+0000 7f8854a00640 1 -- 172.21.15.8:0/3970602591 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844031780 con 0x7f883c0047c0 2024-05-26T15:40:02.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.654+0000 7f8857200640 1 -- 172.21.15.8:0/3970602591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f883c0047c0 msgr2=0x7f883c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.654+0000 7f8857200640 1 --2- 172.21.15.8:0/3970602591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f883c0047c0 0x7f883c004c40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f88580ce010 tx=0x7f883c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.655+0000 7f8857200640 1 -- 172.21.15.8:0/3970602591 shutdown_connections 2024-05-26T15:40:02.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.655+0000 7f8857200640 1 --2- 172.21.15.8:0/3970602591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f883c0047c0 0x7f883c004c40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.655+0000 7f8857200640 1 -- 172.21.15.8:0/3970602591 >> 172.21.15.8:0/3970602591 conn(0x7f88580cf5b0 msgr2=0x7f88580cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:02.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.655+0000 7f8857200640 1 -- 172.21.15.8:0/3970602591 shutdown_connections 2024-05-26T15:40:02.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.655+0000 7f8857200640 1 -- 172.21.15.8:0/3970602591 wait complete. 2024-05-26T15:40:02.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.656+0000 7f8857200640 1 Processor -- start 2024-05-26T15:40:02.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.657+0000 7f8857200640 1 -- start start 2024-05-26T15:40:02.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.657+0000 7f8857200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f883c0047c0 0x7f8858153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.658+0000 7f8857200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f88580ccd40 0x7f8858155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.658+0000 7f8857200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88581561a0 0x7f885806b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.658+0000 7f8857200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581f7000 con 0x7f88581561a0 2024-05-26T15:40:02.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.658+0000 7f8857200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581f6380 con 0x7f883c0047c0 2024-05-26T15:40:02.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.658+0000 7f8857200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88581f6660 con 0x7f88580ccd40 2024-05-26T15:40:02.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.658+0000 7f8856800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88581561a0 0x7f885806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.658+0000 7f8856800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88581561a0 0x7f885806b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47418/0 (socket says 172.21.15.8:47418) 2024-05-26T15:40:02.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.658+0000 7f8856800640 1 -- 172.21.15.8:0/2225106953 learned_addr learned my addr 172.21.15.8:0/2225106953 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:02.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.658+0000 7f8855e00640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f883c0047c0 0x7f8858153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.658+0000 7f8855400640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f88580ccd40 0x7f8858155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.659+0000 7f8856800640 1 -- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f88580ccd40 msgr2=0x7f8858155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.659+0000 7f8856800640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f88580ccd40 0x7f8858155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.659+0000 7f8856800640 1 -- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f883c0047c0 msgr2=0x7f8858153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.659+0000 7f8856800640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f883c0047c0 0x7f8858153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.659+0000 7f8856800640 1 -- 172.21.15.8:0/2225106953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88581f6940 con 0x7f88581561a0 2024-05-26T15:40:02.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.659+0000 7f8856800640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88581561a0 0x7f885806b560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f88580c9bb0 tx=0x7f885000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:02.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.659+0000 7f884e000640 1 -- 172.21.15.8:0/2225106953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850003b70 con 0x7f88581561a0 2024-05-26T15:40:02.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.659+0000 7f884e000640 1 -- 172.21.15.8:0/2225106953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8850003cd0 con 0x7f88581561a0 2024-05-26T15:40:02.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.660+0000 7f884e000640 1 -- 172.21.15.8:0/2225106953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850005290 con 0x7f88581561a0 2024-05-26T15:40:02.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.660+0000 7f8857200640 1 -- 172.21.15.8:0/2225106953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88581f6c20 con 0x7f88581561a0 2024-05-26T15:40:02.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.660+0000 7f8857200640 1 -- 172.21.15.8:0/2225106953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88581529d0 con 0x7f88581561a0 2024-05-26T15:40:02.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.661+0000 7f8857200640 1 -- 172.21.15.8:0/2225106953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858067940 con 0x7f88581561a0 2024-05-26T15:40:02.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.662+0000 7f884e000640 1 -- 172.21.15.8:0/2225106953 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f88500053f0 con 0x7f88581561a0 2024-05-26T15:40:02.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.663+0000 7f884e000640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883806ac00 0x7f883806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:02.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.663+0000 7f884e000640 1 -- 172.21.15.8:0/2225106953 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8850088e40 con 0x7f88581561a0 2024-05-26T15:40:02.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.663+0000 7f8855e00640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883806ac00 0x7f883806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:02.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.665+0000 7f8855e00640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883806ac00 0x7f883806d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8848001eb0 tx=0x7f8848001a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:02.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.667+0000 7f884e000640 1 -- 172.21.15.8:0/2225106953 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8850053de0 con 0x7f88581561a0 2024-05-26T15:40:02.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.862+0000 7f8857200640 1 -- 172.21.15.8:0/2225106953 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88580cd160 con 0x7f883806ac00 2024-05-26T15:40:02.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.897+0000 7f884e000640 1 -- 172.21.15.8:0/2225106953 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345115 (secure 0 0 0) 0x7f88580cd160 con 0x7f883806ac00 2024-05-26T15:40:02.901 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:02.903 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.904+0000 7f8857200640 1 -- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883806ac00 msgr2=0x7f883806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.904+0000 7f8857200640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883806ac00 0x7f883806d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8848001eb0 tx=0x7f8848001a60 comp rx=0 tx=0).stop 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.904+0000 7f8857200640 1 -- 172.21.15.8:0/2225106953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88581561a0 msgr2=0x7f885806b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.904+0000 7f8857200640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88581561a0 0x7f885806b560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f88580c9bb0 tx=0x7f885000dc00 comp rx=0 tx=0).stop 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.904+0000 7f8857200640 1 -- 172.21.15.8:0/2225106953 shutdown_connections 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.904+0000 7f8857200640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88581561a0 0x7f885806b560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.904+0000 7f8857200640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f88580ccd40 0x7f8858155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.904+0000 7f8857200640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883806ac00 0x7f883806d0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.904+0000 7f8857200640 1 --2- 172.21.15.8:0/2225106953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f883c0047c0 0x7f8858153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.904+0000 7f8857200640 1 -- 172.21.15.8:0/2225106953 >> 172.21.15.8:0/2225106953 conn(0x7f88580cf5b0 msgr2=0x7f88580d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:02.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.905+0000 7f8857200640 1 -- 172.21.15.8:0/2225106953 shutdown_connections 2024-05-26T15:40:02.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:02.905+0000 7f8857200640 1 -- 172.21.15.8:0/2225106953 wait complete. 2024-05-26T15:40:02.923 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-05-26T15:40:02.163931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235744,"kb_used_data":3196,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738976,"statfs":{"total":773094113280,"available":772852711424,"internally_reserved":0,"allocated":3272704,"data_stored":1985107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005636"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386165+0000","last_change":"2024-05-26T15:39:32.432165+0000","last_active":"2024-05-26T15:39:37.386165+0000","last_peered":"2024-05-26T15:39:37.386165+0000","last_clean":"2024-05-26T15:39:37.386165+0000","last_became_active":"2024-05-26T15:39:32.431489+0000","last_became_peered":"2024-05-26T15:39:32.431489+0000","last_unstale":"2024-05-26T15:39:37.386165+0000","last_undegraded":"2024-05-26T15:39:37.386165+0000","last_fullsized":"2024-05-26T15:39:37.386165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:45:24.383306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379327+0000","last_change":"2024-05-26T15:39:32.919233+0000","last_active":"2024-05-26T15:39:37.379327+0000","last_peered":"2024-05-26T15:39:37.379327+0000","last_clean":"2024-05-26T15:39:37.379327+0000","last_became_active":"2024-05-26T15:39:32.918954+0000","last_became_peered":"2024-05-26T15:39:32.918954+0000","last_unstale":"2024-05-26T15:39:37.379327+0000","last_undegraded":"2024-05-26T15:39:37.379327+0000","last_fullsized":"2024-05-26T15:39:37.379327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288096+0000","last_change":"2024-05-26T15:39:37.499590+0000","last_active":"2024-05-26T15:39:39.288096+0000","last_peered":"2024-05-26T15:39:39.288096+0000","last_clean":"2024-05-26T15:39:39.288096+0000","last_became_active":"2024-05-26T15:39:37.497710+0000","last_became_peered":"2024-05-26T15:39:37.497710+0000","last_unstale":"2024-05-26T15:39:39.288096+0000","last_undegraded":"2024-05-26T15:39:39.288096+0000","last_fullsized":"2024-05-26T15:39:39.288096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:38:29.550301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379789+0000","last_change":"2024-05-26T15:39:32.420682+0000","last_active":"2024-05-26T15:39:37.379789+0000","last_peered":"2024-05-26T15:39:37.379789+0000","last_clean":"2024-05-26T15:39:37.379789+0000","last_became_active":"2024-05-26T15:39:32.418629+0000","last_became_peered":"2024-05-26T15:39:32.418629+0000","last_unstale":"2024-05-26T15:39:37.379789+0000","last_undegraded":"2024-05-26T15:39:37.379789+0000","last_fullsized":"2024-05-26T15:39:37.379789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383890+0000","last_change":"2024-05-26T15:39:32.930973+0000","last_active":"2024-05-26T15:39:37.383890+0000","last_peered":"2024-05-26T15:39:37.383890+0000","last_clean":"2024-05-26T15:39:37.383890+0000","last_became_active":"2024-05-26T15:39:32.930696+0000","last_became_peered":"2024-05-26T15:39:32.930696+0000","last_unstale":"2024-05-26T15:39:37.383890+0000","last_undegraded":"2024-05-26T15:39:37.383890+0000","last_fullsized":"2024-05-26T15:39:37.383890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881236+0000","last_change":"2024-05-26T15:39:37.407147+0000","last_active":"2024-05-26T15:39:37.881236+0000","last_peered":"2024-05-26T15:39:37.881236+0000","last_clean":"2024-05-26T15:39:37.881236+0000","last_became_active":"2024-05-26T15:39:37.406661+0000","last_became_peered":"2024-05-26T15:39:37.406661+0000","last_unstale":"2024-05-26T15:39:37.881236+0000","last_undegraded":"2024-05-26T15:39:37.881236+0000","last_fullsized":"2024-05-26T15:39:37.881236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:52:01.807307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.494776+0000","last_change":"2024-05-26T15:39:32.436688+0000","last_active":"2024-05-26T15:39:37.494776+0000","last_peered":"2024-05-26T15:39:37.494776+0000","last_clean":"2024-05-26T15:39:37.494776+0000","last_became_active":"2024-05-26T15:39:32.436376+0000","last_became_peered":"2024-05-26T15:39:32.436376+0000","last_unstale":"2024-05-26T15:39:37.494776+0000","last_undegraded":"2024-05-26T15:39:37.494776+0000","last_fullsized":"2024-05-26T15:39:37.494776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:12.690125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402956+0000","last_change":"2024-05-26T15:39:32.937138+0000","last_active":"2024-05-26T15:39:37.402956+0000","last_peered":"2024-05-26T15:39:37.402956+0000","last_clean":"2024-05-26T15:39:37.402956+0000","last_became_active":"2024-05-26T15:39:32.936872+0000","last_became_peered":"2024-05-26T15:39:32.936872+0000","last_unstale":"2024-05-26T15:39:37.402956+0000","last_undegraded":"2024-05-26T15:39:37.402956+0000","last_fullsized":"2024-05-26T15:39:37.402956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:02:49.914564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882195+0000","last_change":"2024-05-26T15:39:37.406227+0000","last_active":"2024-05-26T15:39:37.882195+0000","last_peered":"2024-05-26T15:39:37.882195+0000","last_clean":"2024-05-26T15:39:37.882195+0000","last_became_active":"2024-05-26T15:39:37.405551+0000","last_became_peered":"2024-05-26T15:39:37.405551+0000","last_unstale":"2024-05-26T15:39:37.882195+0000","last_undegraded":"2024-05-26T15:39:37.882195+0000","last_fullsized":"2024-05-26T15:39:37.882195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:45:07.288223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492340+0000","last_change":"2024-05-26T15:39:32.439870+0000","last_active":"2024-05-26T15:39:37.492340+0000","last_peered":"2024-05-26T15:39:37.492340+0000","last_clean":"2024-05-26T15:39:37.492340+0000","last_became_active":"2024-05-26T15:39:32.439491+0000","last_became_peered":"2024-05-26T15:39:32.439491+0000","last_unstale":"2024-05-26T15:39:37.492340+0000","last_undegraded":"2024-05-26T15:39:37.492340+0000","last_fullsized":"2024-05-26T15:39:37.492340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:51:21.068431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405199+0000","last_change":"2024-05-26T15:39:32.932834+0000","last_active":"2024-05-26T15:39:37.405199+0000","last_peered":"2024-05-26T15:39:37.405199+0000","last_clean":"2024-05-26T15:39:37.405199+0000","last_became_active":"2024-05-26T15:39:32.930499+0000","last_became_peered":"2024-05-26T15:39:32.930499+0000","last_unstale":"2024-05-26T15:39:37.405199+0000","last_undegraded":"2024-05-26T15:39:37.405199+0000","last_fullsized":"2024-05-26T15:39:37.405199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:16:58.690646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881578+0000","last_change":"2024-05-26T15:39:37.403865+0000","last_active":"2024-05-26T15:39:37.881578+0000","last_peered":"2024-05-26T15:39:37.881578+0000","last_clean":"2024-05-26T15:39:37.881578+0000","last_became_active":"2024-05-26T15:39:37.403330+0000","last_became_peered":"2024-05-26T15:39:37.403330+0000","last_unstale":"2024-05-26T15:39:37.881578+0000","last_undegraded":"2024-05-26T15:39:37.881578+0000","last_fullsized":"2024-05-26T15:39:37.881578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:56:31.917292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405022+0000","last_change":"2024-05-26T15:39:32.929330+0000","last_active":"2024-05-26T15:39:37.405022+0000","last_peered":"2024-05-26T15:39:37.405022+0000","last_clean":"2024-05-26T15:39:37.405022+0000","last_became_active":"2024-05-26T15:39:32.929059+0000","last_became_peered":"2024-05-26T15:39:32.929059+0000","last_unstale":"2024-05-26T15:39:37.405022+0000","last_undegraded":"2024-05-26T15:39:37.405022+0000","last_fullsized":"2024-05-26T15:39:37.405022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.500100+0000","last_change":"2024-05-26T15:39:32.436030+0000","last_active":"2024-05-26T15:39:37.500100+0000","last_peered":"2024-05-26T15:39:37.500100+0000","last_clean":"2024-05-26T15:39:37.500100+0000","last_became_active":"2024-05-26T15:39:32.434362+0000","last_became_peered":"2024-05-26T15:39:32.434362+0000","last_unstale":"2024-05-26T15:39:37.500100+0000","last_undegraded":"2024-05-26T15:39:37.500100+0000","last_fullsized":"2024-05-26T15:39:37.500100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:25.042059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882811+0000","last_change":"2024-05-26T15:39:37.402375+0000","last_active":"2024-05-26T15:39:37.882811+0000","last_peered":"2024-05-26T15:39:37.882811+0000","last_clean":"2024-05-26T15:39:37.882811+0000","last_became_active":"2024-05-26T15:39:37.401909+0000","last_became_peered":"2024-05-26T15:39:37.401909+0000","last_unstale":"2024-05-26T15:39:37.882811+0000","last_undegraded":"2024-05-26T15:39:37.882811+0000","last_fullsized":"2024-05-26T15:39:37.882811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377881+0000","last_change":"2024-05-26T15:39:32.926407+0000","last_active":"2024-05-26T15:39:37.377881+0000","last_peered":"2024-05-26T15:39:37.377881+0000","last_clean":"2024-05-26T15:39:37.377881+0000","last_became_active":"2024-05-26T15:39:32.924213+0000","last_became_peered":"2024-05-26T15:39:32.924213+0000","last_unstale":"2024-05-26T15:39:37.377881+0000","last_undegraded":"2024-05-26T15:39:37.377881+0000","last_fullsized":"2024-05-26T15:39:37.377881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403642+0000","last_change":"2024-05-26T15:39:32.424999+0000","last_active":"2024-05-26T15:39:37.403642+0000","last_peered":"2024-05-26T15:39:37.403642+0000","last_clean":"2024-05-26T15:39:37.403642+0000","last_became_active":"2024-05-26T15:39:32.424692+0000","last_became_peered":"2024-05-26T15:39:32.424692+0000","last_unstale":"2024-05-26T15:39:37.403642+0000","last_undegraded":"2024-05-26T15:39:37.403642+0000","last_fullsized":"2024-05-26T15:39:37.403642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882346+0000","last_change":"2024-05-26T15:39:37.407719+0000","last_active":"2024-05-26T15:39:37.882346+0000","last_peered":"2024-05-26T15:39:37.882346+0000","last_clean":"2024-05-26T15:39:37.882346+0000","last_became_active":"2024-05-26T15:39:37.407277+0000","last_became_peered":"2024-05-26T15:39:37.407277+0000","last_unstale":"2024-05-26T15:39:37.882346+0000","last_undegraded":"2024-05-26T15:39:37.882346+0000","last_fullsized":"2024-05-26T15:39:37.882346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377305+0000","last_change":"2024-05-26T15:39:32.914034+0000","last_active":"2024-05-26T15:39:37.377305+0000","last_peered":"2024-05-26T15:39:37.377305+0000","last_clean":"2024-05-26T15:39:37.377305+0000","last_became_active":"2024-05-26T15:39:32.912275+0000","last_became_peered":"2024-05-26T15:39:32.912275+0000","last_unstale":"2024-05-26T15:39:37.377305+0000","last_undegraded":"2024-05-26T15:39:37.377305+0000","last_fullsized":"2024-05-26T15:39:37.377305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402750+0000","last_change":"2024-05-26T15:39:32.430257+0000","last_active":"2024-05-26T15:39:37.402750+0000","last_peered":"2024-05-26T15:39:37.402750+0000","last_clean":"2024-05-26T15:39:37.402750+0000","last_became_active":"2024-05-26T15:39:32.429796+0000","last_became_peered":"2024-05-26T15:39:32.429796+0000","last_unstale":"2024-05-26T15:39:37.402750+0000","last_undegraded":"2024-05-26T15:39:37.402750+0000","last_fullsized":"2024-05-26T15:39:37.402750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.293026+0000","last_change":"2024-05-26T15:39:37.502078+0000","last_active":"2024-05-26T15:39:38.293026+0000","last_peered":"2024-05-26T15:39:38.293026+0000","last_clean":"2024-05-26T15:39:38.293026+0000","last_became_active":"2024-05-26T15:39:37.501483+0000","last_became_peered":"2024-05-26T15:39:37.501483+0000","last_unstale":"2024-05-26T15:39:38.293026+0000","last_undegraded":"2024-05-26T15:39:38.293026+0000","last_fullsized":"2024-05-26T15:39:38.293026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387962+0000","last_change":"2024-05-26T15:39:32.916982+0000","last_active":"2024-05-26T15:39:37.387962+0000","last_peered":"2024-05-26T15:39:37.387962+0000","last_clean":"2024-05-26T15:39:37.387962+0000","last_became_active":"2024-05-26T15:39:32.916068+0000","last_became_peered":"2024-05-26T15:39:32.916068+0000","last_unstale":"2024-05-26T15:39:37.387962+0000","last_undegraded":"2024-05-26T15:39:37.387962+0000","last_fullsized":"2024-05-26T15:39:37.387962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:20.298140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490624+0000","last_change":"2024-05-26T15:39:32.429729+0000","last_active":"2024-05-26T15:39:37.490624+0000","last_peered":"2024-05-26T15:39:37.490624+0000","last_clean":"2024-05-26T15:39:37.490624+0000","last_became_active":"2024-05-26T15:39:32.429305+0000","last_became_peered":"2024-05-26T15:39:32.429305+0000","last_unstale":"2024-05-26T15:39:37.490624+0000","last_undegraded":"2024-05-26T15:39:37.490624+0000","last_fullsized":"2024-05-26T15:39:37.490624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.883028+0000","last_change":"2024-05-26T15:39:37.405280+0000","last_active":"2024-05-26T15:39:37.883028+0000","last_peered":"2024-05-26T15:39:37.883028+0000","last_clean":"2024-05-26T15:39:37.883028+0000","last_became_active":"2024-05-26T15:39:37.404901+0000","last_became_peered":"2024-05-26T15:39:37.404901+0000","last_unstale":"2024-05-26T15:39:37.883028+0000","last_undegraded":"2024-05-26T15:39:37.883028+0000","last_fullsized":"2024-05-26T15:39:37.883028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:46:18.529170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387113+0000","last_change":"2024-05-26T15:39:32.912045+0000","last_active":"2024-05-26T15:39:37.387113+0000","last_peered":"2024-05-26T15:39:37.387113+0000","last_clean":"2024-05-26T15:39:37.387113+0000","last_became_active":"2024-05-26T15:39:32.911751+0000","last_became_peered":"2024-05-26T15:39:32.911751+0000","last_unstale":"2024-05-26T15:39:37.387113+0000","last_undegraded":"2024-05-26T15:39:37.387113+0000","last_fullsized":"2024-05-26T15:39:37.387113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:09:26.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.408057+0000","last_change":"2024-05-26T15:39:32.437696+0000","last_active":"2024-05-26T15:39:37.408057+0000","last_peered":"2024-05-26T15:39:37.408057+0000","last_clean":"2024-05-26T15:39:37.408057+0000","last_became_active":"2024-05-26T15:39:32.437168+0000","last_became_peered":"2024-05-26T15:39:32.437168+0000","last_unstale":"2024-05-26T15:39:37.408057+0000","last_undegraded":"2024-05-26T15:39:37.408057+0000","last_fullsized":"2024-05-26T15:39:37.408057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881371+0000","last_change":"2024-05-26T15:39:37.499923+0000","last_active":"2024-05-26T15:39:37.881371+0000","last_peered":"2024-05-26T15:39:37.881371+0000","last_clean":"2024-05-26T15:39:37.881371+0000","last_became_active":"2024-05-26T15:39:37.499000+0000","last_became_peered":"2024-05-26T15:39:37.499000+0000","last_unstale":"2024-05-26T15:39:37.881371+0000","last_undegraded":"2024-05-26T15:39:37.881371+0000","last_fullsized":"2024-05-26T15:39:37.881371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379901+0000","last_change":"2024-05-26T15:39:32.922222+0000","last_active":"2024-05-26T15:39:37.379901+0000","last_peered":"2024-05-26T15:39:37.379901+0000","last_clean":"2024-05-26T15:39:37.379901+0000","last_became_active":"2024-05-26T15:39:32.921594+0000","last_became_peered":"2024-05-26T15:39:32.921594+0000","last_unstale":"2024-05-26T15:39:37.379901+0000","last_undegraded":"2024-05-26T15:39:37.379901+0000","last_fullsized":"2024-05-26T15:39:37.379901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.292819+0000","last_change":"2024-05-26T15:39:32.428520+0000","last_active":"2024-05-26T15:39:38.292819+0000","last_peered":"2024-05-26T15:39:38.292819+0000","last_clean":"2024-05-26T15:39:38.292819+0000","last_became_active":"2024-05-26T15:39:32.427761+0000","last_became_peered":"2024-05-26T15:39:32.427761+0000","last_unstale":"2024-05-26T15:39:38.292819+0000","last_undegraded":"2024-05-26T15:39:38.292819+0000","last_fullsized":"2024-05-26T15:39:38.292819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288088+0000","last_change":"2024-05-26T15:39:37.490760+0000","last_active":"2024-05-26T15:39:39.288088+0000","last_peered":"2024-05-26T15:39:39.288088+0000","last_clean":"2024-05-26T15:39:39.288088+0000","last_became_active":"2024-05-26T15:39:37.490319+0000","last_became_peered":"2024-05-26T15:39:37.490319+0000","last_unstale":"2024-05-26T15:39:39.288088+0000","last_undegraded":"2024-05-26T15:39:39.288088+0000","last_fullsized":"2024-05-26T15:39:39.288088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:46:18.529170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403196+0000","last_change":"2024-05-26T15:39:32.917740+0000","last_active":"2024-05-26T15:39:37.403196+0000","last_peered":"2024-05-26T15:39:37.403196+0000","last_clean":"2024-05-26T15:39:37.403196+0000","last_became_active":"2024-05-26T15:39:32.917370+0000","last_became_peered":"2024-05-26T15:39:32.917370+0000","last_unstale":"2024-05-26T15:39:37.403196+0000","last_undegraded":"2024-05-26T15:39:37.403196+0000","last_fullsized":"2024-05-26T15:39:37.403196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495183+0000","last_change":"2024-05-26T15:39:32.433409+0000","last_active":"2024-05-26T15:39:37.495183+0000","last_peered":"2024-05-26T15:39:37.495183+0000","last_clean":"2024-05-26T15:39:37.495183+0000","last_became_active":"2024-05-26T15:39:32.433133+0000","last_became_peered":"2024-05-26T15:39:32.433133+0000","last_unstale":"2024-05-26T15:39:37.495183+0000","last_undegraded":"2024-05-26T15:39:37.495183+0000","last_fullsized":"2024-05-26T15:39:37.495183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.058977+0000","last_change":"2024-05-26T15:39:37.502064+0000","last_active":"2024-05-26T15:39:39.058977+0000","last_peered":"2024-05-26T15:39:39.058977+0000","last_clean":"2024-05-26T15:39:39.058977+0000","last_became_active":"2024-05-26T15:39:37.500834+0000","last_became_peered":"2024-05-26T15:39:37.500834+0000","last_unstale":"2024-05-26T15:39:39.058977+0000","last_undegraded":"2024-05-26T15:39:39.058977+0000","last_fullsized":"2024-05-26T15:39:39.058977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405289+0000","last_change":"2024-05-26T15:39:32.933048+0000","last_active":"2024-05-26T15:39:37.405289+0000","last_peered":"2024-05-26T15:39:37.405289+0000","last_clean":"2024-05-26T15:39:37.405289+0000","last_became_active":"2024-05-26T15:39:32.932543+0000","last_became_peered":"2024-05-26T15:39:32.932543+0000","last_unstale":"2024-05-26T15:39:37.405289+0000","last_undegraded":"2024-05-26T15:39:37.405289+0000","last_fullsized":"2024-05-26T15:39:37.405289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:47:40.508265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403483+0000","last_change":"2024-05-26T15:39:32.419636+0000","last_active":"2024-05-26T15:39:37.403483+0000","last_peered":"2024-05-26T15:39:37.403483+0000","last_clean":"2024-05-26T15:39:37.403483+0000","last_became_active":"2024-05-26T15:39:32.419323+0000","last_became_peered":"2024-05-26T15:39:32.419323+0000","last_unstale":"2024-05-26T15:39:37.403483+0000","last_undegraded":"2024-05-26T15:39:37.403483+0000","last_fullsized":"2024-05-26T15:39:37.403483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291885+0000","last_change":"2024-05-26T15:39:37.408610+0000","last_active":"2024-05-26T15:39:38.291885+0000","last_peered":"2024-05-26T15:39:38.291885+0000","last_clean":"2024-05-26T15:39:38.291885+0000","last_became_active":"2024-05-26T15:39:37.408202+0000","last_became_peered":"2024-05-26T15:39:37.408202+0000","last_unstale":"2024-05-26T15:39:38.291885+0000","last_undegraded":"2024-05-26T15:39:38.291885+0000","last_fullsized":"2024-05-26T15:39:38.291885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386340+0000","last_change":"2024-05-26T15:39:32.915325+0000","last_active":"2024-05-26T15:39:37.386340+0000","last_peered":"2024-05-26T15:39:37.386340+0000","last_clean":"2024-05-26T15:39:37.386340+0000","last_became_active":"2024-05-26T15:39:32.915062+0000","last_became_peered":"2024-05-26T15:39:32.915062+0000","last_unstale":"2024-05-26T15:39:37.386340+0000","last_undegraded":"2024-05-26T15:39:37.386340+0000","last_fullsized":"2024-05-26T15:39:37.386340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:29.697944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401650+0000","last_change":"2024-05-26T15:39:32.429277+0000","last_active":"2024-05-26T15:39:37.401650+0000","last_peered":"2024-05-26T15:39:37.401650+0000","last_clean":"2024-05-26T15:39:37.401650+0000","last_became_active":"2024-05-26T15:39:32.428675+0000","last_became_peered":"2024-05-26T15:39:32.428675+0000","last_unstale":"2024-05-26T15:39:37.401650+0000","last_undegraded":"2024-05-26T15:39:37.401650+0000","last_fullsized":"2024-05-26T15:39:37.401650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291995+0000","last_change":"2024-05-26T15:39:37.407588+0000","last_active":"2024-05-26T15:39:38.291995+0000","last_peered":"2024-05-26T15:39:38.291995+0000","last_clean":"2024-05-26T15:39:38.291995+0000","last_became_active":"2024-05-26T15:39:37.407196+0000","last_became_peered":"2024-05-26T15:39:37.407196+0000","last_unstale":"2024-05-26T15:39:38.291995+0000","last_undegraded":"2024-05-26T15:39:38.291995+0000","last_fullsized":"2024-05-26T15:39:38.291995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401522+0000","last_change":"2024-05-26T15:39:32.915063+0000","last_active":"2024-05-26T15:39:37.401522+0000","last_peered":"2024-05-26T15:39:37.401522+0000","last_clean":"2024-05-26T15:39:37.401522+0000","last_became_active":"2024-05-26T15:39:32.914721+0000","last_became_peered":"2024-05-26T15:39:32.914721+0000","last_unstale":"2024-05-26T15:39:37.401522+0000","last_undegraded":"2024-05-26T15:39:37.401522+0000","last_fullsized":"2024-05-26T15:39:37.401522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:03.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.392964+0000","last_change":"2024-05-26T15:39:32.414114+0000","last_active":"2024-05-26T15:39:37.392964+0000","last_peered":"2024-05-26T15:39:37.392964+0000","last_clean":"2024-05-26T15:39:37.392964+0000","last_became_active":"2024-05-26T15:39:32.411824+0000","last_became_peered":"2024-05-26T15:39:32.411824+0000","last_unstale":"2024-05-26T15:39:37.392964+0000","last_undegraded":"2024-05-26T15:39:37.392964+0000","last_fullsized":"2024-05-26T15:39:37.392964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.293087+0000","last_change":"2024-05-26T15:39:37.408530+0000","last_active":"2024-05-26T15:39:38.293087+0000","last_peered":"2024-05-26T15:39:38.293087+0000","last_clean":"2024-05-26T15:39:38.293087+0000","last_became_active":"2024-05-26T15:39:37.408147+0000","last_became_peered":"2024-05-26T15:39:37.408147+0000","last_unstale":"2024-05-26T15:39:38.293087+0000","last_undegraded":"2024-05-26T15:39:38.293087+0000","last_fullsized":"2024-05-26T15:39:38.293087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:09:29.167701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384060+0000","last_change":"2024-05-26T15:39:32.899088+0000","last_active":"2024-05-26T15:39:37.384060+0000","last_peered":"2024-05-26T15:39:37.384060+0000","last_clean":"2024-05-26T15:39:37.384060+0000","last_became_active":"2024-05-26T15:39:32.896938+0000","last_became_peered":"2024-05-26T15:39:32.896938+0000","last_unstale":"2024-05-26T15:39:37.384060+0000","last_undegraded":"2024-05-26T15:39:37.384060+0000","last_fullsized":"2024-05-26T15:39:37.384060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:07:16.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490674+0000","last_change":"2024-05-26T15:39:32.430448+0000","last_active":"2024-05-26T15:39:37.490674+0000","last_peered":"2024-05-26T15:39:37.490674+0000","last_clean":"2024-05-26T15:39:37.490674+0000","last_became_active":"2024-05-26T15:39:32.430063+0000","last_became_peered":"2024-05-26T15:39:32.430063+0000","last_unstale":"2024-05-26T15:39:37.490674+0000","last_undegraded":"2024-05-26T15:39:37.490674+0000","last_fullsized":"2024-05-26T15:39:37.490674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059389+0000","last_change":"2024-05-26T15:39:37.498500+0000","last_active":"2024-05-26T15:39:39.059389+0000","last_peered":"2024-05-26T15:39:39.059389+0000","last_clean":"2024-05-26T15:39:39.059389+0000","last_became_active":"2024-05-26T15:39:37.497853+0000","last_became_peered":"2024-05-26T15:39:37.497853+0000","last_unstale":"2024-05-26T15:39:39.059389+0000","last_undegraded":"2024-05-26T15:39:39.059389+0000","last_fullsized":"2024-05-26T15:39:39.059389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:43:41.543097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.378613+0000","last_change":"2024-05-26T15:39:32.931560+0000","last_active":"2024-05-26T15:39:37.378613+0000","last_peered":"2024-05-26T15:39:37.378613+0000","last_clean":"2024-05-26T15:39:37.378613+0000","last_became_active":"2024-05-26T15:39:32.930941+0000","last_became_peered":"2024-05-26T15:39:32.930941+0000","last_unstale":"2024-05-26T15:39:37.378613+0000","last_undegraded":"2024-05-26T15:39:37.378613+0000","last_fullsized":"2024-05-26T15:39:37.378613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402158+0000","last_change":"2024-05-26T15:39:32.426663+0000","last_active":"2024-05-26T15:39:37.402158+0000","last_peered":"2024-05-26T15:39:37.402158+0000","last_clean":"2024-05-26T15:39:37.402158+0000","last_became_active":"2024-05-26T15:39:32.426151+0000","last_became_peered":"2024-05-26T15:39:32.426151+0000","last_unstale":"2024-05-26T15:39:37.402158+0000","last_undegraded":"2024-05-26T15:39:37.402158+0000","last_fullsized":"2024-05-26T15:39:37.402158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490962+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:39:37.490962+0000","last_peered":"2024-05-26T15:39:37.490962+0000","last_clean":"2024-05-26T15:39:37.490962+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:39:37.490962+0000","last_undegraded":"2024-05-26T15:39:37.490962+0000","last_fullsized":"2024-05-26T15:39:37.490962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.002545+0000","last_change":"2024-05-26T15:39:37.505399+0000","last_active":"2024-05-26T15:39:38.002545+0000","last_peered":"2024-05-26T15:39:38.002545+0000","last_clean":"2024-05-26T15:39:38.002545+0000","last_became_active":"2024-05-26T15:39:37.501182+0000","last_became_peered":"2024-05-26T15:39:37.501182+0000","last_unstale":"2024-05-26T15:39:38.002545+0000","last_undegraded":"2024-05-26T15:39:38.002545+0000","last_fullsized":"2024-05-26T15:39:38.002545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:10:47.871214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.498704+0000","last_change":"2024-05-26T15:39:32.938192+0000","last_active":"2024-05-26T15:39:37.498704+0000","last_peered":"2024-05-26T15:39:37.498704+0000","last_clean":"2024-05-26T15:39:37.498704+0000","last_became_active":"2024-05-26T15:39:32.937905+0000","last_became_peered":"2024-05-26T15:39:32.937905+0000","last_unstale":"2024-05-26T15:39:37.498704+0000","last_undegraded":"2024-05-26T15:39:37.498704+0000","last_fullsized":"2024-05-26T15:39:37.498704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:02:49.914564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.393909+0000","last_change":"2024-05-26T15:39:32.438199+0000","last_active":"2024-05-26T15:39:37.393909+0000","last_peered":"2024-05-26T15:39:37.393909+0000","last_clean":"2024-05-26T15:39:37.393909+0000","last_became_active":"2024-05-26T15:39:32.437949+0000","last_became_peered":"2024-05-26T15:39:32.437949+0000","last_unstale":"2024-05-26T15:39:37.393909+0000","last_undegraded":"2024-05-26T15:39:37.393909+0000","last_fullsized":"2024-05-26T15:39:37.393909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.002149+0000","last_change":"2024-05-26T15:39:37.495167+0000","last_active":"2024-05-26T15:39:38.002149+0000","last_peered":"2024-05-26T15:39:38.002149+0000","last_clean":"2024-05-26T15:39:38.002149+0000","last_became_active":"2024-05-26T15:39:37.493976+0000","last_became_peered":"2024-05-26T15:39:37.493976+0000","last_unstale":"2024-05-26T15:39:38.002149+0000","last_undegraded":"2024-05-26T15:39:38.002149+0000","last_fullsized":"2024-05-26T15:39:38.002149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:12:51.547304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404196+0000","last_change":"2024-05-26T15:39:32.938730+0000","last_active":"2024-05-26T15:39:37.404196+0000","last_peered":"2024-05-26T15:39:37.404196+0000","last_clean":"2024-05-26T15:39:37.404196+0000","last_became_active":"2024-05-26T15:39:32.933947+0000","last_became_peered":"2024-05-26T15:39:32.933947+0000","last_unstale":"2024-05-26T15:39:37.404196+0000","last_undegraded":"2024-05-26T15:39:37.404196+0000","last_fullsized":"2024-05-26T15:39:37.404196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:07:02.159693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403811+0000","last_change":"2024-05-26T15:39:32.425826+0000","last_active":"2024-05-26T15:39:37.403811+0000","last_peered":"2024-05-26T15:39:37.403811+0000","last_clean":"2024-05-26T15:39:37.403811+0000","last_became_active":"2024-05-26T15:39:32.424115+0000","last_became_peered":"2024-05-26T15:39:32.424115+0000","last_unstale":"2024-05-26T15:39:37.403811+0000","last_undegraded":"2024-05-26T15:39:37.403811+0000","last_fullsized":"2024-05-26T15:39:37.403811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059111+0000","last_change":"2024-05-26T15:39:37.408873+0000","last_active":"2024-05-26T15:39:39.059111+0000","last_peered":"2024-05-26T15:39:39.059111+0000","last_clean":"2024-05-26T15:39:39.059111+0000","last_became_active":"2024-05-26T15:39:37.408458+0000","last_became_peered":"2024-05-26T15:39:37.408458+0000","last_unstale":"2024-05-26T15:39:39.059111+0000","last_undegraded":"2024-05-26T15:39:39.059111+0000","last_fullsized":"2024-05-26T15:39:39.059111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.499252+0000","last_change":"2024-05-26T15:39:32.928652+0000","last_active":"2024-05-26T15:39:37.499252+0000","last_peered":"2024-05-26T15:39:37.499252+0000","last_clean":"2024-05-26T15:39:37.499252+0000","last_became_active":"2024-05-26T15:39:32.925638+0000","last_became_peered":"2024-05-26T15:39:32.925638+0000","last_unstale":"2024-05-26T15:39:37.499252+0000","last_undegraded":"2024-05-26T15:39:37.499252+0000","last_fullsized":"2024-05-26T15:39:37.499252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.394843+0000","last_change":"2024-05-26T15:39:32.414781+0000","last_active":"2024-05-26T15:39:37.394843+0000","last_peered":"2024-05-26T15:39:37.394843+0000","last_clean":"2024-05-26T15:39:37.394843+0000","last_became_active":"2024-05-26T15:39:32.414352+0000","last_became_peered":"2024-05-26T15:39:32.414352+0000","last_unstale":"2024-05-26T15:39:37.394843+0000","last_undegraded":"2024-05-26T15:39:37.394843+0000","last_fullsized":"2024-05-26T15:39:37.394843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.289544+0000","last_change":"2024-05-26T15:39:37.498550+0000","last_active":"2024-05-26T15:39:39.289544+0000","last_peered":"2024-05-26T15:39:39.289544+0000","last_clean":"2024-05-26T15:39:39.289544+0000","last_became_active":"2024-05-26T15:39:37.497751+0000","last_became_peered":"2024-05-26T15:39:37.497751+0000","last_unstale":"2024-05-26T15:39:39.289544+0000","last_undegraded":"2024-05-26T15:39:39.289544+0000","last_fullsized":"2024-05-26T15:39:39.289544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495328+0000","last_change":"2024-05-26T15:39:32.919184+0000","last_active":"2024-05-26T15:39:37.495328+0000","last_peered":"2024-05-26T15:39:37.495328+0000","last_clean":"2024-05-26T15:39:37.495328+0000","last_became_active":"2024-05-26T15:39:32.917283+0000","last_became_peered":"2024-05-26T15:39:32.917283+0000","last_unstale":"2024-05-26T15:39:37.495328+0000","last_undegraded":"2024-05-26T15:39:37.495328+0000","last_fullsized":"2024-05-26T15:39:37.495328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387011+0000","last_change":"2024-05-26T15:39:32.414068+0000","last_active":"2024-05-26T15:39:37.387011+0000","last_peered":"2024-05-26T15:39:37.387011+0000","last_clean":"2024-05-26T15:39:37.387011+0000","last_became_active":"2024-05-26T15:39:32.411487+0000","last_became_peered":"2024-05-26T15:39:32.411487+0000","last_unstale":"2024-05-26T15:39:37.387011+0000","last_undegraded":"2024-05-26T15:39:37.387011+0000","last_fullsized":"2024-05-26T15:39:37.387011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:04:28.582294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881086+0000","last_change":"2024-05-26T15:39:37.406440+0000","last_active":"2024-05-26T15:39:37.881086+0000","last_peered":"2024-05-26T15:39:37.881086+0000","last_clean":"2024-05-26T15:39:37.881086+0000","last_became_active":"2024-05-26T15:39:37.405935+0000","last_became_peered":"2024-05-26T15:39:37.405935+0000","last_unstale":"2024-05-26T15:39:37.881086+0000","last_undegraded":"2024-05-26T15:39:37.881086+0000","last_fullsized":"2024-05-26T15:39:37.881086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492257+0000","last_change":"2024-05-26T15:39:32.920860+0000","last_active":"2024-05-26T15:39:37.492257+0000","last_peered":"2024-05-26T15:39:37.492257+0000","last_clean":"2024-05-26T15:39:37.492257+0000","last_became_active":"2024-05-26T15:39:32.920251+0000","last_became_peered":"2024-05-26T15:39:32.920251+0000","last_unstale":"2024-05-26T15:39:37.492257+0000","last_undegraded":"2024-05-26T15:39:37.492257+0000","last_fullsized":"2024-05-26T15:39:37.492257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.393055+0000","last_change":"2024-05-26T15:39:32.412837+0000","last_active":"2024-05-26T15:39:37.393055+0000","last_peered":"2024-05-26T15:39:37.393055+0000","last_clean":"2024-05-26T15:39:37.393055+0000","last_became_active":"2024-05-26T15:39:32.412474+0000","last_became_peered":"2024-05-26T15:39:32.412474+0000","last_unstale":"2024-05-26T15:39:37.393055+0000","last_undegraded":"2024-05-26T15:39:37.393055+0000","last_fullsized":"2024-05-26T15:39:37.393055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059319+0000","last_change":"2024-05-26T15:39:37.405354+0000","last_active":"2024-05-26T15:39:39.059319+0000","last_peered":"2024-05-26T15:39:39.059319+0000","last_clean":"2024-05-26T15:39:39.059319+0000","last_became_active":"2024-05-26T15:39:37.404972+0000","last_became_peered":"2024-05-26T15:39:37.404972+0000","last_unstale":"2024-05-26T15:39:39.059319+0000","last_undegraded":"2024-05-26T15:39:39.059319+0000","last_fullsized":"2024-05-26T15:39:39.059319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:29:06.780253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401985+0000","last_change":"2024-05-26T15:39:32.924084+0000","last_active":"2024-05-26T15:39:37.401985+0000","last_peered":"2024-05-26T15:39:37.401985+0000","last_clean":"2024-05-26T15:39:37.401985+0000","last_became_active":"2024-05-26T15:39:32.922027+0000","last_became_peered":"2024-05-26T15:39:32.922027+0000","last_unstale":"2024-05-26T15:39:37.401985+0000","last_undegraded":"2024-05-26T15:39:37.401985+0000","last_fullsized":"2024-05-26T15:39:37.401985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:13:14.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404763+0000","last_change":"2024-05-26T15:39:32.436505+0000","last_active":"2024-05-26T15:39:37.404763+0000","last_peered":"2024-05-26T15:39:37.404763+0000","last_clean":"2024-05-26T15:39:37.404763+0000","last_became_active":"2024-05-26T15:39:32.436215+0000","last_became_peered":"2024-05-26T15:39:32.436215+0000","last_unstale":"2024-05-26T15:39:37.404763+0000","last_undegraded":"2024-05-26T15:39:37.404763+0000","last_fullsized":"2024-05-26T15:39:37.404763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.289226+0000","last_change":"2024-05-26T15:39:37.502778+0000","last_active":"2024-05-26T15:39:39.289226+0000","last_peered":"2024-05-26T15:39:39.289226+0000","last_clean":"2024-05-26T15:39:39.289226+0000","last_became_active":"2024-05-26T15:39:37.502334+0000","last_became_peered":"2024-05-26T15:39:37.502334+0000","last_unstale":"2024-05-26T15:39:39.289226+0000","last_undegraded":"2024-05-26T15:39:39.289226+0000","last_fullsized":"2024-05-26T15:39:39.289226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:46:37.155490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492337+0000","last_change":"2024-05-26T15:39:32.920320+0000","last_active":"2024-05-26T15:39:37.492337+0000","last_peered":"2024-05-26T15:39:37.492337+0000","last_clean":"2024-05-26T15:39:37.492337+0000","last_became_active":"2024-05-26T15:39:32.919937+0000","last_became_peered":"2024-05-26T15:39:32.919937+0000","last_unstale":"2024-05-26T15:39:37.492337+0000","last_undegraded":"2024-05-26T15:39:37.492337+0000","last_fullsized":"2024-05-26T15:39:37.492337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401560+0000","last_change":"2024-05-26T15:39:32.429375+0000","last_active":"2024-05-26T15:39:37.401560+0000","last_peered":"2024-05-26T15:39:37.401560+0000","last_clean":"2024-05-26T15:39:37.401560+0000","last_became_active":"2024-05-26T15:39:32.429095+0000","last_became_peered":"2024-05-26T15:39:32.429095+0000","last_unstale":"2024-05-26T15:39:37.401560+0000","last_undegraded":"2024-05-26T15:39:37.401560+0000","last_fullsized":"2024-05-26T15:39:37.401560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288508+0000","last_change":"2024-05-26T15:39:37.496912+0000","last_active":"2024-05-26T15:39:39.288508+0000","last_peered":"2024-05-26T15:39:39.288508+0000","last_clean":"2024-05-26T15:39:39.288508+0000","last_became_active":"2024-05-26T15:39:37.496258+0000","last_became_peered":"2024-05-26T15:39:37.496258+0000","last_unstale":"2024-05-26T15:39:39.288508+0000","last_undegraded":"2024-05-26T15:39:39.288508+0000","last_fullsized":"2024-05-26T15:39:39.288508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:19:25.927673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384003+0000","last_change":"2024-05-26T15:39:32.919040+0000","last_active":"2024-05-26T15:39:37.384003+0000","last_peered":"2024-05-26T15:39:37.384003+0000","last_clean":"2024-05-26T15:39:37.384003+0000","last_became_active":"2024-05-26T15:39:32.918706+0000","last_became_peered":"2024-05-26T15:39:32.918706+0000","last_unstale":"2024-05-26T15:39:37.384003+0000","last_undegraded":"2024-05-26T15:39:37.384003+0000","last_fullsized":"2024-05-26T15:39:37.384003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387247+0000","last_change":"2024-05-26T15:39:32.421131+0000","last_active":"2024-05-26T15:39:37.387247+0000","last_peered":"2024-05-26T15:39:37.387247+0000","last_clean":"2024-05-26T15:39:37.387247+0000","last_became_active":"2024-05-26T15:39:32.420687+0000","last_became_peered":"2024-05-26T15:39:32.420687+0000","last_unstale":"2024-05-26T15:39:37.387247+0000","last_undegraded":"2024-05-26T15:39:37.387247+0000","last_fullsized":"2024-05-26T15:39:37.387247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:13:58.110518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.293090+0000","last_change":"2024-05-26T15:39:37.506017+0000","last_active":"2024-05-26T15:39:39.293090+0000","last_peered":"2024-05-26T15:39:39.293090+0000","last_clean":"2024-05-26T15:39:39.293090+0000","last_became_active":"2024-05-26T15:39:37.503806+0000","last_became_peered":"2024-05-26T15:39:37.503806+0000","last_unstale":"2024-05-26T15:39:39.293090+0000","last_undegraded":"2024-05-26T15:39:39.293090+0000","last_fullsized":"2024-05-26T15:39:39.293090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.494294+0000","last_change":"2024-05-26T15:39:32.924533+0000","last_active":"2024-05-26T15:39:37.494294+0000","last_peered":"2024-05-26T15:39:37.494294+0000","last_clean":"2024-05-26T15:39:37.494294+0000","last_became_active":"2024-05-26T15:39:32.924038+0000","last_became_peered":"2024-05-26T15:39:32.924038+0000","last_unstale":"2024-05-26T15:39:37.494294+0000","last_undegraded":"2024-05-26T15:39:37.494294+0000","last_fullsized":"2024-05-26T15:39:37.494294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:16:58.690646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:51.992714+0000","last_change":"2024-05-26T15:39:32.426312+0000","last_active":"2024-05-26T15:39:51.992714+0000","last_peered":"2024-05-26T15:39:51.992714+0000","last_clean":"2024-05-26T15:39:51.992714+0000","last_became_active":"2024-05-26T15:39:32.425989+0000","last_became_peered":"2024-05-26T15:39:32.425989+0000","last_unstale":"2024-05-26T15:39:51.992714+0000","last_undegraded":"2024-05-26T15:39:51.992714+0000","last_fullsized":"2024-05-26T15:39:51.992714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291701+0000","last_change":"2024-05-26T15:39:37.405366+0000","last_active":"2024-05-26T15:39:38.291701+0000","last_peered":"2024-05-26T15:39:38.291701+0000","last_clean":"2024-05-26T15:39:38.291701+0000","last_became_active":"2024-05-26T15:39:37.405104+0000","last_became_peered":"2024-05-26T15:39:37.405104+0000","last_unstale":"2024-05-26T15:39:38.291701+0000","last_undegraded":"2024-05-26T15:39:38.291701+0000","last_fullsized":"2024-05-26T15:39:38.291701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:56:31.917292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.389859+0000","last_change":"2024-05-26T15:39:32.925841+0000","last_active":"2024-05-26T15:39:37.389859+0000","last_peered":"2024-05-26T15:39:37.389859+0000","last_clean":"2024-05-26T15:39:37.389859+0000","last_became_active":"2024-05-26T15:39:32.924690+0000","last_became_peered":"2024-05-26T15:39:32.924690+0000","last_unstale":"2024-05-26T15:39:37.389859+0000","last_undegraded":"2024-05-26T15:39:37.389859+0000","last_fullsized":"2024-05-26T15:39:37.389859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:26.362390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403757+0000","last_change":"2024-05-26T15:39:32.430740+0000","last_active":"2024-05-26T15:39:37.403757+0000","last_peered":"2024-05-26T15:39:37.403757+0000","last_clean":"2024-05-26T15:39:37.403757+0000","last_became_active":"2024-05-26T15:39:32.430438+0000","last_became_peered":"2024-05-26T15:39:32.430438+0000","last_unstale":"2024-05-26T15:39:37.403757+0000","last_undegraded":"2024-05-26T15:39:37.403757+0000","last_fullsized":"2024-05-26T15:39:37.403757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:25.042059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882702+0000","last_change":"2024-05-26T15:39:37.410892+0000","last_active":"2024-05-26T15:39:37.882702+0000","last_peered":"2024-05-26T15:39:37.882702+0000","last_clean":"2024-05-26T15:39:37.882702+0000","last_became_active":"2024-05-26T15:39:37.410088+0000","last_became_peered":"2024-05-26T15:39:37.410088+0000","last_unstale":"2024-05-26T15:39:37.882702+0000","last_undegraded":"2024-05-26T15:39:37.882702+0000","last_fullsized":"2024-05-26T15:39:37.882702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:02:32.537310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386400+0000","last_change":"2024-05-26T15:39:32.931871+0000","last_active":"2024-05-26T15:39:37.386400+0000","last_peered":"2024-05-26T15:39:37.386400+0000","last_clean":"2024-05-26T15:39:37.386400+0000","last_became_active":"2024-05-26T15:39:32.931615+0000","last_became_peered":"2024-05-26T15:39:32.931615+0000","last_unstale":"2024-05-26T15:39:37.386400+0000","last_undegraded":"2024-05-26T15:39:37.386400+0000","last_fullsized":"2024-05-26T15:39:37.386400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406122+0000","last_change":"2024-05-26T15:39:32.438097+0000","last_active":"2024-05-26T15:39:37.406122+0000","last_peered":"2024-05-26T15:39:37.406122+0000","last_clean":"2024-05-26T15:39:37.406122+0000","last_became_active":"2024-05-26T15:39:32.437759+0000","last_became_peered":"2024-05-26T15:39:32.437759+0000","last_unstale":"2024-05-26T15:39:37.406122+0000","last_undegraded":"2024-05-26T15:39:37.406122+0000","last_fullsized":"2024-05-26T15:39:37.406122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288406+0000","last_change":"2024-05-26T15:39:37.408245+0000","last_active":"2024-05-26T15:39:39.288406+0000","last_peered":"2024-05-26T15:39:39.288406+0000","last_clean":"2024-05-26T15:39:39.288406+0000","last_became_active":"2024-05-26T15:39:37.407821+0000","last_became_peered":"2024-05-26T15:39:37.407821+0000","last_unstale":"2024-05-26T15:39:39.288406+0000","last_undegraded":"2024-05-26T15:39:39.288406+0000","last_fullsized":"2024-05-26T15:39:39.288406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:08:31.905617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406029+0000","last_change":"2024-05-26T15:39:32.935821+0000","last_active":"2024-05-26T15:39:37.406029+0000","last_peered":"2024-05-26T15:39:37.406029+0000","last_clean":"2024-05-26T15:39:37.406029+0000","last_became_active":"2024-05-26T15:39:32.935652+0000","last_became_peered":"2024-05-26T15:39:32.935652+0000","last_unstale":"2024-05-26T15:39:37.406029+0000","last_undegraded":"2024-05-26T15:39:37.406029+0000","last_fullsized":"2024-05-26T15:39:37.406029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:42:31.950324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.407942+0000","last_change":"2024-05-26T15:39:32.434154+0000","last_active":"2024-05-26T15:39:37.407942+0000","last_peered":"2024-05-26T15:39:37.407942+0000","last_clean":"2024-05-26T15:39:37.407942+0000","last_became_active":"2024-05-26T15:39:32.433569+0000","last_became_peered":"2024-05-26T15:39:32.433569+0000","last_unstale":"2024-05-26T15:39:37.407942+0000","last_undegraded":"2024-05-26T15:39:37.407942+0000","last_fullsized":"2024-05-26T15:39:37.407942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288095+0000","last_change":"2024-05-26T15:39:37.500616+0000","last_active":"2024-05-26T15:39:39.288095+0000","last_peered":"2024-05-26T15:39:39.288095+0000","last_clean":"2024-05-26T15:39:39.288095+0000","last_became_active":"2024-05-26T15:39:37.498904+0000","last_became_peered":"2024-05-26T15:39:37.498904+0000","last_unstale":"2024-05-26T15:39:39.288095+0000","last_undegraded":"2024-05-26T15:39:39.288095+0000","last_fullsized":"2024-05-26T15:39:39.288095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:41:02.121900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059278+0000","last_change":"2024-05-26T15:39:37.496964+0000","last_active":"2024-05-26T15:39:39.059278+0000","last_peered":"2024-05-26T15:39:39.059278+0000","last_clean":"2024-05-26T15:39:39.059278+0000","last_became_active":"2024-05-26T15:39:37.496512+0000","last_became_peered":"2024-05-26T15:39:37.496512+0000","last_unstale":"2024-05-26T15:39:39.059278+0000","last_undegraded":"2024-05-26T15:39:39.059278+0000","last_fullsized":"2024-05-26T15:39:39.059278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402612+0000","last_change":"2024-05-26T15:39:32.911606+0000","last_active":"2024-05-26T15:39:37.402612+0000","last_peered":"2024-05-26T15:39:37.402612+0000","last_clean":"2024-05-26T15:39:37.402612+0000","last_became_active":"2024-05-26T15:39:32.910333+0000","last_became_peered":"2024-05-26T15:39:32.910333+0000","last_unstale":"2024-05-26T15:39:37.402612+0000","last_undegraded":"2024-05-26T15:39:37.402612+0000","last_fullsized":"2024-05-26T15:39:37.402612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400770+0000","last_change":"2024-05-26T15:39:32.428197+0000","last_active":"2024-05-26T15:39:37.400770+0000","last_peered":"2024-05-26T15:39:37.400770+0000","last_clean":"2024-05-26T15:39:37.400770+0000","last_became_active":"2024-05-26T15:39:32.427494+0000","last_became_peered":"2024-05-26T15:39:32.427494+0000","last_unstale":"2024-05-26T15:39:37.400770+0000","last_undegraded":"2024-05-26T15:39:37.400770+0000","last_fullsized":"2024-05-26T15:39:37.400770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.003002+0000","last_change":"2024-05-26T15:39:37.416175+0000","last_active":"2024-05-26T15:39:38.003002+0000","last_peered":"2024-05-26T15:39:38.003002+0000","last_clean":"2024-05-26T15:39:38.003002+0000","last_became_active":"2024-05-26T15:39:37.415776+0000","last_became_peered":"2024-05-26T15:39:37.415776+0000","last_unstale":"2024-05-26T15:39:38.003002+0000","last_undegraded":"2024-05-26T15:39:38.003002+0000","last_fullsized":"2024-05-26T15:39:38.003002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:43:41.543097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377018+0000","last_change":"2024-05-26T15:39:32.916588+0000","last_active":"2024-05-26T15:39:37.377018+0000","last_peered":"2024-05-26T15:39:37.377018+0000","last_clean":"2024-05-26T15:39:37.377018+0000","last_became_active":"2024-05-26T15:39:32.916327+0000","last_became_peered":"2024-05-26T15:39:32.916327+0000","last_unstale":"2024-05-26T15:39:37.377018+0000","last_undegraded":"2024-05-26T15:39:37.377018+0000","last_fullsized":"2024-05-26T15:39:37.377018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:49:42.119038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381500+0000","last_change":"2024-05-26T15:39:32.429439+0000","last_active":"2024-05-26T15:39:37.381500+0000","last_peered":"2024-05-26T15:39:37.381500+0000","last_clean":"2024-05-26T15:39:37.381500+0000","last_became_active":"2024-05-26T15:39:32.428892+0000","last_became_peered":"2024-05-26T15:39:32.428892+0000","last_unstale":"2024-05-26T15:39:37.381500+0000","last_undegraded":"2024-05-26T15:39:37.381500+0000","last_fullsized":"2024-05-26T15:39:37.381500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405154+0000","last_change":"2024-05-26T15:39:32.422718+0000","last_active":"2024-05-26T15:39:37.405154+0000","last_peered":"2024-05-26T15:39:37.405154+0000","last_clean":"2024-05-26T15:39:37.405154+0000","last_became_active":"2024-05-26T15:39:32.422398+0000","last_became_peered":"2024-05-26T15:39:32.422398+0000","last_unstale":"2024-05-26T15:39:37.405154+0000","last_undegraded":"2024-05-26T15:39:37.405154+0000","last_fullsized":"2024-05-26T15:39:37.405154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383126+0000","last_change":"2024-05-26T15:39:32.902434+0000","last_active":"2024-05-26T15:39:37.383126+0000","last_peered":"2024-05-26T15:39:37.383126+0000","last_clean":"2024-05-26T15:39:37.383126+0000","last_became_active":"2024-05-26T15:39:32.901505+0000","last_became_peered":"2024-05-26T15:39:32.901505+0000","last_unstale":"2024-05-26T15:39:37.383126+0000","last_undegraded":"2024-05-26T15:39:37.383126+0000","last_fullsized":"2024-05-26T15:39:37.383126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:21:37.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.877340+0000","last_change":"2024-05-26T15:39:37.405928+0000","last_active":"2024-05-26T15:39:37.877340+0000","last_peered":"2024-05-26T15:39:37.877340+0000","last_clean":"2024-05-26T15:39:37.877340+0000","last_became_active":"2024-05-26T15:39:37.405510+0000","last_became_peered":"2024-05-26T15:39:37.405510+0000","last_unstale":"2024-05-26T15:39:37.877340+0000","last_undegraded":"2024-05-26T15:39:37.877340+0000","last_fullsized":"2024-05-26T15:39:37.877340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:46.788301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.378799+0000","last_change":"2024-05-26T15:39:32.424810+0000","last_active":"2024-05-26T15:39:37.378799+0000","last_peered":"2024-05-26T15:39:37.378799+0000","last_clean":"2024-05-26T15:39:37.378799+0000","last_became_active":"2024-05-26T15:39:32.424518+0000","last_became_peered":"2024-05-26T15:39:32.424518+0000","last_unstale":"2024-05-26T15:39:37.378799+0000","last_undegraded":"2024-05-26T15:39:37.378799+0000","last_fullsized":"2024-05-26T15:39:37.378799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386848+0000","last_change":"2024-05-26T15:39:32.913997+0000","last_active":"2024-05-26T15:39:37.386848+0000","last_peered":"2024-05-26T15:39:37.386848+0000","last_clean":"2024-05-26T15:39:37.386848+0000","last_became_active":"2024-05-26T15:39:32.911604+0000","last_became_peered":"2024-05-26T15:39:32.911604+0000","last_unstale":"2024-05-26T15:39:37.386848+0000","last_undegraded":"2024-05-26T15:39:37.386848+0000","last_fullsized":"2024-05-26T15:39:37.386848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:26.047859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288573+0000","last_change":"2024-05-26T15:39:37.402731+0000","last_active":"2024-05-26T15:39:39.288573+0000","last_peered":"2024-05-26T15:39:39.288573+0000","last_clean":"2024-05-26T15:39:39.288573+0000","last_became_active":"2024-05-26T15:39:37.402227+0000","last_became_peered":"2024-05-26T15:39:37.402227+0000","last_unstale":"2024-05-26T15:39:39.288573+0000","last_undegraded":"2024-05-26T15:39:39.288573+0000","last_fullsized":"2024-05-26T15:39:39.288573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:24:03.470160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401926+0000","last_change":"2024-05-26T15:39:32.924345+0000","last_active":"2024-05-26T15:39:37.401926+0000","last_peered":"2024-05-26T15:39:37.401926+0000","last_clean":"2024-05-26T15:39:37.401926+0000","last_became_active":"2024-05-26T15:39:32.921271+0000","last_became_peered":"2024-05-26T15:39:32.921271+0000","last_unstale":"2024-05-26T15:39:37.401926+0000","last_undegraded":"2024-05-26T15:39:37.401926+0000","last_fullsized":"2024-05-26T15:39:37.401926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.392856+0000","last_change":"2024-05-26T15:39:32.928371+0000","last_active":"2024-05-26T15:39:37.392856+0000","last_peered":"2024-05-26T15:39:37.392856+0000","last_clean":"2024-05-26T15:39:37.392856+0000","last_became_active":"2024-05-26T15:39:32.928159+0000","last_became_peered":"2024-05-26T15:39:32.928159+0000","last_unstale":"2024-05-26T15:39:37.392856+0000","last_undegraded":"2024-05-26T15:39:37.392856+0000","last_fullsized":"2024-05-26T15:39:37.392856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:13.695925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401469+0000","last_change":"2024-05-26T15:39:32.932867+0000","last_active":"2024-05-26T15:39:37.401469+0000","last_peered":"2024-05-26T15:39:37.401469+0000","last_clean":"2024-05-26T15:39:37.401469+0000","last_became_active":"2024-05-26T15:39:32.930753+0000","last_became_peered":"2024-05-26T15:39:32.930753+0000","last_unstale":"2024-05-26T15:39:37.401469+0000","last_undegraded":"2024-05-26T15:39:37.401469+0000","last_fullsized":"2024-05-26T15:39:37.401469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.382843+0000","last_change":"2024-05-26T15:39:32.904786+0000","last_active":"2024-05-26T15:39:37.382843+0000","last_peered":"2024-05-26T15:39:37.382843+0000","last_clean":"2024-05-26T15:39:37.382843+0000","last_became_active":"2024-05-26T15:39:32.904535+0000","last_became_peered":"2024-05-26T15:39:32.904535+0000","last_unstale":"2024-05-26T15:39:37.382843+0000","last_undegraded":"2024-05-26T15:39:37.382843+0000","last_fullsized":"2024-05-26T15:39:37.382843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:59:09.988548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.380690+0000","last_change":"2024-05-26T15:39:32.905236+0000","last_active":"2024-05-26T15:39:37.380690+0000","last_peered":"2024-05-26T15:39:37.380690+0000","last_clean":"2024-05-26T15:39:37.380690+0000","last_became_active":"2024-05-26T15:39:32.904896+0000","last_became_peered":"2024-05-26T15:39:32.904896+0000","last_unstale":"2024-05-26T15:39:37.380690+0000","last_undegraded":"2024-05-26T15:39:37.380690+0000","last_fullsized":"2024-05-26T15:39:37.380690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403711+0000","last_change":"2024-05-26T15:39:32.910981+0000","last_active":"2024-05-26T15:39:37.403711+0000","last_peered":"2024-05-26T15:39:37.403711+0000","last_clean":"2024-05-26T15:39:37.403711+0000","last_became_active":"2024-05-26T15:39:32.910706+0000","last_became_peered":"2024-05-26T15:39:32.910706+0000","last_unstale":"2024-05-26T15:39:37.403711+0000","last_undegraded":"2024-05-26T15:39:37.403711+0000","last_fullsized":"2024-05-26T15:39:37.403711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406819+0000","last_change":"2024-05-26T15:39:32.935119+0000","last_active":"2024-05-26T15:39:37.406819+0000","last_peered":"2024-05-26T15:39:37.406819+0000","last_clean":"2024-05-26T15:39:37.406819+0000","last_became_active":"2024-05-26T15:39:32.934919+0000","last_became_peered":"2024-05-26T15:39:32.934919+0000","last_unstale":"2024-05-26T15:39:37.406819+0000","last_undegraded":"2024-05-26T15:39:37.406819+0000","last_fullsized":"2024-05-26T15:39:37.406819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379796+0000","last_change":"2024-05-26T15:39:32.913549+0000","last_active":"2024-05-26T15:39:37.379796+0000","last_peered":"2024-05-26T15:39:37.379796+0000","last_clean":"2024-05-26T15:39:37.379796+0000","last_became_active":"2024-05-26T15:39:32.913283+0000","last_became_peered":"2024-05-26T15:39:32.913283+0000","last_unstale":"2024-05-26T15:39:37.379796+0000","last_undegraded":"2024-05-26T15:39:37.379796+0000","last_fullsized":"2024-05-26T15:39:37.379796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400722+0000","last_change":"2024-05-26T15:39:32.934682+0000","last_active":"2024-05-26T15:39:37.400722+0000","last_peered":"2024-05-26T15:39:37.400722+0000","last_clean":"2024-05-26T15:39:37.400722+0000","last_became_active":"2024-05-26T15:39:32.934208+0000","last_became_peered":"2024-05-26T15:39:32.934208+0000","last_unstale":"2024-05-26T15:39:37.400722+0000","last_undegraded":"2024-05-26T15:39:37.400722+0000","last_fullsized":"2024-05-26T15:39:37.400722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381124+0000","last_change":"2024-05-26T15:39:32.902536+0000","last_active":"2024-05-26T15:39:37.381124+0000","last_peered":"2024-05-26T15:39:37.381124+0000","last_clean":"2024-05-26T15:39:37.381124+0000","last_became_active":"2024-05-26T15:39:32.901428+0000","last_became_peered":"2024-05-26T15:39:32.901428+0000","last_unstale":"2024-05-26T15:39:37.381124+0000","last_undegraded":"2024-05-26T15:39:37.381124+0000","last_fullsized":"2024-05-26T15:39:37.381124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401378+0000","last_change":"2024-05-26T15:39:32.933748+0000","last_active":"2024-05-26T15:39:37.401378+0000","last_peered":"2024-05-26T15:39:37.401378+0000","last_clean":"2024-05-26T15:39:37.401378+0000","last_became_active":"2024-05-26T15:39:32.933508+0000","last_became_peered":"2024-05-26T15:39:32.933508+0000","last_unstale":"2024-05-26T15:39:37.401378+0000","last_undegraded":"2024-05-26T15:39:37.401378+0000","last_fullsized":"2024-05-26T15:39:37.401378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381893+0000","last_change":"2024-05-26T15:39:32.919340+0000","last_active":"2024-05-26T15:39:37.381893+0000","last_peered":"2024-05-26T15:39:37.381893+0000","last_clean":"2024-05-26T15:39:37.381893+0000","last_became_active":"2024-05-26T15:39:32.919090+0000","last_became_peered":"2024-05-26T15:39:32.919090+0000","last_unstale":"2024-05-26T15:39:37.381893+0000","last_undegraded":"2024-05-26T15:39:37.381893+0000","last_fullsized":"2024-05-26T15:39:37.381893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404517+0000","last_change":"2024-05-26T15:39:32.931353+0000","last_active":"2024-05-26T15:39:37.404517+0000","last_peered":"2024-05-26T15:39:37.404517+0000","last_clean":"2024-05-26T15:39:37.404517+0000","last_became_active":"2024-05-26T15:39:32.931035+0000","last_became_peered":"2024-05-26T15:39:32.931035+0000","last_unstale":"2024-05-26T15:39:37.404517+0000","last_undegraded":"2024-05-26T15:39:37.404517+0000","last_fullsized":"2024-05-26T15:39:37.404517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495006+0000","last_change":"2024-05-26T15:39:32.924340+0000","last_active":"2024-05-26T15:39:37.495006+0000","last_peered":"2024-05-26T15:39:37.495006+0000","last_clean":"2024-05-26T15:39:37.495006+0000","last_became_active":"2024-05-26T15:39:32.923614+0000","last_became_peered":"2024-05-26T15:39:32.923614+0000","last_unstale":"2024-05-26T15:39:37.495006+0000","last_undegraded":"2024-05-26T15:39:37.495006+0000","last_fullsized":"2024-05-26T15:39:37.495006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:49:42.119038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.394752+0000","last_change":"2024-05-26T15:39:32.919960+0000","last_active":"2024-05-26T15:39:37.394752+0000","last_peered":"2024-05-26T15:39:37.394752+0000","last_clean":"2024-05-26T15:39:37.394752+0000","last_became_active":"2024-05-26T15:39:32.919682+0000","last_became_peered":"2024-05-26T15:39:32.919682+0000","last_unstale":"2024-05-26T15:39:37.394752+0000","last_undegraded":"2024-05-26T15:39:37.394752+0000","last_fullsized":"2024-05-26T15:39:37.394752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:51:22.074231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.407162+0000","last_change":"2024-05-26T15:39:32.931526+0000","last_active":"2024-05-26T15:39:37.407162+0000","last_peered":"2024-05-26T15:39:37.407162+0000","last_clean":"2024-05-26T15:39:37.407162+0000","last_became_active":"2024-05-26T15:39:32.930641+0000","last_became_peered":"2024-05-26T15:39:32.930641+0000","last_unstale":"2024-05-26T15:39:37.407162+0000","last_undegraded":"2024-05-26T15:39:37.407162+0000","last_fullsized":"2024-05-26T15:39:37.407162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400658+0000","last_change":"2024-05-26T15:39:32.935238+0000","last_active":"2024-05-26T15:39:37.400658+0000","last_peered":"2024-05-26T15:39:37.400658+0000","last_clean":"2024-05-26T15:39:37.400658+0000","last_became_active":"2024-05-26T15:39:32.934888+0000","last_became_peered":"2024-05-26T15:39:32.934888+0000","last_unstale":"2024-05-26T15:39:37.400658+0000","last_undegraded":"2024-05-26T15:39:37.400658+0000","last_fullsized":"2024-05-26T15:39:37.400658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402726+0000","last_change":"2024-05-26T15:39:32.912394+0000","last_active":"2024-05-26T15:39:37.402726+0000","last_peered":"2024-05-26T15:39:37.402726+0000","last_clean":"2024-05-26T15:39:37.402726+0000","last_became_active":"2024-05-26T15:39:32.911158+0000","last_became_peered":"2024-05-26T15:39:32.911158+0000","last_unstale":"2024-05-26T15:39:37.402726+0000","last_undegraded":"2024-05-26T15:39:37.402726+0000","last_fullsized":"2024-05-26T15:39:37.402726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383741+0000","last_change":"2024-05-26T15:39:32.913949+0000","last_active":"2024-05-26T15:39:37.383741+0000","last_peered":"2024-05-26T15:39:37.383741+0000","last_clean":"2024-05-26T15:39:37.383741+0000","last_became_active":"2024-05-26T15:39:32.911597+0000","last_became_peered":"2024-05-26T15:39:32.911597+0000","last_unstale":"2024-05-26T15:39:37.383741+0000","last_undegraded":"2024-05-26T15:39:37.383741+0000","last_fullsized":"2024-05-26T15:39:37.383741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:13:14.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377776+0000","last_change":"2024-05-26T15:39:32.923083+0000","last_active":"2024-05-26T15:39:37.377776+0000","last_peered":"2024-05-26T15:39:37.377776+0000","last_clean":"2024-05-26T15:39:37.377776+0000","last_became_active":"2024-05-26T15:39:32.921098+0000","last_became_peered":"2024-05-26T15:39:32.921098+0000","last_unstale":"2024-05-26T15:39:37.377776+0000","last_undegraded":"2024-05-26T15:39:37.377776+0000","last_fullsized":"2024-05-26T15:39:37.377776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:21:37.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.390272+0000","last_change":"2024-05-26T15:39:32.923188+0000","last_active":"2024-05-26T15:39:37.390272+0000","last_peered":"2024-05-26T15:39:37.390272+0000","last_clean":"2024-05-26T15:39:37.390272+0000","last_became_active":"2024-05-26T15:39:32.921678+0000","last_became_peered":"2024-05-26T15:39:32.921678+0000","last_unstale":"2024-05-26T15:39:37.390272+0000","last_undegraded":"2024-05-26T15:39:37.390272+0000","last_fullsized":"2024-05-26T15:39:37.390272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:13.695925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406882+0000","last_change":"2024-05-26T15:39:32.939084+0000","last_active":"2024-05-26T15:39:37.406882+0000","last_peered":"2024-05-26T15:39:37.406882+0000","last_clean":"2024-05-26T15:39:37.406882+0000","last_became_active":"2024-05-26T15:39:32.938713+0000","last_became_peered":"2024-05-26T15:39:32.938713+0000","last_unstale":"2024-05-26T15:39:37.406882+0000","last_undegraded":"2024-05-26T15:39:37.406882+0000","last_fullsized":"2024-05-26T15:39:37.406882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406775+0000","last_change":"2024-05-26T15:39:32.939883+0000","last_active":"2024-05-26T15:39:37.406775+0000","last_peered":"2024-05-26T15:39:37.406775+0000","last_clean":"2024-05-26T15:39:37.406775+0000","last_became_active":"2024-05-26T15:39:32.937951+0000","last_became_peered":"2024-05-26T15:39:32.937951+0000","last_unstale":"2024-05-26T15:39:37.406775+0000","last_undegraded":"2024-05-26T15:39:37.406775+0000","last_fullsized":"2024-05-26T15:39:37.406775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.499084+0000","last_change":"2024-05-26T15:39:32.930657+0000","last_active":"2024-05-26T15:39:37.499084+0000","last_peered":"2024-05-26T15:39:37.499084+0000","last_clean":"2024-05-26T15:39:37.499084+0000","last_became_active":"2024-05-26T15:39:32.930382+0000","last_became_peered":"2024-05-26T15:39:32.930382+0000","last_unstale":"2024-05-26T15:39:37.499084+0000","last_undegraded":"2024-05-26T15:39:37.499084+0000","last_fullsized":"2024-05-26T15:39:37.499084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:24.160382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.375877+0000","last_change":"2024-05-26T15:39:32.930568+0000","last_active":"2024-05-26T15:39:37.375877+0000","last_peered":"2024-05-26T15:39:37.375877+0000","last_clean":"2024-05-26T15:39:37.375877+0000","last_became_active":"2024-05-26T15:39:32.930302+0000","last_became_peered":"2024-05-26T15:39:32.930302+0000","last_unstale":"2024-05-26T15:39:37.375877+0000","last_undegraded":"2024-05-26T15:39:37.375877+0000","last_fullsized":"2024-05-26T15:39:37.375877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492015+0000","last_change":"2024-05-26T15:39:32.920604+0000","last_active":"2024-05-26T15:39:37.492015+0000","last_peered":"2024-05-26T15:39:37.492015+0000","last_clean":"2024-05-26T15:39:37.492015+0000","last_became_active":"2024-05-26T15:39:32.919836+0000","last_became_peered":"2024-05-26T15:39:32.919836+0000","last_unstale":"2024-05-26T15:39:37.492015+0000","last_undegraded":"2024-05-26T15:39:37.492015+0000","last_fullsized":"2024-05-26T15:39:37.492015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:07:02.159693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401276+0000","last_change":"2024-05-26T15:39:32.937715+0000","last_active":"2024-05-26T15:39:37.401276+0000","last_peered":"2024-05-26T15:39:37.401276+0000","last_clean":"2024-05-26T15:39:37.401276+0000","last_became_active":"2024-05-26T15:39:32.937451+0000","last_became_peered":"2024-05-26T15:39:32.937451+0000","last_unstale":"2024-05-26T15:39:37.401276+0000","last_undegraded":"2024-05-26T15:39:37.401276+0000","last_fullsized":"2024-05-26T15:39:37.401276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.491613+0000","last_change":"2024-05-26T15:39:32.924295+0000","last_active":"2024-05-26T15:39:37.491613+0000","last_peered":"2024-05-26T15:39:37.491613+0000","last_clean":"2024-05-26T15:39:37.491613+0000","last_became_active":"2024-05-26T15:39:32.923812+0000","last_became_peered":"2024-05-26T15:39:32.923812+0000","last_unstale":"2024-05-26T15:39:37.491613+0000","last_undegraded":"2024-05-26T15:39:37.491613+0000","last_fullsized":"2024-05-26T15:39:37.491613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:42:31.950324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402857+0000","last_change":"2024-05-26T15:39:32.936632+0000","last_active":"2024-05-26T15:39:37.402857+0000","last_peered":"2024-05-26T15:39:37.402857+0000","last_clean":"2024-05-26T15:39:37.402857+0000","last_became_active":"2024-05-26T15:39:32.934911+0000","last_became_peered":"2024-05-26T15:39:32.934911+0000","last_unstale":"2024-05-26T15:39:37.402857+0000","last_undegraded":"2024-05-26T15:39:37.402857+0000","last_fullsized":"2024-05-26T15:39:37.402857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:24.160382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384458+0000","last_change":"2024-05-26T15:39:32.915854+0000","last_active":"2024-05-26T15:39:37.384458+0000","last_peered":"2024-05-26T15:39:37.384458+0000","last_clean":"2024-05-26T15:39:37.384458+0000","last_became_active":"2024-05-26T15:39:32.915514+0000","last_became_peered":"2024-05-26T15:39:32.915514+0000","last_unstale":"2024-05-26T15:39:37.384458+0000","last_undegraded":"2024-05-26T15:39:37.384458+0000","last_fullsized":"2024-05-26T15:39:37.384458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:03.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403966+0000","last_change":"2024-05-26T15:39:32.919780+0000","last_active":"2024-05-26T15:39:37.403966+0000","last_peered":"2024-05-26T15:39:37.403966+0000","last_clean":"2024-05-26T15:39:37.403966+0000","last_became_active":"2024-05-26T15:39:32.919496+0000","last_became_peered":"2024-05-26T15:39:32.919496+0000","last_unstale":"2024-05-26T15:39:37.403966+0000","last_undegraded":"2024-05-26T15:39:37.403966+0000","last_fullsized":"2024-05-26T15:39:37.403966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:09:26.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495449+0000","last_change":"2024-05-26T15:39:32.922248+0000","last_active":"2024-05-26T15:39:37.495449+0000","last_peered":"2024-05-26T15:39:37.495449+0000","last_clean":"2024-05-26T15:39:37.495449+0000","last_became_active":"2024-05-26T15:39:32.921988+0000","last_became_peered":"2024-05-26T15:39:32.921988+0000","last_unstale":"2024-05-26T15:39:37.495449+0000","last_undegraded":"2024-05-26T15:39:37.495449+0000","last_fullsized":"2024-05-26T15:39:37.495449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:47:40.508265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.571}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.839}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":98851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.802}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":98761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:40:02.929 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:40:03.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.190+0000 7f6077e00640 1 Processor -- start 2024-05-26T15:40:03.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.191+0000 7f6077e00640 1 -- start start 2024-05-26T15:40:03.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.192+0000 7f6077e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b4060 0x7f60781655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.192+0000 7f6077e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607806c720 con 0x7f6078144170 2024-05-26T15:40:03.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.192+0000 7f6077e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6078071350 con 0x7f60780cb120 2024-05-26T15:40:03.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.192+0000 7f6077e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607815af60 con 0x7f60780b4060 2024-05-26T15:40:03.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.193+0000 7f6076a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6078144170 0x7f60780cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60366/0 (socket says 172.21.15.8:60366) 2024-05-26T15:40:03.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.193+0000 7f6076a00640 1 -- 172.21.15.8:0/1203529716 learned_addr learned my addr 172.21.15.8:0/1203529716 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:03.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.193+0000 7f6077400640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b4060 0x7f60781655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.193+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772468425 0 0) 0x7f607806c720 con 0x7f6078144170 2024-05-26T15:40:03.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.193+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f605c003520 con 0x7f6078144170 2024-05-26T15:40:03.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2313621149 0 0) 0x7f605c003520 con 0x7f6078144170 2024-05-26T15:40:03.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b4060 msgr2=0x7f60781655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:03.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b4060 0x7f60781655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 >> v1:172.21.15.47:6789/0 conn(0x7f60780cb120 legacy=0x7f60780b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607815b240 con 0x7f6078144170 2024-05-26T15:40:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f6068001670 con 0x7f6078144170 2024-05-26T15:40:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 >> v1:172.21.15.8:6789/0 conn(0x7f6078144170 legacy=0x7f60780cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b4060 0x7f605c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 0x7f605c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f605c004d00 0x7f605c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607815af60 con 0x7f605c003f70 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c00bb70 con 0x7f605c004d00 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c00bd30 con 0x7f60780b4060 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6076000640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 0x7f605c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.194+0000 7f6076a00640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b4060 0x7f605c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.195+0000 7f6077400640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f605c004d00 0x7f605c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.195+0000 7f6076000640 1 -- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b4060 msgr2=0x7f605c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.195+0000 7f6076000640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b4060 0x7f605c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.195+0000 7f6076000640 1 -- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f605c004d00 msgr2=0x7f605c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.195+0000 7f6076000640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f605c004d00 0x7f605c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.195+0000 7f6076000640 1 -- 172.21.15.8:0/1203529716 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c003520 con 0x7f605c003f70 2024-05-26T15:40:03.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.196+0000 7f6076000640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 0x7f605c0047c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6064001750 tx=0x7f605c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3805717afaa7889 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.196+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640052d0 con 0x7f605c003f70 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.196+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064005430 con 0x7f605c003f70 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.196+0000 7f6075600640 1 -- 172.21.15.8:0/1203529716 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606402abe0 con 0x7f605c003f70 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.196+0000 7f6077e00640 1 -- 172.21.15.8:0/1203529716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 msgr2=0x7f605c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.196+0000 7f6077e00640 1 --2- 172.21.15.8:0/1203529716 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 0x7f605c0047c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6064001750 tx=0x7f605c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.197+0000 7f6077400640 1 -- 172.21.15.8:0/1203529716 reap_dead start 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.197+0000 7f6077e00640 1 -- 172.21.15.8:0/1203529716 shutdown_connections 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.197+0000 7f6077e00640 1 -- 172.21.15.8:0/1203529716 >> 172.21.15.8:0/1203529716 conn(0x7f60780ce590 msgr2=0x7f60780ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.197+0000 7f6077e00640 1 -- 172.21.15.8:0/1203529716 shutdown_connections 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.197+0000 7f6077e00640 1 -- 172.21.15.8:0/1203529716 wait complete. 2024-05-26T15:40:03.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.199+0000 7f6077e00640 1 Processor -- start 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.199+0000 7f6077e00640 1 -- start start 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6077e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 0x7f6078140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6077e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b17a0 0x7f60780b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6077e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6078161580 0x7f6078161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6077e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6078161f40 con 0x7f605c003f70 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6077e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6078140cc0 con 0x7f6078161580 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6077e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6078143730 con 0x7f60780b17a0 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6076a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 0x7f6078140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6076a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 0x7f6078140780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47436/0 (socket says 172.21.15.8:47436) 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6076a00640 1 -- 172.21.15.8:0/1063856974 learned_addr learned my addr 172.21.15.8:0/1063856974 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:03.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6077400640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6078161580 0x7f6078161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6076000640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b17a0 0x7f60780b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6076a00640 1 -- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b17a0 msgr2=0x7f60780b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6076a00640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b17a0 0x7f60780b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6076a00640 1 -- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6078161580 msgr2=0x7f6078161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6076a00640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6078161580 0x7f6078161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.200+0000 7f6076a00640 1 -- 172.21.15.8:0/1063856974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780b2310 con 0x7f605c003f70 2024-05-26T15:40:03.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.201+0000 7f6076a00640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 0x7f6078140780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f606800e730 tx=0x7f606800eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:03.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.201+0000 7f606ea00640 1 -- 172.21.15.8:0/1063856974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800c640 con 0x7f605c003f70 2024-05-26T15:40:03.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.201+0000 7f606ea00640 1 -- 172.21.15.8:0/1063856974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606800c7a0 con 0x7f605c003f70 2024-05-26T15:40:03.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.201+0000 7f606ea00640 1 -- 172.21.15.8:0/1063856974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800cb50 con 0x7f605c003f70 2024-05-26T15:40:03.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.201+0000 7f6077e00640 1 -- 172.21.15.8:0/1063856974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60780b25f0 con 0x7f605c003f70 2024-05-26T15:40:03.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.201+0000 7f6077e00640 1 -- 172.21.15.8:0/1063856974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60780b2bb0 con 0x7f605c003f70 2024-05-26T15:40:03.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.203+0000 7f6077e00640 1 -- 172.21.15.8:0/1063856974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60780cf6c0 con 0x7f605c003f70 2024-05-26T15:40:03.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.203+0000 7f606ea00640 1 -- 172.21.15.8:0/1063856974 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f606800ccb0 con 0x7f605c003f70 2024-05-26T15:40:03.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.204+0000 7f606ea00640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f605806ac00 0x7f605806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.204+0000 7f606ea00640 1 -- 172.21.15.8:0/1063856974 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60680895a0 con 0x7f605c003f70 2024-05-26T15:40:03.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.205+0000 7f6076000640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f605806ac00 0x7f605806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.206+0000 7f6076000640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f605806ac00 0x7f605806d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6064032000 tx=0x7f606402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:03.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.209+0000 7f606ea00640 1 -- 172.21.15.8:0/1063856974 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6068054400 con 0x7f605c003f70 2024-05-26T15:40:03.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.404+0000 7f6077e00640 1 -- 172.21.15.8:0/1063856974 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6078071660 con 0x7f605806ac00 2024-05-26T15:40:03.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.430+0000 7f606ea00640 1 -- 172.21.15.8:0/1063856974 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345115 (secure 0 0 0) 0x7f6078071660 con 0x7f605806ac00 2024-05-26T15:40:03.430 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:03.434 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:40:03.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.437+0000 7f6077e00640 1 -- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f605806ac00 msgr2=0x7f605806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.437+0000 7f6077e00640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f605806ac00 0x7f605806d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6064032000 tx=0x7f606402e000 comp rx=0 tx=0).stop 2024-05-26T15:40:03.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.437+0000 7f6077e00640 1 -- 172.21.15.8:0/1063856974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 msgr2=0x7f6078140780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.437+0000 7f6077e00640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 0x7f6078140780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f606800e730 tx=0x7f606800eb30 comp rx=0 tx=0).stop 2024-05-26T15:40:03.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.437+0000 7f6077e00640 1 -- 172.21.15.8:0/1063856974 shutdown_connections 2024-05-26T15:40:03.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.437+0000 7f6077e00640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f605806ac00 0x7f605806d0c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.437+0000 7f6077e00640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6078161580 0x7f6078161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.437+0000 7f6077e00640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60780b17a0 0x7f60780b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.437+0000 7f6077e00640 1 --2- 172.21.15.8:0/1063856974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605c003f70 0x7f6078140780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.437+0000 7f6077e00640 1 -- 172.21.15.8:0/1063856974 >> 172.21.15.8:0/1063856974 conn(0x7f60780ce590 msgr2=0x7f607806dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:03.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.438+0000 7f6077e00640 1 -- 172.21.15.8:0/1063856974 shutdown_connections 2024-05-26T15:40:03.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.438+0000 7f6077e00640 1 -- 172.21.15.8:0/1063856974 wait complete. 2024-05-26T15:40:03.455 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-05-26T15:40:02.163931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235744,"kb_used_data":3196,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738976,"statfs":{"total":773094113280,"available":772852711424,"internally_reserved":0,"allocated":3272704,"data_stored":1985107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005636"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386165+0000","last_change":"2024-05-26T15:39:32.432165+0000","last_active":"2024-05-26T15:39:37.386165+0000","last_peered":"2024-05-26T15:39:37.386165+0000","last_clean":"2024-05-26T15:39:37.386165+0000","last_became_active":"2024-05-26T15:39:32.431489+0000","last_became_peered":"2024-05-26T15:39:32.431489+0000","last_unstale":"2024-05-26T15:39:37.386165+0000","last_undegraded":"2024-05-26T15:39:37.386165+0000","last_fullsized":"2024-05-26T15:39:37.386165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:45:24.383306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379327+0000","last_change":"2024-05-26T15:39:32.919233+0000","last_active":"2024-05-26T15:39:37.379327+0000","last_peered":"2024-05-26T15:39:37.379327+0000","last_clean":"2024-05-26T15:39:37.379327+0000","last_became_active":"2024-05-26T15:39:32.918954+0000","last_became_peered":"2024-05-26T15:39:32.918954+0000","last_unstale":"2024-05-26T15:39:37.379327+0000","last_undegraded":"2024-05-26T15:39:37.379327+0000","last_fullsized":"2024-05-26T15:39:37.379327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288096+0000","last_change":"2024-05-26T15:39:37.499590+0000","last_active":"2024-05-26T15:39:39.288096+0000","last_peered":"2024-05-26T15:39:39.288096+0000","last_clean":"2024-05-26T15:39:39.288096+0000","last_became_active":"2024-05-26T15:39:37.497710+0000","last_became_peered":"2024-05-26T15:39:37.497710+0000","last_unstale":"2024-05-26T15:39:39.288096+0000","last_undegraded":"2024-05-26T15:39:39.288096+0000","last_fullsized":"2024-05-26T15:39:39.288096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:38:29.550301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379789+0000","last_change":"2024-05-26T15:39:32.420682+0000","last_active":"2024-05-26T15:39:37.379789+0000","last_peered":"2024-05-26T15:39:37.379789+0000","last_clean":"2024-05-26T15:39:37.379789+0000","last_became_active":"2024-05-26T15:39:32.418629+0000","last_became_peered":"2024-05-26T15:39:32.418629+0000","last_unstale":"2024-05-26T15:39:37.379789+0000","last_undegraded":"2024-05-26T15:39:37.379789+0000","last_fullsized":"2024-05-26T15:39:37.379789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383890+0000","last_change":"2024-05-26T15:39:32.930973+0000","last_active":"2024-05-26T15:39:37.383890+0000","last_peered":"2024-05-26T15:39:37.383890+0000","last_clean":"2024-05-26T15:39:37.383890+0000","last_became_active":"2024-05-26T15:39:32.930696+0000","last_became_peered":"2024-05-26T15:39:32.930696+0000","last_unstale":"2024-05-26T15:39:37.383890+0000","last_undegraded":"2024-05-26T15:39:37.383890+0000","last_fullsized":"2024-05-26T15:39:37.383890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881236+0000","last_change":"2024-05-26T15:39:37.407147+0000","last_active":"2024-05-26T15:39:37.881236+0000","last_peered":"2024-05-26T15:39:37.881236+0000","last_clean":"2024-05-26T15:39:37.881236+0000","last_became_active":"2024-05-26T15:39:37.406661+0000","last_became_peered":"2024-05-26T15:39:37.406661+0000","last_unstale":"2024-05-26T15:39:37.881236+0000","last_undegraded":"2024-05-26T15:39:37.881236+0000","last_fullsized":"2024-05-26T15:39:37.881236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:52:01.807307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.494776+0000","last_change":"2024-05-26T15:39:32.436688+0000","last_active":"2024-05-26T15:39:37.494776+0000","last_peered":"2024-05-26T15:39:37.494776+0000","last_clean":"2024-05-26T15:39:37.494776+0000","last_became_active":"2024-05-26T15:39:32.436376+0000","last_became_peered":"2024-05-26T15:39:32.436376+0000","last_unstale":"2024-05-26T15:39:37.494776+0000","last_undegraded":"2024-05-26T15:39:37.494776+0000","last_fullsized":"2024-05-26T15:39:37.494776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:12.690125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402956+0000","last_change":"2024-05-26T15:39:32.937138+0000","last_active":"2024-05-26T15:39:37.402956+0000","last_peered":"2024-05-26T15:39:37.402956+0000","last_clean":"2024-05-26T15:39:37.402956+0000","last_became_active":"2024-05-26T15:39:32.936872+0000","last_became_peered":"2024-05-26T15:39:32.936872+0000","last_unstale":"2024-05-26T15:39:37.402956+0000","last_undegraded":"2024-05-26T15:39:37.402956+0000","last_fullsized":"2024-05-26T15:39:37.402956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:02:49.914564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882195+0000","last_change":"2024-05-26T15:39:37.406227+0000","last_active":"2024-05-26T15:39:37.882195+0000","last_peered":"2024-05-26T15:39:37.882195+0000","last_clean":"2024-05-26T15:39:37.882195+0000","last_became_active":"2024-05-26T15:39:37.405551+0000","last_became_peered":"2024-05-26T15:39:37.405551+0000","last_unstale":"2024-05-26T15:39:37.882195+0000","last_undegraded":"2024-05-26T15:39:37.882195+0000","last_fullsized":"2024-05-26T15:39:37.882195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:45:07.288223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492340+0000","last_change":"2024-05-26T15:39:32.439870+0000","last_active":"2024-05-26T15:39:37.492340+0000","last_peered":"2024-05-26T15:39:37.492340+0000","last_clean":"2024-05-26T15:39:37.492340+0000","last_became_active":"2024-05-26T15:39:32.439491+0000","last_became_peered":"2024-05-26T15:39:32.439491+0000","last_unstale":"2024-05-26T15:39:37.492340+0000","last_undegraded":"2024-05-26T15:39:37.492340+0000","last_fullsized":"2024-05-26T15:39:37.492340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:51:21.068431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405199+0000","last_change":"2024-05-26T15:39:32.932834+0000","last_active":"2024-05-26T15:39:37.405199+0000","last_peered":"2024-05-26T15:39:37.405199+0000","last_clean":"2024-05-26T15:39:37.405199+0000","last_became_active":"2024-05-26T15:39:32.930499+0000","last_became_peered":"2024-05-26T15:39:32.930499+0000","last_unstale":"2024-05-26T15:39:37.405199+0000","last_undegraded":"2024-05-26T15:39:37.405199+0000","last_fullsized":"2024-05-26T15:39:37.405199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:16:58.690646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881578+0000","last_change":"2024-05-26T15:39:37.403865+0000","last_active":"2024-05-26T15:39:37.881578+0000","last_peered":"2024-05-26T15:39:37.881578+0000","last_clean":"2024-05-26T15:39:37.881578+0000","last_became_active":"2024-05-26T15:39:37.403330+0000","last_became_peered":"2024-05-26T15:39:37.403330+0000","last_unstale":"2024-05-26T15:39:37.881578+0000","last_undegraded":"2024-05-26T15:39:37.881578+0000","last_fullsized":"2024-05-26T15:39:37.881578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:56:31.917292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405022+0000","last_change":"2024-05-26T15:39:32.929330+0000","last_active":"2024-05-26T15:39:37.405022+0000","last_peered":"2024-05-26T15:39:37.405022+0000","last_clean":"2024-05-26T15:39:37.405022+0000","last_became_active":"2024-05-26T15:39:32.929059+0000","last_became_peered":"2024-05-26T15:39:32.929059+0000","last_unstale":"2024-05-26T15:39:37.405022+0000","last_undegraded":"2024-05-26T15:39:37.405022+0000","last_fullsized":"2024-05-26T15:39:37.405022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.500100+0000","last_change":"2024-05-26T15:39:32.436030+0000","last_active":"2024-05-26T15:39:37.500100+0000","last_peered":"2024-05-26T15:39:37.500100+0000","last_clean":"2024-05-26T15:39:37.500100+0000","last_became_active":"2024-05-26T15:39:32.434362+0000","last_became_peered":"2024-05-26T15:39:32.434362+0000","last_unstale":"2024-05-26T15:39:37.500100+0000","last_undegraded":"2024-05-26T15:39:37.500100+0000","last_fullsized":"2024-05-26T15:39:37.500100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:25.042059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882811+0000","last_change":"2024-05-26T15:39:37.402375+0000","last_active":"2024-05-26T15:39:37.882811+0000","last_peered":"2024-05-26T15:39:37.882811+0000","last_clean":"2024-05-26T15:39:37.882811+0000","last_became_active":"2024-05-26T15:39:37.401909+0000","last_became_peered":"2024-05-26T15:39:37.401909+0000","last_unstale":"2024-05-26T15:39:37.882811+0000","last_undegraded":"2024-05-26T15:39:37.882811+0000","last_fullsized":"2024-05-26T15:39:37.882811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377881+0000","last_change":"2024-05-26T15:39:32.926407+0000","last_active":"2024-05-26T15:39:37.377881+0000","last_peered":"2024-05-26T15:39:37.377881+0000","last_clean":"2024-05-26T15:39:37.377881+0000","last_became_active":"2024-05-26T15:39:32.924213+0000","last_became_peered":"2024-05-26T15:39:32.924213+0000","last_unstale":"2024-05-26T15:39:37.377881+0000","last_undegraded":"2024-05-26T15:39:37.377881+0000","last_fullsized":"2024-05-26T15:39:37.377881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403642+0000","last_change":"2024-05-26T15:39:32.424999+0000","last_active":"2024-05-26T15:39:37.403642+0000","last_peered":"2024-05-26T15:39:37.403642+0000","last_clean":"2024-05-26T15:39:37.403642+0000","last_became_active":"2024-05-26T15:39:32.424692+0000","last_became_peered":"2024-05-26T15:39:32.424692+0000","last_unstale":"2024-05-26T15:39:37.403642+0000","last_undegraded":"2024-05-26T15:39:37.403642+0000","last_fullsized":"2024-05-26T15:39:37.403642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882346+0000","last_change":"2024-05-26T15:39:37.407719+0000","last_active":"2024-05-26T15:39:37.882346+0000","last_peered":"2024-05-26T15:39:37.882346+0000","last_clean":"2024-05-26T15:39:37.882346+0000","last_became_active":"2024-05-26T15:39:37.407277+0000","last_became_peered":"2024-05-26T15:39:37.407277+0000","last_unstale":"2024-05-26T15:39:37.882346+0000","last_undegraded":"2024-05-26T15:39:37.882346+0000","last_fullsized":"2024-05-26T15:39:37.882346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377305+0000","last_change":"2024-05-26T15:39:32.914034+0000","last_active":"2024-05-26T15:39:37.377305+0000","last_peered":"2024-05-26T15:39:37.377305+0000","last_clean":"2024-05-26T15:39:37.377305+0000","last_became_active":"2024-05-26T15:39:32.912275+0000","last_became_peered":"2024-05-26T15:39:32.912275+0000","last_unstale":"2024-05-26T15:39:37.377305+0000","last_undegraded":"2024-05-26T15:39:37.377305+0000","last_fullsized":"2024-05-26T15:39:37.377305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402750+0000","last_change":"2024-05-26T15:39:32.430257+0000","last_active":"2024-05-26T15:39:37.402750+0000","last_peered":"2024-05-26T15:39:37.402750+0000","last_clean":"2024-05-26T15:39:37.402750+0000","last_became_active":"2024-05-26T15:39:32.429796+0000","last_became_peered":"2024-05-26T15:39:32.429796+0000","last_unstale":"2024-05-26T15:39:37.402750+0000","last_undegraded":"2024-05-26T15:39:37.402750+0000","last_fullsized":"2024-05-26T15:39:37.402750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.293026+0000","last_change":"2024-05-26T15:39:37.502078+0000","last_active":"2024-05-26T15:39:38.293026+0000","last_peered":"2024-05-26T15:39:38.293026+0000","last_clean":"2024-05-26T15:39:38.293026+0000","last_became_active":"2024-05-26T15:39:37.501483+0000","last_became_peered":"2024-05-26T15:39:37.501483+0000","last_unstale":"2024-05-26T15:39:38.293026+0000","last_undegraded":"2024-05-26T15:39:38.293026+0000","last_fullsized":"2024-05-26T15:39:38.293026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387962+0000","last_change":"2024-05-26T15:39:32.916982+0000","last_active":"2024-05-26T15:39:37.387962+0000","last_peered":"2024-05-26T15:39:37.387962+0000","last_clean":"2024-05-26T15:39:37.387962+0000","last_became_active":"2024-05-26T15:39:32.916068+0000","last_became_peered":"2024-05-26T15:39:32.916068+0000","last_unstale":"2024-05-26T15:39:37.387962+0000","last_undegraded":"2024-05-26T15:39:37.387962+0000","last_fullsized":"2024-05-26T15:39:37.387962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:20.298140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490624+0000","last_change":"2024-05-26T15:39:32.429729+0000","last_active":"2024-05-26T15:39:37.490624+0000","last_peered":"2024-05-26T15:39:37.490624+0000","last_clean":"2024-05-26T15:39:37.490624+0000","last_became_active":"2024-05-26T15:39:32.429305+0000","last_became_peered":"2024-05-26T15:39:32.429305+0000","last_unstale":"2024-05-26T15:39:37.490624+0000","last_undegraded":"2024-05-26T15:39:37.490624+0000","last_fullsized":"2024-05-26T15:39:37.490624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.883028+0000","last_change":"2024-05-26T15:39:37.405280+0000","last_active":"2024-05-26T15:39:37.883028+0000","last_peered":"2024-05-26T15:39:37.883028+0000","last_clean":"2024-05-26T15:39:37.883028+0000","last_became_active":"2024-05-26T15:39:37.404901+0000","last_became_peered":"2024-05-26T15:39:37.404901+0000","last_unstale":"2024-05-26T15:39:37.883028+0000","last_undegraded":"2024-05-26T15:39:37.883028+0000","last_fullsized":"2024-05-26T15:39:37.883028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:46:18.529170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387113+0000","last_change":"2024-05-26T15:39:32.912045+0000","last_active":"2024-05-26T15:39:37.387113+0000","last_peered":"2024-05-26T15:39:37.387113+0000","last_clean":"2024-05-26T15:39:37.387113+0000","last_became_active":"2024-05-26T15:39:32.911751+0000","last_became_peered":"2024-05-26T15:39:32.911751+0000","last_unstale":"2024-05-26T15:39:37.387113+0000","last_undegraded":"2024-05-26T15:39:37.387113+0000","last_fullsized":"2024-05-26T15:39:37.387113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:09:26.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.408057+0000","last_change":"2024-05-26T15:39:32.437696+0000","last_active":"2024-05-26T15:39:37.408057+0000","last_peered":"2024-05-26T15:39:37.408057+0000","last_clean":"2024-05-26T15:39:37.408057+0000","last_became_active":"2024-05-26T15:39:32.437168+0000","last_became_peered":"2024-05-26T15:39:32.437168+0000","last_unstale":"2024-05-26T15:39:37.408057+0000","last_undegraded":"2024-05-26T15:39:37.408057+0000","last_fullsized":"2024-05-26T15:39:37.408057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881371+0000","last_change":"2024-05-26T15:39:37.499923+0000","last_active":"2024-05-26T15:39:37.881371+0000","last_peered":"2024-05-26T15:39:37.881371+0000","last_clean":"2024-05-26T15:39:37.881371+0000","last_became_active":"2024-05-26T15:39:37.499000+0000","last_became_peered":"2024-05-26T15:39:37.499000+0000","last_unstale":"2024-05-26T15:39:37.881371+0000","last_undegraded":"2024-05-26T15:39:37.881371+0000","last_fullsized":"2024-05-26T15:39:37.881371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379901+0000","last_change":"2024-05-26T15:39:32.922222+0000","last_active":"2024-05-26T15:39:37.379901+0000","last_peered":"2024-05-26T15:39:37.379901+0000","last_clean":"2024-05-26T15:39:37.379901+0000","last_became_active":"2024-05-26T15:39:32.921594+0000","last_became_peered":"2024-05-26T15:39:32.921594+0000","last_unstale":"2024-05-26T15:39:37.379901+0000","last_undegraded":"2024-05-26T15:39:37.379901+0000","last_fullsized":"2024-05-26T15:39:37.379901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.292819+0000","last_change":"2024-05-26T15:39:32.428520+0000","last_active":"2024-05-26T15:39:38.292819+0000","last_peered":"2024-05-26T15:39:38.292819+0000","last_clean":"2024-05-26T15:39:38.292819+0000","last_became_active":"2024-05-26T15:39:32.427761+0000","last_became_peered":"2024-05-26T15:39:32.427761+0000","last_unstale":"2024-05-26T15:39:38.292819+0000","last_undegraded":"2024-05-26T15:39:38.292819+0000","last_fullsized":"2024-05-26T15:39:38.292819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288088+0000","last_change":"2024-05-26T15:39:37.490760+0000","last_active":"2024-05-26T15:39:39.288088+0000","last_peered":"2024-05-26T15:39:39.288088+0000","last_clean":"2024-05-26T15:39:39.288088+0000","last_became_active":"2024-05-26T15:39:37.490319+0000","last_became_peered":"2024-05-26T15:39:37.490319+0000","last_unstale":"2024-05-26T15:39:39.288088+0000","last_undegraded":"2024-05-26T15:39:39.288088+0000","last_fullsized":"2024-05-26T15:39:39.288088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:46:18.529170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403196+0000","last_change":"2024-05-26T15:39:32.917740+0000","last_active":"2024-05-26T15:39:37.403196+0000","last_peered":"2024-05-26T15:39:37.403196+0000","last_clean":"2024-05-26T15:39:37.403196+0000","last_became_active":"2024-05-26T15:39:32.917370+0000","last_became_peered":"2024-05-26T15:39:32.917370+0000","last_unstale":"2024-05-26T15:39:37.403196+0000","last_undegraded":"2024-05-26T15:39:37.403196+0000","last_fullsized":"2024-05-26T15:39:37.403196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495183+0000","last_change":"2024-05-26T15:39:32.433409+0000","last_active":"2024-05-26T15:39:37.495183+0000","last_peered":"2024-05-26T15:39:37.495183+0000","last_clean":"2024-05-26T15:39:37.495183+0000","last_became_active":"2024-05-26T15:39:32.433133+0000","last_became_peered":"2024-05-26T15:39:32.433133+0000","last_unstale":"2024-05-26T15:39:37.495183+0000","last_undegraded":"2024-05-26T15:39:37.495183+0000","last_fullsized":"2024-05-26T15:39:37.495183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.058977+0000","last_change":"2024-05-26T15:39:37.502064+0000","last_active":"2024-05-26T15:39:39.058977+0000","last_peered":"2024-05-26T15:39:39.058977+0000","last_clean":"2024-05-26T15:39:39.058977+0000","last_became_active":"2024-05-26T15:39:37.500834+0000","last_became_peered":"2024-05-26T15:39:37.500834+0000","last_unstale":"2024-05-26T15:39:39.058977+0000","last_undegraded":"2024-05-26T15:39:39.058977+0000","last_fullsized":"2024-05-26T15:39:39.058977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405289+0000","last_change":"2024-05-26T15:39:32.933048+0000","last_active":"2024-05-26T15:39:37.405289+0000","last_peered":"2024-05-26T15:39:37.405289+0000","last_clean":"2024-05-26T15:39:37.405289+0000","last_became_active":"2024-05-26T15:39:32.932543+0000","last_became_peered":"2024-05-26T15:39:32.932543+0000","last_unstale":"2024-05-26T15:39:37.405289+0000","last_undegraded":"2024-05-26T15:39:37.405289+0000","last_fullsized":"2024-05-26T15:39:37.405289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:47:40.508265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403483+0000","last_change":"2024-05-26T15:39:32.419636+0000","last_active":"2024-05-26T15:39:37.403483+0000","last_peered":"2024-05-26T15:39:37.403483+0000","last_clean":"2024-05-26T15:39:37.403483+0000","last_became_active":"2024-05-26T15:39:32.419323+0000","last_became_peered":"2024-05-26T15:39:32.419323+0000","last_unstale":"2024-05-26T15:39:37.403483+0000","last_undegraded":"2024-05-26T15:39:37.403483+0000","last_fullsized":"2024-05-26T15:39:37.403483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291885+0000","last_change":"2024-05-26T15:39:37.408610+0000","last_active":"2024-05-26T15:39:38.291885+0000","last_peered":"2024-05-26T15:39:38.291885+0000","last_clean":"2024-05-26T15:39:38.291885+0000","last_became_active":"2024-05-26T15:39:37.408202+0000","last_became_peered":"2024-05-26T15:39:37.408202+0000","last_unstale":"2024-05-26T15:39:38.291885+0000","last_undegraded":"2024-05-26T15:39:38.291885+0000","last_fullsized":"2024-05-26T15:39:38.291885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386340+0000","last_change":"2024-05-26T15:39:32.915325+0000","last_active":"2024-05-26T15:39:37.386340+0000","last_peered":"2024-05-26T15:39:37.386340+0000","last_clean":"2024-05-26T15:39:37.386340+0000","last_became_active":"2024-05-26T15:39:32.915062+0000","last_became_peered":"2024-05-26T15:39:32.915062+0000","last_unstale":"2024-05-26T15:39:37.386340+0000","last_undegraded":"2024-05-26T15:39:37.386340+0000","last_fullsized":"2024-05-26T15:39:37.386340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:29.697944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401650+0000","last_change":"2024-05-26T15:39:32.429277+0000","last_active":"2024-05-26T15:39:37.401650+0000","last_peered":"2024-05-26T15:39:37.401650+0000","last_clean":"2024-05-26T15:39:37.401650+0000","last_became_active":"2024-05-26T15:39:32.428675+0000","last_became_peered":"2024-05-26T15:39:32.428675+0000","last_unstale":"2024-05-26T15:39:37.401650+0000","last_undegraded":"2024-05-26T15:39:37.401650+0000","last_fullsized":"2024-05-26T15:39:37.401650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291995+0000","last_change":"2024-05-26T15:39:37.407588+0000","last_active":"2024-05-26T15:39:38.291995+0000","last_peered":"2024-05-26T15:39:38.291995+0000","last_clean":"2024-05-26T15:39:38.291995+0000","last_became_active":"2024-05-26T15:39:37.407196+0000","last_became_peered":"2024-05-26T15:39:37.407196+0000","last_unstale":"2024-05-26T15:39:38.291995+0000","last_undegraded":"2024-05-26T15:39:38.291995+0000","last_fullsized":"2024-05-26T15:39:38.291995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401522+0000","last_change":"2024-05-26T15:39:32.915063+0000","last_active":"2024-05-26T15:39:37.401522+0000","last_peered":"2024-05-26T15:39:37.401522+0000","last_clean":"2024-05-26T15:39:37.401522+0000","last_became_active":"2024-05-26T15:39:32.914721+0000","last_became_peered":"2024-05-26T15:39:32.914721+0000","last_unstale":"2024-05-26T15:39:37.401522+0000","last_undegraded":"2024-05-26T15:39:37.401522+0000","last_fullsized":"2024-05-26T15:39:37.401522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:03.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.392964+0000","last_change":"2024-05-26T15:39:32.414114+0000","last_active":"2024-05-26T15:39:37.392964+0000","last_peered":"2024-05-26T15:39:37.392964+0000","last_clean":"2024-05-26T15:39:37.392964+0000","last_became_active":"2024-05-26T15:39:32.411824+0000","last_became_peered":"2024-05-26T15:39:32.411824+0000","last_unstale":"2024-05-26T15:39:37.392964+0000","last_undegraded":"2024-05-26T15:39:37.392964+0000","last_fullsized":"2024-05-26T15:39:37.392964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.293087+0000","last_change":"2024-05-26T15:39:37.408530+0000","last_active":"2024-05-26T15:39:38.293087+0000","last_peered":"2024-05-26T15:39:38.293087+0000","last_clean":"2024-05-26T15:39:38.293087+0000","last_became_active":"2024-05-26T15:39:37.408147+0000","last_became_peered":"2024-05-26T15:39:37.408147+0000","last_unstale":"2024-05-26T15:39:38.293087+0000","last_undegraded":"2024-05-26T15:39:38.293087+0000","last_fullsized":"2024-05-26T15:39:38.293087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:09:29.167701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384060+0000","last_change":"2024-05-26T15:39:32.899088+0000","last_active":"2024-05-26T15:39:37.384060+0000","last_peered":"2024-05-26T15:39:37.384060+0000","last_clean":"2024-05-26T15:39:37.384060+0000","last_became_active":"2024-05-26T15:39:32.896938+0000","last_became_peered":"2024-05-26T15:39:32.896938+0000","last_unstale":"2024-05-26T15:39:37.384060+0000","last_undegraded":"2024-05-26T15:39:37.384060+0000","last_fullsized":"2024-05-26T15:39:37.384060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:07:16.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490674+0000","last_change":"2024-05-26T15:39:32.430448+0000","last_active":"2024-05-26T15:39:37.490674+0000","last_peered":"2024-05-26T15:39:37.490674+0000","last_clean":"2024-05-26T15:39:37.490674+0000","last_became_active":"2024-05-26T15:39:32.430063+0000","last_became_peered":"2024-05-26T15:39:32.430063+0000","last_unstale":"2024-05-26T15:39:37.490674+0000","last_undegraded":"2024-05-26T15:39:37.490674+0000","last_fullsized":"2024-05-26T15:39:37.490674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059389+0000","last_change":"2024-05-26T15:39:37.498500+0000","last_active":"2024-05-26T15:39:39.059389+0000","last_peered":"2024-05-26T15:39:39.059389+0000","last_clean":"2024-05-26T15:39:39.059389+0000","last_became_active":"2024-05-26T15:39:37.497853+0000","last_became_peered":"2024-05-26T15:39:37.497853+0000","last_unstale":"2024-05-26T15:39:39.059389+0000","last_undegraded":"2024-05-26T15:39:39.059389+0000","last_fullsized":"2024-05-26T15:39:39.059389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:43:41.543097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.378613+0000","last_change":"2024-05-26T15:39:32.931560+0000","last_active":"2024-05-26T15:39:37.378613+0000","last_peered":"2024-05-26T15:39:37.378613+0000","last_clean":"2024-05-26T15:39:37.378613+0000","last_became_active":"2024-05-26T15:39:32.930941+0000","last_became_peered":"2024-05-26T15:39:32.930941+0000","last_unstale":"2024-05-26T15:39:37.378613+0000","last_undegraded":"2024-05-26T15:39:37.378613+0000","last_fullsized":"2024-05-26T15:39:37.378613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402158+0000","last_change":"2024-05-26T15:39:32.426663+0000","last_active":"2024-05-26T15:39:37.402158+0000","last_peered":"2024-05-26T15:39:37.402158+0000","last_clean":"2024-05-26T15:39:37.402158+0000","last_became_active":"2024-05-26T15:39:32.426151+0000","last_became_peered":"2024-05-26T15:39:32.426151+0000","last_unstale":"2024-05-26T15:39:37.402158+0000","last_undegraded":"2024-05-26T15:39:37.402158+0000","last_fullsized":"2024-05-26T15:39:37.402158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490962+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:39:37.490962+0000","last_peered":"2024-05-26T15:39:37.490962+0000","last_clean":"2024-05-26T15:39:37.490962+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:39:37.490962+0000","last_undegraded":"2024-05-26T15:39:37.490962+0000","last_fullsized":"2024-05-26T15:39:37.490962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.002545+0000","last_change":"2024-05-26T15:39:37.505399+0000","last_active":"2024-05-26T15:39:38.002545+0000","last_peered":"2024-05-26T15:39:38.002545+0000","last_clean":"2024-05-26T15:39:38.002545+0000","last_became_active":"2024-05-26T15:39:37.501182+0000","last_became_peered":"2024-05-26T15:39:37.501182+0000","last_unstale":"2024-05-26T15:39:38.002545+0000","last_undegraded":"2024-05-26T15:39:38.002545+0000","last_fullsized":"2024-05-26T15:39:38.002545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:10:47.871214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.498704+0000","last_change":"2024-05-26T15:39:32.938192+0000","last_active":"2024-05-26T15:39:37.498704+0000","last_peered":"2024-05-26T15:39:37.498704+0000","last_clean":"2024-05-26T15:39:37.498704+0000","last_became_active":"2024-05-26T15:39:32.937905+0000","last_became_peered":"2024-05-26T15:39:32.937905+0000","last_unstale":"2024-05-26T15:39:37.498704+0000","last_undegraded":"2024-05-26T15:39:37.498704+0000","last_fullsized":"2024-05-26T15:39:37.498704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:02:49.914564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.393909+0000","last_change":"2024-05-26T15:39:32.438199+0000","last_active":"2024-05-26T15:39:37.393909+0000","last_peered":"2024-05-26T15:39:37.393909+0000","last_clean":"2024-05-26T15:39:37.393909+0000","last_became_active":"2024-05-26T15:39:32.437949+0000","last_became_peered":"2024-05-26T15:39:32.437949+0000","last_unstale":"2024-05-26T15:39:37.393909+0000","last_undegraded":"2024-05-26T15:39:37.393909+0000","last_fullsized":"2024-05-26T15:39:37.393909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.002149+0000","last_change":"2024-05-26T15:39:37.495167+0000","last_active":"2024-05-26T15:39:38.002149+0000","last_peered":"2024-05-26T15:39:38.002149+0000","last_clean":"2024-05-26T15:39:38.002149+0000","last_became_active":"2024-05-26T15:39:37.493976+0000","last_became_peered":"2024-05-26T15:39:37.493976+0000","last_unstale":"2024-05-26T15:39:38.002149+0000","last_undegraded":"2024-05-26T15:39:38.002149+0000","last_fullsized":"2024-05-26T15:39:38.002149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:12:51.547304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404196+0000","last_change":"2024-05-26T15:39:32.938730+0000","last_active":"2024-05-26T15:39:37.404196+0000","last_peered":"2024-05-26T15:39:37.404196+0000","last_clean":"2024-05-26T15:39:37.404196+0000","last_became_active":"2024-05-26T15:39:32.933947+0000","last_became_peered":"2024-05-26T15:39:32.933947+0000","last_unstale":"2024-05-26T15:39:37.404196+0000","last_undegraded":"2024-05-26T15:39:37.404196+0000","last_fullsized":"2024-05-26T15:39:37.404196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:07:02.159693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403811+0000","last_change":"2024-05-26T15:39:32.425826+0000","last_active":"2024-05-26T15:39:37.403811+0000","last_peered":"2024-05-26T15:39:37.403811+0000","last_clean":"2024-05-26T15:39:37.403811+0000","last_became_active":"2024-05-26T15:39:32.424115+0000","last_became_peered":"2024-05-26T15:39:32.424115+0000","last_unstale":"2024-05-26T15:39:37.403811+0000","last_undegraded":"2024-05-26T15:39:37.403811+0000","last_fullsized":"2024-05-26T15:39:37.403811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059111+0000","last_change":"2024-05-26T15:39:37.408873+0000","last_active":"2024-05-26T15:39:39.059111+0000","last_peered":"2024-05-26T15:39:39.059111+0000","last_clean":"2024-05-26T15:39:39.059111+0000","last_became_active":"2024-05-26T15:39:37.408458+0000","last_became_peered":"2024-05-26T15:39:37.408458+0000","last_unstale":"2024-05-26T15:39:39.059111+0000","last_undegraded":"2024-05-26T15:39:39.059111+0000","last_fullsized":"2024-05-26T15:39:39.059111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.499252+0000","last_change":"2024-05-26T15:39:32.928652+0000","last_active":"2024-05-26T15:39:37.499252+0000","last_peered":"2024-05-26T15:39:37.499252+0000","last_clean":"2024-05-26T15:39:37.499252+0000","last_became_active":"2024-05-26T15:39:32.925638+0000","last_became_peered":"2024-05-26T15:39:32.925638+0000","last_unstale":"2024-05-26T15:39:37.499252+0000","last_undegraded":"2024-05-26T15:39:37.499252+0000","last_fullsized":"2024-05-26T15:39:37.499252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.394843+0000","last_change":"2024-05-26T15:39:32.414781+0000","last_active":"2024-05-26T15:39:37.394843+0000","last_peered":"2024-05-26T15:39:37.394843+0000","last_clean":"2024-05-26T15:39:37.394843+0000","last_became_active":"2024-05-26T15:39:32.414352+0000","last_became_peered":"2024-05-26T15:39:32.414352+0000","last_unstale":"2024-05-26T15:39:37.394843+0000","last_undegraded":"2024-05-26T15:39:37.394843+0000","last_fullsized":"2024-05-26T15:39:37.394843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.289544+0000","last_change":"2024-05-26T15:39:37.498550+0000","last_active":"2024-05-26T15:39:39.289544+0000","last_peered":"2024-05-26T15:39:39.289544+0000","last_clean":"2024-05-26T15:39:39.289544+0000","last_became_active":"2024-05-26T15:39:37.497751+0000","last_became_peered":"2024-05-26T15:39:37.497751+0000","last_unstale":"2024-05-26T15:39:39.289544+0000","last_undegraded":"2024-05-26T15:39:39.289544+0000","last_fullsized":"2024-05-26T15:39:39.289544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495328+0000","last_change":"2024-05-26T15:39:32.919184+0000","last_active":"2024-05-26T15:39:37.495328+0000","last_peered":"2024-05-26T15:39:37.495328+0000","last_clean":"2024-05-26T15:39:37.495328+0000","last_became_active":"2024-05-26T15:39:32.917283+0000","last_became_peered":"2024-05-26T15:39:32.917283+0000","last_unstale":"2024-05-26T15:39:37.495328+0000","last_undegraded":"2024-05-26T15:39:37.495328+0000","last_fullsized":"2024-05-26T15:39:37.495328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387011+0000","last_change":"2024-05-26T15:39:32.414068+0000","last_active":"2024-05-26T15:39:37.387011+0000","last_peered":"2024-05-26T15:39:37.387011+0000","last_clean":"2024-05-26T15:39:37.387011+0000","last_became_active":"2024-05-26T15:39:32.411487+0000","last_became_peered":"2024-05-26T15:39:32.411487+0000","last_unstale":"2024-05-26T15:39:37.387011+0000","last_undegraded":"2024-05-26T15:39:37.387011+0000","last_fullsized":"2024-05-26T15:39:37.387011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:04:28.582294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881086+0000","last_change":"2024-05-26T15:39:37.406440+0000","last_active":"2024-05-26T15:39:37.881086+0000","last_peered":"2024-05-26T15:39:37.881086+0000","last_clean":"2024-05-26T15:39:37.881086+0000","last_became_active":"2024-05-26T15:39:37.405935+0000","last_became_peered":"2024-05-26T15:39:37.405935+0000","last_unstale":"2024-05-26T15:39:37.881086+0000","last_undegraded":"2024-05-26T15:39:37.881086+0000","last_fullsized":"2024-05-26T15:39:37.881086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492257+0000","last_change":"2024-05-26T15:39:32.920860+0000","last_active":"2024-05-26T15:39:37.492257+0000","last_peered":"2024-05-26T15:39:37.492257+0000","last_clean":"2024-05-26T15:39:37.492257+0000","last_became_active":"2024-05-26T15:39:32.920251+0000","last_became_peered":"2024-05-26T15:39:32.920251+0000","last_unstale":"2024-05-26T15:39:37.492257+0000","last_undegraded":"2024-05-26T15:39:37.492257+0000","last_fullsized":"2024-05-26T15:39:37.492257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.393055+0000","last_change":"2024-05-26T15:39:32.412837+0000","last_active":"2024-05-26T15:39:37.393055+0000","last_peered":"2024-05-26T15:39:37.393055+0000","last_clean":"2024-05-26T15:39:37.393055+0000","last_became_active":"2024-05-26T15:39:32.412474+0000","last_became_peered":"2024-05-26T15:39:32.412474+0000","last_unstale":"2024-05-26T15:39:37.393055+0000","last_undegraded":"2024-05-26T15:39:37.393055+0000","last_fullsized":"2024-05-26T15:39:37.393055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059319+0000","last_change":"2024-05-26T15:39:37.405354+0000","last_active":"2024-05-26T15:39:39.059319+0000","last_peered":"2024-05-26T15:39:39.059319+0000","last_clean":"2024-05-26T15:39:39.059319+0000","last_became_active":"2024-05-26T15:39:37.404972+0000","last_became_peered":"2024-05-26T15:39:37.404972+0000","last_unstale":"2024-05-26T15:39:39.059319+0000","last_undegraded":"2024-05-26T15:39:39.059319+0000","last_fullsized":"2024-05-26T15:39:39.059319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:29:06.780253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401985+0000","last_change":"2024-05-26T15:39:32.924084+0000","last_active":"2024-05-26T15:39:37.401985+0000","last_peered":"2024-05-26T15:39:37.401985+0000","last_clean":"2024-05-26T15:39:37.401985+0000","last_became_active":"2024-05-26T15:39:32.922027+0000","last_became_peered":"2024-05-26T15:39:32.922027+0000","last_unstale":"2024-05-26T15:39:37.401985+0000","last_undegraded":"2024-05-26T15:39:37.401985+0000","last_fullsized":"2024-05-26T15:39:37.401985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:13:14.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404763+0000","last_change":"2024-05-26T15:39:32.436505+0000","last_active":"2024-05-26T15:39:37.404763+0000","last_peered":"2024-05-26T15:39:37.404763+0000","last_clean":"2024-05-26T15:39:37.404763+0000","last_became_active":"2024-05-26T15:39:32.436215+0000","last_became_peered":"2024-05-26T15:39:32.436215+0000","last_unstale":"2024-05-26T15:39:37.404763+0000","last_undegraded":"2024-05-26T15:39:37.404763+0000","last_fullsized":"2024-05-26T15:39:37.404763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.289226+0000","last_change":"2024-05-26T15:39:37.502778+0000","last_active":"2024-05-26T15:39:39.289226+0000","last_peered":"2024-05-26T15:39:39.289226+0000","last_clean":"2024-05-26T15:39:39.289226+0000","last_became_active":"2024-05-26T15:39:37.502334+0000","last_became_peered":"2024-05-26T15:39:37.502334+0000","last_unstale":"2024-05-26T15:39:39.289226+0000","last_undegraded":"2024-05-26T15:39:39.289226+0000","last_fullsized":"2024-05-26T15:39:39.289226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:46:37.155490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492337+0000","last_change":"2024-05-26T15:39:32.920320+0000","last_active":"2024-05-26T15:39:37.492337+0000","last_peered":"2024-05-26T15:39:37.492337+0000","last_clean":"2024-05-26T15:39:37.492337+0000","last_became_active":"2024-05-26T15:39:32.919937+0000","last_became_peered":"2024-05-26T15:39:32.919937+0000","last_unstale":"2024-05-26T15:39:37.492337+0000","last_undegraded":"2024-05-26T15:39:37.492337+0000","last_fullsized":"2024-05-26T15:39:37.492337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401560+0000","last_change":"2024-05-26T15:39:32.429375+0000","last_active":"2024-05-26T15:39:37.401560+0000","last_peered":"2024-05-26T15:39:37.401560+0000","last_clean":"2024-05-26T15:39:37.401560+0000","last_became_active":"2024-05-26T15:39:32.429095+0000","last_became_peered":"2024-05-26T15:39:32.429095+0000","last_unstale":"2024-05-26T15:39:37.401560+0000","last_undegraded":"2024-05-26T15:39:37.401560+0000","last_fullsized":"2024-05-26T15:39:37.401560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288508+0000","last_change":"2024-05-26T15:39:37.496912+0000","last_active":"2024-05-26T15:39:39.288508+0000","last_peered":"2024-05-26T15:39:39.288508+0000","last_clean":"2024-05-26T15:39:39.288508+0000","last_became_active":"2024-05-26T15:39:37.496258+0000","last_became_peered":"2024-05-26T15:39:37.496258+0000","last_unstale":"2024-05-26T15:39:39.288508+0000","last_undegraded":"2024-05-26T15:39:39.288508+0000","last_fullsized":"2024-05-26T15:39:39.288508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:19:25.927673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384003+0000","last_change":"2024-05-26T15:39:32.919040+0000","last_active":"2024-05-26T15:39:37.384003+0000","last_peered":"2024-05-26T15:39:37.384003+0000","last_clean":"2024-05-26T15:39:37.384003+0000","last_became_active":"2024-05-26T15:39:32.918706+0000","last_became_peered":"2024-05-26T15:39:32.918706+0000","last_unstale":"2024-05-26T15:39:37.384003+0000","last_undegraded":"2024-05-26T15:39:37.384003+0000","last_fullsized":"2024-05-26T15:39:37.384003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387247+0000","last_change":"2024-05-26T15:39:32.421131+0000","last_active":"2024-05-26T15:39:37.387247+0000","last_peered":"2024-05-26T15:39:37.387247+0000","last_clean":"2024-05-26T15:39:37.387247+0000","last_became_active":"2024-05-26T15:39:32.420687+0000","last_became_peered":"2024-05-26T15:39:32.420687+0000","last_unstale":"2024-05-26T15:39:37.387247+0000","last_undegraded":"2024-05-26T15:39:37.387247+0000","last_fullsized":"2024-05-26T15:39:37.387247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:13:58.110518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.293090+0000","last_change":"2024-05-26T15:39:37.506017+0000","last_active":"2024-05-26T15:39:39.293090+0000","last_peered":"2024-05-26T15:39:39.293090+0000","last_clean":"2024-05-26T15:39:39.293090+0000","last_became_active":"2024-05-26T15:39:37.503806+0000","last_became_peered":"2024-05-26T15:39:37.503806+0000","last_unstale":"2024-05-26T15:39:39.293090+0000","last_undegraded":"2024-05-26T15:39:39.293090+0000","last_fullsized":"2024-05-26T15:39:39.293090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.494294+0000","last_change":"2024-05-26T15:39:32.924533+0000","last_active":"2024-05-26T15:39:37.494294+0000","last_peered":"2024-05-26T15:39:37.494294+0000","last_clean":"2024-05-26T15:39:37.494294+0000","last_became_active":"2024-05-26T15:39:32.924038+0000","last_became_peered":"2024-05-26T15:39:32.924038+0000","last_unstale":"2024-05-26T15:39:37.494294+0000","last_undegraded":"2024-05-26T15:39:37.494294+0000","last_fullsized":"2024-05-26T15:39:37.494294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:16:58.690646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:51.992714+0000","last_change":"2024-05-26T15:39:32.426312+0000","last_active":"2024-05-26T15:39:51.992714+0000","last_peered":"2024-05-26T15:39:51.992714+0000","last_clean":"2024-05-26T15:39:51.992714+0000","last_became_active":"2024-05-26T15:39:32.425989+0000","last_became_peered":"2024-05-26T15:39:32.425989+0000","last_unstale":"2024-05-26T15:39:51.992714+0000","last_undegraded":"2024-05-26T15:39:51.992714+0000","last_fullsized":"2024-05-26T15:39:51.992714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291701+0000","last_change":"2024-05-26T15:39:37.405366+0000","last_active":"2024-05-26T15:39:38.291701+0000","last_peered":"2024-05-26T15:39:38.291701+0000","last_clean":"2024-05-26T15:39:38.291701+0000","last_became_active":"2024-05-26T15:39:37.405104+0000","last_became_peered":"2024-05-26T15:39:37.405104+0000","last_unstale":"2024-05-26T15:39:38.291701+0000","last_undegraded":"2024-05-26T15:39:38.291701+0000","last_fullsized":"2024-05-26T15:39:38.291701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:56:31.917292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.389859+0000","last_change":"2024-05-26T15:39:32.925841+0000","last_active":"2024-05-26T15:39:37.389859+0000","last_peered":"2024-05-26T15:39:37.389859+0000","last_clean":"2024-05-26T15:39:37.389859+0000","last_became_active":"2024-05-26T15:39:32.924690+0000","last_became_peered":"2024-05-26T15:39:32.924690+0000","last_unstale":"2024-05-26T15:39:37.389859+0000","last_undegraded":"2024-05-26T15:39:37.389859+0000","last_fullsized":"2024-05-26T15:39:37.389859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:26.362390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403757+0000","last_change":"2024-05-26T15:39:32.430740+0000","last_active":"2024-05-26T15:39:37.403757+0000","last_peered":"2024-05-26T15:39:37.403757+0000","last_clean":"2024-05-26T15:39:37.403757+0000","last_became_active":"2024-05-26T15:39:32.430438+0000","last_became_peered":"2024-05-26T15:39:32.430438+0000","last_unstale":"2024-05-26T15:39:37.403757+0000","last_undegraded":"2024-05-26T15:39:37.403757+0000","last_fullsized":"2024-05-26T15:39:37.403757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:25.042059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882702+0000","last_change":"2024-05-26T15:39:37.410892+0000","last_active":"2024-05-26T15:39:37.882702+0000","last_peered":"2024-05-26T15:39:37.882702+0000","last_clean":"2024-05-26T15:39:37.882702+0000","last_became_active":"2024-05-26T15:39:37.410088+0000","last_became_peered":"2024-05-26T15:39:37.410088+0000","last_unstale":"2024-05-26T15:39:37.882702+0000","last_undegraded":"2024-05-26T15:39:37.882702+0000","last_fullsized":"2024-05-26T15:39:37.882702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:02:32.537310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386400+0000","last_change":"2024-05-26T15:39:32.931871+0000","last_active":"2024-05-26T15:39:37.386400+0000","last_peered":"2024-05-26T15:39:37.386400+0000","last_clean":"2024-05-26T15:39:37.386400+0000","last_became_active":"2024-05-26T15:39:32.931615+0000","last_became_peered":"2024-05-26T15:39:32.931615+0000","last_unstale":"2024-05-26T15:39:37.386400+0000","last_undegraded":"2024-05-26T15:39:37.386400+0000","last_fullsized":"2024-05-26T15:39:37.386400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406122+0000","last_change":"2024-05-26T15:39:32.438097+0000","last_active":"2024-05-26T15:39:37.406122+0000","last_peered":"2024-05-26T15:39:37.406122+0000","last_clean":"2024-05-26T15:39:37.406122+0000","last_became_active":"2024-05-26T15:39:32.437759+0000","last_became_peered":"2024-05-26T15:39:32.437759+0000","last_unstale":"2024-05-26T15:39:37.406122+0000","last_undegraded":"2024-05-26T15:39:37.406122+0000","last_fullsized":"2024-05-26T15:39:37.406122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288406+0000","last_change":"2024-05-26T15:39:37.408245+0000","last_active":"2024-05-26T15:39:39.288406+0000","last_peered":"2024-05-26T15:39:39.288406+0000","last_clean":"2024-05-26T15:39:39.288406+0000","last_became_active":"2024-05-26T15:39:37.407821+0000","last_became_peered":"2024-05-26T15:39:37.407821+0000","last_unstale":"2024-05-26T15:39:39.288406+0000","last_undegraded":"2024-05-26T15:39:39.288406+0000","last_fullsized":"2024-05-26T15:39:39.288406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:08:31.905617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406029+0000","last_change":"2024-05-26T15:39:32.935821+0000","last_active":"2024-05-26T15:39:37.406029+0000","last_peered":"2024-05-26T15:39:37.406029+0000","last_clean":"2024-05-26T15:39:37.406029+0000","last_became_active":"2024-05-26T15:39:32.935652+0000","last_became_peered":"2024-05-26T15:39:32.935652+0000","last_unstale":"2024-05-26T15:39:37.406029+0000","last_undegraded":"2024-05-26T15:39:37.406029+0000","last_fullsized":"2024-05-26T15:39:37.406029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:42:31.950324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.407942+0000","last_change":"2024-05-26T15:39:32.434154+0000","last_active":"2024-05-26T15:39:37.407942+0000","last_peered":"2024-05-26T15:39:37.407942+0000","last_clean":"2024-05-26T15:39:37.407942+0000","last_became_active":"2024-05-26T15:39:32.433569+0000","last_became_peered":"2024-05-26T15:39:32.433569+0000","last_unstale":"2024-05-26T15:39:37.407942+0000","last_undegraded":"2024-05-26T15:39:37.407942+0000","last_fullsized":"2024-05-26T15:39:37.407942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288095+0000","last_change":"2024-05-26T15:39:37.500616+0000","last_active":"2024-05-26T15:39:39.288095+0000","last_peered":"2024-05-26T15:39:39.288095+0000","last_clean":"2024-05-26T15:39:39.288095+0000","last_became_active":"2024-05-26T15:39:37.498904+0000","last_became_peered":"2024-05-26T15:39:37.498904+0000","last_unstale":"2024-05-26T15:39:39.288095+0000","last_undegraded":"2024-05-26T15:39:39.288095+0000","last_fullsized":"2024-05-26T15:39:39.288095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:41:02.121900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059278+0000","last_change":"2024-05-26T15:39:37.496964+0000","last_active":"2024-05-26T15:39:39.059278+0000","last_peered":"2024-05-26T15:39:39.059278+0000","last_clean":"2024-05-26T15:39:39.059278+0000","last_became_active":"2024-05-26T15:39:37.496512+0000","last_became_peered":"2024-05-26T15:39:37.496512+0000","last_unstale":"2024-05-26T15:39:39.059278+0000","last_undegraded":"2024-05-26T15:39:39.059278+0000","last_fullsized":"2024-05-26T15:39:39.059278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402612+0000","last_change":"2024-05-26T15:39:32.911606+0000","last_active":"2024-05-26T15:39:37.402612+0000","last_peered":"2024-05-26T15:39:37.402612+0000","last_clean":"2024-05-26T15:39:37.402612+0000","last_became_active":"2024-05-26T15:39:32.910333+0000","last_became_peered":"2024-05-26T15:39:32.910333+0000","last_unstale":"2024-05-26T15:39:37.402612+0000","last_undegraded":"2024-05-26T15:39:37.402612+0000","last_fullsized":"2024-05-26T15:39:37.402612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400770+0000","last_change":"2024-05-26T15:39:32.428197+0000","last_active":"2024-05-26T15:39:37.400770+0000","last_peered":"2024-05-26T15:39:37.400770+0000","last_clean":"2024-05-26T15:39:37.400770+0000","last_became_active":"2024-05-26T15:39:32.427494+0000","last_became_peered":"2024-05-26T15:39:32.427494+0000","last_unstale":"2024-05-26T15:39:37.400770+0000","last_undegraded":"2024-05-26T15:39:37.400770+0000","last_fullsized":"2024-05-26T15:39:37.400770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.003002+0000","last_change":"2024-05-26T15:39:37.416175+0000","last_active":"2024-05-26T15:39:38.003002+0000","last_peered":"2024-05-26T15:39:38.003002+0000","last_clean":"2024-05-26T15:39:38.003002+0000","last_became_active":"2024-05-26T15:39:37.415776+0000","last_became_peered":"2024-05-26T15:39:37.415776+0000","last_unstale":"2024-05-26T15:39:38.003002+0000","last_undegraded":"2024-05-26T15:39:38.003002+0000","last_fullsized":"2024-05-26T15:39:38.003002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:43:41.543097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377018+0000","last_change":"2024-05-26T15:39:32.916588+0000","last_active":"2024-05-26T15:39:37.377018+0000","last_peered":"2024-05-26T15:39:37.377018+0000","last_clean":"2024-05-26T15:39:37.377018+0000","last_became_active":"2024-05-26T15:39:32.916327+0000","last_became_peered":"2024-05-26T15:39:32.916327+0000","last_unstale":"2024-05-26T15:39:37.377018+0000","last_undegraded":"2024-05-26T15:39:37.377018+0000","last_fullsized":"2024-05-26T15:39:37.377018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:49:42.119038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381500+0000","last_change":"2024-05-26T15:39:32.429439+0000","last_active":"2024-05-26T15:39:37.381500+0000","last_peered":"2024-05-26T15:39:37.381500+0000","last_clean":"2024-05-26T15:39:37.381500+0000","last_became_active":"2024-05-26T15:39:32.428892+0000","last_became_peered":"2024-05-26T15:39:32.428892+0000","last_unstale":"2024-05-26T15:39:37.381500+0000","last_undegraded":"2024-05-26T15:39:37.381500+0000","last_fullsized":"2024-05-26T15:39:37.381500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405154+0000","last_change":"2024-05-26T15:39:32.422718+0000","last_active":"2024-05-26T15:39:37.405154+0000","last_peered":"2024-05-26T15:39:37.405154+0000","last_clean":"2024-05-26T15:39:37.405154+0000","last_became_active":"2024-05-26T15:39:32.422398+0000","last_became_peered":"2024-05-26T15:39:32.422398+0000","last_unstale":"2024-05-26T15:39:37.405154+0000","last_undegraded":"2024-05-26T15:39:37.405154+0000","last_fullsized":"2024-05-26T15:39:37.405154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383126+0000","last_change":"2024-05-26T15:39:32.902434+0000","last_active":"2024-05-26T15:39:37.383126+0000","last_peered":"2024-05-26T15:39:37.383126+0000","last_clean":"2024-05-26T15:39:37.383126+0000","last_became_active":"2024-05-26T15:39:32.901505+0000","last_became_peered":"2024-05-26T15:39:32.901505+0000","last_unstale":"2024-05-26T15:39:37.383126+0000","last_undegraded":"2024-05-26T15:39:37.383126+0000","last_fullsized":"2024-05-26T15:39:37.383126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:21:37.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.877340+0000","last_change":"2024-05-26T15:39:37.405928+0000","last_active":"2024-05-26T15:39:37.877340+0000","last_peered":"2024-05-26T15:39:37.877340+0000","last_clean":"2024-05-26T15:39:37.877340+0000","last_became_active":"2024-05-26T15:39:37.405510+0000","last_became_peered":"2024-05-26T15:39:37.405510+0000","last_unstale":"2024-05-26T15:39:37.877340+0000","last_undegraded":"2024-05-26T15:39:37.877340+0000","last_fullsized":"2024-05-26T15:39:37.877340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:46.788301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.378799+0000","last_change":"2024-05-26T15:39:32.424810+0000","last_active":"2024-05-26T15:39:37.378799+0000","last_peered":"2024-05-26T15:39:37.378799+0000","last_clean":"2024-05-26T15:39:37.378799+0000","last_became_active":"2024-05-26T15:39:32.424518+0000","last_became_peered":"2024-05-26T15:39:32.424518+0000","last_unstale":"2024-05-26T15:39:37.378799+0000","last_undegraded":"2024-05-26T15:39:37.378799+0000","last_fullsized":"2024-05-26T15:39:37.378799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386848+0000","last_change":"2024-05-26T15:39:32.913997+0000","last_active":"2024-05-26T15:39:37.386848+0000","last_peered":"2024-05-26T15:39:37.386848+0000","last_clean":"2024-05-26T15:39:37.386848+0000","last_became_active":"2024-05-26T15:39:32.911604+0000","last_became_peered":"2024-05-26T15:39:32.911604+0000","last_unstale":"2024-05-26T15:39:37.386848+0000","last_undegraded":"2024-05-26T15:39:37.386848+0000","last_fullsized":"2024-05-26T15:39:37.386848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:26.047859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288573+0000","last_change":"2024-05-26T15:39:37.402731+0000","last_active":"2024-05-26T15:39:39.288573+0000","last_peered":"2024-05-26T15:39:39.288573+0000","last_clean":"2024-05-26T15:39:39.288573+0000","last_became_active":"2024-05-26T15:39:37.402227+0000","last_became_peered":"2024-05-26T15:39:37.402227+0000","last_unstale":"2024-05-26T15:39:39.288573+0000","last_undegraded":"2024-05-26T15:39:39.288573+0000","last_fullsized":"2024-05-26T15:39:39.288573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:24:03.470160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401926+0000","last_change":"2024-05-26T15:39:32.924345+0000","last_active":"2024-05-26T15:39:37.401926+0000","last_peered":"2024-05-26T15:39:37.401926+0000","last_clean":"2024-05-26T15:39:37.401926+0000","last_became_active":"2024-05-26T15:39:32.921271+0000","last_became_peered":"2024-05-26T15:39:32.921271+0000","last_unstale":"2024-05-26T15:39:37.401926+0000","last_undegraded":"2024-05-26T15:39:37.401926+0000","last_fullsized":"2024-05-26T15:39:37.401926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.392856+0000","last_change":"2024-05-26T15:39:32.928371+0000","last_active":"2024-05-26T15:39:37.392856+0000","last_peered":"2024-05-26T15:39:37.392856+0000","last_clean":"2024-05-26T15:39:37.392856+0000","last_became_active":"2024-05-26T15:39:32.928159+0000","last_became_peered":"2024-05-26T15:39:32.928159+0000","last_unstale":"2024-05-26T15:39:37.392856+0000","last_undegraded":"2024-05-26T15:39:37.392856+0000","last_fullsized":"2024-05-26T15:39:37.392856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:13.695925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401469+0000","last_change":"2024-05-26T15:39:32.932867+0000","last_active":"2024-05-26T15:39:37.401469+0000","last_peered":"2024-05-26T15:39:37.401469+0000","last_clean":"2024-05-26T15:39:37.401469+0000","last_became_active":"2024-05-26T15:39:32.930753+0000","last_became_peered":"2024-05-26T15:39:32.930753+0000","last_unstale":"2024-05-26T15:39:37.401469+0000","last_undegraded":"2024-05-26T15:39:37.401469+0000","last_fullsized":"2024-05-26T15:39:37.401469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.382843+0000","last_change":"2024-05-26T15:39:32.904786+0000","last_active":"2024-05-26T15:39:37.382843+0000","last_peered":"2024-05-26T15:39:37.382843+0000","last_clean":"2024-05-26T15:39:37.382843+0000","last_became_active":"2024-05-26T15:39:32.904535+0000","last_became_peered":"2024-05-26T15:39:32.904535+0000","last_unstale":"2024-05-26T15:39:37.382843+0000","last_undegraded":"2024-05-26T15:39:37.382843+0000","last_fullsized":"2024-05-26T15:39:37.382843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:59:09.988548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.380690+0000","last_change":"2024-05-26T15:39:32.905236+0000","last_active":"2024-05-26T15:39:37.380690+0000","last_peered":"2024-05-26T15:39:37.380690+0000","last_clean":"2024-05-26T15:39:37.380690+0000","last_became_active":"2024-05-26T15:39:32.904896+0000","last_became_peered":"2024-05-26T15:39:32.904896+0000","last_unstale":"2024-05-26T15:39:37.380690+0000","last_undegraded":"2024-05-26T15:39:37.380690+0000","last_fullsized":"2024-05-26T15:39:37.380690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403711+0000","last_change":"2024-05-26T15:39:32.910981+0000","last_active":"2024-05-26T15:39:37.403711+0000","last_peered":"2024-05-26T15:39:37.403711+0000","last_clean":"2024-05-26T15:39:37.403711+0000","last_became_active":"2024-05-26T15:39:32.910706+0000","last_became_peered":"2024-05-26T15:39:32.910706+0000","last_unstale":"2024-05-26T15:39:37.403711+0000","last_undegraded":"2024-05-26T15:39:37.403711+0000","last_fullsized":"2024-05-26T15:39:37.403711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406819+0000","last_change":"2024-05-26T15:39:32.935119+0000","last_active":"2024-05-26T15:39:37.406819+0000","last_peered":"2024-05-26T15:39:37.406819+0000","last_clean":"2024-05-26T15:39:37.406819+0000","last_became_active":"2024-05-26T15:39:32.934919+0000","last_became_peered":"2024-05-26T15:39:32.934919+0000","last_unstale":"2024-05-26T15:39:37.406819+0000","last_undegraded":"2024-05-26T15:39:37.406819+0000","last_fullsized":"2024-05-26T15:39:37.406819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379796+0000","last_change":"2024-05-26T15:39:32.913549+0000","last_active":"2024-05-26T15:39:37.379796+0000","last_peered":"2024-05-26T15:39:37.379796+0000","last_clean":"2024-05-26T15:39:37.379796+0000","last_became_active":"2024-05-26T15:39:32.913283+0000","last_became_peered":"2024-05-26T15:39:32.913283+0000","last_unstale":"2024-05-26T15:39:37.379796+0000","last_undegraded":"2024-05-26T15:39:37.379796+0000","last_fullsized":"2024-05-26T15:39:37.379796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400722+0000","last_change":"2024-05-26T15:39:32.934682+0000","last_active":"2024-05-26T15:39:37.400722+0000","last_peered":"2024-05-26T15:39:37.400722+0000","last_clean":"2024-05-26T15:39:37.400722+0000","last_became_active":"2024-05-26T15:39:32.934208+0000","last_became_peered":"2024-05-26T15:39:32.934208+0000","last_unstale":"2024-05-26T15:39:37.400722+0000","last_undegraded":"2024-05-26T15:39:37.400722+0000","last_fullsized":"2024-05-26T15:39:37.400722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381124+0000","last_change":"2024-05-26T15:39:32.902536+0000","last_active":"2024-05-26T15:39:37.381124+0000","last_peered":"2024-05-26T15:39:37.381124+0000","last_clean":"2024-05-26T15:39:37.381124+0000","last_became_active":"2024-05-26T15:39:32.901428+0000","last_became_peered":"2024-05-26T15:39:32.901428+0000","last_unstale":"2024-05-26T15:39:37.381124+0000","last_undegraded":"2024-05-26T15:39:37.381124+0000","last_fullsized":"2024-05-26T15:39:37.381124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401378+0000","last_change":"2024-05-26T15:39:32.933748+0000","last_active":"2024-05-26T15:39:37.401378+0000","last_peered":"2024-05-26T15:39:37.401378+0000","last_clean":"2024-05-26T15:39:37.401378+0000","last_became_active":"2024-05-26T15:39:32.933508+0000","last_became_peered":"2024-05-26T15:39:32.933508+0000","last_unstale":"2024-05-26T15:39:37.401378+0000","last_undegraded":"2024-05-26T15:39:37.401378+0000","last_fullsized":"2024-05-26T15:39:37.401378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381893+0000","last_change":"2024-05-26T15:39:32.919340+0000","last_active":"2024-05-26T15:39:37.381893+0000","last_peered":"2024-05-26T15:39:37.381893+0000","last_clean":"2024-05-26T15:39:37.381893+0000","last_became_active":"2024-05-26T15:39:32.919090+0000","last_became_peered":"2024-05-26T15:39:32.919090+0000","last_unstale":"2024-05-26T15:39:37.381893+0000","last_undegraded":"2024-05-26T15:39:37.381893+0000","last_fullsized":"2024-05-26T15:39:37.381893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404517+0000","last_change":"2024-05-26T15:39:32.931353+0000","last_active":"2024-05-26T15:39:37.404517+0000","last_peered":"2024-05-26T15:39:37.404517+0000","last_clean":"2024-05-26T15:39:37.404517+0000","last_became_active":"2024-05-26T15:39:32.931035+0000","last_became_peered":"2024-05-26T15:39:32.931035+0000","last_unstale":"2024-05-26T15:39:37.404517+0000","last_undegraded":"2024-05-26T15:39:37.404517+0000","last_fullsized":"2024-05-26T15:39:37.404517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495006+0000","last_change":"2024-05-26T15:39:32.924340+0000","last_active":"2024-05-26T15:39:37.495006+0000","last_peered":"2024-05-26T15:39:37.495006+0000","last_clean":"2024-05-26T15:39:37.495006+0000","last_became_active":"2024-05-26T15:39:32.923614+0000","last_became_peered":"2024-05-26T15:39:32.923614+0000","last_unstale":"2024-05-26T15:39:37.495006+0000","last_undegraded":"2024-05-26T15:39:37.495006+0000","last_fullsized":"2024-05-26T15:39:37.495006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:49:42.119038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.394752+0000","last_change":"2024-05-26T15:39:32.919960+0000","last_active":"2024-05-26T15:39:37.394752+0000","last_peered":"2024-05-26T15:39:37.394752+0000","last_clean":"2024-05-26T15:39:37.394752+0000","last_became_active":"2024-05-26T15:39:32.919682+0000","last_became_peered":"2024-05-26T15:39:32.919682+0000","last_unstale":"2024-05-26T15:39:37.394752+0000","last_undegraded":"2024-05-26T15:39:37.394752+0000","last_fullsized":"2024-05-26T15:39:37.394752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:51:22.074231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.407162+0000","last_change":"2024-05-26T15:39:32.931526+0000","last_active":"2024-05-26T15:39:37.407162+0000","last_peered":"2024-05-26T15:39:37.407162+0000","last_clean":"2024-05-26T15:39:37.407162+0000","last_became_active":"2024-05-26T15:39:32.930641+0000","last_became_peered":"2024-05-26T15:39:32.930641+0000","last_unstale":"2024-05-26T15:39:37.407162+0000","last_undegraded":"2024-05-26T15:39:37.407162+0000","last_fullsized":"2024-05-26T15:39:37.407162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400658+0000","last_change":"2024-05-26T15:39:32.935238+0000","last_active":"2024-05-26T15:39:37.400658+0000","last_peered":"2024-05-26T15:39:37.400658+0000","last_clean":"2024-05-26T15:39:37.400658+0000","last_became_active":"2024-05-26T15:39:32.934888+0000","last_became_peered":"2024-05-26T15:39:32.934888+0000","last_unstale":"2024-05-26T15:39:37.400658+0000","last_undegraded":"2024-05-26T15:39:37.400658+0000","last_fullsized":"2024-05-26T15:39:37.400658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402726+0000","last_change":"2024-05-26T15:39:32.912394+0000","last_active":"2024-05-26T15:39:37.402726+0000","last_peered":"2024-05-26T15:39:37.402726+0000","last_clean":"2024-05-26T15:39:37.402726+0000","last_became_active":"2024-05-26T15:39:32.911158+0000","last_became_peered":"2024-05-26T15:39:32.911158+0000","last_unstale":"2024-05-26T15:39:37.402726+0000","last_undegraded":"2024-05-26T15:39:37.402726+0000","last_fullsized":"2024-05-26T15:39:37.402726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383741+0000","last_change":"2024-05-26T15:39:32.913949+0000","last_active":"2024-05-26T15:39:37.383741+0000","last_peered":"2024-05-26T15:39:37.383741+0000","last_clean":"2024-05-26T15:39:37.383741+0000","last_became_active":"2024-05-26T15:39:32.911597+0000","last_became_peered":"2024-05-26T15:39:32.911597+0000","last_unstale":"2024-05-26T15:39:37.383741+0000","last_undegraded":"2024-05-26T15:39:37.383741+0000","last_fullsized":"2024-05-26T15:39:37.383741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:13:14.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377776+0000","last_change":"2024-05-26T15:39:32.923083+0000","last_active":"2024-05-26T15:39:37.377776+0000","last_peered":"2024-05-26T15:39:37.377776+0000","last_clean":"2024-05-26T15:39:37.377776+0000","last_became_active":"2024-05-26T15:39:32.921098+0000","last_became_peered":"2024-05-26T15:39:32.921098+0000","last_unstale":"2024-05-26T15:39:37.377776+0000","last_undegraded":"2024-05-26T15:39:37.377776+0000","last_fullsized":"2024-05-26T15:39:37.377776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:21:37.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.390272+0000","last_change":"2024-05-26T15:39:32.923188+0000","last_active":"2024-05-26T15:39:37.390272+0000","last_peered":"2024-05-26T15:39:37.390272+0000","last_clean":"2024-05-26T15:39:37.390272+0000","last_became_active":"2024-05-26T15:39:32.921678+0000","last_became_peered":"2024-05-26T15:39:32.921678+0000","last_unstale":"2024-05-26T15:39:37.390272+0000","last_undegraded":"2024-05-26T15:39:37.390272+0000","last_fullsized":"2024-05-26T15:39:37.390272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:13.695925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406882+0000","last_change":"2024-05-26T15:39:32.939084+0000","last_active":"2024-05-26T15:39:37.406882+0000","last_peered":"2024-05-26T15:39:37.406882+0000","last_clean":"2024-05-26T15:39:37.406882+0000","last_became_active":"2024-05-26T15:39:32.938713+0000","last_became_peered":"2024-05-26T15:39:32.938713+0000","last_unstale":"2024-05-26T15:39:37.406882+0000","last_undegraded":"2024-05-26T15:39:37.406882+0000","last_fullsized":"2024-05-26T15:39:37.406882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406775+0000","last_change":"2024-05-26T15:39:32.939883+0000","last_active":"2024-05-26T15:39:37.406775+0000","last_peered":"2024-05-26T15:39:37.406775+0000","last_clean":"2024-05-26T15:39:37.406775+0000","last_became_active":"2024-05-26T15:39:32.937951+0000","last_became_peered":"2024-05-26T15:39:32.937951+0000","last_unstale":"2024-05-26T15:39:37.406775+0000","last_undegraded":"2024-05-26T15:39:37.406775+0000","last_fullsized":"2024-05-26T15:39:37.406775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.499084+0000","last_change":"2024-05-26T15:39:32.930657+0000","last_active":"2024-05-26T15:39:37.499084+0000","last_peered":"2024-05-26T15:39:37.499084+0000","last_clean":"2024-05-26T15:39:37.499084+0000","last_became_active":"2024-05-26T15:39:32.930382+0000","last_became_peered":"2024-05-26T15:39:32.930382+0000","last_unstale":"2024-05-26T15:39:37.499084+0000","last_undegraded":"2024-05-26T15:39:37.499084+0000","last_fullsized":"2024-05-26T15:39:37.499084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:24.160382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.375877+0000","last_change":"2024-05-26T15:39:32.930568+0000","last_active":"2024-05-26T15:39:37.375877+0000","last_peered":"2024-05-26T15:39:37.375877+0000","last_clean":"2024-05-26T15:39:37.375877+0000","last_became_active":"2024-05-26T15:39:32.930302+0000","last_became_peered":"2024-05-26T15:39:32.930302+0000","last_unstale":"2024-05-26T15:39:37.375877+0000","last_undegraded":"2024-05-26T15:39:37.375877+0000","last_fullsized":"2024-05-26T15:39:37.375877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492015+0000","last_change":"2024-05-26T15:39:32.920604+0000","last_active":"2024-05-26T15:39:37.492015+0000","last_peered":"2024-05-26T15:39:37.492015+0000","last_clean":"2024-05-26T15:39:37.492015+0000","last_became_active":"2024-05-26T15:39:32.919836+0000","last_became_peered":"2024-05-26T15:39:32.919836+0000","last_unstale":"2024-05-26T15:39:37.492015+0000","last_undegraded":"2024-05-26T15:39:37.492015+0000","last_fullsized":"2024-05-26T15:39:37.492015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:07:02.159693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401276+0000","last_change":"2024-05-26T15:39:32.937715+0000","last_active":"2024-05-26T15:39:37.401276+0000","last_peered":"2024-05-26T15:39:37.401276+0000","last_clean":"2024-05-26T15:39:37.401276+0000","last_became_active":"2024-05-26T15:39:32.937451+0000","last_became_peered":"2024-05-26T15:39:32.937451+0000","last_unstale":"2024-05-26T15:39:37.401276+0000","last_undegraded":"2024-05-26T15:39:37.401276+0000","last_fullsized":"2024-05-26T15:39:37.401276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.491613+0000","last_change":"2024-05-26T15:39:32.924295+0000","last_active":"2024-05-26T15:39:37.491613+0000","last_peered":"2024-05-26T15:39:37.491613+0000","last_clean":"2024-05-26T15:39:37.491613+0000","last_became_active":"2024-05-26T15:39:32.923812+0000","last_became_peered":"2024-05-26T15:39:32.923812+0000","last_unstale":"2024-05-26T15:39:37.491613+0000","last_undegraded":"2024-05-26T15:39:37.491613+0000","last_fullsized":"2024-05-26T15:39:37.491613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:42:31.950324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402857+0000","last_change":"2024-05-26T15:39:32.936632+0000","last_active":"2024-05-26T15:39:37.402857+0000","last_peered":"2024-05-26T15:39:37.402857+0000","last_clean":"2024-05-26T15:39:37.402857+0000","last_became_active":"2024-05-26T15:39:32.934911+0000","last_became_peered":"2024-05-26T15:39:32.934911+0000","last_unstale":"2024-05-26T15:39:37.402857+0000","last_undegraded":"2024-05-26T15:39:37.402857+0000","last_fullsized":"2024-05-26T15:39:37.402857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:24.160382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384458+0000","last_change":"2024-05-26T15:39:32.915854+0000","last_active":"2024-05-26T15:39:37.384458+0000","last_peered":"2024-05-26T15:39:37.384458+0000","last_clean":"2024-05-26T15:39:37.384458+0000","last_became_active":"2024-05-26T15:39:32.915514+0000","last_became_peered":"2024-05-26T15:39:32.915514+0000","last_unstale":"2024-05-26T15:39:37.384458+0000","last_undegraded":"2024-05-26T15:39:37.384458+0000","last_fullsized":"2024-05-26T15:39:37.384458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:03.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403966+0000","last_change":"2024-05-26T15:39:32.919780+0000","last_active":"2024-05-26T15:39:37.403966+0000","last_peered":"2024-05-26T15:39:37.403966+0000","last_clean":"2024-05-26T15:39:37.403966+0000","last_became_active":"2024-05-26T15:39:32.919496+0000","last_became_peered":"2024-05-26T15:39:32.919496+0000","last_unstale":"2024-05-26T15:39:37.403966+0000","last_undegraded":"2024-05-26T15:39:37.403966+0000","last_fullsized":"2024-05-26T15:39:37.403966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:09:26.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495449+0000","last_change":"2024-05-26T15:39:32.922248+0000","last_active":"2024-05-26T15:39:37.495449+0000","last_peered":"2024-05-26T15:39:37.495449+0000","last_clean":"2024-05-26T15:39:37.495449+0000","last_became_active":"2024-05-26T15:39:32.921988+0000","last_became_peered":"2024-05-26T15:39:32.921988+0000","last_unstale":"2024-05-26T15:39:37.495449+0000","last_undegraded":"2024-05-26T15:39:37.495449+0000","last_fullsized":"2024-05-26T15:39:37.495449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:47:40.508265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.571}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.839}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":98851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.802}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":98761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:40:03.461 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-26T15:40:03.461 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-26T15:40:03.461 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-26T15:40:03.462 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-26T15:40:03.462 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-26T15:40:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.714+0000 7fbcf1a00640 1 Processor -- start 2024-05-26T15:40:03.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.714+0000 7fbcf1a00640 1 -- start start 2024-05-26T15:40:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.715+0000 7fbcf1a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbcec1600d0 0x7fbcec0cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.716+0000 7fbcf1a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec0b7eb0 con 0x7fbcec0b8720 2024-05-26T15:40:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.716+0000 7fbcf1a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec1604b0 con 0x7fbcec0cfed0 2024-05-26T15:40:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.716+0000 7fbcf1a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcec0d0ef0 con 0x7fbcec1600d0 2024-05-26T15:40:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.716+0000 7fbcebe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbcec1600d0 0x7fbcec0cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.716+0000 7fbce3400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbcec0b8720 0x7fbcec0d1310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60376/0 (socket says 172.21.15.8:60376) 2024-05-26T15:40:03.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.716+0000 7fbce3400640 1 -- 172.21.15.8:0/2854238613 learned_addr learned my addr 172.21.15.8:0/2854238613 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.716+0000 7fbcebe00640 1 -- 172.21.15.8:0/2854238613 >> v1:172.21.15.47:6789/0 conn(0x7fbcec0cfed0 legacy=0x7fbcec0b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.716+0000 7fbcebe00640 1 -- 172.21.15.8:0/2854238613 >> v1:172.21.15.8:6789/0 conn(0x7fbcec0b8720 legacy=0x7fbcec0d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.716+0000 7fbceb400640 1 -- 172.21.15.8:0/2854238613 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880387685 0 0) 0x7fbcec0b7eb0 con 0x7fbcec0b8720 2024-05-26T15:40:03.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.716+0000 7fbcebe00640 1 -- 172.21.15.8:0/2854238613 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec0b7610 con 0x7fbcec1600d0 2024-05-26T15:40:03.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.717+0000 7fbcebe00640 1 --2- 172.21.15.8:0/2854238613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec1600d0 0x7fbcec0cf990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009d90 tx=0x7fbcdc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbaab0131774b46c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:03.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.718+0000 7fbceb400640 1 -- 172.21.15.8:0/2854238613 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc031600 con 0x7fbcec1600d0 2024-05-26T15:40:03.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.718+0000 7fbceb400640 1 -- 172.21.15.8:0/2854238613 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc02d050 con 0x7fbcec1600d0 2024-05-26T15:40:03.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.718+0000 7fbceb400640 1 -- 172.21.15.8:0/2854238613 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc031980 con 0x7fbcec1600d0 2024-05-26T15:40:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.718+0000 7fbcf1a00640 1 -- 172.21.15.8:0/2854238613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec1600d0 msgr2=0x7fbcec0cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.718+0000 7fbcf1a00640 1 --2- 172.21.15.8:0/2854238613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec1600d0 0x7fbcec0cf990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009d90 tx=0x7fbcdc02a610 comp rx=0 tx=0).stop 2024-05-26T15:40:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.718+0000 7fbcf1a00640 1 -- 172.21.15.8:0/2854238613 shutdown_connections 2024-05-26T15:40:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.718+0000 7fbcf1a00640 1 --2- 172.21.15.8:0/2854238613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec1600d0 0x7fbcec0cf990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.718+0000 7fbcf1a00640 1 -- 172.21.15.8:0/2854238613 >> 172.21.15.8:0/2854238613 conn(0x7fbcec06b750 msgr2=0x7fbcec06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.719+0000 7fbcf1a00640 1 -- 172.21.15.8:0/2854238613 shutdown_connections 2024-05-26T15:40:03.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.719+0000 7fbcf1a00640 1 -- 172.21.15.8:0/2854238613 wait complete. 2024-05-26T15:40:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.720+0000 7fbcf1a00640 1 Processor -- start 2024-05-26T15:40:03.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.721+0000 7fbcf1a00640 1 -- start start 2024-05-26T15:40:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbcf1a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcec0b8720 0x7fbcec15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbcf1a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec0cfed0 0x7fbcec157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbcf1a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbcec1600d0 0x7fbcec157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbcf1a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec1592c0 con 0x7fbcec0cfed0 2024-05-26T15:40:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbcf1a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec15c270 con 0x7fbcec0b8720 2024-05-26T15:40:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbcf1a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec156bc0 con 0x7fbcec1600d0 2024-05-26T15:40:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbce3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec0cfed0 0x7fbcec157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbce3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec0cfed0 0x7fbcec157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47466/0 (socket says 172.21.15.8:47466) 2024-05-26T15:40:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbce3400640 1 -- 172.21.15.8:0/3804574429 learned_addr learned my addr 172.21.15.8:0/3804574429 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbcebe00640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcec0b8720 0x7fbcec15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.722+0000 7fbcf1000640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbcec1600d0 0x7fbcec157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbce3400640 1 -- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbcec1600d0 msgr2=0x7fbcec157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbce3400640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbcec1600d0 0x7fbcec157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbce3400640 1 -- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcec0b8720 msgr2=0x7fbcec15bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbce3400640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcec0b8720 0x7fbcec15bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbce3400640 1 -- 172.21.15.8:0/3804574429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc009a70 con 0x7fbcec0cfed0 2024-05-26T15:40:03.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbce3400640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec0cfed0 0x7fbcec157980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c500 tx=0x7fbcd400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:03.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbce8c00640 1 -- 172.21.15.8:0/3804574429 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4007560 con 0x7fbcec0cfed0 2024-05-26T15:40:03.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbce8c00640 1 -- 172.21.15.8:0/3804574429 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd40047e0 con 0x7fbcec0cfed0 2024-05-26T15:40:03.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbcf1a00640 1 -- 172.21.15.8:0/3804574429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec156ea0 con 0x7fbcec0cfed0 2024-05-26T15:40:03.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbce8c00640 1 -- 172.21.15.8:0/3804574429 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4004b90 con 0x7fbcec0cfed0 2024-05-26T15:40:03.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.723+0000 7fbcf1a00640 1 -- 172.21.15.8:0/3804574429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcec157460 con 0x7fbcec0cfed0 2024-05-26T15:40:03.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.725+0000 7fbcf1a00640 1 -- 172.21.15.8:0/3804574429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcec157680 con 0x7fbcec0cfed0 2024-05-26T15:40:03.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.726+0000 7fbce8c00640 1 -- 172.21.15.8:0/3804574429 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbcd4004cf0 con 0x7fbcec0cfed0 2024-05-26T15:40:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.726+0000 7fbce8c00640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcc806ac00 0x7fbcc806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.727+0000 7fbce8c00640 1 -- 172.21.15.8:0/3804574429 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbcd4088750 con 0x7fbcec0cfed0 2024-05-26T15:40:03.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.727+0000 7fbcebe00640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcc806ac00 0x7fbcc806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:03.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.728+0000 7fbcebe00640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcc806ac00 0x7fbcc806d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc034000 tx=0x7fbcdc02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:03.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.731+0000 7fbce8c00640 1 -- 172.21.15.8:0/3804574429 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbcd40536d0 con 0x7fbcec0cfed0 2024-05-26T15:40:03.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.986+0000 7fbcf1a00640 1 -- 172.21.15.8:0/3804574429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fbcec04e280 con 0x7fbcec0cfed0 2024-05-26T15:40:03.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:03.995+0000 7fbce8c00640 1 -- 172.21.15.8:0/3804574429 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170936 (secure 0 0 0) 0x7fbcd4056cf0 con 0x7fbcec0cfed0 2024-05-26T15:40:03.994 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 -- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcc806ac00 msgr2=0x7fbcc806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcc806ac00 0x7fbcc806d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc034000 tx=0x7fbcdc02f000 comp rx=0 tx=0).stop 2024-05-26T15:40:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 -- 172.21.15.8:0/3804574429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec0cfed0 msgr2=0x7fbcec157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:03.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec0cfed0 0x7fbcec157980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c500 tx=0x7fbcd400c9c0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 -- 172.21.15.8:0/3804574429 shutdown_connections 2024-05-26T15:40:03.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbcec1600d0 0x7fbcec157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcec0cfed0 0x7fbcec157980 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcc806ac00 0x7fbcc806d0c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 --2- 172.21.15.8:0/3804574429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbcec0b8720 0x7fbcec15bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:03.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 -- 172.21.15.8:0/3804574429 >> 172.21.15.8:0/3804574429 conn(0x7fbcec06b750 msgr2=0x7fbcec0b5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:03.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 -- 172.21.15.8:0/3804574429 shutdown_connections 2024-05-26T15:40:03.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.000+0000 7fbcf1a00640 1 -- 172.21.15.8:0/3804574429 wait complete. 2024-05-26T15:40:04.017 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":36734},{"type":"v1","addr":"172.21.15.47:6833","nonce":36734}]},"active_addr":"172.21.15.47:6833/36734","active_change":"2024-05-26T15:39:14.120641+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":253383730}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3007836365}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2604047759}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":3016567069}]}]} 2024-05-26T15:40:04.020 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-26T15:40:04.020 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-26T15:40:04.020 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:04.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.221+0000 7f1ab8600640 1 Processor -- start 2024-05-26T15:40:04.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.221+0000 7f1ab8600640 1 -- start start 2024-05-26T15:40:04.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.222+0000 7f1ab8600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ab015ab30 0x7f1ab00cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.222+0000 7f1ab8600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1ab00b1ee0 0x7f1ab00af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.222+0000 7f1ab8600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ab00aff30 0x7f1ab00b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.222+0000 7f1ab8600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab00af560 con 0x7f1ab015ab30 2024-05-26T15:40:04.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.222+0000 7f1ab8600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab015af10 con 0x7f1ab00b1ee0 2024-05-26T15:40:04.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.222+0000 7f1ab8600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab00af210 con 0x7f1ab00aff30 2024-05-26T15:40:04.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.223+0000 7f1ab5c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ab015ab30 0x7f1ab00cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.223+0000 7f1ab5c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ab015ab30 0x7f1ab00cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47470/0 (socket says 172.21.15.8:47470) 2024-05-26T15:40:04.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.223+0000 7f1ab5c00640 1 -- 172.21.15.8:0/3920629523 learned_addr learned my addr 172.21.15.8:0/3920629523 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:04.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.223+0000 7f1ab6600640 1 --2- 172.21.15.8:0/3920629523 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ab00aff30 0x7f1ab00b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.223+0000 7f1ab5200640 1 --2- 172.21.15.8:0/3920629523 >> v2:172.21.15.47:3300/0 conn(0x7f1ab00b1ee0 0x7f1ab00af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.223+0000 7f1ab5c00640 1 -- 172.21.15.8:0/3920629523 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ab00aff30 msgr2=0x7f1ab00b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.224+0000 7f1ab5c00640 1 --2- 172.21.15.8:0/3920629523 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ab00aff30 0x7f1ab00b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.224+0000 7f1ab5c00640 1 -- 172.21.15.8:0/3920629523 >> v2:172.21.15.47:3300/0 conn(0x7f1ab00b1ee0 msgr2=0x7f1ab00af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.224+0000 7f1ab5c00640 1 --2- 172.21.15.8:0/3920629523 >> v2:172.21.15.47:3300/0 conn(0x7f1ab00b1ee0 0x7f1ab00af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.224+0000 7f1ab5c00640 1 -- 172.21.15.8:0/3920629523 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00cb930 con 0x7f1ab015ab30 2024-05-26T15:40:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.224+0000 7f1ab5200640 1 --2- 172.21.15.8:0/3920629523 >> v2:172.21.15.47:3300/0 conn(0x7f1ab00b1ee0 0x7f1ab00af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:04.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.225+0000 7f1ab5c00640 1 --2- 172.21.15.8:0/3920629523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab015ab30 0x7f1ab00cb330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00af140 tx=0x7f1aa402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d07f48dd698e65 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:04.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.225+0000 7f1aafe00640 1 -- 172.21.15.8:0/3920629523 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4032440 con 0x7f1ab015ab30 2024-05-26T15:40:04.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.225+0000 7f1aafe00640 1 -- 172.21.15.8:0/3920629523 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa40325a0 con 0x7f1ab015ab30 2024-05-26T15:40:04.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.225+0000 7f1aafe00640 1 -- 172.21.15.8:0/3920629523 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4032930 con 0x7f1ab015ab30 2024-05-26T15:40:04.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.226+0000 7f1ab8600640 1 -- 172.21.15.8:0/3920629523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab015ab30 msgr2=0x7f1ab00cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:04.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.226+0000 7f1ab8600640 1 --2- 172.21.15.8:0/3920629523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab015ab30 0x7f1ab00cb330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00af140 tx=0x7f1aa402a1e0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.226+0000 7f1ab8600640 1 -- 172.21.15.8:0/3920629523 shutdown_connections 2024-05-26T15:40:04.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.226+0000 7f1ab8600640 1 --2- 172.21.15.8:0/3920629523 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ab00aff30 0x7f1ab00b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.226+0000 7f1ab8600640 1 --2- 172.21.15.8:0/3920629523 >> v2:172.21.15.47:3300/0 conn(0x7f1ab00b1ee0 0x7f1ab00af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.226+0000 7f1ab8600640 1 --2- 172.21.15.8:0/3920629523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab015ab30 0x7f1ab00cb330 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.226+0000 7f1ab8600640 1 -- 172.21.15.8:0/3920629523 >> 172.21.15.8:0/3920629523 conn(0x7f1ab0098a50 msgr2=0x7f1ab00b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:04.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.226+0000 7f1ab8600640 1 -- 172.21.15.8:0/3920629523 shutdown_connections 2024-05-26T15:40:04.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.226+0000 7f1ab8600640 1 -- 172.21.15.8:0/3920629523 wait complete. 2024-05-26T15:40:04.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.228+0000 7f1ab8600640 1 Processor -- start 2024-05-26T15:40:04.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.228+0000 7f1ab8600640 1 -- start start 2024-05-26T15:40:04.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.229+0000 7f1ab8600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab00b1ee0 0x7f1ab0157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.229+0000 7f1ab8600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ab015ab30 0x7f1ab00c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.229+0000 7f1ab8600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab00c4290 0x7f1ab00b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.229+0000 7f1ab8600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab00b26c0 con 0x7f1ab00c4290 2024-05-26T15:40:04.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.229+0000 7f1ab8600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab00ce370 con 0x7f1ab00b1ee0 2024-05-26T15:40:04.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.229+0000 7f1ab8600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab00c48c0 con 0x7f1ab015ab30 2024-05-26T15:40:04.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.229+0000 7f1ab6600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab00c4290 0x7f1ab00b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.229+0000 7f1ab6600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab00c4290 0x7f1ab00b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47476/0 (socket says 172.21.15.8:47476) 2024-05-26T15:40:04.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.229+0000 7f1ab6600640 1 -- 172.21.15.8:0/1432282413 learned_addr learned my addr 172.21.15.8:0/1432282413 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:04.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab5200640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ab015ab30 0x7f1ab00c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab5c00640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab00b1ee0 0x7f1ab0157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab6600640 1 -- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ab015ab30 msgr2=0x7f1ab00c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:04.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab6600640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ab015ab30 0x7f1ab00c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab6600640 1 -- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab00b1ee0 msgr2=0x7f1ab0157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:04.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab6600640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab00b1ee0 0x7f1ab0157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab6600640 1 -- 172.21.15.8:0/1432282413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa40094d0 con 0x7f1ab00c4290 2024-05-26T15:40:04.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab5c00640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab00b1ee0 0x7f1ab0157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:04.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab6600640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab00c4290 0x7f1ab00b2e80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8007cc0 tx=0x7f1aa800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:04.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1aad600640 1 -- 172.21.15.8:0/1432282413 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8014420 con 0x7f1ab00c4290 2024-05-26T15:40:04.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1aad600640 1 -- 172.21.15.8:0/1432282413 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8014580 con 0x7f1ab00c4290 2024-05-26T15:40:04.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab8600640 1 -- 172.21.15.8:0/1432282413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab00c4ba0 con 0x7f1ab00c4290 2024-05-26T15:40:04.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1aad600640 1 -- 172.21.15.8:0/1432282413 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8014930 con 0x7f1ab00c4290 2024-05-26T15:40:04.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.230+0000 7f1ab8600640 1 -- 172.21.15.8:0/1432282413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab00b2960 con 0x7f1ab00c4290 2024-05-26T15:40:04.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.232+0000 7f1ab8600640 1 -- 172.21.15.8:0/1432282413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab0158120 con 0x7f1ab00c4290 2024-05-26T15:40:04.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.233+0000 7f1aad600640 1 -- 172.21.15.8:0/1432282413 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1aa8014a90 con 0x7f1ab00c4290 2024-05-26T15:40:04.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.234+0000 7f1aad600640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a9006ac00 0x7f1a9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.234+0000 7f1aad600640 1 -- 172.21.15.8:0/1432282413 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1aa8089f90 con 0x7f1ab00c4290 2024-05-26T15:40:04.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.234+0000 7f1ab5c00640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a9006ac00 0x7f1a9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.236+0000 7f1ab5c00640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a9006ac00 0x7f1a9006d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4034000 tx=0x7f1aa402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:04.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.238+0000 7f1aad600640 1 -- 172.21.15.8:0/1432282413 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1aa8054d50 con 0x7f1ab00c4290 2024-05-26T15:40:04.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.444+0000 7f1ab8600640 1 -- 172.21.15.8:0/1432282413 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ab00681d0 con 0x7f1ab00c4290 2024-05-26T15:40:04.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.446+0000 7f1aad600640 1 -- 172.21.15.8:0/1432282413 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7f1aa8058370 con 0x7f1ab00c4290 2024-05-26T15:40:04.445 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:04.445 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 -- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a9006ac00 msgr2=0x7f1a9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a9006ac00 0x7f1a9006d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4034000 tx=0x7f1aa402e000 comp rx=0 tx=0).stop 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 -- 172.21.15.8:0/1432282413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab00c4290 msgr2=0x7f1ab00b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab00c4290 0x7f1ab00b2e80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8007cc0 tx=0x7f1aa800e4b0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 -- 172.21.15.8:0/1432282413 shutdown_connections 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ab00c4290 0x7f1ab00b2e80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ab015ab30 0x7f1ab00c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a9006ac00 0x7f1a9006d0c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 --2- 172.21.15.8:0/1432282413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab00b1ee0 0x7f1ab0157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 -- 172.21.15.8:0/1432282413 >> 172.21.15.8:0/1432282413 conn(0x7f1ab0098a50 msgr2=0x7f1ab0158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 -- 172.21.15.8:0/1432282413 shutdown_connections 2024-05-26T15:40:04.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.449+0000 7f1ab8600640 1 -- 172.21.15.8:0/1432282413 wait complete. 2024-05-26T15:40:04.466 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-26T15:40:04.466 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:04.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.675+0000 7f45bd800640 1 Processor -- start 2024-05-26T15:40:04.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.676+0000 7f45bd800640 1 -- start start 2024-05-26T15:40:04.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.677+0000 7f45bd800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45b81600d0 0x7f45b80cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.677+0000 7f45bd800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f45b80b8720 0x7f45b80cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.677+0000 7f45bd800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45b80d1310 0x7f45b80d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.677+0000 7f45bd800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b80d0ef0 con 0x7f45b80b8720 2024-05-26T15:40:04.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.677+0000 7f45bd800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b80b7eb0 con 0x7f45b81600d0 2024-05-26T15:40:04.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.677+0000 7f45bd800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b81604b0 con 0x7f45b80d1310 2024-05-26T15:40:04.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45b7400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f45b80b8720 0x7f45b80cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45b7400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f45b80b8720 0x7f45b80cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47482/0 (socket says 172.21.15.8:47482) 2024-05-26T15:40:04.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45b7400640 1 -- 172.21.15.8:0/2469400666 learned_addr learned my addr 172.21.15.8:0/2469400666 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:04.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45bce00640 1 --2- 172.21.15.8:0/2469400666 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45b80d1310 0x7f45b80d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45b7e00640 1 --2- 172.21.15.8:0/2469400666 >> v2:172.21.15.47:3300/0 conn(0x7f45b81600d0 0x7f45b80cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45b7400640 1 -- 172.21.15.8:0/2469400666 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45b80d1310 msgr2=0x7f45b80d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:04.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45b7400640 1 --2- 172.21.15.8:0/2469400666 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45b80d1310 0x7f45b80d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45b7400640 1 -- 172.21.15.8:0/2469400666 >> v2:172.21.15.47:3300/0 conn(0x7f45b81600d0 msgr2=0x7f45b80cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:04.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45b7400640 1 --2- 172.21.15.8:0/2469400666 >> v2:172.21.15.47:3300/0 conn(0x7f45b81600d0 0x7f45b80cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45b7400640 1 -- 172.21.15.8:0/2469400666 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b80b7610 con 0x7f45b80b8720 2024-05-26T15:40:04.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.678+0000 7f45b7e00640 1 --2- 172.21.15.8:0/2469400666 >> v2:172.21.15.47:3300/0 conn(0x7f45b81600d0 0x7f45b80cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:04.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.679+0000 7f45b7400640 1 --2- 172.21.15.8:0/2469400666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80b8720 0x7f45b80cfed0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f45b80b4d50 tx=0x7f45a402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bfb2072386c5bf server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:04.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.680+0000 7f45b6a00640 1 -- 172.21.15.8:0/2469400666 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a402ae90 con 0x7f45b80b8720 2024-05-26T15:40:04.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.680+0000 7f45b6a00640 1 -- 172.21.15.8:0/2469400666 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a4032440 con 0x7f45b80b8720 2024-05-26T15:40:04.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.680+0000 7f45b6a00640 1 -- 172.21.15.8:0/2469400666 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a40327d0 con 0x7f45b80b8720 2024-05-26T15:40:04.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.680+0000 7f45bd800640 1 -- 172.21.15.8:0/2469400666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80b8720 msgr2=0x7f45b80cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:04.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.680+0000 7f45bd800640 1 --2- 172.21.15.8:0/2469400666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80b8720 0x7f45b80cfed0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f45b80b4d50 tx=0x7f45a402a140 comp rx=0 tx=0).stop 2024-05-26T15:40:04.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.681+0000 7f45bd800640 1 -- 172.21.15.8:0/2469400666 shutdown_connections 2024-05-26T15:40:04.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.681+0000 7f45bd800640 1 --2- 172.21.15.8:0/2469400666 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45b80d1310 0x7f45b80d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.681+0000 7f45bd800640 1 --2- 172.21.15.8:0/2469400666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80b8720 0x7f45b80cfed0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.681+0000 7f45bd800640 1 --2- 172.21.15.8:0/2469400666 >> v2:172.21.15.47:3300/0 conn(0x7f45b81600d0 0x7f45b80cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.681+0000 7f45bd800640 1 -- 172.21.15.8:0/2469400666 >> 172.21.15.8:0/2469400666 conn(0x7f45b806b750 msgr2=0x7f45b806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:04.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.681+0000 7f45bd800640 1 -- 172.21.15.8:0/2469400666 shutdown_connections 2024-05-26T15:40:04.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.681+0000 7f45bd800640 1 -- 172.21.15.8:0/2469400666 wait complete. 2024-05-26T15:40:04.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.683+0000 7f45bd800640 1 Processor -- start 2024-05-26T15:40:04.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.683+0000 7f45bd800640 1 -- start start 2024-05-26T15:40:04.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45bd800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45b80b8720 0x7f45b814fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45bd800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80d1310 0x7f45b815d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45bd800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45b81600d0 0x7f45b815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45bd800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b81f7460 con 0x7f45b80d1310 2024-05-26T15:40:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45bd800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8152d80 con 0x7f45b80b8720 2024-05-26T15:40:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45bd800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8158ad0 con 0x7f45b81600d0 2024-05-26T15:40:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45b7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80d1310 0x7f45b815d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45b7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80d1310 0x7f45b815d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47498/0 (socket says 172.21.15.8:47498) 2024-05-26T15:40:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45b7400640 1 -- 172.21.15.8:0/3280237896 learned_addr learned my addr 172.21.15.8:0/3280237896 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45b7e00640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45b80b8720 0x7f45b814fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.685+0000 7f45bce00640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45b81600d0 0x7f45b815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.686+0000 7f45b7400640 1 -- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45b81600d0 msgr2=0x7f45b815dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:04.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.686+0000 7f45b7400640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45b81600d0 0x7f45b815dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.686+0000 7f45b7400640 1 -- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45b80b8720 msgr2=0x7f45b814fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:04.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.686+0000 7f45b7400640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45b80b8720 0x7f45b814fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.686+0000 7f45b7400640 1 -- 172.21.15.8:0/3280237896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a40094d0 con 0x7f45b80d1310 2024-05-26T15:40:04.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.686+0000 7f45b7400640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80d1310 0x7f45b815d700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45a4000c00 tx=0x7f45a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:04.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.687+0000 7f45afe00640 1 -- 172.21.15.8:0/3280237896 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4030850 con 0x7f45b80d1310 2024-05-26T15:40:04.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.687+0000 7f45afe00640 1 -- 172.21.15.8:0/3280237896 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a40309b0 con 0x7f45b80d1310 2024-05-26T15:40:04.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.687+0000 7f45afe00640 1 -- 172.21.15.8:0/3280237896 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4030d60 con 0x7f45b80d1310 2024-05-26T15:40:04.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.687+0000 7f45bd800640 1 -- 172.21.15.8:0/3280237896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b81f6b80 con 0x7f45b80d1310 2024-05-26T15:40:04.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.687+0000 7f45bd800640 1 -- 172.21.15.8:0/3280237896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b81f6e10 con 0x7f45b80d1310 2024-05-26T15:40:04.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.688+0000 7f45bd800640 1 -- 172.21.15.8:0/3280237896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b81f7610 con 0x7f45b80d1310 2024-05-26T15:40:04.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.689+0000 7f45afe00640 1 -- 172.21.15.8:0/3280237896 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f45a4039040 con 0x7f45b80d1310 2024-05-26T15:40:04.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.690+0000 7f45afe00640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f459806ac00 0x7f459806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:04.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.690+0000 7f45afe00640 1 -- 172.21.15.8:0/3280237896 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45a40aa240 con 0x7f45b80d1310 2024-05-26T15:40:04.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.691+0000 7f45b7e00640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f459806ac00 0x7f459806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:04.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.692+0000 7f45b7e00640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f459806ac00 0x7f459806d0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f45a800a950 tx=0x7f45a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:04.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.695+0000 7f45afe00640 1 -- 172.21.15.8:0/3280237896 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f45a4075090 con 0x7f45b80d1310 2024-05-26T15:40:04.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.893+0000 7f45bd800640 1 -- 172.21.15.8:0/3280237896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45b804e280 con 0x7f45b80d1310 2024-05-26T15:40:04.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.895+0000 7f45afe00640 1 -- 172.21.15.8:0/3280237896 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7f45a40786b0 con 0x7f45b80d1310 2024-05-26T15:40:04.894 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:04.894 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:04.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 -- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f459806ac00 msgr2=0x7f459806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:04.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f459806ac00 0x7f459806d0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f45a800a950 tx=0x7f45a8008040 comp rx=0 tx=0).stop 2024-05-26T15:40:04.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 -- 172.21.15.8:0/3280237896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80d1310 msgr2=0x7f45b815d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:04.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80d1310 0x7f45b815d700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f45a4000c00 tx=0x7f45a40046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 -- 172.21.15.8:0/3280237896 shutdown_connections 2024-05-26T15:40:04.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45b81600d0 0x7f45b815dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45b80d1310 0x7f45b815d700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f459806ac00 0x7f459806d0c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 --2- 172.21.15.8:0/3280237896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45b80b8720 0x7f45b814fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:04.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 -- 172.21.15.8:0/3280237896 >> 172.21.15.8:0/3280237896 conn(0x7f45b806b750 msgr2=0x7f45b806bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:04.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 -- 172.21.15.8:0/3280237896 shutdown_connections 2024-05-26T15:40:04.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:04.898+0000 7f45bd800640 1 -- 172.21.15.8:0/3280237896 wait complete. 2024-05-26T15:40:04.918 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-26T15:40:04.918 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-26T15:40:04.919 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-26T15:40:04.919 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-26T15:40:04.920 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-26T15:40:04.920 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-26T15:40:04.920 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-26T15:40:04.921 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-26T15:40:05.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.219+0000 7fc70ea00640 1 Processor -- start 2024-05-26T15:40:05.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.219+0000 7fc70ea00640 1 -- start start 2024-05-26T15:40:05.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.221+0000 7fc70ea00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc70815cb50 0x7fc7080d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.221+0000 7fc70ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc7080d24b0 0x7fc7080cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.221+0000 7fc70ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc7080d0f00 0x7fc7080cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.221+0000 7fc70ea00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7080d1410 con 0x7fc7080d24b0 2024-05-26T15:40:05.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.221+0000 7fc70ea00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7080d16f0 con 0x7fc7080d0f00 2024-05-26T15:40:05.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.221+0000 7fc70ea00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080d19d0 con 0x7fc70815cb50 2024-05-26T15:40:05.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.222+0000 7fc70ca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc7080d0f00 0x7fc7080cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.222+0000 7fc707e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc70815cb50 0x7fc7080d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.223+0000 7fc707400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc7080d24b0 0x7fc7080cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.223+0000 7fc70ca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc7080d0f00 0x7fc7080cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:37070/0 (socket says 172.21.15.8:37070) 2024-05-26T15:40:05.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.223+0000 7fc70ca00640 1 -- 172.21.15.8:0/1757241662 learned_addr learned my addr 172.21.15.8:0/1757241662 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.224+0000 7fc707400640 1 -- 172.21.15.8:0/1757241662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc70815cb50 msgr2=0x7fc7080d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.224+0000 7fc707400640 1 --2- 172.21.15.8:0/1757241662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc70815cb50 0x7fc7080d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.224+0000 7fc707400640 1 -- 172.21.15.8:0/1757241662 >> v2:172.21.15.47:3300/0 conn(0x7fc7080d0f00 msgr2=0x7fc7080cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.224+0000 7fc707400640 1 --2- 172.21.15.8:0/1757241662 >> v2:172.21.15.47:3300/0 conn(0x7fc7080d0f00 0x7fc7080cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.224+0000 7fc707400640 1 -- 172.21.15.8:0/1757241662 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7080d1cb0 con 0x7fc7080d24b0 2024-05-26T15:40:05.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.225+0000 7fc707400640 1 --2- 172.21.15.8:0/1757241662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7080d24b0 0x7fc7080cd6c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc7080b8010 tx=0x7fc70002a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11309082d231b42 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.226+0000 7fc706a00640 1 -- 172.21.15.8:0/1757241662 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700032640 con 0x7fc7080d24b0 2024-05-26T15:40:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.226+0000 7fc706a00640 1 -- 172.21.15.8:0/1757241662 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7000327a0 con 0x7fc7080d24b0 2024-05-26T15:40:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.226+0000 7fc706a00640 1 -- 172.21.15.8:0/1757241662 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700032640 con 0x7fc7080d24b0 2024-05-26T15:40:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.227+0000 7fc70ea00640 1 -- 172.21.15.8:0/1757241662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7080d24b0 msgr2=0x7fc7080cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.227+0000 7fc70ea00640 1 --2- 172.21.15.8:0/1757241662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7080d24b0 0x7fc7080cd6c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc7080b8010 tx=0x7fc70002a850 comp rx=0 tx=0).stop 2024-05-26T15:40:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.228+0000 7fc70ea00640 1 -- 172.21.15.8:0/1757241662 shutdown_connections 2024-05-26T15:40:05.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.228+0000 7fc70ea00640 1 --2- 172.21.15.8:0/1757241662 >> v2:172.21.15.47:3300/0 conn(0x7fc7080d0f00 0x7fc7080cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.228+0000 7fc70ea00640 1 --2- 172.21.15.8:0/1757241662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7080d24b0 0x7fc7080cd6c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.228+0000 7fc70ea00640 1 --2- 172.21.15.8:0/1757241662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc70815cb50 0x7fc7080d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.228+0000 7fc70ea00640 1 -- 172.21.15.8:0/1757241662 >> 172.21.15.8:0/1757241662 conn(0x7fc70806b0b0 msgr2=0x7fc70806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.228+0000 7fc70ea00640 1 -- 172.21.15.8:0/1757241662 shutdown_connections 2024-05-26T15:40:05.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.228+0000 7fc70ea00640 1 -- 172.21.15.8:0/1757241662 wait complete. 2024-05-26T15:40:05.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.232+0000 7fc70ea00640 1 Processor -- start 2024-05-26T15:40:05.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.232+0000 7fc6d3e00640 1 Processor -- start 2024-05-26T15:40:05.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.232+0000 7fc70ea00640 1 -- start start 2024-05-26T15:40:05.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.233+0000 7fc70ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7080d0f00 0x7fc7080b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7fc70ea00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7080d24b0 0x7fc70815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7fc70ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc70815cb50 0x7fc7080c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7fc70ea00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70815b0c0 con 0x7fc70815cb50 2024-05-26T15:40:05.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7fc70ea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70815a440 con 0x7fc7080d0f00 2024-05-26T15:40:05.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7fc70ea00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70815a720 con 0x7fc7080d24b0 2024-05-26T15:40:05.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7f89ab400640 1 Processor -- start 2024-05-26T15:40:05.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7f89ab400640 1 -- start start 2024-05-26T15:40:05.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.233+0000 7fc6d3e00640 1 -- start start 2024-05-26T15:40:05.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7fc6d3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc6d40d2620 0x7fc6d40b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7fc6d3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6d40b4490 0x7fc6d40b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7fc6d3e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d40d1580 con 0x7fc6d415fff0 2024-05-26T15:40:05.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7fc6d3e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d40b4e80 con 0x7fc6d40b4490 2024-05-26T15:40:05.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.234+0000 7fc6d3e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40b6a90 con 0x7fc6d40d2620 2024-05-26T15:40:05.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.235+0000 7fc6d2000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc6d40d2620 0x7fc6d40b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.235+0000 7fc707400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7080d24b0 0x7fc70815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.235+0000 7fc6d3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6d40b4490 0x7fc6d40b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.235+0000 7fc6d3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc6d40b4490 0x7fc6d40b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47516/0 (socket says 172.21.15.8:47516) 2024-05-26T15:40:05.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.235+0000 7fc6d3400640 1 -- 172.21.15.8:0/3836253921 learned_addr learned my addr 172.21.15.8:0/3836253921 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.235+0000 7fc707e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7080d0f00 0x7fc7080b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.235+0000 7fc707400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7080d24b0 0x7fc70815b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52392/0 (socket says 172.21.15.8:52392) 2024-05-26T15:40:05.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.235+0000 7fc707400640 1 -- 172.21.15.8:0/1982620706 learned_addr learned my addr 172.21.15.8:0/1982620706 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc70ca00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc70815cb50 0x7fc7080c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc6d2000640 1 -- 172.21.15.8:0/3836253921 >> v2:172.21.15.8:3300/0 conn(0x7fc6d40b4490 msgr2=0x7fc6d40b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc707e00640 1 -- 172.21.15.8:0/1982620706 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7080d24b0 msgr2=0x7fc70815b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc6d2000640 1 --2- 172.21.15.8:0/3836253921 >> v2:172.21.15.8:3300/0 conn(0x7fc6d40b4490 0x7fc6d40b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc707e00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7080d24b0 0x7fc70815b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc6d2000640 1 -- 172.21.15.8:0/3836253921 >> v1:172.21.15.47:6789/0 conn(0x7fc6d415fff0 legacy=0x7fc6d40d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc707e00640 1 -- 172.21.15.8:0/1982620706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc70815cb50 msgr2=0x7fc7080c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc6d2000640 1 -- 172.21.15.8:0/3836253921 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d40d1860 con 0x7fc6d40d2620 2024-05-26T15:40:05.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc707e00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc70815cb50 0x7fc7080c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc707e00640 1 -- 172.21.15.8:0/1982620706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700009a70 con 0x7fc7080d0f00 2024-05-26T15:40:05.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.236+0000 7fc70ca00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc70815cb50 0x7fc7080c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:40:05.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.237+0000 7f89ab400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f899c04ff40 0x7f899c052c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.237+0000 7fc707e00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7080d0f00 0x7fc7080b4ba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400d520 tx=0x7fc6f400d9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.237+0000 7f89ab400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c0e3600 con 0x7f899c0e3220 2024-05-26T15:40:05.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.237+0000 7f89ab400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c0538f0 con 0x7f899c053170 2024-05-26T15:40:05.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.237+0000 7f89ab400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c053bd0 con 0x7f899c04ff40 2024-05-26T15:40:05.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.238+0000 7f89a8a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f899c0e3220 0x7f899c04f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60392/0 (socket says 172.21.15.8:60392) 2024-05-26T15:40:05.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.238+0000 7f89a8a00640 1 -- 172.21.15.8:0/530416227 learned_addr learned my addr 172.21.15.8:0/530416227 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:05.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.238+0000 7f8a35400640 1 Processor -- start 2024-05-26T15:40:05.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.238+0000 7f89a3e00640 1 --2- 172.21.15.8:0/530416227 >> v2:172.21.15.47:3300/0 conn(0x7f899c04ff40 0x7f899c052c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.238+0000 7f8a35400640 1 -- start start 2024-05-26T15:40:05.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.238+0000 7fc6d2000640 1 --2- 172.21.15.8:0/3836253921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc6d40d2620 0x7fc6d40b8630 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00097d0 tx=0x7fc6c002a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=479bdbd0748a8bd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.238+0000 7fc6fbe00640 1 -- 172.21.15.8:0/1982620706 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f40125f0 con 0x7fc7080d0f00 2024-05-26T15:40:05.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.238+0000 7fc6fbe00640 1 -- 172.21.15.8:0/1982620706 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4012750 con 0x7fc7080d0f00 2024-05-26T15:40:05.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.238+0000 7fc6fbe00640 1 -- 172.21.15.8:0/1982620706 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4012ae0 con 0x7fc7080d0f00 2024-05-26T15:40:05.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.239+0000 7f89a3400640 1 -- 172.21.15.8:0/530416227 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957596156 0 0) 0x7f899c0e3600 con 0x7f899c0e3220 2024-05-26T15:40:05.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.239+0000 7f89a3400640 1 -- 172.21.15.8:0/530416227 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f898c003520 con 0x7f899c0e3220 2024-05-26T15:40:05.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.239+0000 7f89a3e00640 1 -- 172.21.15.8:0/530416227 >> v1:172.21.15.47:6789/0 conn(0x7f899c053170 legacy=0x7f899c037b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.239+0000 7f89a3e00640 1 -- 172.21.15.8:0/530416227 >> v1:172.21.15.8:6789/0 conn(0x7f899c0e3220 legacy=0x7f899c04f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.239+0000 7f89a3e00640 1 -- 172.21.15.8:0/530416227 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c053eb0 con 0x7f899c04ff40 2024-05-26T15:40:05.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.239+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70815aa00 con 0x7fc7080d0f00 2024-05-26T15:40:05.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.239+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7080b50e0 con 0x7fc7080d0f00 2024-05-26T15:40:05.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.240+0000 7fc6d1600640 1 -- 172.21.15.8:0/3836253921 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0032440 con 0x7fc6d40d2620 2024-05-26T15:40:05.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.240+0000 7fc6d1600640 1 -- 172.21.15.8:0/3836253921 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c00325a0 con 0x7fc6d40d2620 2024-05-26T15:40:05.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.240+0000 7fc6d1600640 1 -- 172.21.15.8:0/3836253921 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0032930 con 0x7fc6d40d2620 2024-05-26T15:40:05.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.240+0000 7f8a35400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8a300b2890 0x7f8a3006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.240+0000 7f8a35400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a300cbd40 con 0x7f8a300ce1b0 2024-05-26T15:40:05.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.241+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc70815cf30 con 0x7fc7080d0f00 2024-05-26T15:40:05.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.240+0000 7f8a35400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a300b0840 con 0x7f8a300b0390 2024-05-26T15:40:05.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.240+0000 7f8a35400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a30161550 con 0x7f8a300b2890 2024-05-26T15:40:05.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.241+0000 7f8a2f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8a300b2890 0x7f8a3006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.241+0000 7f8a2f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8a300b2890 0x7f8a3006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47528/0 (socket says 172.21.15.8:47528) 2024-05-26T15:40:05.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.241+0000 7f8a2f400640 1 -- 172.21.15.8:0/45139532 learned_addr learned my addr 172.21.15.8:0/45139532 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.241+0000 7f89a3e00640 1 --2- 172.21.15.8:0/530416227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c04ff40 0x7f899c052c30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f89900097a0 tx=0x7f899002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=490ebedd29ef946b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.241+0000 7fc6d3e00640 1 -- 172.21.15.8:0/3836253921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc6d40d2620 msgr2=0x7fc6d40b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.241+0000 7fc6d3e00640 1 --2- 172.21.15.8:0/3836253921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc6d40d2620 0x7fc6d40b8630 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00097d0 tx=0x7fc6c002a1f0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7fc6d3e00640 1 -- 172.21.15.8:0/3836253921 shutdown_connections 2024-05-26T15:40:05.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7f89a3400640 1 -- 172.21.15.8:0/530416227 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990032440 con 0x7f899c04ff40 2024-05-26T15:40:05.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7f8a2f400640 1 -- 172.21.15.8:0/45139532 >> v1:172.21.15.47:6789/0 conn(0x7f8a300b0390 legacy=0x7f8a300cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7fc6d3e00640 1 --2- 172.21.15.8:0/3836253921 >> v2:172.21.15.8:3300/0 conn(0x7fc6d40b4490 0x7fc6d40b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7fc6d3e00640 1 --2- 172.21.15.8:0/3836253921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc6d40d2620 0x7fc6d40b8630 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7fc6d3e00640 1 -- 172.21.15.8:0/3836253921 >> 172.21.15.8:0/3836253921 conn(0x7fc6d4071bd0 msgr2=0x7fc6d40cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7f89a3400640 1 -- 172.21.15.8:0/530416227 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89900325a0 con 0x7f899c04ff40 2024-05-26T15:40:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7f89a3400640 1 -- 172.21.15.8:0/530416227 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990032910 con 0x7f899c04ff40 2024-05-26T15:40:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7f8a2f400640 1 -- 172.21.15.8:0/45139532 >> v1:172.21.15.8:6789/0 conn(0x7f8a300ce1b0 legacy=0x7f8a300b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7f8a2f400640 1 -- 172.21.15.8:0/45139532 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300b0aa0 con 0x7f8a300b2890 2024-05-26T15:40:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.242+0000 7f8a2ea00640 1 -- 172.21.15.8:0/45139532 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392489726 0 0) 0x7f8a300cbd40 con 0x7f8a300ce1b0 2024-05-26T15:40:05.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.243+0000 7fc6fbe00640 1 -- 172.21.15.8:0/1982620706 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc6f4012c40 con 0x7fc7080d0f00 2024-05-26T15:40:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.243+0000 7f89ab400640 1 -- 172.21.15.8:0/530416227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c04ff40 msgr2=0x7f899c052c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.243+0000 7f89ab400640 1 --2- 172.21.15.8:0/530416227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c04ff40 0x7f899c052c30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f89900097a0 tx=0x7f899002a270 comp rx=0 tx=0).stop 2024-05-26T15:40:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.243+0000 7fc6d3e00640 1 -- 172.21.15.8:0/3836253921 shutdown_connections 2024-05-26T15:40:05.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.243+0000 7fc6d3e00640 1 -- 172.21.15.8:0/3836253921 wait complete. 2024-05-26T15:40:05.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.244+0000 7f89ab400640 1 -- 172.21.15.8:0/530416227 shutdown_connections 2024-05-26T15:40:05.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.244+0000 7f89ab400640 1 --2- 172.21.15.8:0/530416227 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c04ff40 0x7f899c052c30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.244+0000 7f8a2f400640 1 --2- 172.21.15.8:0/45139532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a300b2890 0x7f8a3006d6b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a20009870 tx=0x7f8a2002a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caec103774a5da6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.244+0000 7f89ab400640 1 -- 172.21.15.8:0/530416227 >> 172.21.15.8:0/530416227 conn(0x7f899c009f70 msgr2=0x7f899c00a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.244+0000 7f89ab400640 1 -- 172.21.15.8:0/530416227 shutdown_connections 2024-05-26T15:40:05.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.244+0000 7f89ab400640 1 -- 172.21.15.8:0/530416227 wait complete. 2024-05-26T15:40:05.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.244+0000 7f8a2ea00640 1 -- 172.21.15.8:0/45139532 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20032640 con 0x7f8a300b2890 2024-05-26T15:40:05.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.245+0000 7f8a2ea00640 1 -- 172.21.15.8:0/45139532 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a200327a0 con 0x7f8a300b2890 2024-05-26T15:40:05.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.245+0000 7f8a2ea00640 1 -- 172.21.15.8:0/45139532 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20032b30 con 0x7f8a300b2890 2024-05-26T15:40:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.245+0000 7f8a35400640 1 -- 172.21.15.8:0/45139532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a300b2890 msgr2=0x7f8a3006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.245+0000 7f8a35400640 1 --2- 172.21.15.8:0/45139532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a300b2890 0x7f8a3006d6b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a20009870 tx=0x7f8a2002a2f0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.246+0000 7fc6d3e00640 1 Processor -- start 2024-05-26T15:40:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.246+0000 7f8a35400640 1 -- 172.21.15.8:0/45139532 shutdown_connections 2024-05-26T15:40:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.246+0000 7f8a35400640 1 --2- 172.21.15.8:0/45139532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a300b2890 0x7f8a3006d6b0 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a20009870 tx=0x7f8a2002a2f0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.246+0000 7f8a35400640 1 -- 172.21.15.8:0/45139532 >> 172.21.15.8:0/45139532 conn(0x7f8a30069e70 msgr2=0x7f8a3006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.246+0000 7fc6d3e00640 1 -- start start 2024-05-26T15:40:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.246+0000 7f8a35400640 1 -- 172.21.15.8:0/45139532 shutdown_connections 2024-05-26T15:40:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.247+0000 7fc6fbe00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc6e806acd0 0x7fc6e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.247+0000 7fc6fbe00640 1 -- 172.21.15.8:0/1982620706 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc6f408a350 con 0x7fc7080d0f00 2024-05-26T15:40:05.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.247+0000 7fc6fbe00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] conn(0x7fc6e8074310 0x7fc6e8076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.246+0000 7f8a35400640 1 -- 172.21.15.8:0/45139532 wait complete. 2024-05-26T15:40:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.247+0000 7fc6fbe00640 1 -- 172.21.15.8:0/1982620706 --> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6e8076e20 con 0x7fc6e8074310 2024-05-26T15:40:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.248+0000 7fc6fbe00640 1 -- 172.21.15.8:0/1982620706 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6f408a700 con 0x7fc7080d0f00 2024-05-26T15:40:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.248+0000 7fc70ca00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] conn(0x7fc6e8074310 0x7fc6e8076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.248+0000 7fc707400640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc6e806acd0 0x7fc6e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.248+0000 7fc6d3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6d40b4490 0x7fc6d40cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.248+0000 7fc6d3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc6d415fff0 0x7fc6d415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.248+0000 7fc6d2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6d40b4490 0x7fc6d40cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7fc6d3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6d40cd5e0 0x7fc6d406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7fc6d3e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40cbd90 con 0x7fc6d40b4490 2024-05-26T15:40:05.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7fc6d2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6d40b4490 0x7fc6d40cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47534/0 (socket says 172.21.15.8:47534) 2024-05-26T15:40:05.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7fc6d2a00640 1 -- 172.21.15.8:0/1428258555 learned_addr learned my addr 172.21.15.8:0/1428258555 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40cc070 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40cc350 con 0x7fc6d415fff0 2024-05-26T15:40:05.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7fc70ca00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] conn(0x7fc6e8074310 0x7fc6e8076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7fc707400640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc6e806acd0 0x7fc6e806d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc708144310 tx=0x7fc700030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7f8a35400640 1 Processor -- start 2024-05-26T15:40:05.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7f89ab400640 1 Processor -- start 2024-05-26T15:40:05.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7f89ab400640 1 -- start start 2024-05-26T15:40:05.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7fc6d3400640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6d40cd5e0 0x7fc6d406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7f0fffe00640 1 Processor -- start 2024-05-26T15:40:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.249+0000 7f8a35400640 1 -- start start 2024-05-26T15:40:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.250+0000 7fc6d2000640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc6d415fff0 0x7fc6d415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.250+0000 7fc6d3400640 1 -- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc6d415fff0 msgr2=0x7fc6d415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.250+0000 7fc6d3400640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc6d415fff0 0x7fc6d415a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.251+0000 7fc6d3400640 1 -- 172.21.15.8:0/1428258555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6d40b4490 msgr2=0x7fc6d40cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.250+0000 7f0fffe00640 1 -- start start 2024-05-26T15:40:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.251+0000 7fc6d3400640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6d40b4490 0x7fc6d40cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.251+0000 7fc6d3400640 1 -- 172.21.15.8:0/1428258555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0009400 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.251+0000 7f89ab400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c04ff40 0x7f899c0493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.251+0000 7f89ab400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f899c053170 0x7f899c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.251+0000 7f89ab400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c0e3220 0x7f899c0e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.251+0000 7fc6fbe00640 1 -- 172.21.15.8:0/1982620706 <== osd.0 v2:172.21.15.8:6814/36926 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc6e8076e20 con 0x7fc6e8074310 2024-05-26T15:40:05.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.251+0000 7fc6d2a00640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc6d40b4490 0x7fc6d40cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:05.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f8a35400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a300b0390 0x7f8a3014f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f89ab400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0cf380 con 0x7f899c0e3220 2024-05-26T15:40:05.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f89ab400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c049910 con 0x7f899c04ff40 2024-05-26T15:40:05.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f89ab400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0ce770 con 0x7f899c053170 2024-05-26T15:40:05.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f89a8a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c04ff40 0x7f899c0493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f8a35400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a300ce1b0 0x7f8a300ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f0fffe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0ff80e75d0 0x7f0ff8007640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f0fffe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ff80589a0 0x7f0ff8053510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f0fffe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ff8056e70 0x7f0ff8053a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f0fffe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff8007b80 con 0x7f0ff8056e70 2024-05-26T15:40:05.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f0fffe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80e79b0 con 0x7f0ff80e75d0 2024-05-26T15:40:05.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f0fffe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80065a0 con 0x7f0ff80589a0 2024-05-26T15:40:05.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7fc6d3400640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6d40cd5e0 0x7fc6d406ed50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00efc0 tx=0x7fc6cc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f89a3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f899c053170 0x7f899c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f89a3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f899c053170 0x7f899c0cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52432/0 (socket says 172.21.15.8:52432) 2024-05-26T15:40:05.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f89a3e00640 1 -- 172.21.15.8:0/1264005093 learned_addr learned my addr 172.21.15.8:0/1264005093 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f8a35400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a301fab90 0x7f8a300a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f8a35400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300a7880 con 0x7f8a301fab90 2024-05-26T15:40:05.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f8a35400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300a7b60 con 0x7f8a300ce1b0 2024-05-26T15:40:05.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7f8a35400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300a7e40 con 0x7f8a300b0390 2024-05-26T15:40:05.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7fc6cb400640 1 -- 172.21.15.8:0/1428258555 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00cd20 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7f89a9400640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c0e3220 0x7f899c0e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7f8a2fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a300b0390 0x7f8a3014f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7fc6cb400640 1 -- 172.21.15.8:0/1428258555 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc00f040 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7fc6cb400640 1 -- 172.21.15.8:0/1428258555 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc003bd0 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.252+0000 7f0ffe000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ff80589a0 0x7f0ff8053510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7f0ffe000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ff80589a0 0x7f0ff8053510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52448/0 (socket says 172.21.15.8:52448) 2024-05-26T15:40:05.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7f0ffe000640 1 -- 172.21.15.8:0/405651498 learned_addr learned my addr 172.21.15.8:0/405651498 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7f8a2fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a300b0390 0x7f8a3014f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52438/0 (socket says 172.21.15.8:52438) 2024-05-26T15:40:05.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7f8a2fe00640 1 -- 172.21.15.8:0/3860582530 learned_addr learned my addr 172.21.15.8:0/3860582530 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7f0ffea00640 1 --2- 172.21.15.8:0/405651498 >> v2:172.21.15.47:3300/0 conn(0x7f0ff80e75d0 0x7f0ff8007640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d40cc630 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d40cba80 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.253+0000 7f0fff400640 1 --2- 172.21.15.8:0/405651498 >> v2:172.21.15.8:3300/0 conn(0x7f0ff8056e70 0x7f0ff8053a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f8a34a00640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a301fab90 0x7f8a300a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f8a2fe00640 1 -- 172.21.15.8:0/3860582530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a300ce1b0 msgr2=0x7f8a300ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f8a2fe00640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a300ce1b0 0x7f8a300ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f89a9400640 1 -- 172.21.15.8:0/1264005093 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f899c053170 msgr2=0x7f899c0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f89a9400640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f899c053170 0x7f899c0cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f89a9400640 1 -- 172.21.15.8:0/1264005093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c04ff40 msgr2=0x7f899c0493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f89a9400640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f899c04ff40 0x7f899c0493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f89a9400640 1 -- 172.21.15.8:0/1264005093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8990009400 con 0x7f899c0e3220 2024-05-26T15:40:05.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f8a2fe00640 1 -- 172.21.15.8:0/3860582530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a301fab90 msgr2=0x7f8a300a8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f0ffea00640 1 -- 172.21.15.8:0/405651498 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ff80589a0 msgr2=0x7f0ff8053510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f0ffea00640 1 --2- 172.21.15.8:0/405651498 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ff80589a0 0x7f0ff8053510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f0ffea00640 1 -- 172.21.15.8:0/405651498 >> v2:172.21.15.8:3300/0 conn(0x7f0ff8056e70 msgr2=0x7f0ff8053a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f0ffea00640 1 --2- 172.21.15.8:0/405651498 >> v2:172.21.15.8:3300/0 conn(0x7f0ff8056e70 0x7f0ff8053a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f89a9400640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c0e3220 0x7f899c0e5f40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f89a404efc0 tx=0x7f89a4072ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f0ffea00640 1 -- 172.21.15.8:0/405651498 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8006880 con 0x7f0ff80e75d0 2024-05-26T15:40:05.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f8a2fe00640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a301fab90 0x7f8a300a8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f8a2fe00640 1 -- 172.21.15.8:0/3860582530 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a200094d0 con 0x7f8a300b0390 2024-05-26T15:40:05.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f8a34a00640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a301fab90 0x7f8a300a8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:05.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7fbdb9800640 1 Processor -- start 2024-05-26T15:40:05.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7fa0a4000640 1 Processor -- start 2024-05-26T15:40:05.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f0ffea00640 1 --2- 172.21.15.8:0/405651498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff80e75d0 0x7f0ff8007640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f10000690c0 tx=0x7f10000a3f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c69555add22052a server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7fbdb9800640 1 -- start start 2024-05-26T15:40:05.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f89a0c00640 1 -- 172.21.15.8:0/1264005093 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a40677a0 con 0x7f899c0e3220 2024-05-26T15:40:05.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7fa0a4000640 1 -- start start 2024-05-26T15:40:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f0ffd600640 1 -- 172.21.15.8:0/405651498 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10000a4d50 con 0x7f0ff80e75d0 2024-05-26T15:40:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f0ffd600640 1 -- 172.21.15.8:0/405651498 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10000ac440 con 0x7f0ff80e75d0 2024-05-26T15:40:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f0ffd600640 1 -- 172.21.15.8:0/405651498 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10000ac8b0 con 0x7f0ff80e75d0 2024-05-26T15:40:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.256+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6d40b3910 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.256+0000 7f8a2fe00640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a300b0390 0x7f8a3014f5a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00c410 tx=0x7f8a1c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.254+0000 7f0dd3400640 1 Processor -- start 2024-05-26T15:40:05.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f0dd3400640 1 -- start start 2024-05-26T15:40:05.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.256+0000 7f8a27e00640 1 -- 172.21.15.8:0/3860582530 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0035f0 con 0x7f8a300b0390 2024-05-26T15:40:05.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.257+0000 7f8a27e00640 1 -- 172.21.15.8:0/3860582530 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c003770 con 0x7f8a300b0390 2024-05-26T15:40:05.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.257+0000 7f8a27e00640 1 -- 172.21.15.8:0/3860582530 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c003b20 con 0x7f8a300b0390 2024-05-26T15:40:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.257+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a300a8120 con 0x7f8a300b0390 2024-05-26T15:40:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.257+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3014fae0 con 0x7f8a300b0390 2024-05-26T15:40:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.256+0000 7f0fffe00640 1 -- 172.21.15.8:0/405651498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff80e75d0 msgr2=0x7f0ff8007640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.256+0000 7f0fffe00640 1 --2- 172.21.15.8:0/405651498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff80e75d0 0x7f0ff8007640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f10000690c0 tx=0x7f10000a3f40 comp rx=0 tx=0).stop 2024-05-26T15:40:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7f0fffe00640 1 -- 172.21.15.8:0/405651498 shutdown_connections 2024-05-26T15:40:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7f0fffe00640 1 --2- 172.21.15.8:0/405651498 >> v2:172.21.15.8:3300/0 conn(0x7f0ff8056e70 0x7f0ff8053a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7f0fffe00640 1 --2- 172.21.15.8:0/405651498 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ff80589a0 0x7f0ff8053510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7f0fffe00640 1 --2- 172.21.15.8:0/405651498 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff80e75d0 0x7f0ff8007640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7f0fffe00640 1 -- 172.21.15.8:0/405651498 >> 172.21.15.8:0/405651498 conn(0x7f0ff8058ec0 msgr2=0x7f0ff80592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.255+0000 7f89a0c00640 1 -- 172.21.15.8:0/1264005093 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a4067900 con 0x7f899c0e3220 2024-05-26T15:40:05.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.256+0000 7f89a0c00640 1 -- 172.21.15.8:0/1264005093 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4072ef0 con 0x7f899c0e3220 2024-05-26T15:40:05.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.256+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c0cea50 con 0x7f899c0e3220 2024-05-26T15:40:05.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.257+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c0cf010 con 0x7f899c0e3220 2024-05-26T15:40:05.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.257+0000 7fc6cb400640 1 -- 172.21.15.8:0/1428258555 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc6cc003d30 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7fa0a4000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa09403c100 0x7fa09403c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7f0fffe00640 1 -- 172.21.15.8:0/405651498 shutdown_connections 2024-05-26T15:40:05.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7fa0a4000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa094053540 0x7fa0940539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7fc6cb400640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc6b406acd0 0x7fc6b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7f0fffe00640 1 -- 172.21.15.8:0/405651498 wait complete. 2024-05-26T15:40:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7fc6cb400640 1 -- 172.21.15.8:0/1428258555 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc6cc089c20 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7fbdb9800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 0x7fbdb40cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7fbdb9800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb40cb600 con 0x7fbdb40cf620 2024-05-26T15:40:05.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7fbdb9800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb40cb8a0 con 0x7fbdb415aab0 2024-05-26T15:40:05.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.258+0000 7fbdb9800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40cbb80 con 0x7fbdb4099540 2024-05-26T15:40:05.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fc6cb400640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] conn(0x7fc6b4074310 0x7fc6b4076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fc6d2a00640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc6b406acd0 0x7fc6b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fc6cb400640 1 -- 172.21.15.8:0/1428258555 --> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6b4076e20 con 0x7fc6b4074310 2024-05-26T15:40:05.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fc6cb400640 1 -- 172.21.15.8:0/1428258555 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6cc08e2a0 con 0x7fc6d40cd5e0 2024-05-26T15:40:05.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f899c04eeb0 con 0x7f899c0e3220 2024-05-26T15:40:05.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fa0a4000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0940383c0 con 0x7fa094037fe0 2024-05-26T15:40:05.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fa0a4000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0940e7990 con 0x7fa09403c100 2024-05-26T15:40:05.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fa0a4000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09403cad0 con 0x7fa094053540 2024-05-26T15:40:05.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fa0a1600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa094037fe0 0x7fa094058420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60418/0 (socket says 172.21.15.8:60418) 2024-05-26T15:40:05.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fa0a1600640 1 -- 172.21.15.8:0/2684334561 learned_addr learned my addr 172.21.15.8:0/2684334561 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:05.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a300cb9d0 con 0x7f8a300b0390 2024-05-26T15:40:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fbdb2000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbdb40cf620 0x7fbdb40b00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60432/0 (socket says 172.21.15.8:60432) 2024-05-26T15:40:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fbdb2000640 1 -- 172.21.15.8:0/3681077567 learned_addr learned my addr 172.21.15.8:0/3681077567 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7f0dd3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0dcc06d560 0x7f0dcc0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7f0dd3400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0dcc0b36d0 0x7f0dcc0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7fbdb3400640 1 --2- 172.21.15.8:0/3681077567 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 0x7fbdb40cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7fc6d2000640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] conn(0x7fc6b4074310 0x7fc6b4076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7f0dd3400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc16d9e0 con 0x7f0dcc070660 2024-05-26T15:40:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.259+0000 7fa0a2000640 1 --2- 172.21.15.8:0/2684334561 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa094053540 0x7fa0940539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7fa09be00640 1 -- 172.21.15.8:0/2684334561 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227658810 0 0) 0x7fa0940383c0 con 0x7fa094037fe0 2024-05-26T15:40:05.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7fa09be00640 1 -- 172.21.15.8:0/2684334561 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa084003520 con 0x7fa094037fe0 2024-05-26T15:40:05.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7f0dd0a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0dcc070660 0x7f0dcc070a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60438/0 (socket says 172.21.15.8:60438) 2024-05-26T15:40:05.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7f0dd0a00640 1 -- 172.21.15.8:0/3777801353 learned_addr learned my addr 172.21.15.8:0/3777801353 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:05.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.261+0000 7fc6d2000640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] conn(0x7fc6b4074310 0x7fc6b4076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7f0dd3400640 1 -- 172.21.15.8:0/3777801353 --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc16e5f0 con 0x7f0dcc06d560 2024-05-26T15:40:05.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7fa0a2000640 1 -- 172.21.15.8:0/2684334561 >> v2:172.21.15.8:3300/0 conn(0x7fa09403c100 msgr2=0x7fa09403c590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-26T15:40:05.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7fa0a2000640 1 --2- 172.21.15.8:0/2684334561 >> v2:172.21.15.8:3300/0 conn(0x7fa09403c100 0x7fa09403c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7fa0a2000640 1 -- 172.21.15.8:0/2684334561 >> v1:172.21.15.8:6789/0 conn(0x7fa094037fe0 legacy=0x7fa094058420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.260+0000 7fa0a2000640 1 -- 172.21.15.8:0/2684334561 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0940570a0 con 0x7fa094053540 2024-05-26T15:40:05.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.261+0000 7f0dd1400640 1 --2- 172.21.15.8:0/3777801353 >> v2:172.21.15.47:3300/0 conn(0x7f0dcc0b36d0 0x7f0dcc0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.261+0000 7f0dd3400640 1 -- 172.21.15.8:0/3777801353 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc16dcc0 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.261+0000 7f0dcbe00640 1 --2- 172.21.15.8:0/3777801353 >> v2:172.21.15.8:3300/0 conn(0x7f0dcc06d560 0x7f0dcc0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.262+0000 7fc6d2a00640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc6b406acd0 0x7fc6b406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400a8f0 tx=0x7fc6c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.261+0000 7fbdb3400640 1 -- 172.21.15.8:0/3681077567 >> v1:172.21.15.47:6789/0 conn(0x7fbdb415aab0 legacy=0x7fbdb40cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.261+0000 7fbdb3400640 1 -- 172.21.15.8:0/3681077567 >> v1:172.21.15.8:6789/0 conn(0x7fbdb40cf620 legacy=0x7fbdb40b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.261+0000 7fbdb3400640 1 -- 172.21.15.8:0/3681077567 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb40cbe60 con 0x7fbdb4099540 2024-05-26T15:40:05.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.262+0000 7f0dcb400640 1 -- 172.21.15.8:0/3777801353 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240288719 0 0) 0x7f0dcc16d9e0 con 0x7f0dcc070660 2024-05-26T15:40:05.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.262+0000 7fc6cb400640 1 -- 172.21.15.8:0/1428258555 <== osd.2 v2:172.21.15.8:6800/36922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc6b4076e20 con 0x7fc6b4074310 2024-05-26T15:40:05.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.262+0000 7fa0a2000640 1 --2- 172.21.15.8:0/2684334561 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa094053540 0x7fa0940539b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0900097a0 tx=0x7fa09002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=104535199e2db836 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.262+0000 7fa09be00640 1 -- 172.21.15.8:0/2684334561 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090032440 con 0x7fa094053540 2024-05-26T15:40:05.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7fbdb3400640 1 --2- 172.21.15.8:0/3681077567 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 0x7fbdb40cc360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0097d0 tx=0x7fbd9c02a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b77fb1c762e54395 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7fa09be00640 1 -- 172.21.15.8:0/2684334561 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0900325a0 con 0x7fa094053540 2024-05-26T15:40:05.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7fa09be00640 1 -- 172.21.15.8:0/2684334561 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090032440 con 0x7fa094053540 2024-05-26T15:40:05.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7f0dcb400640 1 -- 172.21.15.8:0/3777801353 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db0003500 con 0x7f0dcc070660 2024-05-26T15:40:05.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7f0dcbe00640 1 -- 172.21.15.8:0/3777801353 >> v2:172.21.15.47:3300/0 conn(0x7f0dcc0b36d0 msgr2=0x7f0dcc0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7f0dcbe00640 1 --2- 172.21.15.8:0/3777801353 >> v2:172.21.15.47:3300/0 conn(0x7f0dcc0b36d0 0x7f0dcc0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7f0dcbe00640 1 -- 172.21.15.8:0/3777801353 >> v1:172.21.15.8:6789/0 conn(0x7f0dcc070660 legacy=0x7f0dcc070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7f0dcbe00640 1 -- 172.21.15.8:0/3777801353 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc16dfa0 con 0x7f0dcc06d560 2024-05-26T15:40:05.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.261+0000 7f89a0c00640 1 -- 172.21.15.8:0/1264005093 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f89a40721c0 con 0x7f899c0e3220 2024-05-26T15:40:05.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7fbdb1600640 1 -- 172.21.15.8:0/3681077567 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c032640 con 0x7fbdb4099540 2024-05-26T15:40:05.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7fbdb1600640 1 -- 172.21.15.8:0/3681077567 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c0327a0 con 0x7fbdb4099540 2024-05-26T15:40:05.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7fbdb1600640 1 -- 172.21.15.8:0/3681077567 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c032b70 con 0x7fbdb4099540 2024-05-26T15:40:05.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7f89a0c00640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f898406ac80 0x7f898406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7f89a0c00640 1 -- 172.21.15.8:0/1264005093 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f89a408d070 con 0x7f899c0e3220 2024-05-26T15:40:05.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7f89a0c00640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x7f89840742c0 0x7f8984076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7f89a0c00640 1 -- 172.21.15.8:0/1264005093 --> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8984076dd0 con 0x7f89840742c0 2024-05-26T15:40:05.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7f89a0c00640 1 -- 172.21.15.8:0/1264005093 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89a41033a0 con 0x7f899c0e3220 2024-05-26T15:40:05.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.263+0000 7f89a8a00640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f898406ac80 0x7f898406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7f89a3e00640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x7f89840742c0 0x7f8984076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7f8a27e00640 1 -- 172.21.15.8:0/3860582530 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8a1c003c80 con 0x7f8a300b0390 2024-05-26T15:40:05.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7f0fffe00640 1 Processor -- start 2024-05-26T15:40:05.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7fa0a4000640 1 -- 172.21.15.8:0/2684334561 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa094053540 msgr2=0x7fa0940539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7fa0a4000640 1 --2- 172.21.15.8:0/2684334561 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa094053540 0x7fa0940539b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0900097a0 tx=0x7fa09002a1a0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7fa0a4000640 1 -- 172.21.15.8:0/2684334561 shutdown_connections 2024-05-26T15:40:05.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7fa0a4000640 1 --2- 172.21.15.8:0/2684334561 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa094053540 0x7fa0940539b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7fa0a4000640 1 --2- 172.21.15.8:0/2684334561 >> v2:172.21.15.8:3300/0 conn(0x7fa09403c100 0x7fa09403c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.264+0000 7fa0a4000640 1 -- 172.21.15.8:0/2684334561 >> 172.21.15.8:0/2684334561 conn(0x7fa094058ef0 msgr2=0x7fa094059300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f8a27e00640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a1006ac00 0x7f8a1006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f8a27e00640 1 -- 172.21.15.8:0/3860582530 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a1c089060 con 0x7f8a300b0390 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f8a27e00640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] conn(0x7f8a100741c0 0x7f8a10076600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f8a27e00640 1 -- 172.21.15.8:0/3860582530 --> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a10076cd0 con 0x7f8a100741c0 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f8a27e00640 1 -- 172.21.15.8:0/3860582530 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a1c0893d0 con 0x7f8a300b0390 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7f8a2f400640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a1006ac00 0x7f8a1006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7f8a34a00640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] conn(0x7f8a100741c0 0x7f8a10076600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f8a2f400640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a1006ac00 0x7f8a1006d0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8a20034000 tx=0x7f8a2002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f8a34a00640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] conn(0x7f8a100741c0 0x7f8a10076600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f89a8a00640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f898406ac80 0x7f898406d140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8998007fd0 tx=0x7f8998007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7f89a3e00640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x7f89840742c0 0x7f8984076700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.265+0000 7f0fffe00640 1 -- start start 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.265+0000 7f0fffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ff8056e70 0x7f0ff80530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.265+0000 7f0fffe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ff80589a0 0x7f0ff80cee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f0fffe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff80e75d0 0x7f0ff80e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f0fffe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80cf3b0 con 0x7f0ff8056e70 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f0fffe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80536d0 con 0x7f0ff80e75d0 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f0fffe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff800a040 con 0x7f0ff80589a0 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f0fff400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff80e75d0 0x7f0ff80e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7f0fff400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff80e75d0 0x7f0ff80e8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:37148/0 (socket says 172.21.15.8:37148) 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7f0fff400640 1 -- 172.21.15.8:0/620911953 learned_addr learned my addr 172.21.15.8:0/620911953 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7f0ffea00640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ff8056e70 0x7f0ff80530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f0ffea00640 1 -- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ff80589a0 msgr2=0x7f0ff80cee70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-26T15:40:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f0ffea00640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ff80589a0 0x7f0ff80cee70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f0ffea00640 1 -- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff80e75d0 msgr2=0x7f0ff80e8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f0ffea00640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff80e75d0 0x7f0ff80e8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f0ffea00640 1 -- 172.21.15.8:0/620911953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1000067fb0 con 0x7f0ff8056e70 2024-05-26T15:40:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.265+0000 7fbdb9800640 1 -- 172.21.15.8:0/3681077567 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 msgr2=0x7fbdb40cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.265+0000 7fbdb9800640 1 --2- 172.21.15.8:0/3681077567 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 0x7fbdb40cc360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c0097d0 tx=0x7fbd9c02a2c0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7fbdb9800640 1 -- 172.21.15.8:0/3681077567 shutdown_connections 2024-05-26T15:40:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7fbdb9800640 1 --2- 172.21.15.8:0/3681077567 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 0x7fbdb40cc360 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7fbdb9800640 1 -- 172.21.15.8:0/3681077567 >> 172.21.15.8:0/3681077567 conn(0x7fbdb40b2440 msgr2=0x7fbdb40b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.265+0000 7f0dcbe00640 1 --2- 172.21.15.8:0/3777801353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dcc06d560 0x7f0dcc0b3190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0097a0 tx=0x7f0dbc02e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aee2115a3c63cd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f0dcb400640 1 -- 172.21.15.8:0/3777801353 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40019f0 con 0x7f0dcc06d560 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.266+0000 7f0dcb400640 1 -- 172.21.15.8:0/3777801353 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc031050 con 0x7f0dcc06d560 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7f0dcb400640 1 -- 172.21.15.8:0/3777801353 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc033710 con 0x7f0dcc06d560 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7f0dd3400640 1 -- 172.21.15.8:0/3777801353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dcc06d560 msgr2=0x7f0dcc0b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7f0dd3400640 1 --2- 172.21.15.8:0/3777801353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dcc06d560 0x7f0dcc0b3190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0097a0 tx=0x7f0dbc02e4c0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f0dd3400640 1 -- 172.21.15.8:0/3777801353 shutdown_connections 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f0dd3400640 1 --2- 172.21.15.8:0/3777801353 >> v2:172.21.15.47:3300/0 conn(0x7f0dcc0b36d0 0x7f0dcc0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f0dd3400640 1 --2- 172.21.15.8:0/3777801353 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dcc06d560 0x7f0dcc0b3190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f0dd3400640 1 -- 172.21.15.8:0/3777801353 >> 172.21.15.8:0/3777801353 conn(0x7f0dcc0b0ba0 msgr2=0x7f0dcc069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.268+0000 7f0dd3400640 1 -- 172.21.15.8:0/3777801353 shutdown_connections 2024-05-26T15:40:05.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.265+0000 7fa0a4000640 1 -- 172.21.15.8:0/2684334561 shutdown_connections 2024-05-26T15:40:05.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.265+0000 7fa0a4000640 1 -- 172.21.15.8:0/2684334561 wait complete. 2024-05-26T15:40:05.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7fa0a4000640 1 Processor -- start 2024-05-26T15:40:05.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.267+0000 7fa0a4000640 1 -- start start 2024-05-26T15:40:05.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.269+0000 7f89a0c00640 1 -- 172.21.15.8:0/1264005093 <== osd.3 v2:172.21.15.8:6813/36924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8984076dd0 con 0x7f89840742c0 2024-05-26T15:40:05.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.269+0000 7fbdb9800640 1 -- 172.21.15.8:0/3681077567 shutdown_connections 2024-05-26T15:40:05.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.270+0000 7f8a27e00640 1 -- 172.21.15.8:0/3860582530 <== osd.1 v2:172.21.15.8:6808/36923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8a10076cd0 con 0x7f8a100741c0 2024-05-26T15:40:05.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.269+0000 7f0ffea00640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ff8056e70 0x7f0ff80530b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1000068b70 tx=0x7f1000067ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.270+0000 7f0ff7400640 1 -- 172.21.15.8:0/620911953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10000ba070 con 0x7f0ff8056e70 2024-05-26T15:40:05.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.270+0000 7f0ff7400640 1 -- 172.21.15.8:0/620911953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10000b5430 con 0x7f0ff8056e70 2024-05-26T15:40:05.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.270+0000 7f0ff7400640 1 -- 172.21.15.8:0/620911953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10000ba070 con 0x7f0ff8056e70 2024-05-26T15:40:05.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.269+0000 7fbdb9800640 1 -- 172.21.15.8:0/3681077567 wait complete. 2024-05-26T15:40:05.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.269+0000 7f0dd3400640 1 -- 172.21.15.8:0/3777801353 wait complete. 2024-05-26T15:40:05.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.271+0000 7f0dd3400640 1 Processor -- start 2024-05-26T15:40:05.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.271+0000 7f0dd3400640 1 -- start start 2024-05-26T15:40:05.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.269+0000 7fa0a4000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa094037fe0 0x7fa09403a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.270+0000 7fa0a4000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa09403c100 0x7fa0940e10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.270+0000 7fa0a4000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa094053540 0x7fa0940e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.270+0000 7fa0a4000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940519d0 con 0x7fa094037fe0 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.270+0000 7fa0a4000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940e1600 con 0x7fa094053540 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.270+0000 7fa0a4000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa094051380 con 0x7fa09403c100 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.271+0000 7fa0a0c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa09403c100 0x7fa0940e10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.271+0000 7fa0a0c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa09403c100 0x7fa0940e10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52472/0 (socket says 172.21.15.8:52472) 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.271+0000 7fa0a2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa094053540 0x7fa0940e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.271+0000 7fa0a0c00640 1 -- 172.21.15.8:0/3862948342 learned_addr learned my addr 172.21.15.8:0/3862948342 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.271+0000 7fa0a1600640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa094037fe0 0x7fa09403a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.272+0000 7fa0a2000640 1 -- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa09403c100 msgr2=0x7fa0940e10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.272+0000 7fa0a2000640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa09403c100 0x7fa0940e10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.272+0000 7fa0a2000640 1 -- 172.21.15.8:0/3862948342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa094037fe0 msgr2=0x7fa09403a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.272+0000 7fa0a2000640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa094037fe0 0x7fa09403a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.272+0000 7fa0a2000640 1 -- 172.21.15.8:0/3862948342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa090009400 con 0x7fa094053540 2024-05-26T15:40:05.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.272+0000 7fa0a0c00640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa09403c100 0x7fa0940e10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:40:05.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.272+0000 7fbdb9800640 1 Processor -- start 2024-05-26T15:40:05.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7fbdb9800640 1 -- start start 2024-05-26T15:40:05.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dd3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dcc06d560 0x7f0dcc15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dd3400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0dcc070660 0x7f0dcc0c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dd3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0dcc0b36d0 0x7f0dcc15ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dd3400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc158760 con 0x7f0dcc06d560 2024-05-26T15:40:05.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dd3400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc15da10 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dd3400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc15a5b0 con 0x7f0dcc070660 2024-05-26T15:40:05.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7fa0a2000640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa094053540 0x7fa0940e1b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa094055490 tx=0x7fa0900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0dcc070660 0x7f0dcc0c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dcbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0dcc070660 0x7f0dcc0c3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52476/0 (socket says 172.21.15.8:52476) 2024-05-26T15:40:05.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dcbe00640 1 -- 172.21.15.8:0/2551892664 learned_addr learned my addr 172.21.15.8:0/2551892664 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dd0a00640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dcc06d560 0x7f0dcc15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0dd1400640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0dcc0b36d0 0x7f0dcc15ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.274+0000 7f0dd1400640 1 -- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0dcc070660 msgr2=0x7f0dcc0c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.274+0000 7fa099600640 1 -- 172.21.15.8:0/3862948342 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090003810 con 0x7fa094053540 2024-05-26T15:40:05.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.274+0000 7fa099600640 1 -- 172.21.15.8:0/3862948342 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0900039b0 con 0x7fa094053540 2024-05-26T15:40:05.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.274+0000 7fa099600640 1 -- 172.21.15.8:0/3862948342 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090003d60 con 0x7fa094053540 2024-05-26T15:40:05.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.274+0000 7fa0a4000640 1 -- 172.21.15.8:0/3862948342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09403a860 con 0x7fa094053540 2024-05-26T15:40:05.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.272+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff80cf750 con 0x7f0ff8056e70 2024-05-26T15:40:05.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.272+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff80cfd10 con 0x7f0ff8056e70 2024-05-26T15:40:05.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.273+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ff8005d70 con 0x7f0ff8056e70 2024-05-26T15:40:05.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.274+0000 7f0dd1400640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0dcc070660 0x7f0dcc0c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.274+0000 7f0dd1400640 1 -- 172.21.15.8:0/2551892664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dcc06d560 msgr2=0x7f0dcc15a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.274+0000 7f0dd1400640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dcc06d560 0x7f0dcc15a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.274+0000 7f0dd1400640 1 -- 172.21.15.8:0/2551892664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc009400 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.274+0000 7fa0a4000640 1 -- 172.21.15.8:0/3862948342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09403ab40 con 0x7fa094053540 2024-05-26T15:40:05.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.275+0000 7f0dd0a00640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0dcc06d560 0x7f0dcc15a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:40:05.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.275+0000 7fa08ea00640 1 -- 172.21.15.8:0/3862948342 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa070000fc0 con 0x7fa094053540 2024-05-26T15:40:05.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.276+0000 7f0dd1400640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0dcc0b36d0 0x7f0dcc15ab10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0db400b240 tx=0x7f0db400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.276+0000 7f0dc8c00640 1 -- 172.21.15.8:0/2551892664 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400dde0 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.276+0000 7f0dc8c00640 1 -- 172.21.15.8:0/2551892664 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4010440 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.276+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc157ae0 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.276+0000 7f0dc8c00640 1 -- 172.21.15.8:0/2551892664 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40107f0 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.276+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc1580a0 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.277+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0dcc06d9f0 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.276+0000 7fbdb9800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 0x7fbdb4200a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.276+0000 7fbdb9800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdb40cf620 0x7fbdb40b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.276+0000 7fbdb2a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 0x7fbdb4200a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.276+0000 7fbdb2a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 0x7fbdb4200a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52478/0 (socket says 172.21.15.8:52478) 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.277+0000 7fbdb2a00640 1 -- 172.21.15.8:0/986703241 learned_addr learned my addr 172.21.15.8:0/986703241 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.277+0000 7fbdb9800640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdb415aab0 0x7fbdb40b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.277+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4200800 con 0x7fbdb415aab0 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.277+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40c8b10 con 0x7fbdb40cf620 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.277+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb40c8df0 con 0x7fbdb4099540 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.277+0000 7fbdb2000640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdb40cf620 0x7fbdb40b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.277+0000 7fbdb3400640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdb415aab0 0x7fbdb40b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fbdb2a00640 1 -- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdb40cf620 msgr2=0x7fbdb40b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fbdb2a00640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdb40cf620 0x7fbdb40b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fbdb2a00640 1 -- 172.21.15.8:0/986703241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdb415aab0 msgr2=0x7fbdb40b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fbdb2a00640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdb415aab0 0x7fbdb40b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fbdb2a00640 1 -- 172.21.15.8:0/986703241 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c009400 con 0x7fbdb4099540 2024-05-26T15:40:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fbdb3400640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdb415aab0 0x7fbdb40b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fbdb2a00640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 0x7fbdb4200a50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c3c0 tx=0x7fbdac00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fbdaaa00640 1 -- 172.21.15.8:0/986703241 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0052d0 con 0x7fbdb4099540 2024-05-26T15:40:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fbdaaa00640 1 -- 172.21.15.8:0/986703241 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac005450 con 0x7fbdb4099540 2024-05-26T15:40:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fbdaaa00640 1 -- 172.21.15.8:0/986703241 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac003830 con 0x7fbdb4099540 2024-05-26T15:40:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.280+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb40c90d0 con 0x7fbdb4099540 2024-05-26T15:40:05.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.280+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb4200f90 con 0x7fbdb4099540 2024-05-26T15:40:05.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.278+0000 7fa099600640 1 -- 172.21.15.8:0/3862948342 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa09003e450 con 0x7fa094053540 2024-05-26T15:40:05.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.280+0000 7fa099600640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa07c06acd0 0x7fa07c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.280+0000 7fa099600640 1 -- 172.21.15.8:0/3862948342 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa0900aa690 con 0x7fa094053540 2024-05-26T15:40:05.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.280+0000 7fa099600640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] conn(0x7fa07c074310 0x7fa07c076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.280+0000 7fa099600640 1 -- 172.21.15.8:0/3862948342 --> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa07c076e20 con 0x7fa07c074310 2024-05-26T15:40:05.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.280+0000 7fa099600640 1 -- 172.21.15.8:0/3862948342 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0900aaa40 con 0x7fa094053540 2024-05-26T15:40:05.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.280+0000 7f0dc8c00640 1 -- 172.21.15.8:0/2551892664 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0db4005990 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.281+0000 7fa0a0c00640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] conn(0x7fa07c074310 0x7fa07c076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.281+0000 7fa0a0c00640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] conn(0x7fa07c074310 0x7fa07c076750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.282+0000 7fa0a1600640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa07c06acd0 0x7fa07c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.282+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbdb415ae90 con 0x7fbdb4099540 2024-05-26T15:40:05.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.280+0000 7f0ff7400640 1 -- 172.21.15.8:0/620911953 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f10000b3040 con 0x7f0ff8056e70 2024-05-26T15:40:05.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.282+0000 7f0ff7400640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fe006ac60 0x7f0fe006d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.282+0000 7f0ff7400640 1 -- 172.21.15.8:0/620911953 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10000f2970 con 0x7f0ff8056e70 2024-05-26T15:40:05.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.282+0000 7f0dc8c00640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0da806acd0 0x7f0da806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.282+0000 7f0dc8c00640 1 -- 172.21.15.8:0/2551892664 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0db408a320 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.283+0000 7f0ffe000640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fe006ac60 0x7f0fe006d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.282+0000 7f0dc8c00640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] conn(0x7f0da8074310 0x7f0da8076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.282+0000 7f0dc8c00640 1 -- 172.21.15.8:0/2551892664 --> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0da8076e20 con 0x7f0da8074310 2024-05-26T15:40:05.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.282+0000 7f0dc8c00640 1 -- 172.21.15.8:0/2551892664 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0db408a6d0 con 0x7f0dcc0b36d0 2024-05-26T15:40:05.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.282+0000 7fa099600640 1 -- 172.21.15.8:0/3862948342 <== osd.7 v2:172.21.15.47:6816/37317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa07c076e20 con 0x7fa07c074310 2024-05-26T15:40:05.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.283+0000 7fa0a1600640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa07c06acd0 0x7fa07c06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa0880011e0 tx=0x7fa088009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.283+0000 7f0ff7400640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] conn(0x7f0fe0074f40 0x7f0fe00773e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.283+0000 7f0dcbe00640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] conn(0x7f0da8074310 0x7f0da8076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.283+0000 7f0dd0a00640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0da806acd0 0x7f0da806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.284+0000 7f0ffe000640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fe006ac60 0x7f0fe006d120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0ff803a040 tx=0x7f0fec009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.284+0000 7f0ff7400640 1 -- 172.21.15.8:0/620911953 --> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fe0077ab0 con 0x7f0fe0074f40 2024-05-26T15:40:05.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.284+0000 7f0ff7400640 1 -- 172.21.15.8:0/620911953 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10000f2040 con 0x7f0ff8056e70 2024-05-26T15:40:05.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.284+0000 7f0fff400640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] conn(0x7f0fe0074f40 0x7f0fe00773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.284+0000 7fbdaaa00640 1 -- 172.21.15.8:0/986703241 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbdac003990 con 0x7fbdb4099540 2024-05-26T15:40:05.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.284+0000 7f0dcbe00640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] conn(0x7f0da8074310 0x7f0da8076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.284+0000 7f0dd0a00640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0da806acd0 0x7f0da806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4007f00 tx=0x7f0dc4007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.285+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 --> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc70815a890 con 0x7fc6e8074310 2024-05-26T15:40:05.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.285+0000 7fc6fbe00640 1 -- 172.21.15.8:0/1982620706 <== osd.0 v2:172.21.15.8:6814/36926 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc70815a890 con 0x7fc6e8074310 2024-05-26T15:40:05.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.285+0000 7fbdaaa00640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd9006ac00 0x7fbd9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fbdaaa00640 1 -- 172.21.15.8:0/986703241 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbdac088f40 con 0x7fbdb4099540 2024-05-26T15:40:05.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 >> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] conn(0x7fc6e8074310 msgr2=0x7fc6e8076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fc70ea00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] conn(0x7fc6e8074310 0x7fc6e8076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7f0fff400640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] conn(0x7f0fe0074f40 0x7f0fe00773e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fbdaaa00640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] conn(0x7fbd90074240 0x7fbd90076680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fbdaaa00640 1 -- 172.21.15.8:0/986703241 --> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd90076d50 con 0x7fbd90074240 2024-05-26T15:40:05.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fbdaaa00640 1 -- 172.21.15.8:0/986703241 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdac0892f0 con 0x7fbdb4099540 2024-05-26T15:40:05.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc6e806acd0 msgr2=0x7fc6e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fc70ea00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc6e806acd0 0x7fc6e806d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc708144310 tx=0x7fc700030000 comp rx=0 tx=0).stop 2024-05-26T15:40:05.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7080d0f00 msgr2=0x7fc7080b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fc70ea00640 1 --2- 172.21.15.8:0/1982620706 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7080d0f00 0x7fc7080b4ba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc6f400d520 tx=0x7fc6f400d9e0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fbdb2000640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd9006ac00 0x7fbd9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fc70ca00640 1 -- 172.21.15.8:0/1982620706 reap_dead start 2024-05-26T15:40:05.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 shutdown_connections 2024-05-26T15:40:05.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 >> 172.21.15.8:0/1982620706 conn(0x7fc70806b0b0 msgr2=0x7fc7080d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.286+0000 7fbdb3400640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] conn(0x7fbd90074240 0x7fbd90076680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.287+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 shutdown_connections 2024-05-26T15:40:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.287+0000 7fc70ea00640 1 -- 172.21.15.8:0/1982620706 wait complete. 2024-05-26T15:40:05.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.288+0000 7f0ff7400640 1 -- 172.21.15.8:0/620911953 <== osd.4 v2:172.21.15.47:6800/37314 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0fe0077ab0 con 0x7f0fe0074f40 2024-05-26T15:40:05.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.288+0000 7fbdb3400640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] conn(0x7fbd90074240 0x7fbd90076680 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.289+0000 7fbdaaa00640 1 -- 172.21.15.8:0/986703241 <== osd.5 v2:172.21.15.47:6824/37316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd90076d50 con 0x7fbd90074240 2024-05-26T15:40:05.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.291+0000 7fbdb2000640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd9006ac00 0x7fbd9006d0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbdb406d120 tx=0x7fbda4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.291+0000 7f0dc8c00640 1 -- 172.21.15.8:0/2551892664 <== osd.6 v2:172.21.15.47:6808/37315 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0da8076e20 con 0x7f0da8074310 2024-05-26T15:40:05.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.302+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 --> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc6d40d2100 con 0x7fc6b4074310 2024-05-26T15:40:05.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.303+0000 7fc6cb400640 1 -- 172.21.15.8:0/1428258555 <== osd.2 v2:172.21.15.8:6800/36922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc6c0032810 con 0x7fc6b4074310 2024-05-26T15:40:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.303+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 --> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f899c000ec0 con 0x7f89840742c0 2024-05-26T15:40:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.304+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 >> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] conn(0x7fc6b4074310 msgr2=0x7fc6b4076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.304+0000 7fc6d3e00640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] conn(0x7fc6b4074310 0x7fc6b4076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.304+0000 7f89a0c00640 1 -- 172.21.15.8:0/1264005093 <== osd.3 v2:172.21.15.8:6813/36924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f899c000ec0 con 0x7f89840742c0 2024-05-26T15:40:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.304+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc6b406acd0 msgr2=0x7fc6b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.304+0000 7fc6d3e00640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc6b406acd0 0x7fc6b406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400a8f0 tx=0x7fc6c4008040 comp rx=0 tx=0).stop 2024-05-26T15:40:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.304+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6d40cd5e0 msgr2=0x7fc6d406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.304+0000 7fc6d3e00640 1 --2- 172.21.15.8:0/1428258555 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6d40cd5e0 0x7fc6d406ed50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00efc0 tx=0x7fc6cc00c490 comp rx=0 tx=0).stop 2024-05-26T15:40:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.305+0000 7fc6d3400640 1 -- 172.21.15.8:0/1428258555 reap_dead start 2024-05-26T15:40:05.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.305+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 shutdown_connections 2024-05-26T15:40:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.305+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 >> 172.21.15.8:0/1428258555 conn(0x7fc6d4071bd0 msgr2=0x7fc6d40d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.305+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 shutdown_connections 2024-05-26T15:40:05.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.305+0000 7fc6d3e00640 1 -- 172.21.15.8:0/1428258555 wait complete. 2024-05-26T15:40:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.306+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x7f89840742c0 msgr2=0x7f8984076700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.306+0000 7f89ab400640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x7f89840742c0 0x7f8984076700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.306+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f898406ac80 msgr2=0x7f898406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.306+0000 7f89ab400640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f898406ac80 0x7f898406d140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8998007fd0 tx=0x7f8998007de0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.306+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c0e3220 msgr2=0x7f899c0e5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.306+0000 7f89ab400640 1 --2- 172.21.15.8:0/1264005093 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c0e3220 0x7f899c0e5f40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f89a404efc0 tx=0x7f89a4072ba0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.307+0000 7f89a9400640 1 -- 172.21.15.8:0/1264005093 reap_dead start 2024-05-26T15:40:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.307+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 shutdown_connections 2024-05-26T15:40:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.307+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 >> 172.21.15.8:0/1264005093 conn(0x7f899c009f70 msgr2=0x7f899c038720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.308+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 --> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a300ad9f0 con 0x7f8a100741c0 2024-05-26T15:40:05.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.308+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 shutdown_connections 2024-05-26T15:40:05.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.308+0000 7f89ab400640 1 -- 172.21.15.8:0/1264005093 wait complete. 2024-05-26T15:40:05.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.309+0000 7f8a27e00640 1 -- 172.21.15.8:0/3860582530 <== osd.1 v2:172.21.15.8:6808/36923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8a300ad9f0 con 0x7f8a100741c0 2024-05-26T15:40:05.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.310+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 >> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] conn(0x7f8a100741c0 msgr2=0x7f8a10076600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.310+0000 7f8a35400640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] conn(0x7f8a100741c0 0x7f8a10076600 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.326 INFO:teuthology.orchestra.run.smithi008.stdout:55834574860 2024-05-26T15:40:05.326 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-26T15:40:05.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.313+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a1006ac00 msgr2=0x7f8a1006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.313+0000 7f8a35400640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a1006ac00 0x7f8a1006d0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8a20034000 tx=0x7f8a2002c000 comp rx=0 tx=0).stop 2024-05-26T15:40:05.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.313+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a300b0390 msgr2=0x7f8a3014f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.313+0000 7f8a35400640 1 --2- 172.21.15.8:0/3860582530 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a300b0390 0x7f8a3014f5a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00c410 tx=0x7f8a1c00c8d0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.313+0000 7f8a34a00640 1 -- 172.21.15.8:0/3860582530 reap_dead start 2024-05-26T15:40:05.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.313+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 shutdown_connections 2024-05-26T15:40:05.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.313+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 >> 172.21.15.8:0/3860582530 conn(0x7f8a30069e70 msgr2=0x7f8a30160990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.313+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 shutdown_connections 2024-05-26T15:40:05.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.313+0000 7f8a35400640 1 -- 172.21.15.8:0/3860582530 wait complete. 2024-05-26T15:40:05.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.315+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 --> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ff8007120 con 0x7f0fe0074f40 2024-05-26T15:40:05.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.315+0000 7fa08ea00640 1 -- 172.21.15.8:0/3862948342 --> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa070002cb0 con 0x7fa07c074310 2024-05-26T15:40:05.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.316+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 --> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbdb40c95f0 con 0x7fbd90074240 2024-05-26T15:40:05.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.316+0000 7fa099600640 1 -- 172.21.15.8:0/3862948342 <== osd.7 v2:172.21.15.47:6816/37317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa070002cb0 con 0x7fa07c074310 2024-05-26T15:40:05.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.316+0000 7f0ff7400640 1 -- 172.21.15.8:0/620911953 <== osd.4 v2:172.21.15.47:6800/37314 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ff0007630 con 0x7f0fe0074f40 2024-05-26T15:40:05.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.317+0000 7fbdaaa00640 1 -- 172.21.15.8:0/986703241 <== osd.5 v2:172.21.15.47:6824/37316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbdb40c95f0 con 0x7fbd90074240 2024-05-26T15:40:05.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.317+0000 7fa08ea00640 1 -- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] conn(0x7fa07c074310 msgr2=0x7fa07c076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.317+0000 7fa08ea00640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] conn(0x7fa07c074310 0x7fa07c076750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.317+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] conn(0x7f0fe0074f40 msgr2=0x7f0fe00773e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.317+0000 7f0fffe00640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] conn(0x7f0fe0074f40 0x7f0fe00773e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.317+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fe006ac60 msgr2=0x7f0fe006d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.317+0000 7f0fffe00640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fe006ac60 0x7f0fe006d120 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0ff803a040 tx=0x7f0fec009240 comp rx=0 tx=0).stop 2024-05-26T15:40:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.317+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ff8056e70 msgr2=0x7f0ff80530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.317+0000 7f0fffe00640 1 --2- 172.21.15.8:0/620911953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ff8056e70 0x7f0ff80530b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1000068b70 tx=0x7f1000067ea0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] conn(0x7fbd90074240 msgr2=0x7fbd90076680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fbdb9800640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] conn(0x7fbd90074240 0x7fbd90076680 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7f0fff400640 1 -- 172.21.15.8:0/620911953 reap_dead start 2024-05-26T15:40:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 shutdown_connections 2024-05-26T15:40:05.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 >> 172.21.15.8:0/620911953 conn(0x7f0ff8058ec0 msgr2=0x7f0ff80e6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd9006ac00 msgr2=0x7fbd9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fbdb9800640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd9006ac00 0x7fbd9006d0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbdb406d120 tx=0x7fbda4009040 comp rx=0 tx=0).stop 2024-05-26T15:40:05.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 msgr2=0x7fbdb4200a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fbdb9800640 1 --2- 172.21.15.8:0/986703241 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdb4099540 0x7fbdb4200a50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c3c0 tx=0x7fbdac00c880 comp rx=0 tx=0).stop 2024-05-26T15:40:05.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fbdb3400640 1 -- 172.21.15.8:0/986703241 reap_dead start 2024-05-26T15:40:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fa08ea00640 1 -- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa07c06acd0 msgr2=0x7fa07c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fa08ea00640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa07c06acd0 0x7fa07c06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa0880011e0 tx=0x7fa088009040 comp rx=0 tx=0).stop 2024-05-26T15:40:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fa08ea00640 1 -- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa094053540 msgr2=0x7fa0940e1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fa08ea00640 1 --2- 172.21.15.8:0/3862948342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa094053540 0x7fa0940e1b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa094055490 tx=0x7fa0900046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fa0a2000640 1 -- 172.21.15.8:0/3862948342 reap_dead start 2024-05-26T15:40:05.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fa08ea00640 1 -- 172.21.15.8:0/3862948342 shutdown_connections 2024-05-26T15:40:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fa08ea00640 1 -- 172.21.15.8:0/3862948342 >> 172.21.15.8:0/3862948342 conn(0x7fa094058ef0 msgr2=0x7fa0940592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fa08ea00640 1 -- 172.21.15.8:0/3862948342 shutdown_connections 2024-05-26T15:40:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.318+0000 7fa08ea00640 1 -- 172.21.15.8:0/3862948342 wait complete. 2024-05-26T15:40:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.319+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 shutdown_connections 2024-05-26T15:40:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.319+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 >> 172.21.15.8:0/986703241 conn(0x7fbdb40b2440 msgr2=0x7fbdb40adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.319+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 shutdown_connections 2024-05-26T15:40:05.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.319+0000 7fbdb9800640 1 -- 172.21.15.8:0/986703241 wait complete. 2024-05-26T15:40:05.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.319+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 shutdown_connections 2024-05-26T15:40:05.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.319+0000 7f0fffe00640 1 -- 172.21.15.8:0/620911953 wait complete. 2024-05-26T15:40:05.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.327+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 --> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0dcc1588a0 con 0x7f0da8074310 2024-05-26T15:40:05.337 INFO:teuthology.orchestra.run.smithi008.stdout:55834574859 2024-05-26T15:40:05.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-26T15:40:05.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.328+0000 7f0dc8c00640 1 -- 172.21.15.8:0/2551892664 <== osd.6 v2:172.21.15.47:6808/37315 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0dcc1588a0 con 0x7f0da8074310 2024-05-26T15:40:05.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.329+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] conn(0x7f0da8074310 msgr2=0x7f0da8076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.329+0000 7f0dd3400640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] conn(0x7f0da8074310 0x7f0da8076750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.329+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0da806acd0 msgr2=0x7f0da806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.329+0000 7f0dd3400640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0da806acd0 0x7f0da806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4007f00 tx=0x7f0dc4007e70 comp rx=0 tx=0).stop 2024-05-26T15:40:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.329+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0dcc0b36d0 msgr2=0x7f0dcc15ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.329+0000 7f0dd3400640 1 --2- 172.21.15.8:0/2551892664 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0dcc0b36d0 0x7f0dcc15ab10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0db400b240 tx=0x7f0db400ee50 comp rx=0 tx=0).stop 2024-05-26T15:40:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.329+0000 7f0dd1400640 1 -- 172.21.15.8:0/2551892664 reap_dead start 2024-05-26T15:40:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.329+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 shutdown_connections 2024-05-26T15:40:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.329+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 >> 172.21.15.8:0/2551892664 conn(0x7f0dcc0b0ba0 msgr2=0x7f0dcc06e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.330+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 shutdown_connections 2024-05-26T15:40:05.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.330+0000 7f0dd3400640 1 -- 172.21.15.8:0/2551892664 wait complete. 2024-05-26T15:40:05.341 INFO:teuthology.orchestra.run.smithi008.stdout:55834574859 2024-05-26T15:40:05.341 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-26T15:40:05.342 INFO:teuthology.orchestra.run.smithi008.stdout:55834574858 2024-05-26T15:40:05.342 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-26T15:40:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:55834574860 2024-05-26T15:40:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:55834574859 2024-05-26T15:40:05.345 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-26T15:40:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:55834574858 2024-05-26T15:40:05.346 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-26T15:40:05.346 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-26T15:40:05.349 INFO:teuthology.orchestra.run.smithi008.stdout:55834574859 2024-05-26T15:40:05.349 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-26T15:40:05.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.621+0000 7fce76400640 1 Processor -- start 2024-05-26T15:40:05.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.621+0000 7fce76400640 1 -- start start 2024-05-26T15:40:05.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.624+0000 7fce76400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce700b4ba0 0x7fce701468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.624+0000 7fce76400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fce70146de0 0x7fce700d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.624+0000 7fce76400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce70147610 con 0x7fce7015b480 2024-05-26T15:40:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.624+0000 7fce76400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce70165b40 con 0x7fce70146de0 2024-05-26T15:40:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.624+0000 7fce76400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce700d05e0 con 0x7fce700b4ba0 2024-05-26T15:40:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.625+0000 7fce6fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce700b4ba0 0x7fce701468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.625+0000 7fce75000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fce7015b480 0x7fce700b4490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60440/0 (socket says 172.21.15.8:60440) 2024-05-26T15:40:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.625+0000 7fce75000640 1 -- 172.21.15.8:0/721749672 learned_addr learned my addr 172.21.15.8:0/721749672 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:05.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.625+0000 7fce75a00640 1 --2- 172.21.15.8:0/721749672 >> v2:172.21.15.47:3300/0 conn(0x7fce70146de0 0x7fce700d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.626+0000 7fce6fe00640 1 -- 172.21.15.8:0/721749672 >> v2:172.21.15.47:3300/0 conn(0x7fce70146de0 msgr2=0x7fce700d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.626+0000 7fce6fe00640 1 --2- 172.21.15.8:0/721749672 >> v2:172.21.15.47:3300/0 conn(0x7fce70146de0 0x7fce700d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.626+0000 7fce6fe00640 1 -- 172.21.15.8:0/721749672 >> v1:172.21.15.8:6789/0 conn(0x7fce7015b480 legacy=0x7fce700b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.626+0000 7fce6fe00640 1 -- 172.21.15.8:0/721749672 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce701624a0 con 0x7fce700b4ba0 2024-05-26T15:40:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.627+0000 7f25ed400640 1 Processor -- start 2024-05-26T15:40:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.627+0000 7f25ed400640 1 -- start start 2024-05-26T15:40:05.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.628+0000 7fce6fe00640 1 --2- 172.21.15.8:0/721749672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce700b4ba0 0x7fce701468a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fce60009d90 tx=0x7fce6002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14809b8bbcc5f127 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.628+0000 7fce6f400640 1 -- 172.21.15.8:0/721749672 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60007740 con 0x7fce700b4ba0 2024-05-26T15:40:05.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.629+0000 7f25ed400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e0053780 0x7f25e0053b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.629+0000 7f25ed400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e0007870 con 0x7f25e003d0d0 2024-05-26T15:40:05.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.629+0000 7f25ed400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e0058180 con 0x7f25e00061e0 2024-05-26T15:40:05.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.629+0000 7f25ed400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00540a0 con 0x7f25e0053780 2024-05-26T15:40:05.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.629+0000 7fce6f400640 1 -- 172.21.15.8:0/721749672 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6002d050 con 0x7fce700b4ba0 2024-05-26T15:40:05.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.629+0000 7fce76400640 1 -- 172.21.15.8:0/721749672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce700b4ba0 msgr2=0x7fce701468a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.629+0000 7fce76400640 1 --2- 172.21.15.8:0/721749672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce700b4ba0 0x7fce701468a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fce60009d90 tx=0x7fce6002a660 comp rx=0 tx=0).stop 2024-05-26T15:40:05.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.630+0000 7f25e7e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e0053780 0x7f25e0053b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.630+0000 7f25e7400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f25e00061e0 0x7f25e0057360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:56270/0 (socket says 172.21.15.8:56270) 2024-05-26T15:40:05.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.630+0000 7f25e7400640 1 -- 172.21.15.8:0/310727587 learned_addr learned my addr 172.21.15.8:0/310727587 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:05.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.631+0000 7fce76400640 1 -- 172.21.15.8:0/721749672 shutdown_connections 2024-05-26T15:40:05.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.631+0000 7fce76400640 1 --2- 172.21.15.8:0/721749672 >> v2:172.21.15.47:3300/0 conn(0x7fce70146de0 0x7fce700d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.631+0000 7fce76400640 1 --2- 172.21.15.8:0/721749672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce700b4ba0 0x7fce701468a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.631+0000 7fce76400640 1 -- 172.21.15.8:0/721749672 >> 172.21.15.8:0/721749672 conn(0x7fce70071bd0 msgr2=0x7fce700cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.631+0000 7f25e6a00640 1 -- 172.21.15.8:0/310727587 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479910349 0 0) 0x7f25e0058180 con 0x7f25e00061e0 2024-05-26T15:40:05.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.632+0000 7f25e6a00640 1 -- 172.21.15.8:0/310727587 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25d0003520 con 0x7f25e00061e0 2024-05-26T15:40:05.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.632+0000 7f25e6a00640 1 -- 172.21.15.8:0/310727587 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602446573 0 0) 0x7f25e0007870 con 0x7f25e003d0d0 2024-05-26T15:40:05.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.632+0000 7fce76400640 1 -- 172.21.15.8:0/721749672 shutdown_connections 2024-05-26T15:40:05.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.632+0000 7f25e6a00640 1 -- 172.21.15.8:0/310727587 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25d0003840 con 0x7f25e003d0d0 2024-05-26T15:40:05.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.632+0000 7f25e7e00640 1 -- 172.21.15.8:0/310727587 >> v1:172.21.15.47:6789/0 conn(0x7f25e00061e0 legacy=0x7f25e0057360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.632+0000 7fce76400640 1 -- 172.21.15.8:0/721749672 wait complete. 2024-05-26T15:40:05.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.632+0000 7f25e7e00640 1 -- 172.21.15.8:0/310727587 >> v1:172.21.15.8:6789/0 conn(0x7f25e003d0d0 legacy=0x7f25e0057a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.632+0000 7f25e7e00640 1 -- 172.21.15.8:0/310727587 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e0006c60 con 0x7f25e0053780 2024-05-26T15:40:05.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.634+0000 7f25e7e00640 1 --2- 172.21.15.8:0/310727587 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e0053780 0x7f25e0053b60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0097d0 tx=0x7f25dc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10c492766fc54c9b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.634+0000 7f25e6a00640 1 -- 172.21.15.8:0/310727587 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc032440 con 0x7f25e0053780 2024-05-26T15:40:05.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.634+0000 7f25e6a00640 1 -- 172.21.15.8:0/310727587 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc0325a0 con 0x7f25e0053780 2024-05-26T15:40:05.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.634+0000 7f25e6a00640 1 -- 172.21.15.8:0/310727587 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc032930 con 0x7f25e0053780 2024-05-26T15:40:05.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.635+0000 7f6864000640 1 Processor -- start 2024-05-26T15:40:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.635+0000 7fce76400640 1 Processor -- start 2024-05-26T15:40:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.635+0000 7fce76400640 1 -- start start 2024-05-26T15:40:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.635+0000 7f25ed400640 1 -- 172.21.15.8:0/310727587 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e0053780 msgr2=0x7f25e0053b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.636+0000 7f25ed400640 1 --2- 172.21.15.8:0/310727587 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e0053780 0x7f25e0053b60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0097d0 tx=0x7f25dc02a210 comp rx=0 tx=0).stop 2024-05-26T15:40:05.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.635+0000 7f6864000640 1 -- start start 2024-05-26T15:40:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.635+0000 7f6a4d400640 1 Processor -- start 2024-05-26T15:40:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.636+0000 7f25ed400640 1 -- 172.21.15.8:0/310727587 shutdown_connections 2024-05-26T15:40:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.636+0000 7f25ed400640 1 --2- 172.21.15.8:0/310727587 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e0053780 0x7f25e0053b60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.636+0000 7f25ed400640 1 -- 172.21.15.8:0/310727587 >> 172.21.15.8:0/310727587 conn(0x7f25e003aa10 msgr2=0x7f25e003ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.636+0000 7f6a4d400640 1 -- start start 2024-05-26T15:40:05.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.637+0000 7f25ed400640 1 -- 172.21.15.8:0/310727587 shutdown_connections 2024-05-26T15:40:05.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.637+0000 7f25ed400640 1 -- 172.21.15.8:0/310727587 wait complete. 2024-05-26T15:40:05.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.637+0000 7f320f600640 1 Processor -- start 2024-05-26T15:40:05.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6864000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0cdcc0 0x7f685c0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6864000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f685c0ce0a0 0x7f685c0cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6864000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c06e170 con 0x7f685c161800 2024-05-26T15:40:05.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6864000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c162350 con 0x7f685c0ce0a0 2024-05-26T15:40:05.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6864000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c162550 con 0x7f685c0cdcc0 2024-05-26T15:40:05.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6a4d400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6a4815ccc0 0x7f6a48161240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6a4d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6a480b5d00 0x7f6a480b6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6a4d400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a480d15b0 con 0x7f6a480d1a40 2024-05-26T15:40:05.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6a4d400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a48161780 con 0x7f6a480b5d00 2024-05-26T15:40:05.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6a4d400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a480d0fd0 con 0x7f6a4815ccc0 2024-05-26T15:40:05.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6860c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f685c0ce0a0 0x7f685c0cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6861600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0cdcc0 0x7f685c0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6860c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f685c0ce0a0 0x7f685c0cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47622/0 (socket says 172.21.15.8:47622) 2024-05-26T15:40:05.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f6860c00640 1 -- 172.21.15.8:0/2072692936 learned_addr learned my addr 172.21.15.8:0/2072692936 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.638+0000 7f320f600640 1 -- start start 2024-05-26T15:40:05.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.639+0000 7f6a45e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6a480b5d00 0x7f6a480b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.639+0000 7f6a45e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6a480b5d00 0x7f6a480b6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47628/0 (socket says 172.21.15.8:47628) 2024-05-26T15:40:05.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.639+0000 7f6a45e00640 1 -- 172.21.15.8:0/420101972 learned_addr learned my addr 172.21.15.8:0/420101972 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.639+0000 7f6860c00640 1 -- 172.21.15.8:0/2072692936 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0cdcc0 msgr2=0x7f685c0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.639+0000 7f6860c00640 1 --2- 172.21.15.8:0/2072692936 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0cdcc0 0x7f685c0cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.639+0000 7f6860c00640 1 -- 172.21.15.8:0/2072692936 >> v1:172.21.15.47:6789/0 conn(0x7f685c161800 legacy=0x7f685c161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.639+0000 7f6860c00640 1 -- 172.21.15.8:0/2072692936 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0cd340 con 0x7f685c0ce0a0 2024-05-26T15:40:05.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.640+0000 7f25ed400640 1 Processor -- start 2024-05-26T15:40:05.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.640+0000 7fce76400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce700b4ba0 0x7fce700cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.640+0000 7fce76400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce70146de0 0x7fce7015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.640+0000 7fce76400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce7015b480 0x7fce700b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.641+0000 7fce76400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce700cc9e0 con 0x7fce70146de0 2024-05-26T15:40:05.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.641+0000 7fce76400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce701f6b70 con 0x7fce700b4ba0 2024-05-26T15:40:05.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.641+0000 7fce76400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce700c9d70 con 0x7fce7015b480 2024-05-26T15:40:05.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.641+0000 7fce6fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce70146de0 0x7fce7015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.641+0000 7fce6fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce70146de0 0x7fce7015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47634/0 (socket says 172.21.15.8:47634) 2024-05-26T15:40:05.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.641+0000 7fce6fe00640 1 -- 172.21.15.8:0/3554668820 learned_addr learned my addr 172.21.15.8:0/3554668820 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.641+0000 7fce75000640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce700b4ba0 0x7fce700cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.641+0000 7fce75a00640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce7015b480 0x7fce700b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.640+0000 7f25ed400640 1 -- start start 2024-05-26T15:40:05.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f25ed400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25e00061e0 0x7f25e00dc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f25ed400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e003d0d0 0x7f25e00e0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f25ed400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e0053780 0x7f25e00e0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f25ed400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00e10a0 con 0x7f25e00061e0 2024-05-26T15:40:05.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f25ed400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00dda80 con 0x7f25e0053780 2024-05-26T15:40:05.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f25ed400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00510a0 con 0x7f25e003d0d0 2024-05-26T15:40:05.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.641+0000 7f6860c00640 1 --2- 172.21.15.8:0/2072692936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685c0ce0a0 0x7f685c0cb750 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6848009870 tx=0x7f684802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29aa5839b6639b28 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.641+0000 7f6861600640 1 --2- 172.21.15.8:0/2072692936 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0cdcc0 0x7f685c0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:05.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f685be00640 1 -- 172.21.15.8:0/2072692936 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848032440 con 0x7f685c0ce0a0 2024-05-26T15:40:05.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f685be00640 1 -- 172.21.15.8:0/2072692936 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68480325a0 con 0x7f685c0ce0a0 2024-05-26T15:40:05.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f685be00640 1 -- 172.21.15.8:0/2072692936 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848032910 con 0x7f685c0ce0a0 2024-05-26T15:40:05.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f320f600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f320815ccf0 0x7f32080cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f320f600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32080d0020 0x7f32080d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f320f600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f32080d2900 0x7f32080d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.640+0000 7f6a45e00640 1 -- 172.21.15.8:0/420101972 >> v2:172.21.15.47:3300/0 conn(0x7f6a4815ccc0 msgr2=0x7f6a48161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.640+0000 7f6a45e00640 1 --2- 172.21.15.8:0/420101972 >> v2:172.21.15.47:3300/0 conn(0x7f6a4815ccc0 0x7f6a48161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.640+0000 7f6a45e00640 1 -- 172.21.15.8:0/420101972 >> v1:172.21.15.47:6789/0 conn(0x7f6a480d1a40 legacy=0x7f6a480cfad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-26T15:40:05.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.640+0000 7f6a45e00640 1 -- 172.21.15.8:0/420101972 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a480cdf10 con 0x7f6a480b5d00 2024-05-26T15:40:05.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f25e7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25e00061e0 0x7f25e00dc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f25e7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25e00061e0 0x7f25e00dc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47642/0 (socket says 172.21.15.8:47642) 2024-05-26T15:40:05.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f320cc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f320815ccf0 0x7f32080cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.642+0000 7f25e7e00640 1 -- 172.21.15.8:0/2101977568 learned_addr learned my addr 172.21.15.8:0/2101977568 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f25e7400640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e003d0d0 0x7f25e00e0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f6864000640 1 -- 172.21.15.8:0/2072692936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685c0ce0a0 msgr2=0x7f685c0cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f6864000640 1 --2- 172.21.15.8:0/2072692936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685c0ce0a0 0x7f685c0cb750 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6848009870 tx=0x7f684802a230 comp rx=0 tx=0).stop 2024-05-26T15:40:05.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f320f600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32080d04a0 con 0x7f32080d2900 2024-05-26T15:40:05.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f320f600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32080b5e30 con 0x7f320815ccf0 2024-05-26T15:40:05.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f25eca00640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e0053780 0x7f25e00e0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f6864000640 1 -- 172.21.15.8:0/2072692936 shutdown_connections 2024-05-26T15:40:05.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f6864000640 1 --2- 172.21.15.8:0/2072692936 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685c0ce0a0 0x7f685c0cb750 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f6864000640 1 --2- 172.21.15.8:0/2072692936 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0cdcc0 0x7f685c0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f6864000640 1 -- 172.21.15.8:0/2072692936 >> 172.21.15.8:0/2072692936 conn(0x7f685c0b0570 msgr2=0x7f685c0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f320cc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f320815ccf0 0x7f32080cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:37192/0 (socket says 172.21.15.8:37192) 2024-05-26T15:40:05.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f320cc00640 1 -- 172.21.15.8:0/2485089686 learned_addr learned my addr 172.21.15.8:0/2485089686 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f320f600640 1 -- 172.21.15.8:0/2485089686 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080d39d0 con 0x7f32080d0020 2024-05-26T15:40:05.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7fce75000640 1 -- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce7015b480 msgr2=0x7fce700b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f3207e00640 1 --2- 172.21.15.8:0/2485089686 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32080d0020 0x7f32080d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f320d600640 1 --2- 172.21.15.8:0/2485089686 >> v2:172.21.15.8:3300/0 conn(0x7f32080d2900 0x7f32080d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7fce75000640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce7015b480 0x7fce700b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7fce75000640 1 -- 172.21.15.8:0/3554668820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce70146de0 msgr2=0x7fce7015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7fce75000640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce70146de0 0x7fce7015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7fce75000640 1 -- 172.21.15.8:0/3554668820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce60009a70 con 0x7fce700b4ba0 2024-05-26T15:40:05.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.643+0000 7f6a45e00640 1 --2- 172.21.15.8:0/420101972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480b5d00 0x7f6a480b6190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a480d0f00 tx=0x7f6a4002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a9eea96641233f server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f6864000640 1 -- 172.21.15.8:0/2072692936 shutdown_connections 2024-05-26T15:40:05.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f25e7e00640 1 -- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e003d0d0 msgr2=0x7f25e00e0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f25e7e00640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e003d0d0 0x7f25e00e0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f25e7e00640 1 -- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e0053780 msgr2=0x7f25e00e0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f25e7e00640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e0053780 0x7f25e00e0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f25e7e00640 1 -- 172.21.15.8:0/2101977568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc009400 con 0x7f25e00061e0 2024-05-26T15:40:05.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f6864000640 1 -- 172.21.15.8:0/2072692936 wait complete. 2024-05-26T15:40:05.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7fce75000640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce700b4ba0 0x7fce700cc4a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce5800c440 tx=0x7fce5800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.645+0000 7fce6cc00640 1 -- 172.21.15.8:0/3554668820 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58005ce0 con 0x7fce700b4ba0 2024-05-26T15:40:05.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.645+0000 7fce6cc00640 1 -- 172.21.15.8:0/3554668820 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce58005e40 con 0x7fce700b4ba0 2024-05-26T15:40:05.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.645+0000 7fce76400640 1 -- 172.21.15.8:0/3554668820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce701fa5a0 con 0x7fce700b4ba0 2024-05-26T15:40:05.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.645+0000 7f6a45400640 1 -- 172.21.15.8:0/420101972 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40031600 con 0x7f6a480b5d00 2024-05-26T15:40:05.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.645+0000 7fce76400640 1 -- 172.21.15.8:0/3554668820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce701fab60 con 0x7fce700b4ba0 2024-05-26T15:40:05.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.645+0000 7f25e7e00640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25e00061e0 0x7f25e00dc940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f25dc000c00 tx=0x7f25dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.645+0000 7fce6cc00640 1 -- 172.21.15.8:0/3554668820 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce580072f0 con 0x7fce700b4ba0 2024-05-26T15:40:05.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f320cc00640 1 -- 172.21.15.8:0/2485089686 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32080d0020 msgr2=0x7f32080d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f320cc00640 1 --2- 172.21.15.8:0/2485089686 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32080d0020 0x7f32080d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f320cc00640 1 -- 172.21.15.8:0/2485089686 >> v2:172.21.15.8:3300/0 conn(0x7f32080d2900 msgr2=0x7f32080d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f320cc00640 1 --2- 172.21.15.8:0/2485089686 >> v2:172.21.15.8:3300/0 conn(0x7f32080d2900 0x7f32080d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.644+0000 7f320cc00640 1 -- 172.21.15.8:0/2485089686 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32080d3130 con 0x7f320815ccf0 2024-05-26T15:40:05.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.645+0000 7f6a45400640 1 -- 172.21.15.8:0/420101972 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4002d050 con 0x7f6a480b5d00 2024-05-26T15:40:05.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.645+0000 7f6a45400640 1 -- 172.21.15.8:0/420101972 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40031980 con 0x7f6a480b5d00 2024-05-26T15:40:05.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.646+0000 7f74d3200640 1 Processor -- start 2024-05-26T15:40:05.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.646+0000 7f74d3200640 1 -- start start 2024-05-26T15:40:05.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f320cc00640 1 --2- 172.21.15.8:0/2485089686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320815ccf0 0x7f32080cfae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f320806c4c0 tx=0x7f31fc02a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ed72af4452e4bef server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f6a4d400640 1 -- 172.21.15.8:0/420101972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480b5d00 msgr2=0x7f6a480b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f6a4d400640 1 --2- 172.21.15.8:0/420101972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480b5d00 0x7f6a480b6190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a480d0f00 tx=0x7f6a4002a710 comp rx=0 tx=0).stop 2024-05-26T15:40:05.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f25dbe00640 1 -- 172.21.15.8:0/2101977568 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc03d6f0 con 0x7f25e00061e0 2024-05-26T15:40:05.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f25dbe00640 1 -- 172.21.15.8:0/2101977568 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc03d870 con 0x7f25e00061e0 2024-05-26T15:40:05.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f25dbe00640 1 -- 172.21.15.8:0/2101977568 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc03dc20 con 0x7f25e00061e0 2024-05-26T15:40:05.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f25ed400640 1 -- 172.21.15.8:0/2101977568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e0051380 con 0x7f25e00061e0 2024-05-26T15:40:05.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f25ed400640 1 -- 172.21.15.8:0/2101977568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e0051940 con 0x7f25e00061e0 2024-05-26T15:40:05.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f3207400640 1 -- 172.21.15.8:0/2485089686 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc032440 con 0x7f320815ccf0 2024-05-26T15:40:05.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f3207400640 1 -- 172.21.15.8:0/2485089686 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc0325a0 con 0x7f320815ccf0 2024-05-26T15:40:05.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f3207400640 1 -- 172.21.15.8:0/2485089686 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc032970 con 0x7f320815ccf0 2024-05-26T15:40:05.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.648+0000 7f6864000640 1 Processor -- start 2024-05-26T15:40:05.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f6a4d400640 1 -- 172.21.15.8:0/420101972 shutdown_connections 2024-05-26T15:40:05.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f6a4d400640 1 --2- 172.21.15.8:0/420101972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a480b5d00 0x7f6a480b6190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f6a4d400640 1 --2- 172.21.15.8:0/420101972 >> v2:172.21.15.47:3300/0 conn(0x7f6a4815ccc0 0x7f6a48161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.647+0000 7f6a4d400640 1 -- 172.21.15.8:0/420101972 >> 172.21.15.8:0/420101972 conn(0x7f6a480719c0 msgr2=0x7f6a48071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.648+0000 7f320f600640 1 -- 172.21.15.8:0/2485089686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320815ccf0 msgr2=0x7f32080cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.648+0000 7f320f600640 1 --2- 172.21.15.8:0/2485089686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320815ccf0 0x7f32080cfae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f320806c4c0 tx=0x7f31fc02a1f0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.648+0000 7f6864000640 1 -- start start 2024-05-26T15:40:05.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f74d3200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f74cc0cdcc0 0x7f74cc0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7fce76400640 1 -- 172.21.15.8:0/3554668820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48005250 con 0x7fce700b4ba0 2024-05-26T15:40:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7fce6cc00640 1 -- 172.21.15.8:0/3554668820 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce58007450 con 0x7fce700b4ba0 2024-05-26T15:40:05.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f74d3200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f74cc0ce0a0 0x7f74cc0cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f320f600640 1 -- 172.21.15.8:0/2485089686 shutdown_connections 2024-05-26T15:40:05.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f320f600640 1 --2- 172.21.15.8:0/2485089686 >> v2:172.21.15.8:3300/0 conn(0x7f32080d2900 0x7f32080d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f320f600640 1 --2- 172.21.15.8:0/2485089686 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32080d0020 0x7f32080d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f320f600640 1 --2- 172.21.15.8:0/2485089686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f320815ccf0 0x7f32080cfae0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f320f600640 1 -- 172.21.15.8:0/2485089686 >> 172.21.15.8:0/2485089686 conn(0x7f3208071990 msgr2=0x7f3208071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f9f31200640 1 Processor -- start 2024-05-26T15:40:05.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.650+0000 7f9f31200640 1 -- start start 2024-05-26T15:40:05.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f6a4d400640 1 -- 172.21.15.8:0/420101972 shutdown_connections 2024-05-26T15:40:05.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.650+0000 7f320f600640 1 -- 172.21.15.8:0/2485089686 shutdown_connections 2024-05-26T15:40:05.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.650+0000 7f74d3200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc06e170 con 0x7f74cc161800 2024-05-26T15:40:05.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.650+0000 7f74d3200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc162550 con 0x7f74cc0cdcc0 2024-05-26T15:40:05.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.650+0000 7f74d3200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc164d10 con 0x7f74cc0ce0a0 2024-05-26T15:40:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.650+0000 7f320f600640 1 -- 172.21.15.8:0/2485089686 wait complete. 2024-05-26T15:40:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.650+0000 7f74d1200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f74cc161800 0x7f74cc161c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60458/0 (socket says 172.21.15.8:60458) 2024-05-26T15:40:05.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.650+0000 7f74d1200640 1 -- 172.21.15.8:0/2014602955 learned_addr learned my addr 172.21.15.8:0/2014602955 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f25ed400640 1 -- 172.21.15.8:0/2101977568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c4005250 con 0x7f25e00061e0 2024-05-26T15:40:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.649+0000 7f6a4d400640 1 -- 172.21.15.8:0/420101972 wait complete. 2024-05-26T15:40:05.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.650+0000 7f74cbe00640 1 --2- 172.21.15.8:0/2014602955 >> v2:172.21.15.8:3300/0 conn(0x7f74cc0cdcc0 0x7f74cc0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.651+0000 7fce6cc00640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce4c06ac00 0x7fce4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.651+0000 7f74cb400640 1 --2- 172.21.15.8:0/2014602955 >> v2:172.21.15.47:3300/0 conn(0x7f74cc0ce0a0 0x7f74cc0cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.651+0000 7fce6cc00640 1 -- 172.21.15.8:0/3554668820 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce58088bb0 con 0x7fce700b4ba0 2024-05-26T15:40:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.651+0000 7f25dbe00640 1 -- 172.21.15.8:0/2101977568 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25dc0453c0 con 0x7f25e00061e0 2024-05-26T15:40:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7fce6fe00640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce4c06ac00 0x7fce4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f74caa00640 1 -- 172.21.15.8:0/2014602955 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689350261 0 0) 0x7f74cc06e170 con 0x7f74cc161800 2024-05-26T15:40:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f74caa00640 1 -- 172.21.15.8:0/2014602955 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b0003520 con 0x7f74cc161800 2024-05-26T15:40:05.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f74cb400640 1 -- 172.21.15.8:0/2014602955 >> v2:172.21.15.8:3300/0 conn(0x7f74cc0cdcc0 msgr2=0x7f74cc0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f9f31200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9f2c0ceca0 0x7f9f2c0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f9f31200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c06b710 con 0x7f9f2c0b2e10 2024-05-26T15:40:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f9f31200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c0cf1c0 con 0x7f9f2c15cd10 2024-05-26T15:40:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f9f31200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2c0d0a70 con 0x7f9f2c0ceca0 2024-05-26T15:40:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f9f2b400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9f2c15cd10 0x7f9f2c0b2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:56306/0 (socket says 172.21.15.8:56306) 2024-05-26T15:40:05.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f9f2b400640 1 -- 172.21.15.8:0/3768065237 learned_addr learned my addr 172.21.15.8:0/3768065237 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:05.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.653+0000 7f9f2be00640 1 --2- 172.21.15.8:0/3768065237 >> v2:172.21.15.8:3300/0 conn(0x7f9f2c0ceca0 0x7f9f2c0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.653+0000 7f25dbe00640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f25c806ac50 0x7f25c806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.653+0000 7f25dbe00640 1 -- 172.21.15.8:0/2101977568 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25dc0aa2d0 con 0x7f25e00061e0 2024-05-26T15:40:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.651+0000 7f6864000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f685c0cdcc0 0x7f685c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.651+0000 7f6864000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0ce0a0 0x7f685c159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.651+0000 7f6864000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685c161800 0x7f685c159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.651+0000 7f6864000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c15a620 con 0x7f685c161800 2024-05-26T15:40:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.651+0000 7f6864000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c15a340 con 0x7f685c0cdcc0 2024-05-26T15:40:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.651+0000 7f6864000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c1f7e20 con 0x7f685c0ce0a0 2024-05-26T15:40:05.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f6860c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0ce0a0 0x7f685c159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f6860c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0ce0a0 0x7f685c159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52556/0 (socket says 172.21.15.8:52556) 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.652+0000 7f6860c00640 1 -- 172.21.15.8:0/405371245 learned_addr learned my addr 172.21.15.8:0/405371245 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.653+0000 7f6862000640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685c161800 0x7f685c159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.653+0000 7f6861600640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f685c0cdcc0 0x7f685c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.653+0000 7f6862000640 1 -- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0ce0a0 msgr2=0x7f685c159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.653+0000 7f6862000640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0ce0a0 0x7f685c159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.653+0000 7f6862000640 1 -- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f685c0cdcc0 msgr2=0x7f685c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.653+0000 7f6862000640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f685c0cdcc0 0x7f685c15f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.653+0000 7f6862000640 1 -- 172.21.15.8:0/405371245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68480094d0 con 0x7f685c161800 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.654+0000 7f6862000640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685c161800 0x7f685c159a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c410 tx=0x7f684c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.654+0000 7f6a4d400640 1 Processor -- start 2024-05-26T15:40:05.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.654+0000 7f74cb400640 1 --2- 172.21.15.8:0/2014602955 >> v2:172.21.15.8:3300/0 conn(0x7f74cc0cdcc0 0x7f74cc0cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.654+0000 7f74cb400640 1 -- 172.21.15.8:0/2014602955 >> v1:172.21.15.8:6789/0 conn(0x7f74cc161800 legacy=0x7f74cc161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.654+0000 7f74cb400640 1 -- 172.21.15.8:0/2014602955 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc0cd340 con 0x7f74cc0ce0a0 2024-05-26T15:40:05.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.654+0000 7f25e7400640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f25c806ac50 0x7f25c806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.654+0000 7f6a4d400640 1 -- start start 2024-05-26T15:40:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.654+0000 7f74cbe00640 1 --2- 172.21.15.8:0/2014602955 >> v2:172.21.15.8:3300/0 conn(0x7f74cc0cdcc0 0x7f74cc0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:40:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.654+0000 7fce6fe00640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce4c06ac00 0x7fce4c06d0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce700b3850 tx=0x7fce6002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.654+0000 7f320f600640 1 Processor -- start 2024-05-26T15:40:05.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.655+0000 7fe5a5000640 1 Processor -- start 2024-05-26T15:40:05.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.655+0000 7f320f600640 1 -- start start 2024-05-26T15:40:05.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.655+0000 7f25e7400640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f25c806ac50 0x7f25c806d110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f25e00520f0 tx=0x7f25d4007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.655+0000 7fe5a5000640 1 -- start start 2024-05-26T15:40:05.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.656+0000 7f74cb400640 1 --2- 172.21.15.8:0/2014602955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc0ce0a0 0x7f74cc0cb750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f74cc071690 tx=0x7f74b402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f255f13a0761ffa server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.655+0000 7f9f2be00640 1 -- 172.21.15.8:0/3768065237 >> v1:172.21.15.47:6789/0 conn(0x7f9f2c15cd10 legacy=0x7f9f2c0b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.655+0000 7f9f2be00640 1 -- 172.21.15.8:0/3768065237 >> v1:172.21.15.8:6789/0 conn(0x7f9f2c0b2e10 legacy=0x7f9f2c0ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.655+0000 7f9f2be00640 1 -- 172.21.15.8:0/3768065237 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0cf4a0 con 0x7f9f2c0ceca0 2024-05-26T15:40:05.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.656+0000 7f320f600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32080d0020 0x7f32080c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.656+0000 7f320f600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32080d2900 0x7f32080b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.656+0000 7f320f600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320815ccf0 0x7f3208152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.656+0000 7f320f600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080b37d0 con 0x7f320815ccf0 2024-05-26T15:40:05.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.656+0000 7f320f600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080b41a0 con 0x7f32080d2900 2024-05-26T15:40:05.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.656+0000 7f320f600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080b2c00 con 0x7f32080d0020 2024-05-26T15:40:05.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.656+0000 7f320d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320815ccf0 0x7f3208152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f320d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320815ccf0 0x7f3208152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47678/0 (socket says 172.21.15.8:47678) 2024-05-26T15:40:05.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f320d600640 1 -- 172.21.15.8:0/681892067 learned_addr learned my addr 172.21.15.8:0/681892067 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f6a4d400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a480b5d00 0x7f6a48159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f320cc00640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32080d0020 0x7f32080c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f3207e00640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32080d2900 0x7f32080b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f6a4d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a480d1a40 0x7f6a480c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f6a4d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4815ccc0 0x7f6a480c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f6a4d400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a480cb0f0 con 0x7f6a4815ccc0 2024-05-26T15:40:05.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f6a4d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a480cb3d0 con 0x7f6a480d1a40 2024-05-26T15:40:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f6a4d400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a480cb6b0 con 0x7f6a480b5d00 2024-05-26T15:40:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f6a45e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a480d1a40 0x7f6a480c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f6a45e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a480d1a40 0x7f6a480c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:37234/0 (socket says 172.21.15.8:37234) 2024-05-26T15:40:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f6a45e00640 1 -- 172.21.15.8:0/2426231795 learned_addr learned my addr 172.21.15.8:0/2426231795 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f6a46800640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a480b5d00 0x7f6a48159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f9f2be00640 1 --2- 172.21.15.8:0/3768065237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f2c0ceca0 0x7f9f2c0cb1e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009d90 tx=0x7f9f2402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30583e8721b9410 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f6a47200640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4815ccc0 0x7f6a480c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f6859600640 1 -- 172.21.15.8:0/405371245 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c011790 con 0x7f685c161800 2024-05-26T15:40:05.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f6859600640 1 -- 172.21.15.8:0/405371245 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c0118f0 con 0x7f685c161800 2024-05-26T15:40:05.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f6859600640 1 -- 172.21.15.8:0/405371245 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c011cc0 con 0x7f685c161800 2024-05-26T15:40:05.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7fe5a5000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe5a00d2670 0x7fe5a00d1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f6864000640 1 -- 172.21.15.8:0/405371245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c1f8100 con 0x7f685c161800 2024-05-26T15:40:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.657+0000 7f320d600640 1 -- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32080d0020 msgr2=0x7f32080c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f320d600640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32080d0020 0x7f32080c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f320d600640 1 -- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32080d2900 msgr2=0x7f32080b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f320d600640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32080d2900 0x7f32080b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f320d600640 1 -- 172.21.15.8:0/681892067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0094d0 con 0x7f320815ccf0 2024-05-26T15:40:05.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f9f2a000640 1 -- 172.21.15.8:0/3768065237 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24007740 con 0x7f9f2c0ceca0 2024-05-26T15:40:05.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f9f2a000640 1 -- 172.21.15.8:0/3768065237 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2402d050 con 0x7f9f2c0ceca0 2024-05-26T15:40:05.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f9f2a000640 1 -- 172.21.15.8:0/3768065237 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24007b00 con 0x7f9f2c0ceca0 2024-05-26T15:40:05.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7fe59de00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe5a00cd810 0x7fe5a00cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:56322/0 (socket says 172.21.15.8:56322) 2024-05-26T15:40:05.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7fe59de00640 1 -- 172.21.15.8:0/878303547 learned_addr learned my addr 172.21.15.8:0/878303547 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:05.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7f6a45e00640 1 -- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a480b5d00 msgr2=0x7f6a48159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7f6a45e00640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a480b5d00 0x7f6a48159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7f6a45e00640 1 -- 172.21.15.8:0/2426231795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4815ccc0 msgr2=0x7f6a480c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.658+0000 7f6864000640 1 -- 172.21.15.8:0/405371245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c159f90 con 0x7f685c161800 2024-05-26T15:40:05.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7f25dbe00640 1 -- 172.21.15.8:0/2101977568 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f25dc075470 con 0x7f25e00061e0 2024-05-26T15:40:05.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7fe5a5000640 1 -- 172.21.15.8:0/878303547 --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a00d2360 con 0x7fe5a00d0710 2024-05-26T15:40:05.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7fe5a5000640 1 -- 172.21.15.8:0/878303547 --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a00b8540 con 0x7fe5a00cd810 2024-05-26T15:40:05.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7fe5a5000640 1 -- 172.21.15.8:0/878303547 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a00d1990 con 0x7fe5a00d2670 2024-05-26T15:40:05.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7fe59e800640 1 --2- 172.21.15.8:0/878303547 >> v2:172.21.15.47:3300/0 conn(0x7fe5a00d2670 0x7fe5a00d1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7f6a45e00640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4815ccc0 0x7f6a480c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7f6a45e00640 1 -- 172.21.15.8:0/2426231795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a40009b30 con 0x7f6a480d1a40 2024-05-26T15:40:05.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7f6a47200640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4815ccc0 0x7f6a480c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:40:05.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7f9f31200640 1 -- 172.21.15.8:0/3768065237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f2c0ceca0 msgr2=0x7f9f2c0cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.659+0000 7f9f31200640 1 --2- 172.21.15.8:0/3768065237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f2c0ceca0 0x7f9f2c0cb1e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009d90 tx=0x7f9f2402a730 comp rx=0 tx=0).stop 2024-05-26T15:40:05.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7fe59ca00640 1 -- 172.21.15.8:0/878303547 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085527735 0 0) 0x7fe588001110 con 0x7fe5a00d0710 2024-05-26T15:40:05.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7f9f31200640 1 -- 172.21.15.8:0/3768065237 shutdown_connections 2024-05-26T15:40:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7fe59ca00640 1 -- 172.21.15.8:0/878303547 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe584003520 con 0x7fe5a00d0710 2024-05-26T15:40:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7f9f31200640 1 --2- 172.21.15.8:0/3768065237 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f2c0ceca0 0x7f9f2c0cb1e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7f9f31200640 1 -- 172.21.15.8:0/3768065237 >> 172.21.15.8:0/3768065237 conn(0x7f9f2c06a290 msgr2=0x7f9f2c06a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7f6864000640 1 -- 172.21.15.8:0/405371245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c1f8620 con 0x7f685c161800 2024-05-26T15:40:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7f9f31200640 1 -- 172.21.15.8:0/3768065237 shutdown_connections 2024-05-26T15:40:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7fe59e800640 1 -- 172.21.15.8:0/878303547 >> v1:172.21.15.47:6789/0 conn(0x7fe5a00cd810 legacy=0x7fe5a00cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7fe59e800640 1 -- 172.21.15.8:0/878303547 >> v1:172.21.15.8:6789/0 conn(0x7fe5a00d0710 legacy=0x7fe5a00b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7fe59e800640 1 -- 172.21.15.8:0/878303547 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00b8790 con 0x7fe5a00d2670 2024-05-26T15:40:05.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.661+0000 7f6859600640 1 -- 172.21.15.8:0/405371245 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f684c01c460 con 0x7f685c161800 2024-05-26T15:40:05.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.661+0000 7f320d600640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320815ccf0 0x7f3208152720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3200007e40 tx=0x7f320000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.660+0000 7f9f31200640 1 -- 172.21.15.8:0/3768065237 wait complete. 2024-05-26T15:40:05.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.661+0000 7f6a45e00640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a480d1a40 0x7f6a480c7bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a40000f80 tx=0x7f6a40004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.661+0000 7f3204c00640 1 -- 172.21.15.8:0/681892067 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200014620 con 0x7f320815ccf0 2024-05-26T15:40:05.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.662+0000 7fe59e800640 1 --2- 172.21.15.8:0/878303547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a00d2670 0x7fe5a00d1e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe598009d90 tx=0x7fe59802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc48e7393b69180a server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.662+0000 7f3204c00640 1 -- 172.21.15.8:0/681892067 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320000ee90 con 0x7f320815ccf0 2024-05-26T15:40:05.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.662+0000 7f320f600640 1 -- 172.21.15.8:0/681892067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32080c72e0 con 0x7f320815ccf0 2024-05-26T15:40:05.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.662+0000 7f6859600640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f683c06ac50 0x7f683c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.662+0000 7f6859600640 1 -- 172.21.15.8:0/405371245 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f684c089040 con 0x7f685c161800 2024-05-26T15:40:05.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.663+0000 7f9f31200640 1 Processor -- start 2024-05-26T15:40:05.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.663+0000 7f9f31200640 1 -- start start 2024-05-26T15:40:05.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.662+0000 7f320f600640 1 -- 172.21.15.8:0/681892067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32080b3180 con 0x7f320815ccf0 2024-05-26T15:40:05.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.662+0000 7f3204c00640 1 -- 172.21.15.8:0/681892067 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32000149e0 con 0x7f320815ccf0 2024-05-26T15:40:05.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.663+0000 7f6861600640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f683c06ac50 0x7f683c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.663+0000 7f320f600640 1 -- 172.21.15.8:0/681892067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e4005250 con 0x7f320815ccf0 2024-05-26T15:40:05.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.664+0000 7f6861600640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f683c06ac50 0x7f683c06d110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f685400f500 tx=0x7f6854007770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.665+0000 7f9f31200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c0b2e10 0x7f9f2c0b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.665+0000 7f9f31200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9f2c0ceca0 0x7f9f2c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.665+0000 7f9f31200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f2c15cd10 0x7f9f2c1f7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.666+0000 7f9f2b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c0b2e10 0x7f9f2c0b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.666+0000 7f9f2b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c0b2e10 0x7f9f2c0b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:37254/0 (socket says 172.21.15.8:37254) 2024-05-26T15:40:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.666+0000 7f9f2aa00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9f2c0ceca0 0x7f9f2c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.666+0000 7f9f2be00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f2c15cd10 0x7f9f2c1f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.666+0000 7f9f2b400640 1 -- 172.21.15.8:0/356593925 learned_addr learned my addr 172.21.15.8:0/356593925 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.666+0000 7f9f31200640 1 -- 172.21.15.8:0/356593925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c159310 con 0x7f9f2c15cd10 2024-05-26T15:40:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.666+0000 7f9f31200640 1 -- 172.21.15.8:0/356593925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0c7880 con 0x7f9f2c0b2e10 2024-05-26T15:40:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.666+0000 7f9f31200640 1 -- 172.21.15.8:0/356593925 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c1f7890 con 0x7f9f2c0ceca0 2024-05-26T15:40:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.667+0000 7f9f2be00640 1 -- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9f2c0ceca0 msgr2=0x7f9f2c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.667+0000 7f9f2be00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9f2c0ceca0 0x7f9f2c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.667+0000 7f9f2be00640 1 -- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c0b2e10 msgr2=0x7f9f2c0b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.667+0000 7f9f2be00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c0b2e10 0x7f9f2c0b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.667+0000 7f9f2be00640 1 -- 172.21.15.8:0/356593925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f24009a70 con 0x7f9f2c15cd10 2024-05-26T15:40:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.667+0000 7f9f2aa00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9f2c0ceca0 0x7f9f2c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:40:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.668+0000 7f9f2be00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f2c15cd10 0x7f9f2c1f7010 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9f24031000 tx=0x7f9f24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.669+0000 7f6859600640 1 -- 172.21.15.8:0/405371245 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f685c1f8620 con 0x7f685c161800 2024-05-26T15:40:05.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.670+0000 7f6a3ea00640 1 -- 172.21.15.8:0/2426231795 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40007c30 con 0x7f6a480d1a40 2024-05-26T15:40:05.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.670+0000 7f6a4d400640 1 -- 172.21.15.8:0/2426231795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a480cb990 con 0x7f6a480d1a40 2024-05-26T15:40:05.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.670+0000 7f6a3ea00640 1 -- 172.21.15.8:0/2426231795 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a40007db0 con 0x7f6a480d1a40 2024-05-26T15:40:05.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.670+0000 7f6a3ea00640 1 -- 172.21.15.8:0/2426231795 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4003d690 con 0x7f6a480d1a40 2024-05-26T15:40:05.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.670+0000 7f9f23400640 1 -- 172.21.15.8:0/356593925 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24031950 con 0x7f9f2c15cd10 2024-05-26T15:40:05.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.670+0000 7fe59ca00640 1 -- 172.21.15.8:0/878303547 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598007740 con 0x7fe5a00d2670 2024-05-26T15:40:05.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.671+0000 7fe59ca00640 1 -- 172.21.15.8:0/878303547 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59802d050 con 0x7fe5a00d2670 2024-05-26T15:40:05.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.671+0000 7fe59ca00640 1 -- 172.21.15.8:0/878303547 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598007ac0 con 0x7fe5a00d2670 2024-05-26T15:40:05.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.670+0000 7f9f23400640 1 -- 172.21.15.8:0/356593925 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24031ab0 con 0x7f9f2c15cd10 2024-05-26T15:40:05.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.670+0000 7f9f23400640 1 -- 172.21.15.8:0/356593925 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24031e40 con 0x7f9f2c15cd10 2024-05-26T15:40:05.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.670+0000 7f9f31200640 1 -- 172.21.15.8:0/356593925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c1f7b70 con 0x7f9f2c15cd10 2024-05-26T15:40:05.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.671+0000 7fce6cc00640 1 -- 172.21.15.8:0/3554668820 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fce58053ab0 con 0x7fce700b4ba0 2024-05-26T15:40:05.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.671+0000 7f74caa00640 1 -- 172.21.15.8:0/2014602955 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b402ae60 con 0x7f74cc0ce0a0 2024-05-26T15:40:05.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.671+0000 7f74caa00640 1 -- 172.21.15.8:0/2014602955 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b4032440 con 0x7f74cc0ce0a0 2024-05-26T15:40:05.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.671+0000 7f74caa00640 1 -- 172.21.15.8:0/2014602955 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b40327d0 con 0x7f74cc0ce0a0 2024-05-26T15:40:05.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.671+0000 7f6a4d400640 1 -- 172.21.15.8:0/2426231795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a48158ea0 con 0x7f6a480d1a40 2024-05-26T15:40:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.672+0000 7fe5a5000640 1 -- 172.21.15.8:0/878303547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a00d2670 msgr2=0x7fe5a00d1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.672+0000 7fe5a5000640 1 --2- 172.21.15.8:0/878303547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a00d2670 0x7fe5a00d1e20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe598009d90 tx=0x7fe59802a6f0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.673+0000 7f9f31200640 1 -- 172.21.15.8:0/356593925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c0c7a90 con 0x7f9f2c15cd10 2024-05-26T15:40:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.674+0000 7fe5a5000640 1 -- 172.21.15.8:0/878303547 shutdown_connections 2024-05-26T15:40:05.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.674+0000 7fe5a5000640 1 --2- 172.21.15.8:0/878303547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a00d2670 0x7fe5a00d1e20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.674+0000 7fe5a5000640 1 -- 172.21.15.8:0/878303547 >> 172.21.15.8:0/878303547 conn(0x7fe5a00719c0 msgr2=0x7fe5a0071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.672+0000 7f74d3200640 1 -- 172.21.15.8:0/2014602955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc0ce0a0 msgr2=0x7f74cc0cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.672+0000 7f74d3200640 1 --2- 172.21.15.8:0/2014602955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc0ce0a0 0x7f74cc0cb750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f74cc071690 tx=0x7f74b402a110 comp rx=0 tx=0).stop 2024-05-26T15:40:05.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.675+0000 7f74d3200640 1 -- 172.21.15.8:0/2014602955 shutdown_connections 2024-05-26T15:40:05.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.675+0000 7f74d3200640 1 --2- 172.21.15.8:0/2014602955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc0ce0a0 0x7f74cc0cb750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.675+0000 7f74d3200640 1 --2- 172.21.15.8:0/2014602955 >> v2:172.21.15.8:3300/0 conn(0x7f74cc0cdcc0 0x7f74cc0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.675+0000 7f74d3200640 1 -- 172.21.15.8:0/2014602955 >> 172.21.15.8:0/2014602955 conn(0x7f74cc0b0570 msgr2=0x7f74cc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:05.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.673+0000 7f6a4d400640 1 -- 172.21.15.8:0/2426231795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a480cbbd0 con 0x7f6a480d1a40 2024-05-26T15:40:05.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.675+0000 7f6a3ea00640 1 -- 172.21.15.8:0/2426231795 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a4003d7f0 con 0x7f6a480d1a40 2024-05-26T15:40:05.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.675+0000 7f74d3200640 1 -- 172.21.15.8:0/2014602955 shutdown_connections 2024-05-26T15:40:05.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.675+0000 7f74d3200640 1 -- 172.21.15.8:0/2014602955 wait complete. 2024-05-26T15:40:05.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.674+0000 7f3204c00640 1 -- 172.21.15.8:0/681892067 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3200014b40 con 0x7f320815ccf0 2024-05-26T15:40:05.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.675+0000 7fe5a5000640 1 -- 172.21.15.8:0/878303547 shutdown_connections 2024-05-26T15:40:05.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.675+0000 7f9f20c00640 1 -- 172.21.15.8:0/356593925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c0c7c80 con 0x7f9f2c15cd10 2024-05-26T15:40:05.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.675+0000 7fe5a5000640 1 -- 172.21.15.8:0/878303547 wait complete. 2024-05-26T15:40:05.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.676+0000 7f3204c00640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f31e806acd0 0x7f31e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.676+0000 7f3204c00640 1 -- 172.21.15.8:0/681892067 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f320008ade0 con 0x7f320815ccf0 2024-05-26T15:40:05.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.677+0000 7f6a3ea00640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a2806ac30 0x7f6a2806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.677+0000 7f6a3ea00640 1 -- 172.21.15.8:0/2426231795 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6a400aa2e0 con 0x7f6a480d1a40 2024-05-26T15:40:05.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.678+0000 7fe5a5000640 1 Processor -- start 2024-05-26T15:40:05.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.678+0000 7f6a46800640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a2806ac30 0x7f6a2806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.679+0000 7f74d3200640 1 Processor -- start 2024-05-26T15:40:05.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.679+0000 7fe5a5000640 1 -- start start 2024-05-26T15:40:05.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.679+0000 7f6a46800640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a2806ac30 0x7f6a2806d0f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6a380098e0 tx=0x7f6a38009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.678+0000 7f320cc00640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f31e806acd0 0x7f31e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.679+0000 7f74d3200640 1 -- start start 2024-05-26T15:40:05.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.681+0000 7f74d3200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74cc0cdcc0 0x7f74cc0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.681+0000 7f9f23400640 1 -- 172.21.15.8:0/356593925 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9f2403c420 con 0x7f9f2c15cd10 2024-05-26T15:40:05.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.681+0000 7f74d3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74cc0ce0a0 0x7f74cc0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.681+0000 7f3204c00640 1 -- 172.21.15.8:0/681892067 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3200055d60 con 0x7f320815ccf0 2024-05-26T15:40:05.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.681+0000 7f74d3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc161800 0x7f74cc0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7f74d3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1fa980 con 0x7f74cc0ce0a0 2024-05-26T15:40:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7fe5a5000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5a00cd810 0x7fe5a0156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7fe5a5000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a00d2670 0x7fe5a00c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7fe5a5000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5a00b2630 0x7fe5a00c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7f320cc00640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f31e806acd0 0x7f31e806d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f31fc034000 tx=0x7f31fc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7f74d3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc15c0b0 con 0x7f74cc161800 2024-05-26T15:40:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7f74d3200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1f9d00 con 0x7f74cc0cdcc0 2024-05-26T15:40:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7f74d1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc161800 0x7f74cc0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7f74d1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc161800 0x7f74cc0708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:37262/0 (socket says 172.21.15.8:37262) 2024-05-26T15:40:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7f74d1200640 1 -- 172.21.15.8:0/2951091558 learned_addr learned my addr 172.21.15.8:0/2951091558 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7fe5a5000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a0156870 con 0x7fe5a00cd810 2024-05-26T15:40:05.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.682+0000 7f9f23400640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9f0c06ac50 0x7f9f0c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7fe5a5000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00c8550 con 0x7fe5a00d2670 2024-05-26T15:40:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7f9f23400640 1 -- 172.21.15.8:0/356593925 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f240ab200 con 0x7f9f2c15cd10 2024-05-26T15:40:05.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7fe5a5000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a01f27c0 con 0x7fe5a00b2630 2024-05-26T15:40:05.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7f74cbe00640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74cc0cdcc0 0x7f74cc0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7fe59e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5a00b2630 0x7fe5a00c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7fe59de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5a00cd810 0x7fe5a0156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7f74cb400640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74cc0ce0a0 0x7f74cc0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7f9f2b400640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9f0c06ac50 0x7f9f0c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7fe59d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a00d2670 0x7fe5a00c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7fe59d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a00d2670 0x7fe5a00c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:37264/0 (socket says 172.21.15.8:37264) 2024-05-26T15:40:05.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.683+0000 7fe59d400640 1 -- 172.21.15.8:0/2746556120 learned_addr learned my addr 172.21.15.8:0/2746556120 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7f74d1200640 1 -- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74cc0cdcc0 msgr2=0x7f74cc0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7f74d1200640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74cc0cdcc0 0x7f74cc0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7f74d1200640 1 -- 172.21.15.8:0/2951091558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74cc0ce0a0 msgr2=0x7f74cc0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7f74d1200640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74cc0ce0a0 0x7f74cc0b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7f74d1200640 1 -- 172.21.15.8:0/2951091558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4009a70 con 0x7f74cc161800 2024-05-26T15:40:05.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7f74cb400640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74cc0ce0a0 0x7f74cc0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:40:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7fe59e800640 1 -- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a00d2670 msgr2=0x7fe5a00c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7fe59e800640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a00d2670 0x7fe5a00c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7fe59e800640 1 -- 172.21.15.8:0/2746556120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5a00cd810 msgr2=0x7fe5a0156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7fe59e800640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5a00cd810 0x7fe5a0156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.684+0000 7fe59e800640 1 -- 172.21.15.8:0/2746556120 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598009a70 con 0x7fe5a00b2630 2024-05-26T15:40:05.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.685+0000 7f9f2b400640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9f0c06ac50 0x7f9f0c06d110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c005880 tx=0x7f9f1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.685+0000 7f74d1200640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc161800 0x7f74cc0708d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00c430 tx=0x7f74bc00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.685+0000 7fe59e800640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5a00b2630 0x7fe5a00c88d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe598031000 tx=0x7fe598004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.686+0000 7f9f23400640 1 -- 172.21.15.8:0/356593925 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9f24076330 con 0x7f9f2c15cd10 2024-05-26T15:40:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.689+0000 7fe596000640 1 -- 172.21.15.8:0/2746556120 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598031950 con 0x7fe5a00b2630 2024-05-26T15:40:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.689+0000 7fe596000640 1 -- 172.21.15.8:0/2746556120 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe598031af0 con 0x7fe5a00b2630 2024-05-26T15:40:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.689+0000 7fe596000640 1 -- 172.21.15.8:0/2746556120 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598031ea0 con 0x7fe5a00b2630 2024-05-26T15:40:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.689+0000 7fe5a5000640 1 -- 172.21.15.8:0/2746556120 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a00c79d0 con 0x7fe5a00b2630 2024-05-26T15:40:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.689+0000 7fe5a5000640 1 -- 172.21.15.8:0/2746556120 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a00c7f90 con 0x7fe5a00b2630 2024-05-26T15:40:05.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.690+0000 7fe5a5000640 1 -- 172.21.15.8:0/2746556120 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a00672c0 con 0x7fe5a00b2630 2024-05-26T15:40:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.691+0000 7f74c3e00640 1 -- 172.21.15.8:0/2951091558 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc005ce0 con 0x7f74cc161800 2024-05-26T15:40:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.691+0000 7f74c3e00640 1 -- 172.21.15.8:0/2951091558 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74bc005e40 con 0x7f74cc161800 2024-05-26T15:40:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.691+0000 7f74c3e00640 1 -- 172.21.15.8:0/2951091558 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74bc007310 con 0x7f74cc161800 2024-05-26T15:40:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.692+0000 7f6a3ea00640 1 -- 172.21.15.8:0/2426231795 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6a480cbbd0 con 0x7f6a480d1a40 2024-05-26T15:40:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.692+0000 7f74d3200640 1 -- 172.21.15.8:0/2951091558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b4009400 con 0x7f74cc161800 2024-05-26T15:40:05.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.693+0000 7f74d3200640 1 -- 172.21.15.8:0/2951091558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc1fa2c0 con 0x7f74cc161800 2024-05-26T15:40:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.694+0000 7fe596000640 1 -- 172.21.15.8:0/2746556120 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe59803b410 con 0x7fe5a00b2630 2024-05-26T15:40:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.694+0000 7f74d3200640 1 -- 172.21.15.8:0/2951091558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc0ab920 con 0x7f74cc161800 2024-05-26T15:40:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.696+0000 7fe596000640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06acd0 0x7fe57c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.696+0000 7fe596000640 1 -- 172.21.15.8:0/2746556120 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5980ab070 con 0x7fe5a00b2630 2024-05-26T15:40:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.697+0000 7f74c3e00640 1 -- 172.21.15.8:0/2951091558 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f74bc007470 con 0x7f74cc161800 2024-05-26T15:40:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.697+0000 7fe59de00640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06acd0 0x7fe57c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.698+0000 7f74c3e00640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f74a806ac50 0x7f74a806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.699+0000 7fe59de00640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06acd0 0x7fe57c06d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe590005880 tx=0x7fe590009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.699+0000 7f74c3e00640 1 -- 172.21.15.8:0/2951091558 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f74bc088ae0 con 0x7f74cc161800 2024-05-26T15:40:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.699+0000 7f74cbe00640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f74a806ac50 0x7f74a806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.701+0000 7f74cbe00640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f74a806ac50 0x7f74a806d110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f74c4007560 tx=0x7f74c400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:05.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.710+0000 7fe596000640 1 -- 172.21.15.8:0/2746556120 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe598075fd0 con 0x7fe5a00b2630 2024-05-26T15:40:05.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:05.713+0000 7f74c3e00640 1 -- 172.21.15.8:0/2951091558 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f74bc053bf0 con 0x7f74cc161800 2024-05-26T15:40:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.098+0000 7f320f600640 1 -- 172.21.15.8:0/681892067 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f31e40057d0 con 0x7f320815ccf0 2024-05-26T15:40:06.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.099+0000 7f3204c00640 1 -- 172.21.15.8:0/681892067 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3200059380 con 0x7f320815ccf0 2024-05-26T15:40:06.097 INFO:teuthology.orchestra.run.smithi008.stdout:55834574857 2024-05-26T15:40:06.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.100+0000 7fce76400640 1 -- 172.21.15.8:0/3554668820 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fce48005500 con 0x7fce700b4ba0 2024-05-26T15:40:06.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.102+0000 7fce6cc00640 1 -- 172.21.15.8:0/3554668820 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce58017090 con 0x7fce700b4ba0 2024-05-26T15:40:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.102+0000 7f25ed400640 1 -- 172.21.15.8:0/2101977568 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25c40050c0 con 0x7f25e00061e0 2024-05-26T15:40:06.101 INFO:teuthology.orchestra.run.smithi008.stdout:55834574859 2024-05-26T15:40:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.103+0000 7f320f600640 1 -- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f31e806acd0 msgr2=0x7f31e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.103+0000 7f320f600640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f31e806acd0 0x7f31e806d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f31fc034000 tx=0x7f31fc02e000 comp rx=0 tx=0).stop 2024-05-26T15:40:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.103+0000 7f25dbe00640 1 -- 172.21.15.8:0/2101977568 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25dc078a90 con 0x7f25e00061e0 2024-05-26T15:40:06.102 INFO:teuthology.orchestra.run.smithi008.stdout:55834574858 2024-05-26T15:40:06.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.103+0000 7f320f600640 1 -- 172.21.15.8:0/681892067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320815ccf0 msgr2=0x7f3208152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.103+0000 7f320f600640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320815ccf0 0x7f3208152720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3200007e40 tx=0x7f320000e4b0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.104+0000 7f320f600640 1 -- 172.21.15.8:0/681892067 shutdown_connections 2024-05-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.104+0000 7f320f600640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f320815ccf0 0x7f3208152720 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.104+0000 7f320f600640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f31e806acd0 0x7f31e806d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.104+0000 7f320f600640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32080d2900 0x7f32080b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.104+0000 7f320f600640 1 --2- 172.21.15.8:0/681892067 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32080d0020 0x7f32080c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.104+0000 7f320f600640 1 -- 172.21.15.8:0/681892067 >> 172.21.15.8:0/681892067 conn(0x7f3208071990 msgr2=0x7f320815c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.104+0000 7f320f600640 1 -- 172.21.15.8:0/681892067 shutdown_connections 2024-05-26T15:40:06.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.104+0000 7f320f600640 1 -- 172.21.15.8:0/681892067 wait complete. 2024-05-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.106+0000 7fce76400640 1 -- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce4c06ac00 msgr2=0x7fce4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.106+0000 7fce76400640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce4c06ac00 0x7fce4c06d0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce700b3850 tx=0x7fce6002f000 comp rx=0 tx=0).stop 2024-05-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.106+0000 7fce76400640 1 -- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce700b4ba0 msgr2=0x7fce700cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.106+0000 7fce76400640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce700b4ba0 0x7fce700cc4a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce5800c440 tx=0x7fce5800c900 comp rx=0 tx=0).stop 2024-05-26T15:40:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.107+0000 7fce76400640 1 -- 172.21.15.8:0/3554668820 shutdown_connections 2024-05-26T15:40:06.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.107+0000 7fce76400640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce7015b480 0x7fce700b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.107+0000 7fce76400640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce70146de0 0x7fce7015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.107+0000 7fce76400640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce4c06ac00 0x7fce4c06d0c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.107+0000 7fce76400640 1 --2- 172.21.15.8:0/3554668820 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce700b4ba0 0x7fce700cc4a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.107+0000 7fce76400640 1 -- 172.21.15.8:0/3554668820 >> 172.21.15.8:0/3554668820 conn(0x7fce70071bd0 msgr2=0x7fce700b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.107+0000 7f25ed400640 1 -- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f25c806ac50 msgr2=0x7f25c806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.107+0000 7f25ed400640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f25c806ac50 0x7f25c806d110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f25e00520f0 tx=0x7f25d4007d50 comp rx=0 tx=0).stop 2024-05-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.107+0000 7f25ed400640 1 -- 172.21.15.8:0/2101977568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25e00061e0 msgr2=0x7f25e00dc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.107+0000 7f25ed400640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25e00061e0 0x7f25e00dc940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f25dc000c00 tx=0x7f25dc0046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.108+0000 7fce76400640 1 -- 172.21.15.8:0/3554668820 shutdown_connections 2024-05-26T15:40:06.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.108+0000 7fce76400640 1 -- 172.21.15.8:0/3554668820 wait complete. 2024-05-26T15:40:06.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.109+0000 7f25ed400640 1 -- 172.21.15.8:0/2101977568 shutdown_connections 2024-05-26T15:40:06.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.109+0000 7f25ed400640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f25c806ac50 0x7f25c806d110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.109+0000 7f25ed400640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25e0053780 0x7f25e00e0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.109+0000 7f25ed400640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25e003d0d0 0x7f25e00e0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.109+0000 7f25ed400640 1 --2- 172.21.15.8:0/2101977568 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25e00061e0 0x7f25e00dc940 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.109+0000 7f25ed400640 1 -- 172.21.15.8:0/2101977568 >> 172.21.15.8:0/2101977568 conn(0x7f25e003aa10 msgr2=0x7f25e00049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:06.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.109+0000 7f25ed400640 1 -- 172.21.15.8:0/2101977568 shutdown_connections 2024-05-26T15:40:06.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.109+0000 7f25ed400640 1 -- 172.21.15.8:0/2101977568 wait complete. 2024-05-26T15:40:06.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.114+0000 7f9f20c00640 1 -- 172.21.15.8:0/356593925 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9f2c04e280 con 0x7f9f2c15cd10 2024-05-26T15:40:06.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.115+0000 7f9f23400640 1 -- 172.21.15.8:0/356593925 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f24079950 con 0x7f9f2c15cd10 2024-05-26T15:40:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.117+0000 7f6864000640 1 -- 172.21.15.8:0/405371245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f685c1f8620 con 0x7f685c161800 2024-05-26T15:40:06.117 INFO:teuthology.orchestra.run.smithi008.stdout:55834574858 2024-05-26T15:40:06.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.119+0000 7f6859600640 1 -- 172.21.15.8:0/405371245 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f685c1f8620 con 0x7f685c161800 2024-05-26T15:40:06.118 INFO:teuthology.orchestra.run.smithi008.stdout:55834574858 2024-05-26T15:40:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 -- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9f0c06ac50 msgr2=0x7f9f0c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9f0c06ac50 0x7f9f0c06d110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c005880 tx=0x7f9f1c009040 comp rx=0 tx=0).stop 2024-05-26T15:40:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 -- 172.21.15.8:0/356593925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f2c15cd10 msgr2=0x7f9f2c1f7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f2c15cd10 0x7f9f2c1f7010 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9f24031000 tx=0x7f9f24004a40 comp rx=0 tx=0).stop 2024-05-26T15:40:06.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 -- 172.21.15.8:0/356593925 shutdown_connections 2024-05-26T15:40:06.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f2c15cd10 0x7f9f2c1f7010 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9f2c0ceca0 0x7f9f2c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9f0c06ac50 0x7f9f0c06d110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 --2- 172.21.15.8:0/356593925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2c0b2e10 0x7f9f2c0b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 -- 172.21.15.8:0/356593925 >> 172.21.15.8:0/356593925 conn(0x7f9f2c06a290 msgr2=0x7f9f2c15f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:06.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 -- 172.21.15.8:0/356593925 shutdown_connections 2024-05-26T15:40:06.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.120+0000 7f9f20c00640 1 -- 172.21.15.8:0/356593925 wait complete. 2024-05-26T15:40:06.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.123+0000 7f6864000640 1 -- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f683c06ac50 msgr2=0x7f683c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.123+0000 7f6864000640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f683c06ac50 0x7f683c06d110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f685400f500 tx=0x7f6854007770 comp rx=0 tx=0).stop 2024-05-26T15:40:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.123+0000 7f6864000640 1 -- 172.21.15.8:0/405371245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685c161800 msgr2=0x7f685c159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.123+0000 7f6864000640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685c161800 0x7f685c159a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f684c00c410 tx=0x7f684c00c8d0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.124+0000 7f6864000640 1 -- 172.21.15.8:0/405371245 shutdown_connections 2024-05-26T15:40:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.124+0000 7f6864000640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f685c161800 0x7f685c159a50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.124+0000 7f6864000640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f685c0ce0a0 0x7f685c159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.124+0000 7f6864000640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f683c06ac50 0x7f683c06d110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.124+0000 7f6864000640 1 --2- 172.21.15.8:0/405371245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f685c0cdcc0 0x7f685c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.124+0000 7f6864000640 1 -- 172.21.15.8:0/405371245 >> 172.21.15.8:0/405371245 conn(0x7f685c0b0570 msgr2=0x7f685c0b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.124+0000 7f6864000640 1 -- 172.21.15.8:0/405371245 shutdown_connections 2024-05-26T15:40:06.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.124+0000 7f6864000640 1 -- 172.21.15.8:0/405371245 wait complete. 2024-05-26T15:40:06.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-05-26T15:40:06.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.135+0000 7f6a4d400640 1 -- 172.21.15.8:0/2426231795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6a480cbbd0 con 0x7f6a480d1a40 2024-05-26T15:40:06.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.136+0000 7f6a3ea00640 1 -- 172.21.15.8:0/2426231795 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a480cbbd0 con 0x7f6a480d1a40 2024-05-26T15:40:06.140 INFO:teuthology.orchestra.run.smithi008.stdout:55834574859 2024-05-26T15:40:06.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.0 2024-05-26T15:40:06.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.139+0000 7f6a4d400640 1 -- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a2806ac30 msgr2=0x7f6a2806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.139+0000 7f6a4d400640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a2806ac30 0x7f6a2806d0f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6a380098e0 tx=0x7f6a38009060 comp rx=0 tx=0).stop 2024-05-26T15:40:06.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.139+0000 7f6a4d400640 1 -- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a480d1a40 msgr2=0x7f6a480c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.139+0000 7f6a4d400640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a480d1a40 0x7f6a480c7bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a40000f80 tx=0x7f6a40004a40 comp rx=0 tx=0).stop 2024-05-26T15:40:06.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2024-05-26T15:40:06.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.139+0000 7f6a4d400640 1 -- 172.21.15.8:0/2426231795 shutdown_connections 2024-05-26T15:40:06.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.139+0000 7f6a4d400640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a4815ccc0 0x7f6a480c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.139+0000 7f6a4d400640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a2806ac30 0x7f6a2806d0f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.139+0000 7f6a4d400640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a480d1a40 0x7f6a480c7bf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.139+0000 7f6a4d400640 1 --2- 172.21.15.8:0/2426231795 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a480b5d00 0x7f6a48159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.139+0000 7f6a4d400640 1 -- 172.21.15.8:0/2426231795 >> 172.21.15.8:0/2426231795 conn(0x7f6a480719c0 msgr2=0x7f6a4815d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:06.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.140+0000 7f6a4d400640 1 -- 172.21.15.8:0/2426231795 shutdown_connections 2024-05-26T15:40:06.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.140+0000 7f6a4d400640 1 -- 172.21.15.8:0/2426231795 wait complete. 2024-05-26T15:40:06.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.142+0000 7fe5a5000640 1 -- 172.21.15.8:0/2746556120 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe5a01f2900 con 0x7fe5a00b2630 2024-05-26T15:40:06.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.142+0000 7fe596000640 1 -- 172.21.15.8:0/2746556120 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5980795f0 con 0x7fe5a00b2630 2024-05-26T15:40:06.144 INFO:teuthology.orchestra.run.smithi008.stdout:55834574857 2024-05-26T15:40:06.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.144+0000 7f74d3200640 1 -- 172.21.15.8:0/2951091558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f74cc0681d0 con 0x7f74cc161800 2024-05-26T15:40:06.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2024-05-26T15:40:06.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.145+0000 7f74c3e00640 1 -- 172.21.15.8:0/2951091558 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74bc057210 con 0x7f74cc161800 2024-05-26T15:40:06.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 -- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06acd0 msgr2=0x7fe57c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06acd0 0x7fe57c06d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe590005880 tx=0x7fe590009040 comp rx=0 tx=0).stop 2024-05-26T15:40:06.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 -- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5a00b2630 msgr2=0x7fe5a00c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5a00b2630 0x7fe5a00c88d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe598031000 tx=0x7fe598004a40 comp rx=0 tx=0).stop 2024-05-26T15:40:06.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 -- 172.21.15.8:0/2746556120 shutdown_connections 2024-05-26T15:40:06.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5a00b2630 0x7fe5a00c88d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06acd0 0x7fe57c06d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a00d2670 0x7fe5a00c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 --2- 172.21.15.8:0/2746556120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5a00cd810 0x7fe5a0156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 -- 172.21.15.8:0/2746556120 >> 172.21.15.8:0/2746556120 conn(0x7fe5a00719c0 msgr2=0x7fe5a00727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:06.147 INFO:teuthology.orchestra.run.smithi008.stdout:55834574858 2024-05-26T15:40:06.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 -- 172.21.15.8:0/2746556120 shutdown_connections 2024-05-26T15:40:06.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.146+0000 7fe5a5000640 1 -- 172.21.15.8:0/2746556120 wait complete. 2024-05-26T15:40:06.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.148+0000 7f74d3200640 1 -- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f74a806ac50 msgr2=0x7f74a806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.148+0000 7f74d3200640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f74a806ac50 0x7f74a806d110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f74c4007560 tx=0x7f74c400b040 comp rx=0 tx=0).stop 2024-05-26T15:40:06.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.148+0000 7f74d3200640 1 -- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc161800 msgr2=0x7f74cc0708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:06.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.148+0000 7f74d3200640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc161800 0x7f74cc0708d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f74bc00c430 tx=0x7f74bc00c8f0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-05-26T15:40:06.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.149+0000 7f74d3200640 1 -- 172.21.15.8:0/2951091558 shutdown_connections 2024-05-26T15:40:06.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.149+0000 7f74d3200640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f74a806ac50 0x7f74a806d110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.149+0000 7f74d3200640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74cc161800 0x7f74cc0708d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.149+0000 7f74d3200640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f74cc0ce0a0 0x7f74cc0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.149+0000 7f74d3200640 1 --2- 172.21.15.8:0/2951091558 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f74cc0cdcc0 0x7f74cc0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:06.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.149+0000 7f74d3200640 1 -- 172.21.15.8:0/2951091558 >> 172.21.15.8:0/2951091558 conn(0x7f74cc0b0570 msgr2=0x7f74cc0b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:06.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.149+0000 7f74d3200640 1 -- 172.21.15.8:0/2951091558 shutdown_connections 2024-05-26T15:40:06.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:06.149+0000 7f74d3200640 1 -- 172.21.15.8:0/2951091558 wait complete. 2024-05-26T15:40:06.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2024-05-26T15:40:06.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-05-26T15:40:06.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-05-26T15:40:07.132 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-26T15:40:07.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-26T15:40:07.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-26T15:40:07.146 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-26T15:40:07.149 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-26T15:40:07.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-26T15:40:07.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-26T15:40:07.168 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-26T15:40:07.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.427+0000 7f9211400640 1 Processor -- start 2024-05-26T15:40:07.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.428+0000 7f9211400640 1 -- start start 2024-05-26T15:40:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.430+0000 7f9211400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f920c153510 0x7f920c06e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.430+0000 7f9211400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f920c070660 0x7f920c070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.430+0000 7f9211400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f920c15a4d0 0x7f920c15a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.430+0000 7f9211400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920c071020 con 0x7f920c15a4d0 2024-05-26T15:40:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.430+0000 7f9211400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f920c06dc10 con 0x7f920c070660 2024-05-26T15:40:07.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.430+0000 7f9211400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c06def0 con 0x7f920c153510 2024-05-26T15:40:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.432+0000 7f920b200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f920c15a4d0 0x7f920c15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.432+0000 7f920b200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f920c15a4d0 0x7f920c15a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47720/0 (socket says 172.21.15.8:47720) 2024-05-26T15:40:07.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.432+0000 7f920b200640 1 -- 172.21.15.8:0/2464007035 learned_addr learned my addr 172.21.15.8:0/2464007035 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.433+0000 7f920b200640 1 -- 172.21.15.8:0/2464007035 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f920c153510 msgr2=0x7f920c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.433+0000 7f920b200640 1 --2- 172.21.15.8:0/2464007035 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f920c153510 0x7f920c06e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.433+0000 7f920b200640 1 -- 172.21.15.8:0/2464007035 >> v2:172.21.15.47:3300/0 conn(0x7f920c070660 msgr2=0x7f920c070ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-26T15:40:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.433+0000 7f920b200640 1 --2- 172.21.15.8:0/2464007035 >> v2:172.21.15.47:3300/0 conn(0x7f920c070660 0x7f920c070ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.433+0000 7f920b200640 1 -- 172.21.15.8:0/2464007035 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c06e1d0 con 0x7f920c15a4d0 2024-05-26T15:40:07.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.435+0000 7f920b200640 1 --2- 172.21.15.8:0/2464007035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c15a4d0 0x7f920c15a960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f920c06a7d0 tx=0x7f91fc02e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a56b80f5d437c6d server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.435+0000 7f9209400640 1 -- 172.21.15.8:0/2464007035 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc030040 con 0x7f920c15a4d0 2024-05-26T15:40:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.436+0000 7f9209400640 1 -- 172.21.15.8:0/2464007035 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc035780 con 0x7f920c15a4d0 2024-05-26T15:40:07.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.436+0000 7f9209400640 1 -- 172.21.15.8:0/2464007035 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc035b50 con 0x7f920c15a4d0 2024-05-26T15:40:07.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.437+0000 7f9211400640 1 -- 172.21.15.8:0/2464007035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c15a4d0 msgr2=0x7f920c15a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.437+0000 7f9211400640 1 --2- 172.21.15.8:0/2464007035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c15a4d0 0x7f920c15a960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f920c06a7d0 tx=0x7f91fc02e950 comp rx=0 tx=0).stop 2024-05-26T15:40:07.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.438+0000 7f9211400640 1 -- 172.21.15.8:0/2464007035 shutdown_connections 2024-05-26T15:40:07.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.438+0000 7f9211400640 1 --2- 172.21.15.8:0/2464007035 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c15a4d0 0x7f920c15a960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.438+0000 7f9211400640 1 --2- 172.21.15.8:0/2464007035 >> v2:172.21.15.47:3300/0 conn(0x7f920c070660 0x7f920c070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.438+0000 7f9211400640 1 --2- 172.21.15.8:0/2464007035 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f920c153510 0x7f920c06e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.438+0000 7f9211400640 1 -- 172.21.15.8:0/2464007035 >> 172.21.15.8:0/2464007035 conn(0x7f920c0b0ba0 msgr2=0x7f920c069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.438+0000 7f9211400640 1 -- 172.21.15.8:0/2464007035 shutdown_connections 2024-05-26T15:40:07.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.439+0000 7f9211400640 1 -- 172.21.15.8:0/2464007035 wait complete. 2024-05-26T15:40:07.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.442+0000 7f9211400640 1 Processor -- start 2024-05-26T15:40:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.442+0000 7f9211400640 1 -- start start 2024-05-26T15:40:07.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.444+0000 7f9211400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c070660 0x7f920c140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.445+0000 7f920a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c070660 0x7f920c140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.445+0000 7f920a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c070660 0x7f920c140130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47722/0 (socket says 172.21.15.8:47722) 2024-05-26T15:40:07.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.445+0000 7f9211400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f920c153510 0x7f920c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.445+0000 7f920a800640 1 -- 172.21.15.8:0/2009112008 learned_addr learned my addr 172.21.15.8:0/2009112008 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.446+0000 7f9211400640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f920c15a4d0 0x7f920c1e25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.446+0000 7f9209e00640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f920c153510 0x7f920c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.446+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c156570 con 0x7f920c070660 2024-05-26T15:40:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.447+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c140670 con 0x7f920c15a4d0 2024-05-26T15:40:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.447+0000 7f920b200640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f920c15a4d0 0x7f920c1e25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.447+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c14f800 con 0x7f920c153510 2024-05-26T15:40:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.449+0000 7f920a800640 1 -- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f920c153510 msgr2=0x7f920c1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.449+0000 7f920a800640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f920c153510 0x7f920c1538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.449+0000 7f920a800640 1 -- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f920c15a4d0 msgr2=0x7f920c1e25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.449+0000 7f920a800640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f920c15a4d0 0x7f920c1e25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.449+0000 7f920a800640 1 -- 172.21.15.8:0/2009112008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc008550 con 0x7f920c070660 2024-05-26T15:40:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.450+0000 7f920b200640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f920c15a4d0 0x7f920c1e25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:07.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.450+0000 7f920a800640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c070660 0x7f920c140130 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91f800b4a0 tx=0x7f91f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.451+0000 7f9202a00640 1 -- 172.21.15.8:0/2009112008 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8010610 con 0x7f920c070660 2024-05-26T15:40:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.451+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920c1558f0 con 0x7f920c070660 2024-05-26T15:40:07.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.451+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c155eb0 con 0x7f920c070660 2024-05-26T15:40:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.452+0000 7f9202a00640 1 -- 172.21.15.8:0/2009112008 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f8010770 con 0x7f920c070660 2024-05-26T15:40:07.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.453+0000 7f9202a00640 1 -- 172.21.15.8:0/2009112008 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8010610 con 0x7f920c070660 2024-05-26T15:40:07.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.454+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e4005250 con 0x7f920c070660 2024-05-26T15:40:07.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.464+0000 7f9202a00640 1 -- 172.21.15.8:0/2009112008 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91f80108e0 con 0x7f920c070660 2024-05-26T15:40:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.468+0000 7f9202a00640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f91ec06acc0 0x7f91ec06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.469+0000 7f9202a00640 1 -- 172.21.15.8:0/2009112008 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91f80891a0 con 0x7f920c070660 2024-05-26T15:40:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.470+0000 7f9202a00640 1 -- 172.21.15.8:0/2009112008 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f91f8054130 con 0x7f920c070660 2024-05-26T15:40:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.470+0000 7f9209e00640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f91ec06acc0 0x7f91ec06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.472+0000 7f9209e00640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f91ec06acc0 0x7f91ec06d180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f920c1599a0 tx=0x7f920400d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.478+0000 7fc1da200640 1 Processor -- start 2024-05-26T15:40:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.478+0000 7fc1da200640 1 -- start start 2024-05-26T15:40:07.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.480+0000 7fc1da200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc1d406a990 0x7fc1d40ade00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.480+0000 7fc1da200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1d4070f00 0x7fc1d41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.481+0000 7fc1da200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d4071340 con 0x7fc1d4158d10 2024-05-26T15:40:07.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.481+0000 7fc1da200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d40b3110 con 0x7fc1d406a990 2024-05-26T15:40:07.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.481+0000 7fc1da200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d415f6d0 con 0x7fc1d4070f00 2024-05-26T15:40:07.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.481+0000 7fc1d9800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc1d4158d10 0x7fc1d40b0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60480/0 (socket says 172.21.15.8:60480) 2024-05-26T15:40:07.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.481+0000 7fc1d9800640 1 -- 172.21.15.8:0/4218616467 learned_addr learned my addr 172.21.15.8:0/4218616467 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:07.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.482+0000 7fc1d8e00640 1 --2- 172.21.15.8:0/4218616467 >> v2:172.21.15.8:3300/0 conn(0x7fc1d406a990 0x7fc1d40ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.482+0000 7f01f9200640 1 Processor -- start 2024-05-26T15:40:07.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.483+0000 7fc1d8e00640 1 -- 172.21.15.8:0/4218616467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1d4070f00 msgr2=0x7fc1d41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:07.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.483+0000 7fc1d8e00640 1 --2- 172.21.15.8:0/4218616467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1d4070f00 0x7fc1d41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.483+0000 7fc1d3400640 1 -- 172.21.15.8:0/4218616467 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251040633 0 0) 0x7fc1d4071340 con 0x7fc1d4158d10 2024-05-26T15:40:07.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.483+0000 7f01f9200640 1 -- start start 2024-05-26T15:40:07.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.483+0000 7fc1d8e00640 1 -- 172.21.15.8:0/4218616467 >> v1:172.21.15.8:6789/0 conn(0x7fc1d4158d10 legacy=0x7fc1d40b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.483+0000 7fc1d8e00640 1 -- 172.21.15.8:0/4218616467 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d40b2490 con 0x7fc1d406a990 2024-05-26T15:40:07.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.484+0000 7f8943e00640 1 Processor -- start 2024-05-26T15:40:07.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.484+0000 7f8943e00640 1 -- start start 2024-05-26T15:40:07.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.485+0000 7f01f9200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f01ec005eb0 0x7f01ec0062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.485+0000 7f01f9200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 0x7f01ec006cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.485+0000 7f01f9200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec054300 con 0x7f01ec0eacd0 2024-05-26T15:40:07.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.485+0000 7f01f9200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec0536f0 con 0x7f01ec005eb0 2024-05-26T15:40:07.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.485+0000 7f01f9200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0539d0 con 0x7f01ec006830 2024-05-26T15:40:07.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.485+0000 7fc1d8e00640 1 --2- 172.21.15.8:0/4218616467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d406a990 0x7fc1d40ade00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009d90 tx=0x7fc1c402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302a53a9950ca033 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.485+0000 7f4558c00640 1 Processor -- start 2024-05-26T15:40:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.486+0000 7f01f3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 0x7f01ec006cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.486+0000 7f01f3400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f01ec0eacd0 0x7f01ec04fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:56338/0 (socket says 172.21.15.8:56338) 2024-05-26T15:40:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.486+0000 7f01f3400640 1 -- 172.21.15.8:0/3736428080 learned_addr learned my addr 172.21.15.8:0/3736428080 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.486+0000 7fc1d3400640 1 -- 172.21.15.8:0/4218616467 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4007740 con 0x7fc1d406a990 2024-05-26T15:40:07.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.486+0000 7fc1d3400640 1 -- 172.21.15.8:0/4218616467 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c402d050 con 0x7fc1d406a990 2024-05-26T15:40:07.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f01f2000640 1 -- 172.21.15.8:0/3736428080 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120335493 0 0) 0x7f01ec054300 con 0x7f01ec0eacd0 2024-05-26T15:40:07.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f01f2000640 1 -- 172.21.15.8:0/3736428080 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01dc003520 con 0x7f01ec0eacd0 2024-05-26T15:40:07.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.486+0000 7fc1d3400640 1 -- 172.21.15.8:0/4218616467 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4007ac0 con 0x7fc1d406a990 2024-05-26T15:40:07.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f8943e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f893c009d70 0x7f893c0e21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7fc1da200640 1 -- 172.21.15.8:0/4218616467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d406a990 msgr2=0x7fc1d40ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7fc1da200640 1 --2- 172.21.15.8:0/4218616467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d406a990 0x7fc1d40ade00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009d90 tx=0x7fc1c402a6f0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f01f3e00640 1 -- 172.21.15.8:0/3736428080 >> v2:172.21.15.47:3300/0 conn(0x7f01ec005eb0 msgr2=0x7f01ec0062f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:07.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f01f3e00640 1 --2- 172.21.15.8:0/3736428080 >> v2:172.21.15.47:3300/0 conn(0x7f01ec005eb0 0x7f01ec0062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f01f3e00640 1 -- 172.21.15.8:0/3736428080 >> v1:172.21.15.47:6789/0 conn(0x7f01ec0eacd0 legacy=0x7f01ec04fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f01f3e00640 1 -- 172.21.15.8:0/3736428080 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec053cb0 con 0x7f01ec006830 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f8943e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f893c0e3460 0x7f893c0e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f8943e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893c051e50 con 0x7f893c051660 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f8943e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893c0e2710 con 0x7f893c009d70 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f8943e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893c052130 con 0x7f893c0e3460 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f8942a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f893c009d70 0x7f893c0e21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f8942a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f893c009d70 0x7f893c0e21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47740/0 (socket says 172.21.15.8:47740) 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.487+0000 7f8942a00640 1 -- 172.21.15.8:0/2578207951 learned_addr learned my addr 172.21.15.8:0/2578207951 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.488+0000 7f8943400640 1 --2- 172.21.15.8:0/2578207951 >> v2:172.21.15.47:3300/0 conn(0x7f893c0e3460 0x7f893c0e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.488+0000 7f8942a00640 1 -- 172.21.15.8:0/2578207951 >> v2:172.21.15.47:3300/0 conn(0x7f893c0e3460 msgr2=0x7f893c0e38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.488+0000 7f8942a00640 1 --2- 172.21.15.8:0/2578207951 >> v2:172.21.15.47:3300/0 conn(0x7f893c0e3460 0x7f893c0e38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.488+0000 7f8942a00640 1 -- 172.21.15.8:0/2578207951 >> v1:172.21.15.47:6789/0 conn(0x7f893c051660 legacy=0x7f893c00a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.488+0000 7f8942a00640 1 -- 172.21.15.8:0/2578207951 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0e2c60 con 0x7f893c009d70 2024-05-26T15:40:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.486+0000 7f4558c00640 1 -- start start 2024-05-26T15:40:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.489+0000 7f4558c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d01f0 0x7f45540d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.489+0000 7f4558c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f45540d2900 0x7f45540b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.489+0000 7fc1da200640 1 -- 172.21.15.8:0/4218616467 shutdown_connections 2024-05-26T15:40:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.489+0000 7fc1da200640 1 --2- 172.21.15.8:0/4218616467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1d4070f00 0x7fc1d41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.489+0000 7fc1da200640 1 --2- 172.21.15.8:0/4218616467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d406a990 0x7fc1d40ade00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.489+0000 7fc1da200640 1 -- 172.21.15.8:0/4218616467 >> 172.21.15.8:0/4218616467 conn(0x7fc1d4069e70 msgr2=0x7fc1d406a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.489+0000 7f4558c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45540b5e30 con 0x7f455415ccf0 2024-05-26T15:40:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.489+0000 7f4558c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45540d39d0 con 0x7f45540d2900 2024-05-26T15:40:07.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.489+0000 7f4558c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45540d3130 con 0x7f45540d01f0 2024-05-26T15:40:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7fc1da200640 1 -- 172.21.15.8:0/4218616467 shutdown_connections 2024-05-26T15:40:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7f01f3e00640 1 --2- 172.21.15.8:0/3736428080 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 0x7f01ec006cc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f01e00097a0 tx=0x7f01e002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df3c7852f910b677 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7fa07ca00640 1 Processor -- start 2024-05-26T15:40:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7f4551400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d01f0 0x7f45540d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7f4551400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d01f0 0x7f45540d23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52656/0 (socket says 172.21.15.8:52656) 2024-05-26T15:40:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7f4551400640 1 -- 172.21.15.8:0/2139063805 learned_addr learned my addr 172.21.15.8:0/2139063805 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7f8942a00640 1 --2- 172.21.15.8:0/2578207951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c009d70 0x7f893c0e21d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f893c006b90 tx=0x7f893002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b0f0b1985429a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7fa07ca00640 1 -- start start 2024-05-26T15:40:07.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7f01f2000640 1 -- 172.21.15.8:0/3736428080 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0032440 con 0x7f01ec006830 2024-05-26T15:40:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7fc1da200640 1 -- 172.21.15.8:0/4218616467 wait complete. 2024-05-26T15:40:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7f4552800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f45540d2900 0x7f45540b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7f01f2000640 1 -- 172.21.15.8:0/3736428080 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e00325a0 con 0x7f01ec006830 2024-05-26T15:40:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f8941600640 1 -- 172.21.15.8:0/2578207951 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930032440 con 0x7f893c009d70 2024-05-26T15:40:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.490+0000 7f01f2000640 1 -- 172.21.15.8:0/3736428080 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0032950 con 0x7f01ec006830 2024-05-26T15:40:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f8941600640 1 -- 172.21.15.8:0/2578207951 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89300325a0 con 0x7f893c009d70 2024-05-26T15:40:07.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f8941600640 1 -- 172.21.15.8:0/2578207951 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930032930 con 0x7f893c009d70 2024-05-26T15:40:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f4551400640 1 -- 172.21.15.8:0/2139063805 >> v2:172.21.15.8:3300/0 conn(0x7f45540d2900 msgr2=0x7f45540b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f01f9200640 1 -- 172.21.15.8:0/3736428080 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 msgr2=0x7f01ec006cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f01f9200640 1 --2- 172.21.15.8:0/3736428080 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 0x7f01ec006cc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f01e00097a0 tx=0x7f01e002a1a0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f01f9200640 1 -- 172.21.15.8:0/3736428080 shutdown_connections 2024-05-26T15:40:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f01f9200640 1 --2- 172.21.15.8:0/3736428080 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 0x7f01ec006cc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f01f9200640 1 --2- 172.21.15.8:0/3736428080 >> v2:172.21.15.47:3300/0 conn(0x7f01ec005eb0 0x7f01ec0062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f01f9200640 1 -- 172.21.15.8:0/3736428080 >> 172.21.15.8:0/3736428080 conn(0x7f01ec009f80 msgr2=0x7f01ec00a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f01f9200640 1 -- 172.21.15.8:0/3736428080 shutdown_connections 2024-05-26T15:40:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f01f9200640 1 -- 172.21.15.8:0/3736428080 wait complete. 2024-05-26T15:40:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f8943e00640 1 -- 172.21.15.8:0/2578207951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c009d70 msgr2=0x7f893c0e21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f8943e00640 1 --2- 172.21.15.8:0/2578207951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c009d70 0x7f893c0e21d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f893c006b90 tx=0x7f893002a270 comp rx=0 tx=0).stop 2024-05-26T15:40:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f8943e00640 1 -- 172.21.15.8:0/2578207951 shutdown_connections 2024-05-26T15:40:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f8943e00640 1 --2- 172.21.15.8:0/2578207951 >> v2:172.21.15.47:3300/0 conn(0x7f893c0e3460 0x7f893c0e38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f8943e00640 1 --2- 172.21.15.8:0/2578207951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c009d70 0x7f893c0e21d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f8943e00640 1 -- 172.21.15.8:0/2578207951 >> 172.21.15.8:0/2578207951 conn(0x7f893c053780 msgr2=0x7f893c053b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f8943e00640 1 -- 172.21.15.8:0/2578207951 shutdown_connections 2024-05-26T15:40:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f4551400640 1 --2- 172.21.15.8:0/2139063805 >> v2:172.21.15.8:3300/0 conn(0x7f45540d2900 0x7f45540b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f4551400640 1 -- 172.21.15.8:0/2139063805 >> v1:172.21.15.47:6789/0 conn(0x7f455415ccf0 legacy=0x7f45540cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f390d000640 1 Processor -- start 2024-05-26T15:40:07.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f390d000640 1 -- start start 2024-05-26T15:40:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7fa07ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa07815cf60 0x7fa0780d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7fa07ca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa0780b4d00 0x7fa0780b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7fa07ca00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780d2950 con 0x7fa0780d1410 2024-05-26T15:40:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.493+0000 7fa07ca00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780d2530 con 0x7fa07815cf60 2024-05-26T15:40:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.493+0000 7fa07ca00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780d18b0 con 0x7fa0780b4d00 2024-05-26T15:40:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.491+0000 7f4551400640 1 -- 172.21.15.8:0/2139063805 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45540d3410 con 0x7f45540d01f0 2024-05-26T15:40:07.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.492+0000 7f8943e00640 1 -- 172.21.15.8:0/2578207951 wait complete. 2024-05-26T15:40:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.493+0000 7f4552800640 1 --2- 172.21.15.8:0/2139063805 >> v2:172.21.15.8:3300/0 conn(0x7f45540d2900 0x7f45540b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.493+0000 7f4551400640 1 --2- 172.21.15.8:0/2139063805 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d01f0 0x7f45540d23c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a13ae635bef18ba server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.493+0000 7fa075400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa0780d1410 0x7fa0780b45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:56370/0 (socket says 172.21.15.8:56370) 2024-05-26T15:40:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.493+0000 7fa075400640 1 -- 172.21.15.8:0/3635775832 learned_addr learned my addr 172.21.15.8:0/3635775832 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:07.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.493+0000 7fa076800640 1 --2- 172.21.15.8:0/3635775832 >> v2:172.21.15.47:3300/0 conn(0x7fa0780b4d00 0x7fa0780b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7f8943e00640 1 Processor -- start 2024-05-26T15:40:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7fa075e00640 1 --2- 172.21.15.8:0/3635775832 >> v2:172.21.15.8:3300/0 conn(0x7fa07815cf60 0x7fa0780d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7f4550a00640 1 -- 172.21.15.8:0/2139063805 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c032440 con 0x7f45540d01f0 2024-05-26T15:40:07.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7f390d000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f390806d160 0x7f39080b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7f390d000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f390815d3f0 0x7f390815d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7fc1da200640 1 Processor -- start 2024-05-26T15:40:07.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7f8943e00640 1 -- start start 2024-05-26T15:40:07.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7f4550a00640 1 -- 172.21.15.8:0/2139063805 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c0325a0 con 0x7f45540d01f0 2024-05-26T15:40:07.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.495+0000 7f4550a00640 1 -- 172.21.15.8:0/2139063805 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c032930 con 0x7f45540d01f0 2024-05-26T15:40:07.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7f390d000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39080ae1c0 con 0x7f39080b1700 2024-05-26T15:40:07.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7f390d000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39080cc1f0 con 0x7f390815d3f0 2024-05-26T15:40:07.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7f390d000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390806e370 con 0x7f390806d160 2024-05-26T15:40:07.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.495+0000 7f3907e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f39080b1700 0x7f39080b1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60494/0 (socket says 172.21.15.8:60494) 2024-05-26T15:40:07.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.495+0000 7f3906a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f390815d3f0 0x7f390815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.495+0000 7f3907e00640 1 -- 172.21.15.8:0/2089254737 learned_addr learned my addr 172.21.15.8:0/2089254737 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:07.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.495+0000 7f3907400640 1 --2- 172.21.15.8:0/2089254737 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f390806d160 0x7f39080b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7f3906a00640 1 -- 172.21.15.8:0/2089254737 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f390806d160 msgr2=0x7f39080b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:07.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7f3906a00640 1 --2- 172.21.15.8:0/2089254737 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f390806d160 0x7f39080b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7f3906a00640 1 -- 172.21.15.8:0/2089254737 >> v1:172.21.15.8:6789/0 conn(0x7f39080b1700 legacy=0x7f39080b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:07.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7f3906a00640 1 -- 172.21.15.8:0/2089254737 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390815e320 con 0x7f390815d3f0 2024-05-26T15:40:07.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7f4558c00640 1 -- 172.21.15.8:0/2139063805 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d01f0 msgr2=0x7f45540d23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7f4558c00640 1 --2- 172.21.15.8:0/2139063805 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d01f0 0x7f45540d23c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c02a270 comp rx=0 tx=0).stop 2024-05-26T15:40:07.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7f8943e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f893c009d70 0x7f893c04f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7f8943e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c051660 0x7f893c02df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.494+0000 7fa074a00640 1 -- 172.21.15.8:0/3635775832 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953650964 0 0) 0x7fa0780d2950 con 0x7fa0780d1410 2024-05-26T15:40:07.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7fa074a00640 1 -- 172.21.15.8:0/3635775832 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa058003520 con 0x7fa0780d1410 2024-05-26T15:40:07.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7fa076800640 1 -- 172.21.15.8:0/3635775832 >> v2:172.21.15.8:3300/0 conn(0x7fa07815cf60 msgr2=0x7fa0780d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7fa076800640 1 --2- 172.21.15.8:0/3635775832 >> v2:172.21.15.8:3300/0 conn(0x7fa07815cf60 0x7fa0780d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7fa076800640 1 -- 172.21.15.8:0/3635775832 >> v1:172.21.15.47:6789/0 conn(0x7fa0780d1410 legacy=0x7fa0780b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.496+0000 7fa076800640 1 -- 172.21.15.8:0/3635775832 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780d1b90 con 0x7fa0780b4d00 2024-05-26T15:40:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.495+0000 7f01f9200640 1 Processor -- start 2024-05-26T15:40:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.495+0000 7f01f9200640 1 -- start start 2024-05-26T15:40:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f4558c00640 1 -- 172.21.15.8:0/2139063805 shutdown_connections 2024-05-26T15:40:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f4558c00640 1 --2- 172.21.15.8:0/2139063805 >> v2:172.21.15.8:3300/0 conn(0x7f45540d2900 0x7f45540b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f4558c00640 1 --2- 172.21.15.8:0/2139063805 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d01f0 0x7f45540d23c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f4558c00640 1 -- 172.21.15.8:0/2139063805 >> 172.21.15.8:0/2139063805 conn(0x7f4554071990 msgr2=0x7f4554071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f4558c00640 1 -- 172.21.15.8:0/2139063805 shutdown_connections 2024-05-26T15:40:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f8942a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f893c009d70 0x7f893c04f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f8942a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f893c009d70 0x7f893c04f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:37338/0 (socket says 172.21.15.8:37338) 2024-05-26T15:40:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f8942000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c051660 0x7f893c02df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f8942000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c051660 0x7f893c02df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47770/0 (socket says 172.21.15.8:47770) 2024-05-26T15:40:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f8942a00640 1 -- 172.21.15.8:0/2296987219 learned_addr learned my addr 172.21.15.8:0/2296987219 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f8943e00640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f893c0e3460 0x7f893c185790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f4558c00640 1 -- 172.21.15.8:0/2139063805 wait complete. 2024-05-26T15:40:07.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c0506c0 con 0x7f893c051660 2024-05-26T15:40:07.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893c04fab0 con 0x7f893c009d70 2024-05-26T15:40:07.509 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7fc1da200640 1 -- start start 2024-05-26T15:40:07.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.497+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893c04fd90 con 0x7f893c0e3460 2024-05-26T15:40:07.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f01f9200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ec005eb0 0x7f01ec0dff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7faeb4c00640 1 Processor -- start 2024-05-26T15:40:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f01f9200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 0x7f01ec006c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f01f9200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01ec0eacd0 0x7f01ec007150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f01f9200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec045020 con 0x7f01ec005eb0 2024-05-26T15:40:07.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7faeb4c00640 1 -- start start 2024-05-26T15:40:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f01f9200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0444a0 con 0x7f01ec0eacd0 2024-05-26T15:40:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f8943400640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f893c0e3460 0x7f893c185790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f8942000640 1 -- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f893c0e3460 msgr2=0x7f893c185790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f8942000640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f893c0e3460 0x7f893c185790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f8942000640 1 -- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f893c009d70 msgr2=0x7f893c04f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f8942000640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f893c009d70 0x7f893c04f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f8942000640 1 -- 172.21.15.8:0/2296987219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300094d0 con 0x7f893c051660 2024-05-26T15:40:07.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.498+0000 7f01f9200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec044780 con 0x7f01ec006830 2024-05-26T15:40:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f8942000640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c051660 0x7f893c02df70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f893400c390 tx=0x7f893400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f01f3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ec005eb0 0x7f01ec0dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f01f2a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 0x7f01ec006c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f01f2a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 0x7f01ec006c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52684/0 (socket says 172.21.15.8:52684) 2024-05-26T15:40:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f01f2a00640 1 -- 172.21.15.8:0/482213373 learned_addr learned my addr 172.21.15.8:0/482213373 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f3906a00640 1 --2- 172.21.15.8:0/2089254737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f390815d3f0 0x7f390815d850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097d0 tx=0x7f38f402a120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a78724ba94dec671 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f893aa00640 1 -- 172.21.15.8:0/2296987219 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89340052d0 con 0x7f893c051660 2024-05-26T15:40:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f01f3e00640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01ec0eacd0 0x7f01ec007150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7fa076800640 1 --2- 172.21.15.8:0/3635775832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0780b4d00 0x7fa0780b5ca0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa0780b2580 tx=0x7fa070032e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f21ea9372d77d963 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893c050070 con 0x7f893c051660 2024-05-26T15:40:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f893aa00640 1 -- 172.21.15.8:0/2296987219 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8934005430 con 0x7f893c051660 2024-05-26T15:40:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.499+0000 7f893aa00640 1 -- 172.21.15.8:0/2296987219 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934003830 con 0x7f893c051660 2024-05-26T15:40:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.500+0000 7f01f3400640 1 -- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 msgr2=0x7f01ec006c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.500+0000 7f01f3400640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 0x7f01ec006c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.500+0000 7f01f3400640 1 -- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01ec0eacd0 msgr2=0x7f01ec007150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.500+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893c02e4b0 con 0x7f893c051660 2024-05-26T15:40:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.500+0000 7f3906000640 1 -- 172.21.15.8:0/2089254737 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f402ae30 con 0x7f390815d3f0 2024-05-26T15:40:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.500+0000 7f3906000640 1 -- 172.21.15.8:0/2089254737 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f4032440 con 0x7f390815d3f0 2024-05-26T15:40:07.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.500+0000 7f3906000640 1 -- 172.21.15.8:0/2089254737 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40327d0 con 0x7f390815d3f0 2024-05-26T15:40:07.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.500+0000 7f4558c00640 1 Processor -- start 2024-05-26T15:40:07.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.500+0000 7f01f3400640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01ec0eacd0 0x7f01ec007150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.500+0000 7f01f3400640 1 -- 172.21.15.8:0/482213373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e0009400 con 0x7f01ec005eb0 2024-05-26T15:40:07.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7f4558c00640 1 -- start start 2024-05-26T15:40:07.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7faeb4c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faeb00b24a0 0x7faeb015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7faeb4c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7faeb00ce380 0x7faeb00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7faeb4c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb015b4e0 con 0x7faeb00b2880 2024-05-26T15:40:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7faeb4c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb015e710 con 0x7faeb00b24a0 2024-05-26T15:40:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7faeb4c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb015b780 con 0x7faeb00ce380 2024-05-26T15:40:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7f01f3400640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ec005eb0 0x7f01ec0dff50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01f402c970 tx=0x7f01f4067880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7fa074a00640 1 -- 172.21.15.8:0/3635775832 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa070033b50 con 0x7fa0780b4d00 2024-05-26T15:40:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7fa074a00640 1 -- 172.21.15.8:0/3635775832 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa070033cb0 con 0x7fa0780b4d00 2024-05-26T15:40:07.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7fa074a00640 1 -- 172.21.15.8:0/3635775832 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07003b660 con 0x7fa0780b4d00 2024-05-26T15:40:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7fc1da200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1d406a990 0x7fc1d415ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7fc1da200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d4070f00 0x7fc1d415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7fc1da200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1d4158d10 0x7fc1d415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7faeaea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7faeb00ce380 0x7faeb00ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7faeaea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7faeb00ce380 0x7faeb00ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:37360/0 (socket says 172.21.15.8:37360) 2024-05-26T15:40:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7faeaea00640 1 -- 172.21.15.8:0/317246537 learned_addr learned my addr 172.21.15.8:0/317246537 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7faeaf400640 1 --2- 172.21.15.8:0/317246537 >> v2:172.21.15.8:3300/0 conn(0x7faeb00b24a0 0x7faeb015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7f390d000640 1 -- 172.21.15.8:0/2089254737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f390815d3f0 msgr2=0x7f390815d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.501+0000 7f390d000640 1 --2- 172.21.15.8:0/2089254737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f390815d3f0 0x7f390815d850 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f38f40097d0 tx=0x7f38f402a120 comp rx=0 tx=0).stop 2024-05-26T15:40:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7f390d000640 1 -- 172.21.15.8:0/2089254737 shutdown_connections 2024-05-26T15:40:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7f390d000640 1 --2- 172.21.15.8:0/2089254737 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f390815d3f0 0x7f390815d850 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7f390d000640 1 --2- 172.21.15.8:0/2089254737 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f390806d160 0x7f39080b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7f390d000640 1 -- 172.21.15.8:0/2089254737 >> 172.21.15.8:0/2089254737 conn(0x7f3908069e70 msgr2=0x7f390806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7f390d000640 1 -- 172.21.15.8:0/2089254737 shutdown_connections 2024-05-26T15:40:07.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7faeaea00640 1 -- 172.21.15.8:0/317246537 >> v2:172.21.15.8:3300/0 conn(0x7faeb00b24a0 msgr2=0x7faeb015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:07.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7faeaea00640 1 --2- 172.21.15.8:0/317246537 >> v2:172.21.15.8:3300/0 conn(0x7faeb00b24a0 0x7faeb015afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7faeaea00640 1 -- 172.21.15.8:0/317246537 >> v1:172.21.15.8:6789/0 conn(0x7faeb00b2880 legacy=0x7faeb015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7f390d000640 1 -- 172.21.15.8:0/2089254737 wait complete. 2024-05-26T15:40:07.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7faeaea00640 1 -- 172.21.15.8:0/317246537 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb015ba60 con 0x7faeb00ce380 2024-05-26T15:40:07.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7fc1d8e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1d406a990 0x7fc1d415ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7fc1d8e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1d406a990 0x7fc1d415ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52690/0 (socket says 172.21.15.8:52690) 2024-05-26T15:40:07.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7fc1d3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d4070f00 0x7fc1d415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7fc1da200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d4144310 con 0x7fc1d4070f00 2024-05-26T15:40:07.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7fc1d8e00640 1 -- 172.21.15.8:0/3216912889 learned_addr learned my addr 172.21.15.8:0/3216912889 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d40a7930 con 0x7fc1d4158d10 2024-05-26T15:40:07.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d415c410 con 0x7fc1d406a990 2024-05-26T15:40:07.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893c007990 con 0x7f893c051660 2024-05-26T15:40:07.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.502+0000 7f893aa00640 1 -- 172.21.15.8:0/2296987219 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8934003990 con 0x7f893c051660 2024-05-26T15:40:07.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7f01e7400640 1 -- 172.21.15.8:0/482213373 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f4068230 con 0x7f01ec005eb0 2024-05-26T15:40:07.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.504+0000 7f4558c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540d01f0 0x7f455406fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.504+0000 7f4558c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d2900 0x7f45541ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.504+0000 7fc1d3e00640 1 -- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1d406a990 msgr2=0x7fc1d415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.504+0000 7fc1d3e00640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1d406a990 0x7fc1d415ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.504+0000 7fc1d3e00640 1 -- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1d4158d10 msgr2=0x7fc1d415a680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-26T15:40:07.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.504+0000 7fc1d3e00640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1d4158d10 0x7fc1d415a680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.504+0000 7fc1d3e00640 1 -- 172.21.15.8:0/3216912889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c4009a70 con 0x7fc1d4070f00 2024-05-26T15:40:07.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f4558c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455415ccf0 0x7f455406d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.504+0000 7f893aa00640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f892406ac00 0x7f892406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.504+0000 7f893aa00640 1 -- 172.21.15.8:0/2296987219 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8934088b00 con 0x7f893c051660 2024-05-26T15:40:07.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f390d000640 1 Processor -- start 2024-05-26T15:40:07.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f4558c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45541f6640 con 0x7f45540d01f0 2024-05-26T15:40:07.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f8942a00640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f892406ac00 0x7f892406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f4551400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d2900 0x7f45541ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f4551400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d2900 0x7f45541ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52694/0 (socket says 172.21.15.8:52694) 2024-05-26T15:40:07.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f4551400640 1 -- 172.21.15.8:0/84024163 learned_addr learned my addr 172.21.15.8:0/84024163 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45540caea0 con 0x7f455415ccf0 2024-05-26T15:40:07.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45541ffbb0 con 0x7f45540d2900 2024-05-26T15:40:07.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f390d000640 1 -- start start 2024-05-26T15:40:07.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.505+0000 7f4552800640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455415ccf0 0x7f455406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7f01e7400640 1 -- 172.21.15.8:0/482213373 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f406be90 con 0x7f01ec005eb0 2024-05-26T15:40:07.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7f01e7400640 1 -- 172.21.15.8:0/482213373 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f40723c0 con 0x7f01ec005eb0 2024-05-26T15:40:07.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7f01f9200640 1 -- 172.21.15.8:0/482213373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec044a60 con 0x7f01ec005eb0 2024-05-26T15:40:07.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.506+0000 7fc1d3e00640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d4070f00 0x7fc1d415a140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00b3f0 tx=0x7fc1cc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.503+0000 7f01f9200640 1 -- 172.21.15.8:0/482213373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec0e0490 con 0x7f01ec005eb0 2024-05-26T15:40:07.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.506+0000 7f8942a00640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f892406ac00 0x7f892406d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8930035040 tx=0x7f893002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.506+0000 7fa07ca00640 1 -- 172.21.15.8:0/3635775832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0780b4d00 msgr2=0x7fa0780b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f4551400640 1 -- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455415ccf0 msgr2=0x7f455406d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f4551400640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455415ccf0 0x7f455406d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7fa07ca00640 1 --2- 172.21.15.8:0/3635775832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0780b4d00 0x7fa0780b5ca0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa0780b2580 tx=0x7fa070032e00 comp rx=0 tx=0).stop 2024-05-26T15:40:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f4551400640 1 -- 172.21.15.8:0/84024163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540d01f0 msgr2=0x7f455406fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f4551400640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540d01f0 0x7f455406fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f4551400640 1 -- 172.21.15.8:0/84024163 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0094d0 con 0x7f45540d2900 2024-05-26T15:40:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f4552800640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455415ccf0 0x7f455406d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:40:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f390d000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f390806d160 0x7f39081539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f390d000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39080b1700 0x7f3908157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f390d000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390815d3f0 0x7f39080a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f390d000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3908156500 con 0x7f390815d3f0 2024-05-26T15:40:07.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f390d000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39081567e0 con 0x7f39080b1700 2024-05-26T15:40:07.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.507+0000 7f390d000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3908156ac0 con 0x7f390806d160 2024-05-26T15:40:07.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7faeaea00640 1 --2- 172.21.15.8:0/317246537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 0x7faeb00ce7f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faeb00b68f0 tx=0x7faea002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb6b7d790e4af398 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7f4551400640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d2900 0x7f45541ff670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f454c000c00 tx=0x7f454c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7fa07ca00640 1 -- 172.21.15.8:0/3635775832 shutdown_connections 2024-05-26T15:40:07.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7f3907e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390815d3f0 0x7f39080a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7f3907e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390815d3f0 0x7f39080a74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47812/0 (socket says 172.21.15.8:47812) 2024-05-26T15:40:07.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7f3907e00640 1 -- 172.21.15.8:0/830487481 learned_addr learned my addr 172.21.15.8:0/830487481 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7f3907400640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f390806d160 0x7f39081539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7f3906a00640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39080b1700 0x7f3908157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7fa07ca00640 1 --2- 172.21.15.8:0/3635775832 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0780b4d00 0x7fa0780b5ca0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7f01e7400640 1 -- 172.21.15.8:0/482213373 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f01f40923c0 con 0x7f01ec005eb0 2024-05-26T15:40:07.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7fa07ca00640 1 --2- 172.21.15.8:0/3635775832 >> v2:172.21.15.8:3300/0 conn(0x7fa07815cf60 0x7fa0780d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7fa07ca00640 1 -- 172.21.15.8:0/3635775832 >> 172.21.15.8:0/3635775832 conn(0x7fa078071c00 msgr2=0x7fa0780cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7fa07ca00640 1 -- 172.21.15.8:0/3635775832 shutdown_connections 2024-05-26T15:40:07.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7f3907e00640 1 -- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f390806d160 msgr2=0x7f39081539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7f3907e00640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f390806d160 0x7f39081539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7f3907e00640 1 -- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39080b1700 msgr2=0x7f3908157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7f3907e00640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39080b1700 0x7f3908157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7f3907e00640 1 -- 172.21.15.8:0/830487481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4009400 con 0x7f390815d3f0 2024-05-26T15:40:07.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7f01f9200640 1 -- 172.21.15.8:0/482213373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec17d120 con 0x7f01ec005eb0 2024-05-26T15:40:07.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7f454a000640 1 -- 172.21.15.8:0/84024163 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c032440 con 0x7f45540d2900 2024-05-26T15:40:07.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7f454a000640 1 -- 172.21.15.8:0/84024163 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c030b80 con 0x7f45540d2900 2024-05-26T15:40:07.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7f3907e00640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390815d3f0 0x7f39080a74b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f390000caa0 tx=0x7f390000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.508+0000 7fa07ca00640 1 -- 172.21.15.8:0/3635775832 wait complete. 2024-05-26T15:40:07.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45541ffe50 con 0x7f45540d2900 2024-05-26T15:40:07.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.510+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4554200410 con 0x7f45540d2900 2024-05-26T15:40:07.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.510+0000 7f454a000640 1 -- 172.21.15.8:0/84024163 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c03d440 con 0x7f45540d2900 2024-05-26T15:40:07.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.509+0000 7faeae000640 1 -- 172.21.15.8:0/317246537 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0032440 con 0x7faeb00ce380 2024-05-26T15:40:07.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.510+0000 7faeae000640 1 -- 172.21.15.8:0/317246537 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea00325a0 con 0x7faeb00ce380 2024-05-26T15:40:07.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.510+0000 7faeae000640 1 -- 172.21.15.8:0/317246537 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0032930 con 0x7faeb00ce380 2024-05-26T15:40:07.539 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.510+0000 7f01e7400640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f01d406ac50 0x7f01d406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7faeb4c00640 1 -- 172.21.15.8:0/317246537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 msgr2=0x7faeb00ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7faeb4c00640 1 --2- 172.21.15.8:0/317246537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 0x7faeb00ce7f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faeb00b68f0 tx=0x7faea002a270 comp rx=0 tx=0).stop 2024-05-26T15:40:07.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7f01e7400640 1 -- 172.21.15.8:0/482213373 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f01f40d1ad0 con 0x7f01ec005eb0 2024-05-26T15:40:07.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7faeb4c00640 1 -- 172.21.15.8:0/317246537 shutdown_connections 2024-05-26T15:40:07.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7faeb4c00640 1 --2- 172.21.15.8:0/317246537 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 0x7faeb00ce7f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7faeb4c00640 1 --2- 172.21.15.8:0/317246537 >> v2:172.21.15.8:3300/0 conn(0x7faeb00b24a0 0x7faeb015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7faeb4c00640 1 -- 172.21.15.8:0/317246537 >> 172.21.15.8:0/317246537 conn(0x7faeb006e7f0 msgr2=0x7faeb006ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7faeb4c00640 1 -- 172.21.15.8:0/317246537 shutdown_connections 2024-05-26T15:40:07.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7f01f2a00640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f01d406ac50 0x7f01d406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7faeb4c00640 1 -- 172.21.15.8:0/317246537 wait complete. 2024-05-26T15:40:07.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.511+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452c005250 con 0x7f45540d2900 2024-05-26T15:40:07.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.512+0000 7fa07ca00640 1 Processor -- start 2024-05-26T15:40:07.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.512+0000 7fa07ca00640 1 -- start start 2024-05-26T15:40:07.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.513+0000 7f01f2a00640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f01d406ac50 0x7f01d406d110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0398a0 tx=0x7f01e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.513+0000 7f38ff400640 1 -- 172.21.15.8:0/830487481 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390000ac00 con 0x7f390815d3f0 2024-05-26T15:40:07.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.513+0000 7f390d000640 1 -- 172.21.15.8:0/830487481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3908156da0 con 0x7f390815d3f0 2024-05-26T15:40:07.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.513+0000 7f893aa00640 1 -- 172.21.15.8:0/2296987219 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8934053ac0 con 0x7f893c051660 2024-05-26T15:40:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.513+0000 7f390d000640 1 -- 172.21.15.8:0/830487481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3908157360 con 0x7f390815d3f0 2024-05-26T15:40:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.513+0000 7faeb4c00640 1 Processor -- start 2024-05-26T15:40:07.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.513+0000 7faeb4c00640 1 -- start start 2024-05-26T15:40:07.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7fa07ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0780b4d00 0x7fa07814de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7fa07ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0780d1410 0x7fa0780c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7fa07ca00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa07815cf60 0x7fa07806b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7fa07ca00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c7130 con 0x7fa0780b4d00 2024-05-26T15:40:07.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7fa07ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c7410 con 0x7fa0780d1410 2024-05-26T15:40:07.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7fa07ca00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c76f0 con 0x7fa07815cf60 2024-05-26T15:40:07.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7faeb4c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faeb00b24a0 0x7faeb015d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7faeb4c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faeb00b2880 0x7faeb0145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7faeb4c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 0x7faeb0149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7f390d000640 1 -- 172.21.15.8:0/830487481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390804e280 con 0x7f390815d3f0 2024-05-26T15:40:07.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7faeb4c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb015c820 con 0x7faeb00b2880 2024-05-26T15:40:07.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7faeb4c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb014e230 con 0x7faeb00ce380 2024-05-26T15:40:07.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7faeb4c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb014df50 con 0x7faeb00b24a0 2024-05-26T15:40:07.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7fc1d0c00640 1 -- 172.21.15.8:0/3216912889 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc011830 con 0x7fc1d4070f00 2024-05-26T15:40:07.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d40ab3a0 con 0x7fc1d4070f00 2024-05-26T15:40:07.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d40a75c0 con 0x7fc1d4070f00 2024-05-26T15:40:07.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7fa075e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0780b4d00 0x7fa07814de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7fa075e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0780b4d00 0x7fa07814de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47822/0 (socket says 172.21.15.8:47822) 2024-05-26T15:40:07.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.514+0000 7f454a000640 1 -- 172.21.15.8:0/84024163 <== mon.2 v2:172.21.15.47:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f454c039040 con 0x7f45540d2900 2024-05-26T15:40:07.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7fa075e00640 1 -- 172.21.15.8:0/1456074974 learned_addr learned my addr 172.21.15.8:0/1456074974 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7faeaf400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faeb00b24a0 0x7faeb015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7fa076800640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa07815cf60 0x7fa07806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7faeafe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 0x7faeb0149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.516+0000 7fa075400640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0780d1410 0x7fa0780c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.516+0000 7faeafe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 0x7faeb0149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:37396/0 (socket says 172.21.15.8:37396) 2024-05-26T15:40:07.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.516+0000 7faeafe00640 1 -- 172.21.15.8:0/3075693383 learned_addr learned my addr 172.21.15.8:0/3075693383 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:07.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.515+0000 7f454a000640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f453406ac00 0x7f453406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.516+0000 7faeaea00640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faeb00b2880 0x7faeb0145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.516+0000 7f454a000640 1 -- 172.21.15.8:0/84024163 <== mon.2 v2:172.21.15.47:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f454c0aa320 con 0x7f45540d2900 2024-05-26T15:40:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.516+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d40a7ae0 con 0x7fc1d4070f00 2024-05-26T15:40:07.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7faeafe00640 1 -- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faeb00b24a0 msgr2=0x7faeb015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7faeafe00640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faeb00b24a0 0x7faeb015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7faeafe00640 1 -- 172.21.15.8:0/3075693383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faeb00b2880 msgr2=0x7faeb0145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7faeafe00640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faeb00b2880 0x7faeb0145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7faeafe00640 1 -- 172.21.15.8:0/3075693383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea00094d0 con 0x7faeb00ce380 2024-05-26T15:40:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7faeaf400640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faeb00b24a0 0x7faeb015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:40:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7f4551e00640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f453406ac00 0x7f453406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7fa075e00640 1 -- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa07815cf60 msgr2=0x7fa07806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7fa075e00640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa07815cf60 0x7fa07806b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7fa075e00640 1 -- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0780d1410 msgr2=0x7fa0780c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7fa075e00640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0780d1410 0x7fa0780c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7fa075e00640 1 -- 172.21.15.8:0/1456074974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070009a70 con 0x7fa0780b4d00 2024-05-26T15:40:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.517+0000 7faeafe00640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 0x7faeb0149080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae9800c3c0 tx=0x7fae9800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.518+0000 7fa075e00640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0780b4d00 0x7fa07814de80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa06800d800 tx=0x7fa06800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.518+0000 7faea7400640 1 -- 172.21.15.8:0/3075693383 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae980052d0 con 0x7faeb00ce380 2024-05-26T15:40:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.518+0000 7faea7400640 1 -- 172.21.15.8:0/3075693383 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae98005450 con 0x7faeb00ce380 2024-05-26T15:40:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.518+0000 7faea7400640 1 -- 172.21.15.8:0/3075693383 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae98007260 con 0x7faeb00ce380 2024-05-26T15:40:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.518+0000 7faeb4c00640 1 -- 172.21.15.8:0/3075693383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb015ca30 con 0x7faeb00ce380 2024-05-26T15:40:07.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.518+0000 7faeb4c00640 1 -- 172.21.15.8:0/3075693383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb015cff0 con 0x7faeb00ce380 2024-05-26T15:40:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.518+0000 7f4551e00640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f453406ac00 0x7f453406d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4540000f60 tx=0x7f45400079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.520+0000 7fc1d0c00640 1 -- 172.21.15.8:0/3216912889 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc011990 con 0x7fc1d4070f00 2024-05-26T15:40:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.520+0000 7fc1d0c00640 1 -- 172.21.15.8:0/3216912889 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc011d00 con 0x7fc1d4070f00 2024-05-26T15:40:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.520+0000 7fa06e000640 1 -- 172.21.15.8:0/1456074974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800b6c0 con 0x7fa0780b4d00 2024-05-26T15:40:07.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.520+0000 7fa07ca00640 1 -- 172.21.15.8:0/1456074974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0780c79d0 con 0x7fa0780b4d00 2024-05-26T15:40:07.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.520+0000 7faeb4c00640 1 -- 172.21.15.8:0/3075693383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb015d1e0 con 0x7faeb00ce380 2024-05-26T15:40:07.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.520+0000 7fa07ca00640 1 -- 172.21.15.8:0/1456074974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07814e3c0 con 0x7fa0780b4d00 2024-05-26T15:40:07.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.520+0000 7f38ff400640 1 -- 172.21.15.8:0/830487481 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900001b70 con 0x7f390815d3f0 2024-05-26T15:40:07.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.521+0000 7fa06e000640 1 -- 172.21.15.8:0/1456074974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06800b820 con 0x7fa0780b4d00 2024-05-26T15:40:07.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.521+0000 7f38ff400640 1 -- 172.21.15.8:0/830487481 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390001c440 con 0x7f390815d3f0 2024-05-26T15:40:07.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.521+0000 7fa06e000640 1 -- 172.21.15.8:0/1456074974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06800bb90 con 0x7fa0780b4d00 2024-05-26T15:40:07.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.523+0000 7f01e7400640 1 -- 172.21.15.8:0/482213373 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f01f408d070 con 0x7f01ec005eb0 2024-05-26T15:40:07.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.523+0000 7fa07ca00640 1 -- 172.21.15.8:0/1456074974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c005250 con 0x7fa0780b4d00 2024-05-26T15:40:07.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.523+0000 7faea7400640 1 -- 172.21.15.8:0/3075693383 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae980073c0 con 0x7faeb00ce380 2024-05-26T15:40:07.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.525+0000 7fa06e000640 1 -- 172.21.15.8:0/1456074974 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa06800bcf0 con 0x7fa0780b4d00 2024-05-26T15:40:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.524+0000 7f38ff400640 1 -- 172.21.15.8:0/830487481 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3900007070 con 0x7f390815d3f0 2024-05-26T15:40:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.525+0000 7f38ff400640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f38e806ac00 0x7f38e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.525+0000 7f38ff400640 1 -- 172.21.15.8:0/830487481 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f39000899c0 con 0x7f390815d3f0 2024-05-26T15:40:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.525+0000 7faea7400640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae8c06ac00 0x7fae8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.525+0000 7faea7400640 1 -- 172.21.15.8:0/3075693383 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae98089210 con 0x7faeb00ce380 2024-05-26T15:40:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.526+0000 7faeaf400640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae8c06ac00 0x7fae8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.526+0000 7f3907400640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f38e806ac00 0x7f38e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.527+0000 7fc1d0c00640 1 -- 172.21.15.8:0/3216912889 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc1cc01a400 con 0x7fc1d4070f00 2024-05-26T15:40:07.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.528+0000 7f454a000640 1 -- 172.21.15.8:0/84024163 <== mon.2 v2:172.21.15.47:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f454c0754a0 con 0x7f45540d2900 2024-05-26T15:40:07.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.528+0000 7fc1d0c00640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc1b006ac00 0x7fc1b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.529+0000 7faeaf400640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae8c06ac00 0x7fae8c06d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faeb015ac90 tx=0x7faea800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.527+0000 7fa06e000640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa05406ac30 0x7fa05406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.528+0000 7fa075400640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa05406ac30 0x7fa05406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.529+0000 7fc1d0c00640 1 -- 172.21.15.8:0/3216912889 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc1cc089b30 con 0x7fc1d4070f00 2024-05-26T15:40:07.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.529+0000 7fc1d8e00640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc1b006ac00 0x7fc1b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.529+0000 7f3907400640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f38e806ac00 0x7f38e806d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009b40 tx=0x7f38f8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.529+0000 7fa075400640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa05406ac30 0x7fa05406d0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa078067290 tx=0x7fa060009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.531+0000 7fc1d8e00640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc1b006ac00 0x7fc1b006d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4000f80 tx=0x7fc1c402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:07.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.531+0000 7fc1d0c00640 1 -- 172.21.15.8:0/3216912889 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc1cc054a00 con 0x7fc1d4070f00 2024-05-26T15:40:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.539+0000 7f38ff400640 1 -- 172.21.15.8:0/830487481 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3900054960 con 0x7f390815d3f0 2024-05-26T15:40:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.539+0000 7faea7400640 1 -- 172.21.15.8:0/3075693383 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fae98054190 con 0x7faeb00ce380 2024-05-26T15:40:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.539+0000 7fa06e000640 1 -- 172.21.15.8:0/1456074974 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa068058ea0 con 0x7fa0780b4d00 2024-05-26T15:40:07.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.551+0000 7fa06e000640 1 -- 172.21.15.8:0/1456074974 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa068054ae0 con 0x7fa0780b4d00 2024-05-26T15:40:07.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.908+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f91e40057d0 con 0x7f920c070660 2024-05-26T15:40:07.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.909+0000 7f9202a00640 1 -- 172.21.15.8:0/2009112008 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91f80092b0 con 0x7f920c070660 2024-05-26T15:40:07.908 INFO:teuthology.orchestra.run.smithi008.stdout:55834574858 2024-05-26T15:40:07.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.913+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f91ec06acc0 msgr2=0x7f91ec06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.913+0000 7f9211400640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f91ec06acc0 0x7f91ec06d180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f920c1599a0 tx=0x7f920400d040 comp rx=0 tx=0).stop 2024-05-26T15:40:07.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.913+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c070660 msgr2=0x7f920c140130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.914+0000 7f9211400640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c070660 0x7f920c140130 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91f800b4a0 tx=0x7f91f800b960 comp rx=0 tx=0).stop 2024-05-26T15:40:07.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.914+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 shutdown_connections 2024-05-26T15:40:07.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.914+0000 7f9211400640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f91ec06acc0 0x7f91ec06d180 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.914+0000 7f9211400640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f920c15a4d0 0x7f920c1e25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.914+0000 7f9211400640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f920c153510 0x7f920c1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.914+0000 7f9211400640 1 --2- 172.21.15.8:0/2009112008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f920c070660 0x7f920c140130 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.914+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 >> 172.21.15.8:0/2009112008 conn(0x7f920c0b0ba0 msgr2=0x7f920c151280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.915+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 shutdown_connections 2024-05-26T15:40:07.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.915+0000 7f9211400640 1 -- 172.21.15.8:0/2009112008 wait complete. 2024-05-26T15:40:07.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-05-26T15:40:07.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.942+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f893c0056e0 con 0x7f893c051660 2024-05-26T15:40:07.941 DEBUG:teuthology.parallel:result is None 2024-05-26T15:40:07.942 INFO:teuthology.orchestra.run.smithi008.stdout:55834574859 2024-05-26T15:40:07.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.943+0000 7f893aa00640 1 -- 172.21.15.8:0/2296987219 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8934017020 con 0x7f893c051660 2024-05-26T15:40:07.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.946+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f892406ac00 msgr2=0x7f892406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.946+0000 7f8943e00640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f892406ac00 0x7f892406d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8930035040 tx=0x7f893002e000 comp rx=0 tx=0).stop 2024-05-26T15:40:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.946+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c051660 msgr2=0x7f893c02df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.946+0000 7f8943e00640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c051660 0x7f893c02df70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f893400c390 tx=0x7f893400c850 comp rx=0 tx=0).stop 2024-05-26T15:40:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.947+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 shutdown_connections 2024-05-26T15:40:07.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.947+0000 7f8943e00640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f893c0e3460 0x7f893c185790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.947+0000 7f8943e00640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f893c051660 0x7f893c02df70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.947+0000 7f8943e00640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f892406ac00 0x7f892406d0c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.947+0000 7f8943e00640 1 --2- 172.21.15.8:0/2296987219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f893c009d70 0x7f893c04f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.947+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 >> 172.21.15.8:0/2296987219 conn(0x7f893c053780 msgr2=0x7f893c007b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.947+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 shutdown_connections 2024-05-26T15:40:07.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.947+0000 7f8943e00640 1 -- 172.21.15.8:0/2296987219 wait complete. 2024-05-26T15:40:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.957+0000 7f01f9200640 1 -- 172.21.15.8:0/482213373 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f01ec005290 con 0x7f01ec005eb0 2024-05-26T15:40:07.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.957+0000 7f01e7400640 1 -- 172.21.15.8:0/482213373 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01f40cd710 con 0x7f01ec005eb0 2024-05-26T15:40:07.956 INFO:teuthology.orchestra.run.smithi008.stdout:55834574859 2024-05-26T15:40:07.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.961+0000 7f01f9200640 1 -- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f01d406ac50 msgr2=0x7f01d406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.961+0000 7f01f9200640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f01d406ac50 0x7f01d406d110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0398a0 tx=0x7f01e8008040 comp rx=0 tx=0).stop 2024-05-26T15:40:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.961+0000 7f01f9200640 1 -- 172.21.15.8:0/482213373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ec005eb0 msgr2=0x7f01ec0dff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.961+0000 7f01f9200640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ec005eb0 0x7f01ec0dff50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01f402c970 tx=0x7f01f4067880 comp rx=0 tx=0).stop 2024-05-26T15:40:07.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.961+0000 7f01f9200640 1 -- 172.21.15.8:0/482213373 shutdown_connections 2024-05-26T15:40:07.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.961+0000 7f01f9200640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f01d406ac50 0x7f01d406d110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.961+0000 7f01f9200640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01ec0eacd0 0x7f01ec007150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.961+0000 7f01f9200640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f01ec006830 0x7f01ec006c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.961+0000 7f01f9200640 1 --2- 172.21.15.8:0/482213373 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01ec005eb0 0x7f01ec0dff50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.962+0000 7f01f9200640 1 -- 172.21.15.8:0/482213373 >> 172.21.15.8:0/482213373 conn(0x7f01ec009f80 msgr2=0x7f01ec04db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.962+0000 7f01f9200640 1 -- 172.21.15.8:0/482213373 shutdown_connections 2024-05-26T15:40:07.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.962+0000 7f01f9200640 1 -- 172.21.15.8:0/482213373 wait complete. 2024-05-26T15:40:07.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.965+0000 7fa07ca00640 1 -- 172.21.15.8:0/1456074974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa04c005500 con 0x7fa0780b4d00 2024-05-26T15:40:07.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.965+0000 7fa06e000640 1 -- 172.21.15.8:0/1456074974 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa068058100 con 0x7fa0780b4d00 2024-05-26T15:40:07.964 INFO:teuthology.orchestra.run.smithi008.stdout:55834574859 2024-05-26T15:40:07.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.968+0000 7fa07ca00640 1 -- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa05406ac30 msgr2=0x7fa05406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.968+0000 7fa07ca00640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa05406ac30 0x7fa05406d0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa078067290 tx=0x7fa060009040 comp rx=0 tx=0).stop 2024-05-26T15:40:07.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.968+0000 7fa07ca00640 1 -- 172.21.15.8:0/1456074974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0780b4d00 msgr2=0x7fa07814de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.968+0000 7fa07ca00640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0780b4d00 0x7fa07814de80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa06800d800 tx=0x7fa06800dcc0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.968+0000 7fa07ca00640 1 -- 172.21.15.8:0/1456074974 shutdown_connections 2024-05-26T15:40:07.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.968+0000 7fa07ca00640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa07815cf60 0x7fa07806b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.968+0000 7fa07ca00640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa05406ac30 0x7fa05406d0f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.968+0000 7fa07ca00640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0780d1410 0x7fa0780c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.968+0000 7fa07ca00640 1 --2- 172.21.15.8:0/1456074974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0780b4d00 0x7fa07814de80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.968+0000 7fa07ca00640 1 -- 172.21.15.8:0/1456074974 >> 172.21.15.8:0/1456074974 conn(0x7fa078071c00 msgr2=0x7fa07815fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.969+0000 7fa07ca00640 1 -- 172.21.15.8:0/1456074974 shutdown_connections 2024-05-26T15:40:07.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.969+0000 7fa07ca00640 1 -- 172.21.15.8:0/1456074974 wait complete. 2024-05-26T15:40:07.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-05-26T15:40:07.971 DEBUG:teuthology.parallel:result is None 2024-05-26T15:40:07.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.974+0000 7faeb4c00640 1 -- 172.21.15.8:0/3075693383 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7faeb004e280 con 0x7faeb00ce380 2024-05-26T15:40:07.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.975+0000 7faea7400640 1 -- 172.21.15.8:0/3075693383 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae980577b0 con 0x7faeb00ce380 2024-05-26T15:40:07.973 INFO:teuthology.orchestra.run.smithi008.stdout:55834574859 2024-05-26T15:40:07.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7faeb4c00640 1 -- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae8c06ac00 msgr2=0x7fae8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7faeb4c00640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae8c06ac00 0x7fae8c06d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faeb015ac90 tx=0x7faea800b040 comp rx=0 tx=0).stop 2024-05-26T15:40:07.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7faeb4c00640 1 -- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 msgr2=0x7faeb0149080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7faeb4c00640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 0x7faeb0149080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae9800c3c0 tx=0x7fae9800c880 comp rx=0 tx=0).stop 2024-05-26T15:40:07.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc1d40a7ae0 con 0x7fc1d4070f00 2024-05-26T15:40:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7faeb4c00640 1 -- 172.21.15.8:0/3075693383 shutdown_connections 2024-05-26T15:40:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7faeb4c00640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae8c06ac00 0x7fae8c06d0c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7faeb4c00640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faeb00ce380 0x7faeb0149080 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7faeb4c00640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faeb00b2880 0x7faeb0145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7faeb4c00640 1 --2- 172.21.15.8:0/3075693383 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faeb00b24a0 0x7faeb015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.977+0000 7faeb4c00640 1 -- 172.21.15.8:0/3075693383 >> 172.21.15.8:0/3075693383 conn(0x7faeb006e7f0 msgr2=0x7faeb00b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.978+0000 7faeb4c00640 1 -- 172.21.15.8:0/3075693383 shutdown_connections 2024-05-26T15:40:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.978+0000 7faeb4c00640 1 -- 172.21.15.8:0/3075693383 wait complete. 2024-05-26T15:40:07.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.978+0000 7fc1d0c00640 1 -- 172.21.15.8:0/3216912889 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1d40a7ae0 con 0x7fc1d4070f00 2024-05-26T15:40:07.978 INFO:teuthology.orchestra.run.smithi008.stdout:55834574860 2024-05-26T15:40:07.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc1b006ac00 msgr2=0x7fc1b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7fc1da200640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc1b006ac00 0x7fc1b006d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4000f80 tx=0x7fc1c402f000 comp rx=0 tx=0).stop 2024-05-26T15:40:07.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d4070f00 msgr2=0x7fc1d415a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7fc1da200640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d4070f00 0x7fc1d415a140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00b3f0 tx=0x7fc1cc00b8b0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 shutdown_connections 2024-05-26T15:40:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7fc1da200640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc1b006ac00 0x7fc1b006d0c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7fc1da200640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc1d4158d10 0x7fc1d415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7fc1da200640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d4070f00 0x7fc1d415a140 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7fc1da200640 1 --2- 172.21.15.8:0/3216912889 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc1d406a990 0x7fc1d415ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 >> 172.21.15.8:0/3216912889 conn(0x7fc1d4069e70 msgr2=0x7fc1d40cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.981+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f452c0057d0 con 0x7f45540d2900 2024-05-26T15:40:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.982+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 shutdown_connections 2024-05-26T15:40:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.982+0000 7fc1da200640 1 -- 172.21.15.8:0/3216912889 wait complete. 2024-05-26T15:40:07.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.982+0000 7f454a000640 1 -- 172.21.15.8:0/84024163 <== mon.2 v2:172.21.15.47:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f454c078ac0 con 0x7f45540d2900 2024-05-26T15:40:07.981 INFO:teuthology.orchestra.run.smithi008.stdout:55834574860 2024-05-26T15:40:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.985+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f453406ac00 msgr2=0x7f453406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.986+0000 7f4558c00640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f453406ac00 0x7f453406d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4540000f60 tx=0x7f45400079b0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.986+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d2900 msgr2=0x7f45541ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.986+0000 7f4558c00640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d2900 0x7f45541ff670 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f454c000c00 tx=0x7f454c0046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.986+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 shutdown_connections 2024-05-26T15:40:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.986+0000 7f4558c00640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f453406ac00 0x7f453406d0c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.986+0000 7f4558c00640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f455415ccf0 0x7f455406d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.986+0000 7f4558c00640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f45540d2900 0x7f45541ff670 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.986+0000 7f4558c00640 1 --2- 172.21.15.8:0/84024163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45540d01f0 0x7f455406fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.986+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 >> 172.21.15.8:0/84024163 conn(0x7f4554071990 msgr2=0x7f45540b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-05-26T15:40:07.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.987+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 shutdown_connections 2024-05-26T15:40:07.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.987+0000 7f4558c00640 1 -- 172.21.15.8:0/84024163 wait complete. 2024-05-26T15:40:07.988 DEBUG:teuthology.parallel:result is None 2024-05-26T15:40:07.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.990+0000 7f390d000640 1 -- 172.21.15.8:0/830487481 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3908157550 con 0x7f390815d3f0 2024-05-26T15:40:07.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.991+0000 7f38ff400640 1 -- 172.21.15.8:0/830487481 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3900017090 con 0x7f390815d3f0 2024-05-26T15:40:07.990 INFO:teuthology.orchestra.run.smithi008.stdout:55834574858 2024-05-26T15:40:07.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-05-26T15:40:07.991 DEBUG:teuthology.parallel:result is None 2024-05-26T15:40:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 -- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f38e806ac00 msgr2=0x7f38e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f38e806ac00 0x7f38e806d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009b40 tx=0x7f38f8009190 comp rx=0 tx=0).stop 2024-05-26T15:40:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 -- 172.21.15.8:0/830487481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390815d3f0 msgr2=0x7f39080a74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390815d3f0 0x7f39080a74b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f390000caa0 tx=0x7f390000cf60 comp rx=0 tx=0).stop 2024-05-26T15:40:07.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 -- 172.21.15.8:0/830487481 shutdown_connections 2024-05-26T15:40:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f390815d3f0 0x7f39080a74b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f38e806ac00 0x7f38e806d0c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39080b1700 0x7f3908157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 --2- 172.21.15.8:0/830487481 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f390806d160 0x7f39081539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 -- 172.21.15.8:0/830487481 >> 172.21.15.8:0/830487481 conn(0x7f3908069e70 msgr2=0x7f39080b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 -- 172.21.15.8:0/830487481 shutdown_connections 2024-05-26T15:40:07.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:07.997+0000 7f390d000640 1 -- 172.21.15.8:0/830487481 wait complete. 2024-05-26T15:40:08.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-05-26T15:40:08.002 DEBUG:teuthology.parallel:result is None 2024-05-26T15:40:08.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2024-05-26T15:40:08.008 DEBUG:teuthology.parallel:result is None 2024-05-26T15:40:08.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2024-05-26T15:40:08.008 DEBUG:teuthology.parallel:result is None 2024-05-26T15:40:08.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-05-26T15:40:08.013 DEBUG:teuthology.parallel:result is None 2024-05-26T15:40:08.013 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-26T15:40:08.014 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:40:08.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.254+0000 7fe232a00640 1 Processor -- start 2024-05-26T15:40:08.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.254+0000 7fe232a00640 1 -- start start 2024-05-26T15:40:08.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.256+0000 7fe232a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe22c15d2e0 0x7fe22c13ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.256+0000 7fe232a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c15d850 con 0x7fe22c13c640 2024-05-26T15:40:08.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.256+0000 7fe232a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe22c15db30 con 0x7fe22c06d590 2024-05-26T15:40:08.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.256+0000 7fe232a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe22c15de10 con 0x7fe22c15d2e0 2024-05-26T15:40:08.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.256+0000 7fe231600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe22c13c640 0x7fe22c13f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60504/0 (socket says 172.21.15.8:60504) 2024-05-26T15:40:08.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.256+0000 7fe230c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe22c15d2e0 0x7fe22c13ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.256+0000 7fe231600640 1 -- 172.21.15.8:0/4037425283 learned_addr learned my addr 172.21.15.8:0/4037425283 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:08.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.257+0000 7fe230c00640 1 -- 172.21.15.8:0/4037425283 >> v1:172.21.15.47:6789/0 conn(0x7fe22c06d590 legacy=0x7fe22c15a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:08.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.257+0000 7fe230c00640 1 -- 172.21.15.8:0/4037425283 >> v1:172.21.15.8:6789/0 conn(0x7fe22c13c640 legacy=0x7fe22c13f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.257+0000 7fe230c00640 1 -- 172.21.15.8:0/4037425283 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c15e0f0 con 0x7fe22c15d2e0 2024-05-26T15:40:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.258+0000 7fe230c00640 1 --2- 172.21.15.8:0/4037425283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c15d2e0 0x7fe22c13ce60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe2180097a0 tx=0x7fe21802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58211bcaeacc4aad server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.258+0000 7fe22be00640 1 -- 172.21.15.8:0/4037425283 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe218032440 con 0x7fe22c15d2e0 2024-05-26T15:40:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.258+0000 7fe22be00640 1 -- 172.21.15.8:0/4037425283 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2180325a0 con 0x7fe22c15d2e0 2024-05-26T15:40:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.258+0000 7fe22be00640 1 -- 172.21.15.8:0/4037425283 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe218032930 con 0x7fe22c15d2e0 2024-05-26T15:40:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.258+0000 7fe232a00640 1 -- 172.21.15.8:0/4037425283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c15d2e0 msgr2=0x7fe22c13ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.258+0000 7fe232a00640 1 --2- 172.21.15.8:0/4037425283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c15d2e0 0x7fe22c13ce60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe2180097a0 tx=0x7fe21802a1e0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.259+0000 7fe232a00640 1 -- 172.21.15.8:0/4037425283 shutdown_connections 2024-05-26T15:40:08.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.259+0000 7fe232a00640 1 --2- 172.21.15.8:0/4037425283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c15d2e0 0x7fe22c13ce60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.259+0000 7fe232a00640 1 -- 172.21.15.8:0/4037425283 >> 172.21.15.8:0/4037425283 conn(0x7fe22c070480 msgr2=0x7fe22c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:08.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.259+0000 7fe232a00640 1 -- 172.21.15.8:0/4037425283 shutdown_connections 2024-05-26T15:40:08.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.259+0000 7fe232a00640 1 -- 172.21.15.8:0/4037425283 wait complete. 2024-05-26T15:40:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.260+0000 7fe232a00640 1 Processor -- start 2024-05-26T15:40:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.260+0000 7fe232a00640 1 -- start start 2024-05-26T15:40:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.261+0000 7fe232a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe22c06d590 0x7fe22c134dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.261+0000 7fe232a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13c640 0x7fe22c1414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.261+0000 7fe232a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c15d2e0 0x7fe22c1f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.261+0000 7fe232a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c0b10e0 con 0x7fe22c13c640 2024-05-26T15:40:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.261+0000 7fe232a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c132ac0 con 0x7fe22c15d2e0 2024-05-26T15:40:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.261+0000 7fe232a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c142470 con 0x7fe22c06d590 2024-05-26T15:40:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe230c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13c640 0x7fe22c1414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe230c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13c640 0x7fe22c1414f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47844/0 (socket says 172.21.15.8:47844) 2024-05-26T15:40:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe230c00640 1 -- 172.21.15.8:0/3195304624 learned_addr learned my addr 172.21.15.8:0/3195304624 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe231600640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe22c06d590 0x7fe22c134dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe232000640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c15d2e0 0x7fe22c1f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe230c00640 1 -- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe22c06d590 msgr2=0x7fe22c134dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe230c00640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe22c06d590 0x7fe22c134dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe230c00640 1 -- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c15d2e0 msgr2=0x7fe22c1f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe230c00640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c15d2e0 0x7fe22c1f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe230c00640 1 -- 172.21.15.8:0/3195304624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe218009400 con 0x7fe22c13c640 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.262+0000 7fe232000640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c15d2e0 0x7fe22c1f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.263+0000 7fe230c00640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13c640 0x7fe22c1414f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe218035040 tx=0x7fe2180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.263+0000 7fe229600640 1 -- 172.21.15.8:0/3195304624 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe218030b80 con 0x7fe22c13c640 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.263+0000 7fe229600640 1 -- 172.21.15.8:0/3195304624 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe218030d20 con 0x7fe22c13c640 2024-05-26T15:40:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.263+0000 7fe229600640 1 -- 172.21.15.8:0/3195304624 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21803c640 con 0x7fe22c13c640 2024-05-26T15:40:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.263+0000 7fe232a00640 1 -- 172.21.15.8:0/3195304624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c141eb0 con 0x7fe22c13c640 2024-05-26T15:40:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.263+0000 7fe232a00640 1 -- 172.21.15.8:0/3195304624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c0b0d00 con 0x7fe22c13c640 2024-05-26T15:40:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.264+0000 7fe232a00640 1 -- 172.21.15.8:0/3195304624 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c0b1220 con 0x7fe22c13c640 2024-05-26T15:40:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.265+0000 7fe229600640 1 -- 172.21.15.8:0/3195304624 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe21803c7a0 con 0x7fe22c13c640 2024-05-26T15:40:08.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.266+0000 7fe229600640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe20c06ac00 0x7fe20c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.266+0000 7fe229600640 1 -- 172.21.15.8:0/3195304624 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe2180aa520 con 0x7fe22c13c640 2024-05-26T15:40:08.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.267+0000 7fe231600640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe20c06ac00 0x7fe20c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.268+0000 7fe231600640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe20c06ac00 0x7fe20c06d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe220005880 tx=0x7fe220009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.270+0000 7fe229600640 1 -- 172.21.15.8:0/3195304624 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe22c0b1220 con 0x7fe22c13c640 2024-05-26T15:40:08.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.461+0000 7fe232a00640 1 -- 172.21.15.8:0/3195304624 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe22c13d3a0 con 0x7fe20c06ac00 2024-05-26T15:40:08.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.489+0000 7fe229600640 1 -- 172.21.15.8:0/3195304624 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345086 (secure 0 0 0) 0x7fe2200013f0 con 0x7fe20c06ac00 2024-05-26T15:40:08.490 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:08.494 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 -- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe20c06ac00 msgr2=0x7fe20c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe20c06ac00 0x7fe20c06d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe220005880 tx=0x7fe220009040 comp rx=0 tx=0).stop 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 -- 172.21.15.8:0/3195304624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13c640 msgr2=0x7fe22c1414f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13c640 0x7fe22c1414f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe218035040 tx=0x7fe2180046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 -- 172.21.15.8:0/3195304624 shutdown_connections 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe20c06ac00 0x7fe20c06d0c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe22c15d2e0 0x7fe22c1f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe22c13c640 0x7fe22c1414f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 --2- 172.21.15.8:0/3195304624 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe22c06d590 0x7fe22c134dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 -- 172.21.15.8:0/3195304624 >> 172.21.15.8:0/3195304624 conn(0x7fe22c070480 msgr2=0x7fe22c13a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 -- 172.21.15.8:0/3195304624 shutdown_connections 2024-05-26T15:40:08.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.497+0000 7fe232a00640 1 -- 172.21.15.8:0/3195304624 wait complete. 2024-05-26T15:40:08.515 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-05-26T15:40:08.167077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235744,"kb_used_data":3196,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738976,"statfs":{"total":773094113280,"available":772852711424,"internally_reserved":0,"allocated":3272704,"data_stored":1985107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005713"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386165+0000","last_change":"2024-05-26T15:39:32.432165+0000","last_active":"2024-05-26T15:39:37.386165+0000","last_peered":"2024-05-26T15:39:37.386165+0000","last_clean":"2024-05-26T15:39:37.386165+0000","last_became_active":"2024-05-26T15:39:32.431489+0000","last_became_peered":"2024-05-26T15:39:32.431489+0000","last_unstale":"2024-05-26T15:39:37.386165+0000","last_undegraded":"2024-05-26T15:39:37.386165+0000","last_fullsized":"2024-05-26T15:39:37.386165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:45:24.383306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379327+0000","last_change":"2024-05-26T15:39:32.919233+0000","last_active":"2024-05-26T15:39:37.379327+0000","last_peered":"2024-05-26T15:39:37.379327+0000","last_clean":"2024-05-26T15:39:37.379327+0000","last_became_active":"2024-05-26T15:39:32.918954+0000","last_became_peered":"2024-05-26T15:39:32.918954+0000","last_unstale":"2024-05-26T15:39:37.379327+0000","last_undegraded":"2024-05-26T15:39:37.379327+0000","last_fullsized":"2024-05-26T15:39:37.379327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288096+0000","last_change":"2024-05-26T15:39:37.499590+0000","last_active":"2024-05-26T15:39:39.288096+0000","last_peered":"2024-05-26T15:39:39.288096+0000","last_clean":"2024-05-26T15:39:39.288096+0000","last_became_active":"2024-05-26T15:39:37.497710+0000","last_became_peered":"2024-05-26T15:39:37.497710+0000","last_unstale":"2024-05-26T15:39:39.288096+0000","last_undegraded":"2024-05-26T15:39:39.288096+0000","last_fullsized":"2024-05-26T15:39:39.288096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:38:29.550301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379789+0000","last_change":"2024-05-26T15:39:32.420682+0000","last_active":"2024-05-26T15:39:37.379789+0000","last_peered":"2024-05-26T15:39:37.379789+0000","last_clean":"2024-05-26T15:39:37.379789+0000","last_became_active":"2024-05-26T15:39:32.418629+0000","last_became_peered":"2024-05-26T15:39:32.418629+0000","last_unstale":"2024-05-26T15:39:37.379789+0000","last_undegraded":"2024-05-26T15:39:37.379789+0000","last_fullsized":"2024-05-26T15:39:37.379789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383890+0000","last_change":"2024-05-26T15:39:32.930973+0000","last_active":"2024-05-26T15:39:37.383890+0000","last_peered":"2024-05-26T15:39:37.383890+0000","last_clean":"2024-05-26T15:39:37.383890+0000","last_became_active":"2024-05-26T15:39:32.930696+0000","last_became_peered":"2024-05-26T15:39:32.930696+0000","last_unstale":"2024-05-26T15:39:37.383890+0000","last_undegraded":"2024-05-26T15:39:37.383890+0000","last_fullsized":"2024-05-26T15:39:37.383890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881236+0000","last_change":"2024-05-26T15:39:37.407147+0000","last_active":"2024-05-26T15:39:37.881236+0000","last_peered":"2024-05-26T15:39:37.881236+0000","last_clean":"2024-05-26T15:39:37.881236+0000","last_became_active":"2024-05-26T15:39:37.406661+0000","last_became_peered":"2024-05-26T15:39:37.406661+0000","last_unstale":"2024-05-26T15:39:37.881236+0000","last_undegraded":"2024-05-26T15:39:37.881236+0000","last_fullsized":"2024-05-26T15:39:37.881236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:52:01.807307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.494776+0000","last_change":"2024-05-26T15:39:32.436688+0000","last_active":"2024-05-26T15:39:37.494776+0000","last_peered":"2024-05-26T15:39:37.494776+0000","last_clean":"2024-05-26T15:39:37.494776+0000","last_became_active":"2024-05-26T15:39:32.436376+0000","last_became_peered":"2024-05-26T15:39:32.436376+0000","last_unstale":"2024-05-26T15:39:37.494776+0000","last_undegraded":"2024-05-26T15:39:37.494776+0000","last_fullsized":"2024-05-26T15:39:37.494776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:12.690125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402956+0000","last_change":"2024-05-26T15:39:32.937138+0000","last_active":"2024-05-26T15:39:37.402956+0000","last_peered":"2024-05-26T15:39:37.402956+0000","last_clean":"2024-05-26T15:39:37.402956+0000","last_became_active":"2024-05-26T15:39:32.936872+0000","last_became_peered":"2024-05-26T15:39:32.936872+0000","last_unstale":"2024-05-26T15:39:37.402956+0000","last_undegraded":"2024-05-26T15:39:37.402956+0000","last_fullsized":"2024-05-26T15:39:37.402956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:02:49.914564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882195+0000","last_change":"2024-05-26T15:39:37.406227+0000","last_active":"2024-05-26T15:39:37.882195+0000","last_peered":"2024-05-26T15:39:37.882195+0000","last_clean":"2024-05-26T15:39:37.882195+0000","last_became_active":"2024-05-26T15:39:37.405551+0000","last_became_peered":"2024-05-26T15:39:37.405551+0000","last_unstale":"2024-05-26T15:39:37.882195+0000","last_undegraded":"2024-05-26T15:39:37.882195+0000","last_fullsized":"2024-05-26T15:39:37.882195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:45:07.288223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492340+0000","last_change":"2024-05-26T15:39:32.439870+0000","last_active":"2024-05-26T15:39:37.492340+0000","last_peered":"2024-05-26T15:39:37.492340+0000","last_clean":"2024-05-26T15:39:37.492340+0000","last_became_active":"2024-05-26T15:39:32.439491+0000","last_became_peered":"2024-05-26T15:39:32.439491+0000","last_unstale":"2024-05-26T15:39:37.492340+0000","last_undegraded":"2024-05-26T15:39:37.492340+0000","last_fullsized":"2024-05-26T15:39:37.492340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:51:21.068431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405199+0000","last_change":"2024-05-26T15:39:32.932834+0000","last_active":"2024-05-26T15:39:37.405199+0000","last_peered":"2024-05-26T15:39:37.405199+0000","last_clean":"2024-05-26T15:39:37.405199+0000","last_became_active":"2024-05-26T15:39:32.930499+0000","last_became_peered":"2024-05-26T15:39:32.930499+0000","last_unstale":"2024-05-26T15:39:37.405199+0000","last_undegraded":"2024-05-26T15:39:37.405199+0000","last_fullsized":"2024-05-26T15:39:37.405199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:16:58.690646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881578+0000","last_change":"2024-05-26T15:39:37.403865+0000","last_active":"2024-05-26T15:39:37.881578+0000","last_peered":"2024-05-26T15:39:37.881578+0000","last_clean":"2024-05-26T15:39:37.881578+0000","last_became_active":"2024-05-26T15:39:37.403330+0000","last_became_peered":"2024-05-26T15:39:37.403330+0000","last_unstale":"2024-05-26T15:39:37.881578+0000","last_undegraded":"2024-05-26T15:39:37.881578+0000","last_fullsized":"2024-05-26T15:39:37.881578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:56:31.917292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405022+0000","last_change":"2024-05-26T15:39:32.929330+0000","last_active":"2024-05-26T15:39:37.405022+0000","last_peered":"2024-05-26T15:39:37.405022+0000","last_clean":"2024-05-26T15:39:37.405022+0000","last_became_active":"2024-05-26T15:39:32.929059+0000","last_became_peered":"2024-05-26T15:39:32.929059+0000","last_unstale":"2024-05-26T15:39:37.405022+0000","last_undegraded":"2024-05-26T15:39:37.405022+0000","last_fullsized":"2024-05-26T15:39:37.405022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.500100+0000","last_change":"2024-05-26T15:39:32.436030+0000","last_active":"2024-05-26T15:39:37.500100+0000","last_peered":"2024-05-26T15:39:37.500100+0000","last_clean":"2024-05-26T15:39:37.500100+0000","last_became_active":"2024-05-26T15:39:32.434362+0000","last_became_peered":"2024-05-26T15:39:32.434362+0000","last_unstale":"2024-05-26T15:39:37.500100+0000","last_undegraded":"2024-05-26T15:39:37.500100+0000","last_fullsized":"2024-05-26T15:39:37.500100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:25.042059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882811+0000","last_change":"2024-05-26T15:39:37.402375+0000","last_active":"2024-05-26T15:39:37.882811+0000","last_peered":"2024-05-26T15:39:37.882811+0000","last_clean":"2024-05-26T15:39:37.882811+0000","last_became_active":"2024-05-26T15:39:37.401909+0000","last_became_peered":"2024-05-26T15:39:37.401909+0000","last_unstale":"2024-05-26T15:39:37.882811+0000","last_undegraded":"2024-05-26T15:39:37.882811+0000","last_fullsized":"2024-05-26T15:39:37.882811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377881+0000","last_change":"2024-05-26T15:39:32.926407+0000","last_active":"2024-05-26T15:39:37.377881+0000","last_peered":"2024-05-26T15:39:37.377881+0000","last_clean":"2024-05-26T15:39:37.377881+0000","last_became_active":"2024-05-26T15:39:32.924213+0000","last_became_peered":"2024-05-26T15:39:32.924213+0000","last_unstale":"2024-05-26T15:39:37.377881+0000","last_undegraded":"2024-05-26T15:39:37.377881+0000","last_fullsized":"2024-05-26T15:39:37.377881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403642+0000","last_change":"2024-05-26T15:39:32.424999+0000","last_active":"2024-05-26T15:39:37.403642+0000","last_peered":"2024-05-26T15:39:37.403642+0000","last_clean":"2024-05-26T15:39:37.403642+0000","last_became_active":"2024-05-26T15:39:32.424692+0000","last_became_peered":"2024-05-26T15:39:32.424692+0000","last_unstale":"2024-05-26T15:39:37.403642+0000","last_undegraded":"2024-05-26T15:39:37.403642+0000","last_fullsized":"2024-05-26T15:39:37.403642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882346+0000","last_change":"2024-05-26T15:39:37.407719+0000","last_active":"2024-05-26T15:39:37.882346+0000","last_peered":"2024-05-26T15:39:37.882346+0000","last_clean":"2024-05-26T15:39:37.882346+0000","last_became_active":"2024-05-26T15:39:37.407277+0000","last_became_peered":"2024-05-26T15:39:37.407277+0000","last_unstale":"2024-05-26T15:39:37.882346+0000","last_undegraded":"2024-05-26T15:39:37.882346+0000","last_fullsized":"2024-05-26T15:39:37.882346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377305+0000","last_change":"2024-05-26T15:39:32.914034+0000","last_active":"2024-05-26T15:39:37.377305+0000","last_peered":"2024-05-26T15:39:37.377305+0000","last_clean":"2024-05-26T15:39:37.377305+0000","last_became_active":"2024-05-26T15:39:32.912275+0000","last_became_peered":"2024-05-26T15:39:32.912275+0000","last_unstale":"2024-05-26T15:39:37.377305+0000","last_undegraded":"2024-05-26T15:39:37.377305+0000","last_fullsized":"2024-05-26T15:39:37.377305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402750+0000","last_change":"2024-05-26T15:39:32.430257+0000","last_active":"2024-05-26T15:39:37.402750+0000","last_peered":"2024-05-26T15:39:37.402750+0000","last_clean":"2024-05-26T15:39:37.402750+0000","last_became_active":"2024-05-26T15:39:32.429796+0000","last_became_peered":"2024-05-26T15:39:32.429796+0000","last_unstale":"2024-05-26T15:39:37.402750+0000","last_undegraded":"2024-05-26T15:39:37.402750+0000","last_fullsized":"2024-05-26T15:39:37.402750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.293026+0000","last_change":"2024-05-26T15:39:37.502078+0000","last_active":"2024-05-26T15:39:38.293026+0000","last_peered":"2024-05-26T15:39:38.293026+0000","last_clean":"2024-05-26T15:39:38.293026+0000","last_became_active":"2024-05-26T15:39:37.501483+0000","last_became_peered":"2024-05-26T15:39:37.501483+0000","last_unstale":"2024-05-26T15:39:38.293026+0000","last_undegraded":"2024-05-26T15:39:38.293026+0000","last_fullsized":"2024-05-26T15:39:38.293026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387962+0000","last_change":"2024-05-26T15:39:32.916982+0000","last_active":"2024-05-26T15:39:37.387962+0000","last_peered":"2024-05-26T15:39:37.387962+0000","last_clean":"2024-05-26T15:39:37.387962+0000","last_became_active":"2024-05-26T15:39:32.916068+0000","last_became_peered":"2024-05-26T15:39:32.916068+0000","last_unstale":"2024-05-26T15:39:37.387962+0000","last_undegraded":"2024-05-26T15:39:37.387962+0000","last_fullsized":"2024-05-26T15:39:37.387962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:20.298140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490624+0000","last_change":"2024-05-26T15:39:32.429729+0000","last_active":"2024-05-26T15:39:37.490624+0000","last_peered":"2024-05-26T15:39:37.490624+0000","last_clean":"2024-05-26T15:39:37.490624+0000","last_became_active":"2024-05-26T15:39:32.429305+0000","last_became_peered":"2024-05-26T15:39:32.429305+0000","last_unstale":"2024-05-26T15:39:37.490624+0000","last_undegraded":"2024-05-26T15:39:37.490624+0000","last_fullsized":"2024-05-26T15:39:37.490624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.883028+0000","last_change":"2024-05-26T15:39:37.405280+0000","last_active":"2024-05-26T15:39:37.883028+0000","last_peered":"2024-05-26T15:39:37.883028+0000","last_clean":"2024-05-26T15:39:37.883028+0000","last_became_active":"2024-05-26T15:39:37.404901+0000","last_became_peered":"2024-05-26T15:39:37.404901+0000","last_unstale":"2024-05-26T15:39:37.883028+0000","last_undegraded":"2024-05-26T15:39:37.883028+0000","last_fullsized":"2024-05-26T15:39:37.883028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:46:18.529170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387113+0000","last_change":"2024-05-26T15:39:32.912045+0000","last_active":"2024-05-26T15:39:37.387113+0000","last_peered":"2024-05-26T15:39:37.387113+0000","last_clean":"2024-05-26T15:39:37.387113+0000","last_became_active":"2024-05-26T15:39:32.911751+0000","last_became_peered":"2024-05-26T15:39:32.911751+0000","last_unstale":"2024-05-26T15:39:37.387113+0000","last_undegraded":"2024-05-26T15:39:37.387113+0000","last_fullsized":"2024-05-26T15:39:37.387113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:09:26.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.408057+0000","last_change":"2024-05-26T15:39:32.437696+0000","last_active":"2024-05-26T15:39:37.408057+0000","last_peered":"2024-05-26T15:39:37.408057+0000","last_clean":"2024-05-26T15:39:37.408057+0000","last_became_active":"2024-05-26T15:39:32.437168+0000","last_became_peered":"2024-05-26T15:39:32.437168+0000","last_unstale":"2024-05-26T15:39:37.408057+0000","last_undegraded":"2024-05-26T15:39:37.408057+0000","last_fullsized":"2024-05-26T15:39:37.408057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881371+0000","last_change":"2024-05-26T15:39:37.499923+0000","last_active":"2024-05-26T15:39:37.881371+0000","last_peered":"2024-05-26T15:39:37.881371+0000","last_clean":"2024-05-26T15:39:37.881371+0000","last_became_active":"2024-05-26T15:39:37.499000+0000","last_became_peered":"2024-05-26T15:39:37.499000+0000","last_unstale":"2024-05-26T15:39:37.881371+0000","last_undegraded":"2024-05-26T15:39:37.881371+0000","last_fullsized":"2024-05-26T15:39:37.881371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379901+0000","last_change":"2024-05-26T15:39:32.922222+0000","last_active":"2024-05-26T15:39:37.379901+0000","last_peered":"2024-05-26T15:39:37.379901+0000","last_clean":"2024-05-26T15:39:37.379901+0000","last_became_active":"2024-05-26T15:39:32.921594+0000","last_became_peered":"2024-05-26T15:39:32.921594+0000","last_unstale":"2024-05-26T15:39:37.379901+0000","last_undegraded":"2024-05-26T15:39:37.379901+0000","last_fullsized":"2024-05-26T15:39:37.379901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.292819+0000","last_change":"2024-05-26T15:39:32.428520+0000","last_active":"2024-05-26T15:39:38.292819+0000","last_peered":"2024-05-26T15:39:38.292819+0000","last_clean":"2024-05-26T15:39:38.292819+0000","last_became_active":"2024-05-26T15:39:32.427761+0000","last_became_peered":"2024-05-26T15:39:32.427761+0000","last_unstale":"2024-05-26T15:39:38.292819+0000","last_undegraded":"2024-05-26T15:39:38.292819+0000","last_fullsized":"2024-05-26T15:39:38.292819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288088+0000","last_change":"2024-05-26T15:39:37.490760+0000","last_active":"2024-05-26T15:39:39.288088+0000","last_peered":"2024-05-26T15:39:39.288088+0000","last_clean":"2024-05-26T15:39:39.288088+0000","last_became_active":"2024-05-26T15:39:37.490319+0000","last_became_peered":"2024-05-26T15:39:37.490319+0000","last_unstale":"2024-05-26T15:39:39.288088+0000","last_undegraded":"2024-05-26T15:39:39.288088+0000","last_fullsized":"2024-05-26T15:39:39.288088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:46:18.529170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403196+0000","last_change":"2024-05-26T15:39:32.917740+0000","last_active":"2024-05-26T15:39:37.403196+0000","last_peered":"2024-05-26T15:39:37.403196+0000","last_clean":"2024-05-26T15:39:37.403196+0000","last_became_active":"2024-05-26T15:39:32.917370+0000","last_became_peered":"2024-05-26T15:39:32.917370+0000","last_unstale":"2024-05-26T15:39:37.403196+0000","last_undegraded":"2024-05-26T15:39:37.403196+0000","last_fullsized":"2024-05-26T15:39:37.403196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495183+0000","last_change":"2024-05-26T15:39:32.433409+0000","last_active":"2024-05-26T15:39:37.495183+0000","last_peered":"2024-05-26T15:39:37.495183+0000","last_clean":"2024-05-26T15:39:37.495183+0000","last_became_active":"2024-05-26T15:39:32.433133+0000","last_became_peered":"2024-05-26T15:39:32.433133+0000","last_unstale":"2024-05-26T15:39:37.495183+0000","last_undegraded":"2024-05-26T15:39:37.495183+0000","last_fullsized":"2024-05-26T15:39:37.495183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.058977+0000","last_change":"2024-05-26T15:39:37.502064+0000","last_active":"2024-05-26T15:39:39.058977+0000","last_peered":"2024-05-26T15:39:39.058977+0000","last_clean":"2024-05-26T15:39:39.058977+0000","last_became_active":"2024-05-26T15:39:37.500834+0000","last_became_peered":"2024-05-26T15:39:37.500834+0000","last_unstale":"2024-05-26T15:39:39.058977+0000","last_undegraded":"2024-05-26T15:39:39.058977+0000","last_fullsized":"2024-05-26T15:39:39.058977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405289+0000","last_change":"2024-05-26T15:39:32.933048+0000","last_active":"2024-05-26T15:39:37.405289+0000","last_peered":"2024-05-26T15:39:37.405289+0000","last_clean":"2024-05-26T15:39:37.405289+0000","last_became_active":"2024-05-26T15:39:32.932543+0000","last_became_peered":"2024-05-26T15:39:32.932543+0000","last_unstale":"2024-05-26T15:39:37.405289+0000","last_undegraded":"2024-05-26T15:39:37.405289+0000","last_fullsized":"2024-05-26T15:39:37.405289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:47:40.508265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403483+0000","last_change":"2024-05-26T15:39:32.419636+0000","last_active":"2024-05-26T15:39:37.403483+0000","last_peered":"2024-05-26T15:39:37.403483+0000","last_clean":"2024-05-26T15:39:37.403483+0000","last_became_active":"2024-05-26T15:39:32.419323+0000","last_became_peered":"2024-05-26T15:39:32.419323+0000","last_unstale":"2024-05-26T15:39:37.403483+0000","last_undegraded":"2024-05-26T15:39:37.403483+0000","last_fullsized":"2024-05-26T15:39:37.403483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291885+0000","last_change":"2024-05-26T15:39:37.408610+0000","last_active":"2024-05-26T15:39:38.291885+0000","last_peered":"2024-05-26T15:39:38.291885+0000","last_clean":"2024-05-26T15:39:38.291885+0000","last_became_active":"2024-05-26T15:39:37.408202+0000","last_became_peered":"2024-05-26T15:39:37.408202+0000","last_unstale":"2024-05-26T15:39:38.291885+0000","last_undegraded":"2024-05-26T15:39:38.291885+0000","last_fullsized":"2024-05-26T15:39:38.291885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386340+0000","last_change":"2024-05-26T15:39:32.915325+0000","last_active":"2024-05-26T15:39:37.386340+0000","last_peered":"2024-05-26T15:39:37.386340+0000","last_clean":"2024-05-26T15:39:37.386340+0000","last_became_active":"2024-05-26T15:39:32.915062+0000","last_became_peered":"2024-05-26T15:39:32.915062+0000","last_unstale":"2024-05-26T15:39:37.386340+0000","last_undegraded":"2024-05-26T15:39:37.386340+0000","last_fullsized":"2024-05-26T15:39:37.386340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:29.697944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401650+0000","last_change":"2024-05-26T15:39:32.429277+0000","last_active":"2024-05-26T15:39:37.401650+0000","last_peered":"2024-05-26T15:39:37.401650+0000","last_clean":"2024-05-26T15:39:37.401650+0000","last_became_active":"2024-05-26T15:39:32.428675+0000","last_became_peered":"2024-05-26T15:39:32.428675+0000","last_unstale":"2024-05-26T15:39:37.401650+0000","last_undegraded":"2024-05-26T15:39:37.401650+0000","last_fullsized":"2024-05-26T15:39:37.401650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291995+0000","last_change":"2024-05-26T15:39:37.407588+0000","last_active":"2024-05-26T15:39:38.291995+0000","last_peered":"2024-05-26T15:39:38.291995+0000","last_clean":"2024-05-26T15:39:38.291995+0000","last_became_active":"2024-05-26T15:39:37.407196+0000","last_became_peered":"2024-05-26T15:39:37.407196+0000","last_unstale":"2024-05-26T15:39:38.291995+0000","last_undegraded":"2024-05-26T15:39:38.291995+0000","last_fullsized":"2024-05-26T15:39:38.291995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401522+0000","last_change":"2024-05-26T15:39:32.915063+0000","last_active":"2024-05-26T15:39:37.401522+0000","last_peered":"2024-05-26T15:39:37.401522+0000","last_clean":"2024-05-26T15:39:37.401522+0000","last_became_active":"2024-05-26T15:39:32.914721+0000","last_became_peered":"2024-05-26T15:39:32.914721+0000","last_unstale":"2024-05-26T15:39:37.401522+0000","last_undegraded":"2024-05-26T15:39:37.401522+0000","last_fullsized":"2024-05-26T15:39:37.401522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:03.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.392964+0000","last_change":"2024-05-26T15:39:32.414114+0000","last_active":"2024-05-26T15:39:37.392964+0000","last_peered":"2024-05-26T15:39:37.392964+0000","last_clean":"2024-05-26T15:39:37.392964+0000","last_became_active":"2024-05-26T15:39:32.411824+0000","last_became_peered":"2024-05-26T15:39:32.411824+0000","last_unstale":"2024-05-26T15:39:37.392964+0000","last_undegraded":"2024-05-26T15:39:37.392964+0000","last_fullsized":"2024-05-26T15:39:37.392964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.293087+0000","last_change":"2024-05-26T15:39:37.408530+0000","last_active":"2024-05-26T15:39:38.293087+0000","last_peered":"2024-05-26T15:39:38.293087+0000","last_clean":"2024-05-26T15:39:38.293087+0000","last_became_active":"2024-05-26T15:39:37.408147+0000","last_became_peered":"2024-05-26T15:39:37.408147+0000","last_unstale":"2024-05-26T15:39:38.293087+0000","last_undegraded":"2024-05-26T15:39:38.293087+0000","last_fullsized":"2024-05-26T15:39:38.293087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:09:29.167701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384060+0000","last_change":"2024-05-26T15:39:32.899088+0000","last_active":"2024-05-26T15:39:37.384060+0000","last_peered":"2024-05-26T15:39:37.384060+0000","last_clean":"2024-05-26T15:39:37.384060+0000","last_became_active":"2024-05-26T15:39:32.896938+0000","last_became_peered":"2024-05-26T15:39:32.896938+0000","last_unstale":"2024-05-26T15:39:37.384060+0000","last_undegraded":"2024-05-26T15:39:37.384060+0000","last_fullsized":"2024-05-26T15:39:37.384060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:07:16.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490674+0000","last_change":"2024-05-26T15:39:32.430448+0000","last_active":"2024-05-26T15:39:37.490674+0000","last_peered":"2024-05-26T15:39:37.490674+0000","last_clean":"2024-05-26T15:39:37.490674+0000","last_became_active":"2024-05-26T15:39:32.430063+0000","last_became_peered":"2024-05-26T15:39:32.430063+0000","last_unstale":"2024-05-26T15:39:37.490674+0000","last_undegraded":"2024-05-26T15:39:37.490674+0000","last_fullsized":"2024-05-26T15:39:37.490674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059389+0000","last_change":"2024-05-26T15:39:37.498500+0000","last_active":"2024-05-26T15:39:39.059389+0000","last_peered":"2024-05-26T15:39:39.059389+0000","last_clean":"2024-05-26T15:39:39.059389+0000","last_became_active":"2024-05-26T15:39:37.497853+0000","last_became_peered":"2024-05-26T15:39:37.497853+0000","last_unstale":"2024-05-26T15:39:39.059389+0000","last_undegraded":"2024-05-26T15:39:39.059389+0000","last_fullsized":"2024-05-26T15:39:39.059389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:43:41.543097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.378613+0000","last_change":"2024-05-26T15:39:32.931560+0000","last_active":"2024-05-26T15:39:37.378613+0000","last_peered":"2024-05-26T15:39:37.378613+0000","last_clean":"2024-05-26T15:39:37.378613+0000","last_became_active":"2024-05-26T15:39:32.930941+0000","last_became_peered":"2024-05-26T15:39:32.930941+0000","last_unstale":"2024-05-26T15:39:37.378613+0000","last_undegraded":"2024-05-26T15:39:37.378613+0000","last_fullsized":"2024-05-26T15:39:37.378613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402158+0000","last_change":"2024-05-26T15:39:32.426663+0000","last_active":"2024-05-26T15:39:37.402158+0000","last_peered":"2024-05-26T15:39:37.402158+0000","last_clean":"2024-05-26T15:39:37.402158+0000","last_became_active":"2024-05-26T15:39:32.426151+0000","last_became_peered":"2024-05-26T15:39:32.426151+0000","last_unstale":"2024-05-26T15:39:37.402158+0000","last_undegraded":"2024-05-26T15:39:37.402158+0000","last_fullsized":"2024-05-26T15:39:37.402158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490962+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:39:37.490962+0000","last_peered":"2024-05-26T15:39:37.490962+0000","last_clean":"2024-05-26T15:39:37.490962+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:39:37.490962+0000","last_undegraded":"2024-05-26T15:39:37.490962+0000","last_fullsized":"2024-05-26T15:39:37.490962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.002545+0000","last_change":"2024-05-26T15:39:37.505399+0000","last_active":"2024-05-26T15:39:38.002545+0000","last_peered":"2024-05-26T15:39:38.002545+0000","last_clean":"2024-05-26T15:39:38.002545+0000","last_became_active":"2024-05-26T15:39:37.501182+0000","last_became_peered":"2024-05-26T15:39:37.501182+0000","last_unstale":"2024-05-26T15:39:38.002545+0000","last_undegraded":"2024-05-26T15:39:38.002545+0000","last_fullsized":"2024-05-26T15:39:38.002545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:10:47.871214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.498704+0000","last_change":"2024-05-26T15:39:32.938192+0000","last_active":"2024-05-26T15:39:37.498704+0000","last_peered":"2024-05-26T15:39:37.498704+0000","last_clean":"2024-05-26T15:39:37.498704+0000","last_became_active":"2024-05-26T15:39:32.937905+0000","last_became_peered":"2024-05-26T15:39:32.937905+0000","last_unstale":"2024-05-26T15:39:37.498704+0000","last_undegraded":"2024-05-26T15:39:37.498704+0000","last_fullsized":"2024-05-26T15:39:37.498704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:02:49.914564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.393909+0000","last_change":"2024-05-26T15:39:32.438199+0000","last_active":"2024-05-26T15:39:37.393909+0000","last_peered":"2024-05-26T15:39:37.393909+0000","last_clean":"2024-05-26T15:39:37.393909+0000","last_became_active":"2024-05-26T15:39:32.437949+0000","last_became_peered":"2024-05-26T15:39:32.437949+0000","last_unstale":"2024-05-26T15:39:37.393909+0000","last_undegraded":"2024-05-26T15:39:37.393909+0000","last_fullsized":"2024-05-26T15:39:37.393909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.002149+0000","last_change":"2024-05-26T15:39:37.495167+0000","last_active":"2024-05-26T15:39:38.002149+0000","last_peered":"2024-05-26T15:39:38.002149+0000","last_clean":"2024-05-26T15:39:38.002149+0000","last_became_active":"2024-05-26T15:39:37.493976+0000","last_became_peered":"2024-05-26T15:39:37.493976+0000","last_unstale":"2024-05-26T15:39:38.002149+0000","last_undegraded":"2024-05-26T15:39:38.002149+0000","last_fullsized":"2024-05-26T15:39:38.002149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:12:51.547304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404196+0000","last_change":"2024-05-26T15:39:32.938730+0000","last_active":"2024-05-26T15:39:37.404196+0000","last_peered":"2024-05-26T15:39:37.404196+0000","last_clean":"2024-05-26T15:39:37.404196+0000","last_became_active":"2024-05-26T15:39:32.933947+0000","last_became_peered":"2024-05-26T15:39:32.933947+0000","last_unstale":"2024-05-26T15:39:37.404196+0000","last_undegraded":"2024-05-26T15:39:37.404196+0000","last_fullsized":"2024-05-26T15:39:37.404196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:07:02.159693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403811+0000","last_change":"2024-05-26T15:39:32.425826+0000","last_active":"2024-05-26T15:39:37.403811+0000","last_peered":"2024-05-26T15:39:37.403811+0000","last_clean":"2024-05-26T15:39:37.403811+0000","last_became_active":"2024-05-26T15:39:32.424115+0000","last_became_peered":"2024-05-26T15:39:32.424115+0000","last_unstale":"2024-05-26T15:39:37.403811+0000","last_undegraded":"2024-05-26T15:39:37.403811+0000","last_fullsized":"2024-05-26T15:39:37.403811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059111+0000","last_change":"2024-05-26T15:39:37.408873+0000","last_active":"2024-05-26T15:39:39.059111+0000","last_peered":"2024-05-26T15:39:39.059111+0000","last_clean":"2024-05-26T15:39:39.059111+0000","last_became_active":"2024-05-26T15:39:37.408458+0000","last_became_peered":"2024-05-26T15:39:37.408458+0000","last_unstale":"2024-05-26T15:39:39.059111+0000","last_undegraded":"2024-05-26T15:39:39.059111+0000","last_fullsized":"2024-05-26T15:39:39.059111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.499252+0000","last_change":"2024-05-26T15:39:32.928652+0000","last_active":"2024-05-26T15:39:37.499252+0000","last_peered":"2024-05-26T15:39:37.499252+0000","last_clean":"2024-05-26T15:39:37.499252+0000","last_became_active":"2024-05-26T15:39:32.925638+0000","last_became_peered":"2024-05-26T15:39:32.925638+0000","last_unstale":"2024-05-26T15:39:37.499252+0000","last_undegraded":"2024-05-26T15:39:37.499252+0000","last_fullsized":"2024-05-26T15:39:37.499252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.394843+0000","last_change":"2024-05-26T15:39:32.414781+0000","last_active":"2024-05-26T15:39:37.394843+0000","last_peered":"2024-05-26T15:39:37.394843+0000","last_clean":"2024-05-26T15:39:37.394843+0000","last_became_active":"2024-05-26T15:39:32.414352+0000","last_became_peered":"2024-05-26T15:39:32.414352+0000","last_unstale":"2024-05-26T15:39:37.394843+0000","last_undegraded":"2024-05-26T15:39:37.394843+0000","last_fullsized":"2024-05-26T15:39:37.394843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.289544+0000","last_change":"2024-05-26T15:39:37.498550+0000","last_active":"2024-05-26T15:39:39.289544+0000","last_peered":"2024-05-26T15:39:39.289544+0000","last_clean":"2024-05-26T15:39:39.289544+0000","last_became_active":"2024-05-26T15:39:37.497751+0000","last_became_peered":"2024-05-26T15:39:37.497751+0000","last_unstale":"2024-05-26T15:39:39.289544+0000","last_undegraded":"2024-05-26T15:39:39.289544+0000","last_fullsized":"2024-05-26T15:39:39.289544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495328+0000","last_change":"2024-05-26T15:39:32.919184+0000","last_active":"2024-05-26T15:39:37.495328+0000","last_peered":"2024-05-26T15:39:37.495328+0000","last_clean":"2024-05-26T15:39:37.495328+0000","last_became_active":"2024-05-26T15:39:32.917283+0000","last_became_peered":"2024-05-26T15:39:32.917283+0000","last_unstale":"2024-05-26T15:39:37.495328+0000","last_undegraded":"2024-05-26T15:39:37.495328+0000","last_fullsized":"2024-05-26T15:39:37.495328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387011+0000","last_change":"2024-05-26T15:39:32.414068+0000","last_active":"2024-05-26T15:39:37.387011+0000","last_peered":"2024-05-26T15:39:37.387011+0000","last_clean":"2024-05-26T15:39:37.387011+0000","last_became_active":"2024-05-26T15:39:32.411487+0000","last_became_peered":"2024-05-26T15:39:32.411487+0000","last_unstale":"2024-05-26T15:39:37.387011+0000","last_undegraded":"2024-05-26T15:39:37.387011+0000","last_fullsized":"2024-05-26T15:39:37.387011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:04:28.582294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881086+0000","last_change":"2024-05-26T15:39:37.406440+0000","last_active":"2024-05-26T15:39:37.881086+0000","last_peered":"2024-05-26T15:39:37.881086+0000","last_clean":"2024-05-26T15:39:37.881086+0000","last_became_active":"2024-05-26T15:39:37.405935+0000","last_became_peered":"2024-05-26T15:39:37.405935+0000","last_unstale":"2024-05-26T15:39:37.881086+0000","last_undegraded":"2024-05-26T15:39:37.881086+0000","last_fullsized":"2024-05-26T15:39:37.881086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492257+0000","last_change":"2024-05-26T15:39:32.920860+0000","last_active":"2024-05-26T15:39:37.492257+0000","last_peered":"2024-05-26T15:39:37.492257+0000","last_clean":"2024-05-26T15:39:37.492257+0000","last_became_active":"2024-05-26T15:39:32.920251+0000","last_became_peered":"2024-05-26T15:39:32.920251+0000","last_unstale":"2024-05-26T15:39:37.492257+0000","last_undegraded":"2024-05-26T15:39:37.492257+0000","last_fullsized":"2024-05-26T15:39:37.492257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.393055+0000","last_change":"2024-05-26T15:39:32.412837+0000","last_active":"2024-05-26T15:39:37.393055+0000","last_peered":"2024-05-26T15:39:37.393055+0000","last_clean":"2024-05-26T15:39:37.393055+0000","last_became_active":"2024-05-26T15:39:32.412474+0000","last_became_peered":"2024-05-26T15:39:32.412474+0000","last_unstale":"2024-05-26T15:39:37.393055+0000","last_undegraded":"2024-05-26T15:39:37.393055+0000","last_fullsized":"2024-05-26T15:39:37.393055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059319+0000","last_change":"2024-05-26T15:39:37.405354+0000","last_active":"2024-05-26T15:39:39.059319+0000","last_peered":"2024-05-26T15:39:39.059319+0000","last_clean":"2024-05-26T15:39:39.059319+0000","last_became_active":"2024-05-26T15:39:37.404972+0000","last_became_peered":"2024-05-26T15:39:37.404972+0000","last_unstale":"2024-05-26T15:39:39.059319+0000","last_undegraded":"2024-05-26T15:39:39.059319+0000","last_fullsized":"2024-05-26T15:39:39.059319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:29:06.780253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401985+0000","last_change":"2024-05-26T15:39:32.924084+0000","last_active":"2024-05-26T15:39:37.401985+0000","last_peered":"2024-05-26T15:39:37.401985+0000","last_clean":"2024-05-26T15:39:37.401985+0000","last_became_active":"2024-05-26T15:39:32.922027+0000","last_became_peered":"2024-05-26T15:39:32.922027+0000","last_unstale":"2024-05-26T15:39:37.401985+0000","last_undegraded":"2024-05-26T15:39:37.401985+0000","last_fullsized":"2024-05-26T15:39:37.401985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:13:14.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404763+0000","last_change":"2024-05-26T15:39:32.436505+0000","last_active":"2024-05-26T15:39:37.404763+0000","last_peered":"2024-05-26T15:39:37.404763+0000","last_clean":"2024-05-26T15:39:37.404763+0000","last_became_active":"2024-05-26T15:39:32.436215+0000","last_became_peered":"2024-05-26T15:39:32.436215+0000","last_unstale":"2024-05-26T15:39:37.404763+0000","last_undegraded":"2024-05-26T15:39:37.404763+0000","last_fullsized":"2024-05-26T15:39:37.404763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.289226+0000","last_change":"2024-05-26T15:39:37.502778+0000","last_active":"2024-05-26T15:39:39.289226+0000","last_peered":"2024-05-26T15:39:39.289226+0000","last_clean":"2024-05-26T15:39:39.289226+0000","last_became_active":"2024-05-26T15:39:37.502334+0000","last_became_peered":"2024-05-26T15:39:37.502334+0000","last_unstale":"2024-05-26T15:39:39.289226+0000","last_undegraded":"2024-05-26T15:39:39.289226+0000","last_fullsized":"2024-05-26T15:39:39.289226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:46:37.155490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492337+0000","last_change":"2024-05-26T15:39:32.920320+0000","last_active":"2024-05-26T15:39:37.492337+0000","last_peered":"2024-05-26T15:39:37.492337+0000","last_clean":"2024-05-26T15:39:37.492337+0000","last_became_active":"2024-05-26T15:39:32.919937+0000","last_became_peered":"2024-05-26T15:39:32.919937+0000","last_unstale":"2024-05-26T15:39:37.492337+0000","last_undegraded":"2024-05-26T15:39:37.492337+0000","last_fullsized":"2024-05-26T15:39:37.492337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401560+0000","last_change":"2024-05-26T15:39:32.429375+0000","last_active":"2024-05-26T15:39:37.401560+0000","last_peered":"2024-05-26T15:39:37.401560+0000","last_clean":"2024-05-26T15:39:37.401560+0000","last_became_active":"2024-05-26T15:39:32.429095+0000","last_became_peered":"2024-05-26T15:39:32.429095+0000","last_unstale":"2024-05-26T15:39:37.401560+0000","last_undegraded":"2024-05-26T15:39:37.401560+0000","last_fullsized":"2024-05-26T15:39:37.401560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288508+0000","last_change":"2024-05-26T15:39:37.496912+0000","last_active":"2024-05-26T15:39:39.288508+0000","last_peered":"2024-05-26T15:39:39.288508+0000","last_clean":"2024-05-26T15:39:39.288508+0000","last_became_active":"2024-05-26T15:39:37.496258+0000","last_became_peered":"2024-05-26T15:39:37.496258+0000","last_unstale":"2024-05-26T15:39:39.288508+0000","last_undegraded":"2024-05-26T15:39:39.288508+0000","last_fullsized":"2024-05-26T15:39:39.288508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:19:25.927673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384003+0000","last_change":"2024-05-26T15:39:32.919040+0000","last_active":"2024-05-26T15:39:37.384003+0000","last_peered":"2024-05-26T15:39:37.384003+0000","last_clean":"2024-05-26T15:39:37.384003+0000","last_became_active":"2024-05-26T15:39:32.918706+0000","last_became_peered":"2024-05-26T15:39:32.918706+0000","last_unstale":"2024-05-26T15:39:37.384003+0000","last_undegraded":"2024-05-26T15:39:37.384003+0000","last_fullsized":"2024-05-26T15:39:37.384003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387247+0000","last_change":"2024-05-26T15:39:32.421131+0000","last_active":"2024-05-26T15:39:37.387247+0000","last_peered":"2024-05-26T15:39:37.387247+0000","last_clean":"2024-05-26T15:39:37.387247+0000","last_became_active":"2024-05-26T15:39:32.420687+0000","last_became_peered":"2024-05-26T15:39:32.420687+0000","last_unstale":"2024-05-26T15:39:37.387247+0000","last_undegraded":"2024-05-26T15:39:37.387247+0000","last_fullsized":"2024-05-26T15:39:37.387247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:13:58.110518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.293090+0000","last_change":"2024-05-26T15:39:37.506017+0000","last_active":"2024-05-26T15:39:39.293090+0000","last_peered":"2024-05-26T15:39:39.293090+0000","last_clean":"2024-05-26T15:39:39.293090+0000","last_became_active":"2024-05-26T15:39:37.503806+0000","last_became_peered":"2024-05-26T15:39:37.503806+0000","last_unstale":"2024-05-26T15:39:39.293090+0000","last_undegraded":"2024-05-26T15:39:39.293090+0000","last_fullsized":"2024-05-26T15:39:39.293090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.494294+0000","last_change":"2024-05-26T15:39:32.924533+0000","last_active":"2024-05-26T15:39:37.494294+0000","last_peered":"2024-05-26T15:39:37.494294+0000","last_clean":"2024-05-26T15:39:37.494294+0000","last_became_active":"2024-05-26T15:39:32.924038+0000","last_became_peered":"2024-05-26T15:39:32.924038+0000","last_unstale":"2024-05-26T15:39:37.494294+0000","last_undegraded":"2024-05-26T15:39:37.494294+0000","last_fullsized":"2024-05-26T15:39:37.494294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:16:58.690646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:51.992714+0000","last_change":"2024-05-26T15:39:32.426312+0000","last_active":"2024-05-26T15:39:51.992714+0000","last_peered":"2024-05-26T15:39:51.992714+0000","last_clean":"2024-05-26T15:39:51.992714+0000","last_became_active":"2024-05-26T15:39:32.425989+0000","last_became_peered":"2024-05-26T15:39:32.425989+0000","last_unstale":"2024-05-26T15:39:51.992714+0000","last_undegraded":"2024-05-26T15:39:51.992714+0000","last_fullsized":"2024-05-26T15:39:51.992714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291701+0000","last_change":"2024-05-26T15:39:37.405366+0000","last_active":"2024-05-26T15:39:38.291701+0000","last_peered":"2024-05-26T15:39:38.291701+0000","last_clean":"2024-05-26T15:39:38.291701+0000","last_became_active":"2024-05-26T15:39:37.405104+0000","last_became_peered":"2024-05-26T15:39:37.405104+0000","last_unstale":"2024-05-26T15:39:38.291701+0000","last_undegraded":"2024-05-26T15:39:38.291701+0000","last_fullsized":"2024-05-26T15:39:38.291701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:56:31.917292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.389859+0000","last_change":"2024-05-26T15:39:32.925841+0000","last_active":"2024-05-26T15:39:37.389859+0000","last_peered":"2024-05-26T15:39:37.389859+0000","last_clean":"2024-05-26T15:39:37.389859+0000","last_became_active":"2024-05-26T15:39:32.924690+0000","last_became_peered":"2024-05-26T15:39:32.924690+0000","last_unstale":"2024-05-26T15:39:37.389859+0000","last_undegraded":"2024-05-26T15:39:37.389859+0000","last_fullsized":"2024-05-26T15:39:37.389859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:26.362390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403757+0000","last_change":"2024-05-26T15:39:32.430740+0000","last_active":"2024-05-26T15:39:37.403757+0000","last_peered":"2024-05-26T15:39:37.403757+0000","last_clean":"2024-05-26T15:39:37.403757+0000","last_became_active":"2024-05-26T15:39:32.430438+0000","last_became_peered":"2024-05-26T15:39:32.430438+0000","last_unstale":"2024-05-26T15:39:37.403757+0000","last_undegraded":"2024-05-26T15:39:37.403757+0000","last_fullsized":"2024-05-26T15:39:37.403757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:25.042059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882702+0000","last_change":"2024-05-26T15:39:37.410892+0000","last_active":"2024-05-26T15:39:37.882702+0000","last_peered":"2024-05-26T15:39:37.882702+0000","last_clean":"2024-05-26T15:39:37.882702+0000","last_became_active":"2024-05-26T15:39:37.410088+0000","last_became_peered":"2024-05-26T15:39:37.410088+0000","last_unstale":"2024-05-26T15:39:37.882702+0000","last_undegraded":"2024-05-26T15:39:37.882702+0000","last_fullsized":"2024-05-26T15:39:37.882702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:02:32.537310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386400+0000","last_change":"2024-05-26T15:39:32.931871+0000","last_active":"2024-05-26T15:39:37.386400+0000","last_peered":"2024-05-26T15:39:37.386400+0000","last_clean":"2024-05-26T15:39:37.386400+0000","last_became_active":"2024-05-26T15:39:32.931615+0000","last_became_peered":"2024-05-26T15:39:32.931615+0000","last_unstale":"2024-05-26T15:39:37.386400+0000","last_undegraded":"2024-05-26T15:39:37.386400+0000","last_fullsized":"2024-05-26T15:39:37.386400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406122+0000","last_change":"2024-05-26T15:39:32.438097+0000","last_active":"2024-05-26T15:39:37.406122+0000","last_peered":"2024-05-26T15:39:37.406122+0000","last_clean":"2024-05-26T15:39:37.406122+0000","last_became_active":"2024-05-26T15:39:32.437759+0000","last_became_peered":"2024-05-26T15:39:32.437759+0000","last_unstale":"2024-05-26T15:39:37.406122+0000","last_undegraded":"2024-05-26T15:39:37.406122+0000","last_fullsized":"2024-05-26T15:39:37.406122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288406+0000","last_change":"2024-05-26T15:39:37.408245+0000","last_active":"2024-05-26T15:39:39.288406+0000","last_peered":"2024-05-26T15:39:39.288406+0000","last_clean":"2024-05-26T15:39:39.288406+0000","last_became_active":"2024-05-26T15:39:37.407821+0000","last_became_peered":"2024-05-26T15:39:37.407821+0000","last_unstale":"2024-05-26T15:39:39.288406+0000","last_undegraded":"2024-05-26T15:39:39.288406+0000","last_fullsized":"2024-05-26T15:39:39.288406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:08:31.905617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406029+0000","last_change":"2024-05-26T15:39:32.935821+0000","last_active":"2024-05-26T15:39:37.406029+0000","last_peered":"2024-05-26T15:39:37.406029+0000","last_clean":"2024-05-26T15:39:37.406029+0000","last_became_active":"2024-05-26T15:39:32.935652+0000","last_became_peered":"2024-05-26T15:39:32.935652+0000","last_unstale":"2024-05-26T15:39:37.406029+0000","last_undegraded":"2024-05-26T15:39:37.406029+0000","last_fullsized":"2024-05-26T15:39:37.406029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:42:31.950324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.407942+0000","last_change":"2024-05-26T15:39:32.434154+0000","last_active":"2024-05-26T15:39:37.407942+0000","last_peered":"2024-05-26T15:39:37.407942+0000","last_clean":"2024-05-26T15:39:37.407942+0000","last_became_active":"2024-05-26T15:39:32.433569+0000","last_became_peered":"2024-05-26T15:39:32.433569+0000","last_unstale":"2024-05-26T15:39:37.407942+0000","last_undegraded":"2024-05-26T15:39:37.407942+0000","last_fullsized":"2024-05-26T15:39:37.407942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288095+0000","last_change":"2024-05-26T15:39:37.500616+0000","last_active":"2024-05-26T15:39:39.288095+0000","last_peered":"2024-05-26T15:39:39.288095+0000","last_clean":"2024-05-26T15:39:39.288095+0000","last_became_active":"2024-05-26T15:39:37.498904+0000","last_became_peered":"2024-05-26T15:39:37.498904+0000","last_unstale":"2024-05-26T15:39:39.288095+0000","last_undegraded":"2024-05-26T15:39:39.288095+0000","last_fullsized":"2024-05-26T15:39:39.288095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:41:02.121900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059278+0000","last_change":"2024-05-26T15:39:37.496964+0000","last_active":"2024-05-26T15:39:39.059278+0000","last_peered":"2024-05-26T15:39:39.059278+0000","last_clean":"2024-05-26T15:39:39.059278+0000","last_became_active":"2024-05-26T15:39:37.496512+0000","last_became_peered":"2024-05-26T15:39:37.496512+0000","last_unstale":"2024-05-26T15:39:39.059278+0000","last_undegraded":"2024-05-26T15:39:39.059278+0000","last_fullsized":"2024-05-26T15:39:39.059278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402612+0000","last_change":"2024-05-26T15:39:32.911606+0000","last_active":"2024-05-26T15:39:37.402612+0000","last_peered":"2024-05-26T15:39:37.402612+0000","last_clean":"2024-05-26T15:39:37.402612+0000","last_became_active":"2024-05-26T15:39:32.910333+0000","last_became_peered":"2024-05-26T15:39:32.910333+0000","last_unstale":"2024-05-26T15:39:37.402612+0000","last_undegraded":"2024-05-26T15:39:37.402612+0000","last_fullsized":"2024-05-26T15:39:37.402612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400770+0000","last_change":"2024-05-26T15:39:32.428197+0000","last_active":"2024-05-26T15:39:37.400770+0000","last_peered":"2024-05-26T15:39:37.400770+0000","last_clean":"2024-05-26T15:39:37.400770+0000","last_became_active":"2024-05-26T15:39:32.427494+0000","last_became_peered":"2024-05-26T15:39:32.427494+0000","last_unstale":"2024-05-26T15:39:37.400770+0000","last_undegraded":"2024-05-26T15:39:37.400770+0000","last_fullsized":"2024-05-26T15:39:37.400770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.003002+0000","last_change":"2024-05-26T15:39:37.416175+0000","last_active":"2024-05-26T15:39:38.003002+0000","last_peered":"2024-05-26T15:39:38.003002+0000","last_clean":"2024-05-26T15:39:38.003002+0000","last_became_active":"2024-05-26T15:39:37.415776+0000","last_became_peered":"2024-05-26T15:39:37.415776+0000","last_unstale":"2024-05-26T15:39:38.003002+0000","last_undegraded":"2024-05-26T15:39:38.003002+0000","last_fullsized":"2024-05-26T15:39:38.003002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:43:41.543097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377018+0000","last_change":"2024-05-26T15:39:32.916588+0000","last_active":"2024-05-26T15:39:37.377018+0000","last_peered":"2024-05-26T15:39:37.377018+0000","last_clean":"2024-05-26T15:39:37.377018+0000","last_became_active":"2024-05-26T15:39:32.916327+0000","last_became_peered":"2024-05-26T15:39:32.916327+0000","last_unstale":"2024-05-26T15:39:37.377018+0000","last_undegraded":"2024-05-26T15:39:37.377018+0000","last_fullsized":"2024-05-26T15:39:37.377018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:49:42.119038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381500+0000","last_change":"2024-05-26T15:39:32.429439+0000","last_active":"2024-05-26T15:39:37.381500+0000","last_peered":"2024-05-26T15:39:37.381500+0000","last_clean":"2024-05-26T15:39:37.381500+0000","last_became_active":"2024-05-26T15:39:32.428892+0000","last_became_peered":"2024-05-26T15:39:32.428892+0000","last_unstale":"2024-05-26T15:39:37.381500+0000","last_undegraded":"2024-05-26T15:39:37.381500+0000","last_fullsized":"2024-05-26T15:39:37.381500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405154+0000","last_change":"2024-05-26T15:39:32.422718+0000","last_active":"2024-05-26T15:39:37.405154+0000","last_peered":"2024-05-26T15:39:37.405154+0000","last_clean":"2024-05-26T15:39:37.405154+0000","last_became_active":"2024-05-26T15:39:32.422398+0000","last_became_peered":"2024-05-26T15:39:32.422398+0000","last_unstale":"2024-05-26T15:39:37.405154+0000","last_undegraded":"2024-05-26T15:39:37.405154+0000","last_fullsized":"2024-05-26T15:39:37.405154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383126+0000","last_change":"2024-05-26T15:39:32.902434+0000","last_active":"2024-05-26T15:39:37.383126+0000","last_peered":"2024-05-26T15:39:37.383126+0000","last_clean":"2024-05-26T15:39:37.383126+0000","last_became_active":"2024-05-26T15:39:32.901505+0000","last_became_peered":"2024-05-26T15:39:32.901505+0000","last_unstale":"2024-05-26T15:39:37.383126+0000","last_undegraded":"2024-05-26T15:39:37.383126+0000","last_fullsized":"2024-05-26T15:39:37.383126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:21:37.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.877340+0000","last_change":"2024-05-26T15:39:37.405928+0000","last_active":"2024-05-26T15:39:37.877340+0000","last_peered":"2024-05-26T15:39:37.877340+0000","last_clean":"2024-05-26T15:39:37.877340+0000","last_became_active":"2024-05-26T15:39:37.405510+0000","last_became_peered":"2024-05-26T15:39:37.405510+0000","last_unstale":"2024-05-26T15:39:37.877340+0000","last_undegraded":"2024-05-26T15:39:37.877340+0000","last_fullsized":"2024-05-26T15:39:37.877340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:46.788301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.378799+0000","last_change":"2024-05-26T15:39:32.424810+0000","last_active":"2024-05-26T15:39:37.378799+0000","last_peered":"2024-05-26T15:39:37.378799+0000","last_clean":"2024-05-26T15:39:37.378799+0000","last_became_active":"2024-05-26T15:39:32.424518+0000","last_became_peered":"2024-05-26T15:39:32.424518+0000","last_unstale":"2024-05-26T15:39:37.378799+0000","last_undegraded":"2024-05-26T15:39:37.378799+0000","last_fullsized":"2024-05-26T15:39:37.378799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386848+0000","last_change":"2024-05-26T15:39:32.913997+0000","last_active":"2024-05-26T15:39:37.386848+0000","last_peered":"2024-05-26T15:39:37.386848+0000","last_clean":"2024-05-26T15:39:37.386848+0000","last_became_active":"2024-05-26T15:39:32.911604+0000","last_became_peered":"2024-05-26T15:39:32.911604+0000","last_unstale":"2024-05-26T15:39:37.386848+0000","last_undegraded":"2024-05-26T15:39:37.386848+0000","last_fullsized":"2024-05-26T15:39:37.386848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:26.047859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288573+0000","last_change":"2024-05-26T15:39:37.402731+0000","last_active":"2024-05-26T15:39:39.288573+0000","last_peered":"2024-05-26T15:39:39.288573+0000","last_clean":"2024-05-26T15:39:39.288573+0000","last_became_active":"2024-05-26T15:39:37.402227+0000","last_became_peered":"2024-05-26T15:39:37.402227+0000","last_unstale":"2024-05-26T15:39:39.288573+0000","last_undegraded":"2024-05-26T15:39:39.288573+0000","last_fullsized":"2024-05-26T15:39:39.288573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:24:03.470160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401926+0000","last_change":"2024-05-26T15:39:32.924345+0000","last_active":"2024-05-26T15:39:37.401926+0000","last_peered":"2024-05-26T15:39:37.401926+0000","last_clean":"2024-05-26T15:39:37.401926+0000","last_became_active":"2024-05-26T15:39:32.921271+0000","last_became_peered":"2024-05-26T15:39:32.921271+0000","last_unstale":"2024-05-26T15:39:37.401926+0000","last_undegraded":"2024-05-26T15:39:37.401926+0000","last_fullsized":"2024-05-26T15:39:37.401926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.392856+0000","last_change":"2024-05-26T15:39:32.928371+0000","last_active":"2024-05-26T15:39:37.392856+0000","last_peered":"2024-05-26T15:39:37.392856+0000","last_clean":"2024-05-26T15:39:37.392856+0000","last_became_active":"2024-05-26T15:39:32.928159+0000","last_became_peered":"2024-05-26T15:39:32.928159+0000","last_unstale":"2024-05-26T15:39:37.392856+0000","last_undegraded":"2024-05-26T15:39:37.392856+0000","last_fullsized":"2024-05-26T15:39:37.392856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:13.695925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401469+0000","last_change":"2024-05-26T15:39:32.932867+0000","last_active":"2024-05-26T15:39:37.401469+0000","last_peered":"2024-05-26T15:39:37.401469+0000","last_clean":"2024-05-26T15:39:37.401469+0000","last_became_active":"2024-05-26T15:39:32.930753+0000","last_became_peered":"2024-05-26T15:39:32.930753+0000","last_unstale":"2024-05-26T15:39:37.401469+0000","last_undegraded":"2024-05-26T15:39:37.401469+0000","last_fullsized":"2024-05-26T15:39:37.401469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.382843+0000","last_change":"2024-05-26T15:39:32.904786+0000","last_active":"2024-05-26T15:39:37.382843+0000","last_peered":"2024-05-26T15:39:37.382843+0000","last_clean":"2024-05-26T15:39:37.382843+0000","last_became_active":"2024-05-26T15:39:32.904535+0000","last_became_peered":"2024-05-26T15:39:32.904535+0000","last_unstale":"2024-05-26T15:39:37.382843+0000","last_undegraded":"2024-05-26T15:39:37.382843+0000","last_fullsized":"2024-05-26T15:39:37.382843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:59:09.988548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.380690+0000","last_change":"2024-05-26T15:39:32.905236+0000","last_active":"2024-05-26T15:39:37.380690+0000","last_peered":"2024-05-26T15:39:37.380690+0000","last_clean":"2024-05-26T15:39:37.380690+0000","last_became_active":"2024-05-26T15:39:32.904896+0000","last_became_peered":"2024-05-26T15:39:32.904896+0000","last_unstale":"2024-05-26T15:39:37.380690+0000","last_undegraded":"2024-05-26T15:39:37.380690+0000","last_fullsized":"2024-05-26T15:39:37.380690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403711+0000","last_change":"2024-05-26T15:39:32.910981+0000","last_active":"2024-05-26T15:39:37.403711+0000","last_peered":"2024-05-26T15:39:37.403711+0000","last_clean":"2024-05-26T15:39:37.403711+0000","last_became_active":"2024-05-26T15:39:32.910706+0000","last_became_peered":"2024-05-26T15:39:32.910706+0000","last_unstale":"2024-05-26T15:39:37.403711+0000","last_undegraded":"2024-05-26T15:39:37.403711+0000","last_fullsized":"2024-05-26T15:39:37.403711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406819+0000","last_change":"2024-05-26T15:39:32.935119+0000","last_active":"2024-05-26T15:39:37.406819+0000","last_peered":"2024-05-26T15:39:37.406819+0000","last_clean":"2024-05-26T15:39:37.406819+0000","last_became_active":"2024-05-26T15:39:32.934919+0000","last_became_peered":"2024-05-26T15:39:32.934919+0000","last_unstale":"2024-05-26T15:39:37.406819+0000","last_undegraded":"2024-05-26T15:39:37.406819+0000","last_fullsized":"2024-05-26T15:39:37.406819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379796+0000","last_change":"2024-05-26T15:39:32.913549+0000","last_active":"2024-05-26T15:39:37.379796+0000","last_peered":"2024-05-26T15:39:37.379796+0000","last_clean":"2024-05-26T15:39:37.379796+0000","last_became_active":"2024-05-26T15:39:32.913283+0000","last_became_peered":"2024-05-26T15:39:32.913283+0000","last_unstale":"2024-05-26T15:39:37.379796+0000","last_undegraded":"2024-05-26T15:39:37.379796+0000","last_fullsized":"2024-05-26T15:39:37.379796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400722+0000","last_change":"2024-05-26T15:39:32.934682+0000","last_active":"2024-05-26T15:39:37.400722+0000","last_peered":"2024-05-26T15:39:37.400722+0000","last_clean":"2024-05-26T15:39:37.400722+0000","last_became_active":"2024-05-26T15:39:32.934208+0000","last_became_peered":"2024-05-26T15:39:32.934208+0000","last_unstale":"2024-05-26T15:39:37.400722+0000","last_undegraded":"2024-05-26T15:39:37.400722+0000","last_fullsized":"2024-05-26T15:39:37.400722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381124+0000","last_change":"2024-05-26T15:39:32.902536+0000","last_active":"2024-05-26T15:39:37.381124+0000","last_peered":"2024-05-26T15:39:37.381124+0000","last_clean":"2024-05-26T15:39:37.381124+0000","last_became_active":"2024-05-26T15:39:32.901428+0000","last_became_peered":"2024-05-26T15:39:32.901428+0000","last_unstale":"2024-05-26T15:39:37.381124+0000","last_undegraded":"2024-05-26T15:39:37.381124+0000","last_fullsized":"2024-05-26T15:39:37.381124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401378+0000","last_change":"2024-05-26T15:39:32.933748+0000","last_active":"2024-05-26T15:39:37.401378+0000","last_peered":"2024-05-26T15:39:37.401378+0000","last_clean":"2024-05-26T15:39:37.401378+0000","last_became_active":"2024-05-26T15:39:32.933508+0000","last_became_peered":"2024-05-26T15:39:32.933508+0000","last_unstale":"2024-05-26T15:39:37.401378+0000","last_undegraded":"2024-05-26T15:39:37.401378+0000","last_fullsized":"2024-05-26T15:39:37.401378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381893+0000","last_change":"2024-05-26T15:39:32.919340+0000","last_active":"2024-05-26T15:39:37.381893+0000","last_peered":"2024-05-26T15:39:37.381893+0000","last_clean":"2024-05-26T15:39:37.381893+0000","last_became_active":"2024-05-26T15:39:32.919090+0000","last_became_peered":"2024-05-26T15:39:32.919090+0000","last_unstale":"2024-05-26T15:39:37.381893+0000","last_undegraded":"2024-05-26T15:39:37.381893+0000","last_fullsized":"2024-05-26T15:39:37.381893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404517+0000","last_change":"2024-05-26T15:39:32.931353+0000","last_active":"2024-05-26T15:39:37.404517+0000","last_peered":"2024-05-26T15:39:37.404517+0000","last_clean":"2024-05-26T15:39:37.404517+0000","last_became_active":"2024-05-26T15:39:32.931035+0000","last_became_peered":"2024-05-26T15:39:32.931035+0000","last_unstale":"2024-05-26T15:39:37.404517+0000","last_undegraded":"2024-05-26T15:39:37.404517+0000","last_fullsized":"2024-05-26T15:39:37.404517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495006+0000","last_change":"2024-05-26T15:39:32.924340+0000","last_active":"2024-05-26T15:39:37.495006+0000","last_peered":"2024-05-26T15:39:37.495006+0000","last_clean":"2024-05-26T15:39:37.495006+0000","last_became_active":"2024-05-26T15:39:32.923614+0000","last_became_peered":"2024-05-26T15:39:32.923614+0000","last_unstale":"2024-05-26T15:39:37.495006+0000","last_undegraded":"2024-05-26T15:39:37.495006+0000","last_fullsized":"2024-05-26T15:39:37.495006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:49:42.119038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.394752+0000","last_change":"2024-05-26T15:39:32.919960+0000","last_active":"2024-05-26T15:39:37.394752+0000","last_peered":"2024-05-26T15:39:37.394752+0000","last_clean":"2024-05-26T15:39:37.394752+0000","last_became_active":"2024-05-26T15:39:32.919682+0000","last_became_peered":"2024-05-26T15:39:32.919682+0000","last_unstale":"2024-05-26T15:39:37.394752+0000","last_undegraded":"2024-05-26T15:39:37.394752+0000","last_fullsized":"2024-05-26T15:39:37.394752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:51:22.074231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.407162+0000","last_change":"2024-05-26T15:39:32.931526+0000","last_active":"2024-05-26T15:39:37.407162+0000","last_peered":"2024-05-26T15:39:37.407162+0000","last_clean":"2024-05-26T15:39:37.407162+0000","last_became_active":"2024-05-26T15:39:32.930641+0000","last_became_peered":"2024-05-26T15:39:32.930641+0000","last_unstale":"2024-05-26T15:39:37.407162+0000","last_undegraded":"2024-05-26T15:39:37.407162+0000","last_fullsized":"2024-05-26T15:39:37.407162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400658+0000","last_change":"2024-05-26T15:39:32.935238+0000","last_active":"2024-05-26T15:39:37.400658+0000","last_peered":"2024-05-26T15:39:37.400658+0000","last_clean":"2024-05-26T15:39:37.400658+0000","last_became_active":"2024-05-26T15:39:32.934888+0000","last_became_peered":"2024-05-26T15:39:32.934888+0000","last_unstale":"2024-05-26T15:39:37.400658+0000","last_undegraded":"2024-05-26T15:39:37.400658+0000","last_fullsized":"2024-05-26T15:39:37.400658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402726+0000","last_change":"2024-05-26T15:39:32.912394+0000","last_active":"2024-05-26T15:39:37.402726+0000","last_peered":"2024-05-26T15:39:37.402726+0000","last_clean":"2024-05-26T15:39:37.402726+0000","last_became_active":"2024-05-26T15:39:32.911158+0000","last_became_peered":"2024-05-26T15:39:32.911158+0000","last_unstale":"2024-05-26T15:39:37.402726+0000","last_undegraded":"2024-05-26T15:39:37.402726+0000","last_fullsized":"2024-05-26T15:39:37.402726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383741+0000","last_change":"2024-05-26T15:39:32.913949+0000","last_active":"2024-05-26T15:39:37.383741+0000","last_peered":"2024-05-26T15:39:37.383741+0000","last_clean":"2024-05-26T15:39:37.383741+0000","last_became_active":"2024-05-26T15:39:32.911597+0000","last_became_peered":"2024-05-26T15:39:32.911597+0000","last_unstale":"2024-05-26T15:39:37.383741+0000","last_undegraded":"2024-05-26T15:39:37.383741+0000","last_fullsized":"2024-05-26T15:39:37.383741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:13:14.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377776+0000","last_change":"2024-05-26T15:39:32.923083+0000","last_active":"2024-05-26T15:39:37.377776+0000","last_peered":"2024-05-26T15:39:37.377776+0000","last_clean":"2024-05-26T15:39:37.377776+0000","last_became_active":"2024-05-26T15:39:32.921098+0000","last_became_peered":"2024-05-26T15:39:32.921098+0000","last_unstale":"2024-05-26T15:39:37.377776+0000","last_undegraded":"2024-05-26T15:39:37.377776+0000","last_fullsized":"2024-05-26T15:39:37.377776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:21:37.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.390272+0000","last_change":"2024-05-26T15:39:32.923188+0000","last_active":"2024-05-26T15:39:37.390272+0000","last_peered":"2024-05-26T15:39:37.390272+0000","last_clean":"2024-05-26T15:39:37.390272+0000","last_became_active":"2024-05-26T15:39:32.921678+0000","last_became_peered":"2024-05-26T15:39:32.921678+0000","last_unstale":"2024-05-26T15:39:37.390272+0000","last_undegraded":"2024-05-26T15:39:37.390272+0000","last_fullsized":"2024-05-26T15:39:37.390272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:13.695925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406882+0000","last_change":"2024-05-26T15:39:32.939084+0000","last_active":"2024-05-26T15:39:37.406882+0000","last_peered":"2024-05-26T15:39:37.406882+0000","last_clean":"2024-05-26T15:39:37.406882+0000","last_became_active":"2024-05-26T15:39:32.938713+0000","last_became_peered":"2024-05-26T15:39:32.938713+0000","last_unstale":"2024-05-26T15:39:37.406882+0000","last_undegraded":"2024-05-26T15:39:37.406882+0000","last_fullsized":"2024-05-26T15:39:37.406882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406775+0000","last_change":"2024-05-26T15:39:32.939883+0000","last_active":"2024-05-26T15:39:37.406775+0000","last_peered":"2024-05-26T15:39:37.406775+0000","last_clean":"2024-05-26T15:39:37.406775+0000","last_became_active":"2024-05-26T15:39:32.937951+0000","last_became_peered":"2024-05-26T15:39:32.937951+0000","last_unstale":"2024-05-26T15:39:37.406775+0000","last_undegraded":"2024-05-26T15:39:37.406775+0000","last_fullsized":"2024-05-26T15:39:37.406775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.499084+0000","last_change":"2024-05-26T15:39:32.930657+0000","last_active":"2024-05-26T15:39:37.499084+0000","last_peered":"2024-05-26T15:39:37.499084+0000","last_clean":"2024-05-26T15:39:37.499084+0000","last_became_active":"2024-05-26T15:39:32.930382+0000","last_became_peered":"2024-05-26T15:39:32.930382+0000","last_unstale":"2024-05-26T15:39:37.499084+0000","last_undegraded":"2024-05-26T15:39:37.499084+0000","last_fullsized":"2024-05-26T15:39:37.499084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:24.160382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.375877+0000","last_change":"2024-05-26T15:39:32.930568+0000","last_active":"2024-05-26T15:39:37.375877+0000","last_peered":"2024-05-26T15:39:37.375877+0000","last_clean":"2024-05-26T15:39:37.375877+0000","last_became_active":"2024-05-26T15:39:32.930302+0000","last_became_peered":"2024-05-26T15:39:32.930302+0000","last_unstale":"2024-05-26T15:39:37.375877+0000","last_undegraded":"2024-05-26T15:39:37.375877+0000","last_fullsized":"2024-05-26T15:39:37.375877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492015+0000","last_change":"2024-05-26T15:39:32.920604+0000","last_active":"2024-05-26T15:39:37.492015+0000","last_peered":"2024-05-26T15:39:37.492015+0000","last_clean":"2024-05-26T15:39:37.492015+0000","last_became_active":"2024-05-26T15:39:32.919836+0000","last_became_peered":"2024-05-26T15:39:32.919836+0000","last_unstale":"2024-05-26T15:39:37.492015+0000","last_undegraded":"2024-05-26T15:39:37.492015+0000","last_fullsized":"2024-05-26T15:39:37.492015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:07:02.159693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401276+0000","last_change":"2024-05-26T15:39:32.937715+0000","last_active":"2024-05-26T15:39:37.401276+0000","last_peered":"2024-05-26T15:39:37.401276+0000","last_clean":"2024-05-26T15:39:37.401276+0000","last_became_active":"2024-05-26T15:39:32.937451+0000","last_became_peered":"2024-05-26T15:39:32.937451+0000","last_unstale":"2024-05-26T15:39:37.401276+0000","last_undegraded":"2024-05-26T15:39:37.401276+0000","last_fullsized":"2024-05-26T15:39:37.401276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.491613+0000","last_change":"2024-05-26T15:39:32.924295+0000","last_active":"2024-05-26T15:39:37.491613+0000","last_peered":"2024-05-26T15:39:37.491613+0000","last_clean":"2024-05-26T15:39:37.491613+0000","last_became_active":"2024-05-26T15:39:32.923812+0000","last_became_peered":"2024-05-26T15:39:32.923812+0000","last_unstale":"2024-05-26T15:39:37.491613+0000","last_undegraded":"2024-05-26T15:39:37.491613+0000","last_fullsized":"2024-05-26T15:39:37.491613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:42:31.950324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402857+0000","last_change":"2024-05-26T15:39:32.936632+0000","last_active":"2024-05-26T15:39:37.402857+0000","last_peered":"2024-05-26T15:39:37.402857+0000","last_clean":"2024-05-26T15:39:37.402857+0000","last_became_active":"2024-05-26T15:39:32.934911+0000","last_became_peered":"2024-05-26T15:39:32.934911+0000","last_unstale":"2024-05-26T15:39:37.402857+0000","last_undegraded":"2024-05-26T15:39:37.402857+0000","last_fullsized":"2024-05-26T15:39:37.402857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:24.160382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384458+0000","last_change":"2024-05-26T15:39:32.915854+0000","last_active":"2024-05-26T15:39:37.384458+0000","last_peered":"2024-05-26T15:39:37.384458+0000","last_clean":"2024-05-26T15:39:37.384458+0000","last_became_active":"2024-05-26T15:39:32.915514+0000","last_became_peered":"2024-05-26T15:39:32.915514+0000","last_unstale":"2024-05-26T15:39:37.384458+0000","last_undegraded":"2024-05-26T15:39:37.384458+0000","last_fullsized":"2024-05-26T15:39:37.384458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:03.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403966+0000","last_change":"2024-05-26T15:39:32.919780+0000","last_active":"2024-05-26T15:39:37.403966+0000","last_peered":"2024-05-26T15:39:37.403966+0000","last_clean":"2024-05-26T15:39:37.403966+0000","last_became_active":"2024-05-26T15:39:32.919496+0000","last_became_peered":"2024-05-26T15:39:32.919496+0000","last_unstale":"2024-05-26T15:39:37.403966+0000","last_undegraded":"2024-05-26T15:39:37.403966+0000","last_fullsized":"2024-05-26T15:39:37.403966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:09:26.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495449+0000","last_change":"2024-05-26T15:39:32.922248+0000","last_active":"2024-05-26T15:39:37.495449+0000","last_peered":"2024-05-26T15:39:37.495449+0000","last_clean":"2024-05-26T15:39:37.495449+0000","last_became_active":"2024-05-26T15:39:32.921988+0000","last_became_peered":"2024-05-26T15:39:32.921988+0000","last_unstale":"2024-05-26T15:39:37.495449+0000","last_undegraded":"2024-05-26T15:39:37.495449+0000","last_fullsized":"2024-05-26T15:39:37.495449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:47:40.508265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":98851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.839}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.238}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":98761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:40:08.521 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:40:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.759+0000 7f2eda600640 1 Processor -- start 2024-05-26T15:40:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.759+0000 7f2eda600640 1 -- start start 2024-05-26T15:40:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.761+0000 7f2eda600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ed415cfe0 0x7f2ed40b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.761+0000 7f2eda600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed415d480 con 0x7f2ed41571a0 2024-05-26T15:40:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.761+0000 7f2eda600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed415d760 con 0x7f2ed40b0d20 2024-05-26T15:40:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.761+0000 7f2eda600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed415e090 con 0x7f2ed415cfe0 2024-05-26T15:40:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.762+0000 7f2ed9200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2ed41571a0 0x7f2ed40caaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60506/0 (socket says 172.21.15.8:60506) 2024-05-26T15:40:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.762+0000 7f2ed9200640 1 -- 172.21.15.8:0/274243757 learned_addr learned my addr 172.21.15.8:0/274243757 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.762+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/274243757 >> v2:172.21.15.47:3300/0 conn(0x7f2ed415cfe0 0x7f2ed40b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.762+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077610504 0 0) 0x7f2ed415d480 con 0x7f2ed41571a0 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.762+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb8003520 con 0x7f2ed41571a0 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2296675517 0 0) 0x7f2eb8003520 con 0x7f2ed41571a0 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 >> v2:172.21.15.47:3300/0 conn(0x7f2ed415cfe0 msgr2=0x7f2ed40b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 --2- 172.21.15.8:0/274243757 >> v2:172.21.15.47:3300/0 conn(0x7f2ed415cfe0 0x7f2ed40b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 >> v1:172.21.15.47:6789/0 conn(0x7f2ed40b0d20 legacy=0x7f2ed40c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed415da40 con 0x7f2ed41571a0 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f2ec4001670 con 0x7f2ed41571a0 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 >> v1:172.21.15.8:6789/0 conn(0x7f2ed41571a0 legacy=0x7f2ed40caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb80039c0 0x7f2eb8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb80047c0 0x7f2eb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb8005180 0x7f2eb800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed415e090 con 0x7f2eb80047c0 2024-05-26T15:40:08.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb800c080 con 0x7f2eb80039c0 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb800c240 con 0x7f2eb8005180 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.763+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb80047c0 0x7f2eb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.764+0000 7f2ed9200640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb80039c0 0x7f2eb8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.764+0000 7f2ed9c00640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb8005180 0x7f2eb800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.764+0000 7f2ecbe00640 1 -- 172.21.15.8:0/274243757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb8005180 msgr2=0x7f2eb800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.764+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb8005180 0x7f2eb800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.764+0000 7f2ecbe00640 1 -- 172.21.15.8:0/274243757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb80039c0 msgr2=0x7f2eb8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.764+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb80039c0 0x7f2eb8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.764+0000 7f2ecbe00640 1 -- 172.21.15.8:0/274243757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8003520 con 0x7f2eb80047c0 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.764+0000 7f2ed9c00640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb8005180 0x7f2eb800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.764+0000 7f2ed9c00640 1 -- 172.21.15.8:0/274243757 reap_dead start 2024-05-26T15:40:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.765+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb80047c0 0x7f2eb8004c40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009ac0 tx=0x7f2eb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e671a489440f691d server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.765+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc031400 con 0x7f2eb80047c0 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.765+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc02d050 con 0x7f2eb80047c0 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.765+0000 7f2ed3e00640 1 -- 172.21.15.8:0/274243757 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc031780 con 0x7f2eb80047c0 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.766+0000 7f2eda600640 1 -- 172.21.15.8:0/274243757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb80047c0 msgr2=0x7f2eb8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.766+0000 7f2eda600640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb80047c0 0x7f2eb8004c40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009ac0 tx=0x7f2eb80057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.766+0000 7f2eda600640 1 -- 172.21.15.8:0/274243757 shutdown_connections 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.766+0000 7f2eda600640 1 --2- 172.21.15.8:0/274243757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb80047c0 0x7f2eb8004c40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.766+0000 7f2eda600640 1 -- 172.21.15.8:0/274243757 >> 172.21.15.8:0/274243757 conn(0x7f2ed4070480 msgr2=0x7f2ed4070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.766+0000 7f2eda600640 1 -- 172.21.15.8:0/274243757 shutdown_connections 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.766+0000 7f2eda600640 1 -- 172.21.15.8:0/274243757 wait complete. 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.767+0000 7f2eda600640 1 Processor -- start 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.768+0000 7f2eda600640 1 -- start start 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.768+0000 7f2eda600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb80047c0 0x7f2ed40b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2eda600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ed414ee00 0x7f2ed413d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2eda600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ed415a210 0x7f2ed41576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2eda600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed414e550 con 0x7f2ed414ee00 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2eda600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed40b1e20 con 0x7f2eb80047c0 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2eda600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed40b2100 con 0x7f2ed415a210 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ecbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ed414ee00 0x7f2ed413d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ecbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ed414ee00 0x7f2ed413d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47862/0 (socket says 172.21.15.8:47862) 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ecbe00640 1 -- 172.21.15.8:0/3318060271 learned_addr learned my addr 172.21.15.8:0/3318060271 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ed9c00640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ed415a210 0x7f2ed41576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ed9200640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb80047c0 0x7f2ed40b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ecbe00640 1 -- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ed415a210 msgr2=0x7f2ed41576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ed415a210 0x7f2ed41576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ecbe00640 1 -- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb80047c0 msgr2=0x7f2ed40b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb80047c0 0x7f2ed40b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ecbe00640 1 -- 172.21.15.8:0/3318060271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed40b23e0 con 0x7f2ed414ee00 2024-05-26T15:40:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.769+0000 7f2ed9200640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb80047c0 0x7f2ed40b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.770+0000 7f2ecbe00640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ed414ee00 0x7f2ed413d900 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc02aae0 tx=0x7f2ebc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.770+0000 7f2ed1600640 1 -- 172.21.15.8:0/3318060271 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc003e90 con 0x7f2ed414ee00 2024-05-26T15:40:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.770+0000 7f2ed1600640 1 -- 172.21.15.8:0/3318060271 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc03b400 con 0x7f2ed414ee00 2024-05-26T15:40:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.770+0000 7f2ed1600640 1 -- 172.21.15.8:0/3318060271 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc03b790 con 0x7f2ed414ee00 2024-05-26T15:40:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.770+0000 7f2eda600640 1 -- 172.21.15.8:0/3318060271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed40b26c0 con 0x7f2ed414ee00 2024-05-26T15:40:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.770+0000 7f2eda600640 1 -- 172.21.15.8:0/3318060271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed40b1ab0 con 0x7f2ed414ee00 2024-05-26T15:40:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.771+0000 7f2eda600640 1 -- 172.21.15.8:0/3318060271 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed404e280 con 0x7f2ed414ee00 2024-05-26T15:40:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.772+0000 7f2ed1600640 1 -- 172.21.15.8:0/3318060271 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2ebc03b8f0 con 0x7f2ed414ee00 2024-05-26T15:40:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.773+0000 7f2ed1600640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2eb006ac30 0x7f2eb006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.773+0000 7f2ed1600640 1 -- 172.21.15.8:0/3318060271 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ebc0a9c00 con 0x7f2ed414ee00 2024-05-26T15:40:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.774+0000 7f2ed9200640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2eb006ac30 0x7f2eb006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:08.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.775+0000 7f2ed9200640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2eb006ac30 0x7f2eb006d0f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40058b0 tx=0x7f2ec4000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:08.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.778+0000 7f2ed1600640 1 -- 172.21.15.8:0/3318060271 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2ebc0b0080 con 0x7f2ed414ee00 2024-05-26T15:40:08.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.969+0000 7f2eda600640 1 -- 172.21.15.8:0/3318060271 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ed40ca7d0 con 0x7f2eb006ac30 2024-05-26T15:40:08.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:08.996+0000 7f2ed1600640 1 -- 172.21.15.8:0/3318060271 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345086 (secure 0 0 0) 0x7f2ec4005e30 con 0x7f2eb006ac30 2024-05-26T15:40:08.999 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:09.001 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:40:09.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.003+0000 7f2eda600640 1 -- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2eb006ac30 msgr2=0x7f2eb006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.003+0000 7f2eda600640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2eb006ac30 0x7f2eb006d0f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40058b0 tx=0x7f2ec4000ed0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.003+0000 7f2eda600640 1 -- 172.21.15.8:0/3318060271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ed414ee00 msgr2=0x7f2ed413d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.004+0000 7f2eda600640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ed414ee00 0x7f2ed413d900 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc02aae0 tx=0x7f2ebc004730 comp rx=0 tx=0).stop 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.004+0000 7f2eda600640 1 -- 172.21.15.8:0/3318060271 shutdown_connections 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.004+0000 7f2eda600640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2ed415a210 0x7f2ed41576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.004+0000 7f2eda600640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2ed414ee00 0x7f2ed413d900 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.004+0000 7f2eda600640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2eb006ac30 0x7f2eb006d0f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.004+0000 7f2eda600640 1 --2- 172.21.15.8:0/3318060271 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2eb80047c0 0x7f2ed40b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.004+0000 7f2eda600640 1 -- 172.21.15.8:0/3318060271 >> 172.21.15.8:0/3318060271 conn(0x7f2ed4070480 msgr2=0x7f2ed406d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.004+0000 7f2eda600640 1 -- 172.21.15.8:0/3318060271 shutdown_connections 2024-05-26T15:40:09.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.004+0000 7f2eda600640 1 -- 172.21.15.8:0/3318060271 wait complete. 2024-05-26T15:40:09.020 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-05-26T15:40:08.167077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235744,"kb_used_data":3196,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738976,"statfs":{"total":773094113280,"available":772852711424,"internally_reserved":0,"allocated":3272704,"data_stored":1985107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005713"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386165+0000","last_change":"2024-05-26T15:39:32.432165+0000","last_active":"2024-05-26T15:39:37.386165+0000","last_peered":"2024-05-26T15:39:37.386165+0000","last_clean":"2024-05-26T15:39:37.386165+0000","last_became_active":"2024-05-26T15:39:32.431489+0000","last_became_peered":"2024-05-26T15:39:32.431489+0000","last_unstale":"2024-05-26T15:39:37.386165+0000","last_undegraded":"2024-05-26T15:39:37.386165+0000","last_fullsized":"2024-05-26T15:39:37.386165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:45:24.383306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379327+0000","last_change":"2024-05-26T15:39:32.919233+0000","last_active":"2024-05-26T15:39:37.379327+0000","last_peered":"2024-05-26T15:39:37.379327+0000","last_clean":"2024-05-26T15:39:37.379327+0000","last_became_active":"2024-05-26T15:39:32.918954+0000","last_became_peered":"2024-05-26T15:39:32.918954+0000","last_unstale":"2024-05-26T15:39:37.379327+0000","last_undegraded":"2024-05-26T15:39:37.379327+0000","last_fullsized":"2024-05-26T15:39:37.379327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288096+0000","last_change":"2024-05-26T15:39:37.499590+0000","last_active":"2024-05-26T15:39:39.288096+0000","last_peered":"2024-05-26T15:39:39.288096+0000","last_clean":"2024-05-26T15:39:39.288096+0000","last_became_active":"2024-05-26T15:39:37.497710+0000","last_became_peered":"2024-05-26T15:39:37.497710+0000","last_unstale":"2024-05-26T15:39:39.288096+0000","last_undegraded":"2024-05-26T15:39:39.288096+0000","last_fullsized":"2024-05-26T15:39:39.288096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:38:29.550301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379789+0000","last_change":"2024-05-26T15:39:32.420682+0000","last_active":"2024-05-26T15:39:37.379789+0000","last_peered":"2024-05-26T15:39:37.379789+0000","last_clean":"2024-05-26T15:39:37.379789+0000","last_became_active":"2024-05-26T15:39:32.418629+0000","last_became_peered":"2024-05-26T15:39:32.418629+0000","last_unstale":"2024-05-26T15:39:37.379789+0000","last_undegraded":"2024-05-26T15:39:37.379789+0000","last_fullsized":"2024-05-26T15:39:37.379789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383890+0000","last_change":"2024-05-26T15:39:32.930973+0000","last_active":"2024-05-26T15:39:37.383890+0000","last_peered":"2024-05-26T15:39:37.383890+0000","last_clean":"2024-05-26T15:39:37.383890+0000","last_became_active":"2024-05-26T15:39:32.930696+0000","last_became_peered":"2024-05-26T15:39:32.930696+0000","last_unstale":"2024-05-26T15:39:37.383890+0000","last_undegraded":"2024-05-26T15:39:37.383890+0000","last_fullsized":"2024-05-26T15:39:37.383890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881236+0000","last_change":"2024-05-26T15:39:37.407147+0000","last_active":"2024-05-26T15:39:37.881236+0000","last_peered":"2024-05-26T15:39:37.881236+0000","last_clean":"2024-05-26T15:39:37.881236+0000","last_became_active":"2024-05-26T15:39:37.406661+0000","last_became_peered":"2024-05-26T15:39:37.406661+0000","last_unstale":"2024-05-26T15:39:37.881236+0000","last_undegraded":"2024-05-26T15:39:37.881236+0000","last_fullsized":"2024-05-26T15:39:37.881236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:52:01.807307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.494776+0000","last_change":"2024-05-26T15:39:32.436688+0000","last_active":"2024-05-26T15:39:37.494776+0000","last_peered":"2024-05-26T15:39:37.494776+0000","last_clean":"2024-05-26T15:39:37.494776+0000","last_became_active":"2024-05-26T15:39:32.436376+0000","last_became_peered":"2024-05-26T15:39:32.436376+0000","last_unstale":"2024-05-26T15:39:37.494776+0000","last_undegraded":"2024-05-26T15:39:37.494776+0000","last_fullsized":"2024-05-26T15:39:37.494776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:12.690125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402956+0000","last_change":"2024-05-26T15:39:32.937138+0000","last_active":"2024-05-26T15:39:37.402956+0000","last_peered":"2024-05-26T15:39:37.402956+0000","last_clean":"2024-05-26T15:39:37.402956+0000","last_became_active":"2024-05-26T15:39:32.936872+0000","last_became_peered":"2024-05-26T15:39:32.936872+0000","last_unstale":"2024-05-26T15:39:37.402956+0000","last_undegraded":"2024-05-26T15:39:37.402956+0000","last_fullsized":"2024-05-26T15:39:37.402956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:02:49.914564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882195+0000","last_change":"2024-05-26T15:39:37.406227+0000","last_active":"2024-05-26T15:39:37.882195+0000","last_peered":"2024-05-26T15:39:37.882195+0000","last_clean":"2024-05-26T15:39:37.882195+0000","last_became_active":"2024-05-26T15:39:37.405551+0000","last_became_peered":"2024-05-26T15:39:37.405551+0000","last_unstale":"2024-05-26T15:39:37.882195+0000","last_undegraded":"2024-05-26T15:39:37.882195+0000","last_fullsized":"2024-05-26T15:39:37.882195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:45:07.288223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492340+0000","last_change":"2024-05-26T15:39:32.439870+0000","last_active":"2024-05-26T15:39:37.492340+0000","last_peered":"2024-05-26T15:39:37.492340+0000","last_clean":"2024-05-26T15:39:37.492340+0000","last_became_active":"2024-05-26T15:39:32.439491+0000","last_became_peered":"2024-05-26T15:39:32.439491+0000","last_unstale":"2024-05-26T15:39:37.492340+0000","last_undegraded":"2024-05-26T15:39:37.492340+0000","last_fullsized":"2024-05-26T15:39:37.492340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:51:21.068431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405199+0000","last_change":"2024-05-26T15:39:32.932834+0000","last_active":"2024-05-26T15:39:37.405199+0000","last_peered":"2024-05-26T15:39:37.405199+0000","last_clean":"2024-05-26T15:39:37.405199+0000","last_became_active":"2024-05-26T15:39:32.930499+0000","last_became_peered":"2024-05-26T15:39:32.930499+0000","last_unstale":"2024-05-26T15:39:37.405199+0000","last_undegraded":"2024-05-26T15:39:37.405199+0000","last_fullsized":"2024-05-26T15:39:37.405199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:16:58.690646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881578+0000","last_change":"2024-05-26T15:39:37.403865+0000","last_active":"2024-05-26T15:39:37.881578+0000","last_peered":"2024-05-26T15:39:37.881578+0000","last_clean":"2024-05-26T15:39:37.881578+0000","last_became_active":"2024-05-26T15:39:37.403330+0000","last_became_peered":"2024-05-26T15:39:37.403330+0000","last_unstale":"2024-05-26T15:39:37.881578+0000","last_undegraded":"2024-05-26T15:39:37.881578+0000","last_fullsized":"2024-05-26T15:39:37.881578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:56:31.917292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405022+0000","last_change":"2024-05-26T15:39:32.929330+0000","last_active":"2024-05-26T15:39:37.405022+0000","last_peered":"2024-05-26T15:39:37.405022+0000","last_clean":"2024-05-26T15:39:37.405022+0000","last_became_active":"2024-05-26T15:39:32.929059+0000","last_became_peered":"2024-05-26T15:39:32.929059+0000","last_unstale":"2024-05-26T15:39:37.405022+0000","last_undegraded":"2024-05-26T15:39:37.405022+0000","last_fullsized":"2024-05-26T15:39:37.405022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.500100+0000","last_change":"2024-05-26T15:39:32.436030+0000","last_active":"2024-05-26T15:39:37.500100+0000","last_peered":"2024-05-26T15:39:37.500100+0000","last_clean":"2024-05-26T15:39:37.500100+0000","last_became_active":"2024-05-26T15:39:32.434362+0000","last_became_peered":"2024-05-26T15:39:32.434362+0000","last_unstale":"2024-05-26T15:39:37.500100+0000","last_undegraded":"2024-05-26T15:39:37.500100+0000","last_fullsized":"2024-05-26T15:39:37.500100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:25.042059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882811+0000","last_change":"2024-05-26T15:39:37.402375+0000","last_active":"2024-05-26T15:39:37.882811+0000","last_peered":"2024-05-26T15:39:37.882811+0000","last_clean":"2024-05-26T15:39:37.882811+0000","last_became_active":"2024-05-26T15:39:37.401909+0000","last_became_peered":"2024-05-26T15:39:37.401909+0000","last_unstale":"2024-05-26T15:39:37.882811+0000","last_undegraded":"2024-05-26T15:39:37.882811+0000","last_fullsized":"2024-05-26T15:39:37.882811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377881+0000","last_change":"2024-05-26T15:39:32.926407+0000","last_active":"2024-05-26T15:39:37.377881+0000","last_peered":"2024-05-26T15:39:37.377881+0000","last_clean":"2024-05-26T15:39:37.377881+0000","last_became_active":"2024-05-26T15:39:32.924213+0000","last_became_peered":"2024-05-26T15:39:32.924213+0000","last_unstale":"2024-05-26T15:39:37.377881+0000","last_undegraded":"2024-05-26T15:39:37.377881+0000","last_fullsized":"2024-05-26T15:39:37.377881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403642+0000","last_change":"2024-05-26T15:39:32.424999+0000","last_active":"2024-05-26T15:39:37.403642+0000","last_peered":"2024-05-26T15:39:37.403642+0000","last_clean":"2024-05-26T15:39:37.403642+0000","last_became_active":"2024-05-26T15:39:32.424692+0000","last_became_peered":"2024-05-26T15:39:32.424692+0000","last_unstale":"2024-05-26T15:39:37.403642+0000","last_undegraded":"2024-05-26T15:39:37.403642+0000","last_fullsized":"2024-05-26T15:39:37.403642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882346+0000","last_change":"2024-05-26T15:39:37.407719+0000","last_active":"2024-05-26T15:39:37.882346+0000","last_peered":"2024-05-26T15:39:37.882346+0000","last_clean":"2024-05-26T15:39:37.882346+0000","last_became_active":"2024-05-26T15:39:37.407277+0000","last_became_peered":"2024-05-26T15:39:37.407277+0000","last_unstale":"2024-05-26T15:39:37.882346+0000","last_undegraded":"2024-05-26T15:39:37.882346+0000","last_fullsized":"2024-05-26T15:39:37.882346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377305+0000","last_change":"2024-05-26T15:39:32.914034+0000","last_active":"2024-05-26T15:39:37.377305+0000","last_peered":"2024-05-26T15:39:37.377305+0000","last_clean":"2024-05-26T15:39:37.377305+0000","last_became_active":"2024-05-26T15:39:32.912275+0000","last_became_peered":"2024-05-26T15:39:32.912275+0000","last_unstale":"2024-05-26T15:39:37.377305+0000","last_undegraded":"2024-05-26T15:39:37.377305+0000","last_fullsized":"2024-05-26T15:39:37.377305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402750+0000","last_change":"2024-05-26T15:39:32.430257+0000","last_active":"2024-05-26T15:39:37.402750+0000","last_peered":"2024-05-26T15:39:37.402750+0000","last_clean":"2024-05-26T15:39:37.402750+0000","last_became_active":"2024-05-26T15:39:32.429796+0000","last_became_peered":"2024-05-26T15:39:32.429796+0000","last_unstale":"2024-05-26T15:39:37.402750+0000","last_undegraded":"2024-05-26T15:39:37.402750+0000","last_fullsized":"2024-05-26T15:39:37.402750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.293026+0000","last_change":"2024-05-26T15:39:37.502078+0000","last_active":"2024-05-26T15:39:38.293026+0000","last_peered":"2024-05-26T15:39:38.293026+0000","last_clean":"2024-05-26T15:39:38.293026+0000","last_became_active":"2024-05-26T15:39:37.501483+0000","last_became_peered":"2024-05-26T15:39:37.501483+0000","last_unstale":"2024-05-26T15:39:38.293026+0000","last_undegraded":"2024-05-26T15:39:38.293026+0000","last_fullsized":"2024-05-26T15:39:38.293026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387962+0000","last_change":"2024-05-26T15:39:32.916982+0000","last_active":"2024-05-26T15:39:37.387962+0000","last_peered":"2024-05-26T15:39:37.387962+0000","last_clean":"2024-05-26T15:39:37.387962+0000","last_became_active":"2024-05-26T15:39:32.916068+0000","last_became_peered":"2024-05-26T15:39:32.916068+0000","last_unstale":"2024-05-26T15:39:37.387962+0000","last_undegraded":"2024-05-26T15:39:37.387962+0000","last_fullsized":"2024-05-26T15:39:37.387962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:20.298140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490624+0000","last_change":"2024-05-26T15:39:32.429729+0000","last_active":"2024-05-26T15:39:37.490624+0000","last_peered":"2024-05-26T15:39:37.490624+0000","last_clean":"2024-05-26T15:39:37.490624+0000","last_became_active":"2024-05-26T15:39:32.429305+0000","last_became_peered":"2024-05-26T15:39:32.429305+0000","last_unstale":"2024-05-26T15:39:37.490624+0000","last_undegraded":"2024-05-26T15:39:37.490624+0000","last_fullsized":"2024-05-26T15:39:37.490624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.883028+0000","last_change":"2024-05-26T15:39:37.405280+0000","last_active":"2024-05-26T15:39:37.883028+0000","last_peered":"2024-05-26T15:39:37.883028+0000","last_clean":"2024-05-26T15:39:37.883028+0000","last_became_active":"2024-05-26T15:39:37.404901+0000","last_became_peered":"2024-05-26T15:39:37.404901+0000","last_unstale":"2024-05-26T15:39:37.883028+0000","last_undegraded":"2024-05-26T15:39:37.883028+0000","last_fullsized":"2024-05-26T15:39:37.883028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:46:18.529170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387113+0000","last_change":"2024-05-26T15:39:32.912045+0000","last_active":"2024-05-26T15:39:37.387113+0000","last_peered":"2024-05-26T15:39:37.387113+0000","last_clean":"2024-05-26T15:39:37.387113+0000","last_became_active":"2024-05-26T15:39:32.911751+0000","last_became_peered":"2024-05-26T15:39:32.911751+0000","last_unstale":"2024-05-26T15:39:37.387113+0000","last_undegraded":"2024-05-26T15:39:37.387113+0000","last_fullsized":"2024-05-26T15:39:37.387113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:09:26.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.408057+0000","last_change":"2024-05-26T15:39:32.437696+0000","last_active":"2024-05-26T15:39:37.408057+0000","last_peered":"2024-05-26T15:39:37.408057+0000","last_clean":"2024-05-26T15:39:37.408057+0000","last_became_active":"2024-05-26T15:39:32.437168+0000","last_became_peered":"2024-05-26T15:39:32.437168+0000","last_unstale":"2024-05-26T15:39:37.408057+0000","last_undegraded":"2024-05-26T15:39:37.408057+0000","last_fullsized":"2024-05-26T15:39:37.408057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881371+0000","last_change":"2024-05-26T15:39:37.499923+0000","last_active":"2024-05-26T15:39:37.881371+0000","last_peered":"2024-05-26T15:39:37.881371+0000","last_clean":"2024-05-26T15:39:37.881371+0000","last_became_active":"2024-05-26T15:39:37.499000+0000","last_became_peered":"2024-05-26T15:39:37.499000+0000","last_unstale":"2024-05-26T15:39:37.881371+0000","last_undegraded":"2024-05-26T15:39:37.881371+0000","last_fullsized":"2024-05-26T15:39:37.881371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379901+0000","last_change":"2024-05-26T15:39:32.922222+0000","last_active":"2024-05-26T15:39:37.379901+0000","last_peered":"2024-05-26T15:39:37.379901+0000","last_clean":"2024-05-26T15:39:37.379901+0000","last_became_active":"2024-05-26T15:39:32.921594+0000","last_became_peered":"2024-05-26T15:39:32.921594+0000","last_unstale":"2024-05-26T15:39:37.379901+0000","last_undegraded":"2024-05-26T15:39:37.379901+0000","last_fullsized":"2024-05-26T15:39:37.379901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.292819+0000","last_change":"2024-05-26T15:39:32.428520+0000","last_active":"2024-05-26T15:39:38.292819+0000","last_peered":"2024-05-26T15:39:38.292819+0000","last_clean":"2024-05-26T15:39:38.292819+0000","last_became_active":"2024-05-26T15:39:32.427761+0000","last_became_peered":"2024-05-26T15:39:32.427761+0000","last_unstale":"2024-05-26T15:39:38.292819+0000","last_undegraded":"2024-05-26T15:39:38.292819+0000","last_fullsized":"2024-05-26T15:39:38.292819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288088+0000","last_change":"2024-05-26T15:39:37.490760+0000","last_active":"2024-05-26T15:39:39.288088+0000","last_peered":"2024-05-26T15:39:39.288088+0000","last_clean":"2024-05-26T15:39:39.288088+0000","last_became_active":"2024-05-26T15:39:37.490319+0000","last_became_peered":"2024-05-26T15:39:37.490319+0000","last_unstale":"2024-05-26T15:39:39.288088+0000","last_undegraded":"2024-05-26T15:39:39.288088+0000","last_fullsized":"2024-05-26T15:39:39.288088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:46:18.529170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403196+0000","last_change":"2024-05-26T15:39:32.917740+0000","last_active":"2024-05-26T15:39:37.403196+0000","last_peered":"2024-05-26T15:39:37.403196+0000","last_clean":"2024-05-26T15:39:37.403196+0000","last_became_active":"2024-05-26T15:39:32.917370+0000","last_became_peered":"2024-05-26T15:39:32.917370+0000","last_unstale":"2024-05-26T15:39:37.403196+0000","last_undegraded":"2024-05-26T15:39:37.403196+0000","last_fullsized":"2024-05-26T15:39:37.403196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495183+0000","last_change":"2024-05-26T15:39:32.433409+0000","last_active":"2024-05-26T15:39:37.495183+0000","last_peered":"2024-05-26T15:39:37.495183+0000","last_clean":"2024-05-26T15:39:37.495183+0000","last_became_active":"2024-05-26T15:39:32.433133+0000","last_became_peered":"2024-05-26T15:39:32.433133+0000","last_unstale":"2024-05-26T15:39:37.495183+0000","last_undegraded":"2024-05-26T15:39:37.495183+0000","last_fullsized":"2024-05-26T15:39:37.495183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.058977+0000","last_change":"2024-05-26T15:39:37.502064+0000","last_active":"2024-05-26T15:39:39.058977+0000","last_peered":"2024-05-26T15:39:39.058977+0000","last_clean":"2024-05-26T15:39:39.058977+0000","last_became_active":"2024-05-26T15:39:37.500834+0000","last_became_peered":"2024-05-26T15:39:37.500834+0000","last_unstale":"2024-05-26T15:39:39.058977+0000","last_undegraded":"2024-05-26T15:39:39.058977+0000","last_fullsized":"2024-05-26T15:39:39.058977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405289+0000","last_change":"2024-05-26T15:39:32.933048+0000","last_active":"2024-05-26T15:39:37.405289+0000","last_peered":"2024-05-26T15:39:37.405289+0000","last_clean":"2024-05-26T15:39:37.405289+0000","last_became_active":"2024-05-26T15:39:32.932543+0000","last_became_peered":"2024-05-26T15:39:32.932543+0000","last_unstale":"2024-05-26T15:39:37.405289+0000","last_undegraded":"2024-05-26T15:39:37.405289+0000","last_fullsized":"2024-05-26T15:39:37.405289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:47:40.508265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403483+0000","last_change":"2024-05-26T15:39:32.419636+0000","last_active":"2024-05-26T15:39:37.403483+0000","last_peered":"2024-05-26T15:39:37.403483+0000","last_clean":"2024-05-26T15:39:37.403483+0000","last_became_active":"2024-05-26T15:39:32.419323+0000","last_became_peered":"2024-05-26T15:39:32.419323+0000","last_unstale":"2024-05-26T15:39:37.403483+0000","last_undegraded":"2024-05-26T15:39:37.403483+0000","last_fullsized":"2024-05-26T15:39:37.403483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291885+0000","last_change":"2024-05-26T15:39:37.408610+0000","last_active":"2024-05-26T15:39:38.291885+0000","last_peered":"2024-05-26T15:39:38.291885+0000","last_clean":"2024-05-26T15:39:38.291885+0000","last_became_active":"2024-05-26T15:39:37.408202+0000","last_became_peered":"2024-05-26T15:39:37.408202+0000","last_unstale":"2024-05-26T15:39:38.291885+0000","last_undegraded":"2024-05-26T15:39:38.291885+0000","last_fullsized":"2024-05-26T15:39:38.291885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386340+0000","last_change":"2024-05-26T15:39:32.915325+0000","last_active":"2024-05-26T15:39:37.386340+0000","last_peered":"2024-05-26T15:39:37.386340+0000","last_clean":"2024-05-26T15:39:37.386340+0000","last_became_active":"2024-05-26T15:39:32.915062+0000","last_became_peered":"2024-05-26T15:39:32.915062+0000","last_unstale":"2024-05-26T15:39:37.386340+0000","last_undegraded":"2024-05-26T15:39:37.386340+0000","last_fullsized":"2024-05-26T15:39:37.386340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:29.697944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401650+0000","last_change":"2024-05-26T15:39:32.429277+0000","last_active":"2024-05-26T15:39:37.401650+0000","last_peered":"2024-05-26T15:39:37.401650+0000","last_clean":"2024-05-26T15:39:37.401650+0000","last_became_active":"2024-05-26T15:39:32.428675+0000","last_became_peered":"2024-05-26T15:39:32.428675+0000","last_unstale":"2024-05-26T15:39:37.401650+0000","last_undegraded":"2024-05-26T15:39:37.401650+0000","last_fullsized":"2024-05-26T15:39:37.401650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291995+0000","last_change":"2024-05-26T15:39:37.407588+0000","last_active":"2024-05-26T15:39:38.291995+0000","last_peered":"2024-05-26T15:39:38.291995+0000","last_clean":"2024-05-26T15:39:38.291995+0000","last_became_active":"2024-05-26T15:39:37.407196+0000","last_became_peered":"2024-05-26T15:39:37.407196+0000","last_unstale":"2024-05-26T15:39:38.291995+0000","last_undegraded":"2024-05-26T15:39:38.291995+0000","last_fullsized":"2024-05-26T15:39:38.291995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401522+0000","last_change":"2024-05-26T15:39:32.915063+0000","last_active":"2024-05-26T15:39:37.401522+0000","last_peered":"2024-05-26T15:39:37.401522+0000","last_clean":"2024-05-26T15:39:37.401522+0000","last_became_active":"2024-05-26T15:39:32.914721+0000","last_became_peered":"2024-05-26T15:39:32.914721+0000","last_unstale":"2024-05-26T15:39:37.401522+0000","last_undegraded":"2024-05-26T15:39:37.401522+0000","last_fullsized":"2024-05-26T15:39:37.401522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:03.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.392964+0000","last_change":"2024-05-26T15:39:32.414114+0000","last_active":"2024-05-26T15:39:37.392964+0000","last_peered":"2024-05-26T15:39:37.392964+0000","last_clean":"2024-05-26T15:39:37.392964+0000","last_became_active":"2024-05-26T15:39:32.411824+0000","last_became_peered":"2024-05-26T15:39:32.411824+0000","last_unstale":"2024-05-26T15:39:37.392964+0000","last_undegraded":"2024-05-26T15:39:37.392964+0000","last_fullsized":"2024-05-26T15:39:37.392964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.293087+0000","last_change":"2024-05-26T15:39:37.408530+0000","last_active":"2024-05-26T15:39:38.293087+0000","last_peered":"2024-05-26T15:39:38.293087+0000","last_clean":"2024-05-26T15:39:38.293087+0000","last_became_active":"2024-05-26T15:39:37.408147+0000","last_became_peered":"2024-05-26T15:39:37.408147+0000","last_unstale":"2024-05-26T15:39:38.293087+0000","last_undegraded":"2024-05-26T15:39:38.293087+0000","last_fullsized":"2024-05-26T15:39:38.293087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:09:29.167701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384060+0000","last_change":"2024-05-26T15:39:32.899088+0000","last_active":"2024-05-26T15:39:37.384060+0000","last_peered":"2024-05-26T15:39:37.384060+0000","last_clean":"2024-05-26T15:39:37.384060+0000","last_became_active":"2024-05-26T15:39:32.896938+0000","last_became_peered":"2024-05-26T15:39:32.896938+0000","last_unstale":"2024-05-26T15:39:37.384060+0000","last_undegraded":"2024-05-26T15:39:37.384060+0000","last_fullsized":"2024-05-26T15:39:37.384060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:07:16.942254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490674+0000","last_change":"2024-05-26T15:39:32.430448+0000","last_active":"2024-05-26T15:39:37.490674+0000","last_peered":"2024-05-26T15:39:37.490674+0000","last_clean":"2024-05-26T15:39:37.490674+0000","last_became_active":"2024-05-26T15:39:32.430063+0000","last_became_peered":"2024-05-26T15:39:32.430063+0000","last_unstale":"2024-05-26T15:39:37.490674+0000","last_undegraded":"2024-05-26T15:39:37.490674+0000","last_fullsized":"2024-05-26T15:39:37.490674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059389+0000","last_change":"2024-05-26T15:39:37.498500+0000","last_active":"2024-05-26T15:39:39.059389+0000","last_peered":"2024-05-26T15:39:39.059389+0000","last_clean":"2024-05-26T15:39:39.059389+0000","last_became_active":"2024-05-26T15:39:37.497853+0000","last_became_peered":"2024-05-26T15:39:37.497853+0000","last_unstale":"2024-05-26T15:39:39.059389+0000","last_undegraded":"2024-05-26T15:39:39.059389+0000","last_fullsized":"2024-05-26T15:39:39.059389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:43:41.543097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.378613+0000","last_change":"2024-05-26T15:39:32.931560+0000","last_active":"2024-05-26T15:39:37.378613+0000","last_peered":"2024-05-26T15:39:37.378613+0000","last_clean":"2024-05-26T15:39:37.378613+0000","last_became_active":"2024-05-26T15:39:32.930941+0000","last_became_peered":"2024-05-26T15:39:32.930941+0000","last_unstale":"2024-05-26T15:39:37.378613+0000","last_undegraded":"2024-05-26T15:39:37.378613+0000","last_fullsized":"2024-05-26T15:39:37.378613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402158+0000","last_change":"2024-05-26T15:39:32.426663+0000","last_active":"2024-05-26T15:39:37.402158+0000","last_peered":"2024-05-26T15:39:37.402158+0000","last_clean":"2024-05-26T15:39:37.402158+0000","last_became_active":"2024-05-26T15:39:32.426151+0000","last_became_peered":"2024-05-26T15:39:32.426151+0000","last_unstale":"2024-05-26T15:39:37.402158+0000","last_undegraded":"2024-05-26T15:39:37.402158+0000","last_fullsized":"2024-05-26T15:39:37.402158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.490962+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:39:37.490962+0000","last_peered":"2024-05-26T15:39:37.490962+0000","last_clean":"2024-05-26T15:39:37.490962+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:39:37.490962+0000","last_undegraded":"2024-05-26T15:39:37.490962+0000","last_fullsized":"2024-05-26T15:39:37.490962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.002545+0000","last_change":"2024-05-26T15:39:37.505399+0000","last_active":"2024-05-26T15:39:38.002545+0000","last_peered":"2024-05-26T15:39:38.002545+0000","last_clean":"2024-05-26T15:39:38.002545+0000","last_became_active":"2024-05-26T15:39:37.501182+0000","last_became_peered":"2024-05-26T15:39:37.501182+0000","last_unstale":"2024-05-26T15:39:38.002545+0000","last_undegraded":"2024-05-26T15:39:38.002545+0000","last_fullsized":"2024-05-26T15:39:38.002545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:10:47.871214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.498704+0000","last_change":"2024-05-26T15:39:32.938192+0000","last_active":"2024-05-26T15:39:37.498704+0000","last_peered":"2024-05-26T15:39:37.498704+0000","last_clean":"2024-05-26T15:39:37.498704+0000","last_became_active":"2024-05-26T15:39:32.937905+0000","last_became_peered":"2024-05-26T15:39:32.937905+0000","last_unstale":"2024-05-26T15:39:37.498704+0000","last_undegraded":"2024-05-26T15:39:37.498704+0000","last_fullsized":"2024-05-26T15:39:37.498704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:02:49.914564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.393909+0000","last_change":"2024-05-26T15:39:32.438199+0000","last_active":"2024-05-26T15:39:37.393909+0000","last_peered":"2024-05-26T15:39:37.393909+0000","last_clean":"2024-05-26T15:39:37.393909+0000","last_became_active":"2024-05-26T15:39:32.437949+0000","last_became_peered":"2024-05-26T15:39:32.437949+0000","last_unstale":"2024-05-26T15:39:37.393909+0000","last_undegraded":"2024-05-26T15:39:37.393909+0000","last_fullsized":"2024-05-26T15:39:37.393909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.002149+0000","last_change":"2024-05-26T15:39:37.495167+0000","last_active":"2024-05-26T15:39:38.002149+0000","last_peered":"2024-05-26T15:39:38.002149+0000","last_clean":"2024-05-26T15:39:38.002149+0000","last_became_active":"2024-05-26T15:39:37.493976+0000","last_became_peered":"2024-05-26T15:39:37.493976+0000","last_unstale":"2024-05-26T15:39:38.002149+0000","last_undegraded":"2024-05-26T15:39:38.002149+0000","last_fullsized":"2024-05-26T15:39:38.002149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:12:51.547304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404196+0000","last_change":"2024-05-26T15:39:32.938730+0000","last_active":"2024-05-26T15:39:37.404196+0000","last_peered":"2024-05-26T15:39:37.404196+0000","last_clean":"2024-05-26T15:39:37.404196+0000","last_became_active":"2024-05-26T15:39:32.933947+0000","last_became_peered":"2024-05-26T15:39:32.933947+0000","last_unstale":"2024-05-26T15:39:37.404196+0000","last_undegraded":"2024-05-26T15:39:37.404196+0000","last_fullsized":"2024-05-26T15:39:37.404196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:07:02.159693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403811+0000","last_change":"2024-05-26T15:39:32.425826+0000","last_active":"2024-05-26T15:39:37.403811+0000","last_peered":"2024-05-26T15:39:37.403811+0000","last_clean":"2024-05-26T15:39:37.403811+0000","last_became_active":"2024-05-26T15:39:32.424115+0000","last_became_peered":"2024-05-26T15:39:32.424115+0000","last_unstale":"2024-05-26T15:39:37.403811+0000","last_undegraded":"2024-05-26T15:39:37.403811+0000","last_fullsized":"2024-05-26T15:39:37.403811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059111+0000","last_change":"2024-05-26T15:39:37.408873+0000","last_active":"2024-05-26T15:39:39.059111+0000","last_peered":"2024-05-26T15:39:39.059111+0000","last_clean":"2024-05-26T15:39:39.059111+0000","last_became_active":"2024-05-26T15:39:37.408458+0000","last_became_peered":"2024-05-26T15:39:37.408458+0000","last_unstale":"2024-05-26T15:39:39.059111+0000","last_undegraded":"2024-05-26T15:39:39.059111+0000","last_fullsized":"2024-05-26T15:39:39.059111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:34:47.971033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.499252+0000","last_change":"2024-05-26T15:39:32.928652+0000","last_active":"2024-05-26T15:39:37.499252+0000","last_peered":"2024-05-26T15:39:37.499252+0000","last_clean":"2024-05-26T15:39:37.499252+0000","last_became_active":"2024-05-26T15:39:32.925638+0000","last_became_peered":"2024-05-26T15:39:32.925638+0000","last_unstale":"2024-05-26T15:39:37.499252+0000","last_undegraded":"2024-05-26T15:39:37.499252+0000","last_fullsized":"2024-05-26T15:39:37.499252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.394843+0000","last_change":"2024-05-26T15:39:32.414781+0000","last_active":"2024-05-26T15:39:37.394843+0000","last_peered":"2024-05-26T15:39:37.394843+0000","last_clean":"2024-05-26T15:39:37.394843+0000","last_became_active":"2024-05-26T15:39:32.414352+0000","last_became_peered":"2024-05-26T15:39:32.414352+0000","last_unstale":"2024-05-26T15:39:37.394843+0000","last_undegraded":"2024-05-26T15:39:37.394843+0000","last_fullsized":"2024-05-26T15:39:37.394843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.289544+0000","last_change":"2024-05-26T15:39:37.498550+0000","last_active":"2024-05-26T15:39:39.289544+0000","last_peered":"2024-05-26T15:39:39.289544+0000","last_clean":"2024-05-26T15:39:39.289544+0000","last_became_active":"2024-05-26T15:39:37.497751+0000","last_became_peered":"2024-05-26T15:39:37.497751+0000","last_unstale":"2024-05-26T15:39:39.289544+0000","last_undegraded":"2024-05-26T15:39:39.289544+0000","last_fullsized":"2024-05-26T15:39:39.289544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:11:12.184867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495328+0000","last_change":"2024-05-26T15:39:32.919184+0000","last_active":"2024-05-26T15:39:37.495328+0000","last_peered":"2024-05-26T15:39:37.495328+0000","last_clean":"2024-05-26T15:39:37.495328+0000","last_became_active":"2024-05-26T15:39:32.917283+0000","last_became_peered":"2024-05-26T15:39:32.917283+0000","last_unstale":"2024-05-26T15:39:37.495328+0000","last_undegraded":"2024-05-26T15:39:37.495328+0000","last_fullsized":"2024-05-26T15:39:37.495328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387011+0000","last_change":"2024-05-26T15:39:32.414068+0000","last_active":"2024-05-26T15:39:37.387011+0000","last_peered":"2024-05-26T15:39:37.387011+0000","last_clean":"2024-05-26T15:39:37.387011+0000","last_became_active":"2024-05-26T15:39:32.411487+0000","last_became_peered":"2024-05-26T15:39:32.411487+0000","last_unstale":"2024-05-26T15:39:37.387011+0000","last_undegraded":"2024-05-26T15:39:37.387011+0000","last_fullsized":"2024-05-26T15:39:37.387011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:04:28.582294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.881086+0000","last_change":"2024-05-26T15:39:37.406440+0000","last_active":"2024-05-26T15:39:37.881086+0000","last_peered":"2024-05-26T15:39:37.881086+0000","last_clean":"2024-05-26T15:39:37.881086+0000","last_became_active":"2024-05-26T15:39:37.405935+0000","last_became_peered":"2024-05-26T15:39:37.405935+0000","last_unstale":"2024-05-26T15:39:37.881086+0000","last_undegraded":"2024-05-26T15:39:37.881086+0000","last_fullsized":"2024-05-26T15:39:37.881086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492257+0000","last_change":"2024-05-26T15:39:32.920860+0000","last_active":"2024-05-26T15:39:37.492257+0000","last_peered":"2024-05-26T15:39:37.492257+0000","last_clean":"2024-05-26T15:39:37.492257+0000","last_became_active":"2024-05-26T15:39:32.920251+0000","last_became_peered":"2024-05-26T15:39:32.920251+0000","last_unstale":"2024-05-26T15:39:37.492257+0000","last_undegraded":"2024-05-26T15:39:37.492257+0000","last_fullsized":"2024-05-26T15:39:37.492257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.393055+0000","last_change":"2024-05-26T15:39:32.412837+0000","last_active":"2024-05-26T15:39:37.393055+0000","last_peered":"2024-05-26T15:39:37.393055+0000","last_clean":"2024-05-26T15:39:37.393055+0000","last_became_active":"2024-05-26T15:39:32.412474+0000","last_became_peered":"2024-05-26T15:39:32.412474+0000","last_unstale":"2024-05-26T15:39:37.393055+0000","last_undegraded":"2024-05-26T15:39:37.393055+0000","last_fullsized":"2024-05-26T15:39:37.393055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059319+0000","last_change":"2024-05-26T15:39:37.405354+0000","last_active":"2024-05-26T15:39:39.059319+0000","last_peered":"2024-05-26T15:39:39.059319+0000","last_clean":"2024-05-26T15:39:39.059319+0000","last_became_active":"2024-05-26T15:39:37.404972+0000","last_became_peered":"2024-05-26T15:39:37.404972+0000","last_unstale":"2024-05-26T15:39:39.059319+0000","last_undegraded":"2024-05-26T15:39:39.059319+0000","last_fullsized":"2024-05-26T15:39:39.059319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:29:06.780253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401985+0000","last_change":"2024-05-26T15:39:32.924084+0000","last_active":"2024-05-26T15:39:37.401985+0000","last_peered":"2024-05-26T15:39:37.401985+0000","last_clean":"2024-05-26T15:39:37.401985+0000","last_became_active":"2024-05-26T15:39:32.922027+0000","last_became_peered":"2024-05-26T15:39:32.922027+0000","last_unstale":"2024-05-26T15:39:37.401985+0000","last_undegraded":"2024-05-26T15:39:37.401985+0000","last_fullsized":"2024-05-26T15:39:37.401985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:13:14.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404763+0000","last_change":"2024-05-26T15:39:32.436505+0000","last_active":"2024-05-26T15:39:37.404763+0000","last_peered":"2024-05-26T15:39:37.404763+0000","last_clean":"2024-05-26T15:39:37.404763+0000","last_became_active":"2024-05-26T15:39:32.436215+0000","last_became_peered":"2024-05-26T15:39:32.436215+0000","last_unstale":"2024-05-26T15:39:37.404763+0000","last_undegraded":"2024-05-26T15:39:37.404763+0000","last_fullsized":"2024-05-26T15:39:37.404763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:25.356590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.289226+0000","last_change":"2024-05-26T15:39:37.502778+0000","last_active":"2024-05-26T15:39:39.289226+0000","last_peered":"2024-05-26T15:39:39.289226+0000","last_clean":"2024-05-26T15:39:39.289226+0000","last_became_active":"2024-05-26T15:39:37.502334+0000","last_became_peered":"2024-05-26T15:39:37.502334+0000","last_unstale":"2024-05-26T15:39:39.289226+0000","last_undegraded":"2024-05-26T15:39:39.289226+0000","last_fullsized":"2024-05-26T15:39:39.289226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:46:37.155490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492337+0000","last_change":"2024-05-26T15:39:32.920320+0000","last_active":"2024-05-26T15:39:37.492337+0000","last_peered":"2024-05-26T15:39:37.492337+0000","last_clean":"2024-05-26T15:39:37.492337+0000","last_became_active":"2024-05-26T15:39:32.919937+0000","last_became_peered":"2024-05-26T15:39:32.919937+0000","last_unstale":"2024-05-26T15:39:37.492337+0000","last_undegraded":"2024-05-26T15:39:37.492337+0000","last_fullsized":"2024-05-26T15:39:37.492337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401560+0000","last_change":"2024-05-26T15:39:32.429375+0000","last_active":"2024-05-26T15:39:37.401560+0000","last_peered":"2024-05-26T15:39:37.401560+0000","last_clean":"2024-05-26T15:39:37.401560+0000","last_became_active":"2024-05-26T15:39:32.429095+0000","last_became_peered":"2024-05-26T15:39:32.429095+0000","last_unstale":"2024-05-26T15:39:37.401560+0000","last_undegraded":"2024-05-26T15:39:37.401560+0000","last_fullsized":"2024-05-26T15:39:37.401560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288508+0000","last_change":"2024-05-26T15:39:37.496912+0000","last_active":"2024-05-26T15:39:39.288508+0000","last_peered":"2024-05-26T15:39:39.288508+0000","last_clean":"2024-05-26T15:39:39.288508+0000","last_became_active":"2024-05-26T15:39:37.496258+0000","last_became_peered":"2024-05-26T15:39:37.496258+0000","last_unstale":"2024-05-26T15:39:39.288508+0000","last_undegraded":"2024-05-26T15:39:39.288508+0000","last_fullsized":"2024-05-26T15:39:39.288508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:19:25.927673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384003+0000","last_change":"2024-05-26T15:39:32.919040+0000","last_active":"2024-05-26T15:39:37.384003+0000","last_peered":"2024-05-26T15:39:37.384003+0000","last_clean":"2024-05-26T15:39:37.384003+0000","last_became_active":"2024-05-26T15:39:32.918706+0000","last_became_peered":"2024-05-26T15:39:32.918706+0000","last_unstale":"2024-05-26T15:39:37.384003+0000","last_undegraded":"2024-05-26T15:39:37.384003+0000","last_fullsized":"2024-05-26T15:39:37.384003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.387247+0000","last_change":"2024-05-26T15:39:32.421131+0000","last_active":"2024-05-26T15:39:37.387247+0000","last_peered":"2024-05-26T15:39:37.387247+0000","last_clean":"2024-05-26T15:39:37.387247+0000","last_became_active":"2024-05-26T15:39:32.420687+0000","last_became_peered":"2024-05-26T15:39:32.420687+0000","last_unstale":"2024-05-26T15:39:37.387247+0000","last_undegraded":"2024-05-26T15:39:37.387247+0000","last_fullsized":"2024-05-26T15:39:37.387247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:13:58.110518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.293090+0000","last_change":"2024-05-26T15:39:37.506017+0000","last_active":"2024-05-26T15:39:39.293090+0000","last_peered":"2024-05-26T15:39:39.293090+0000","last_clean":"2024-05-26T15:39:39.293090+0000","last_became_active":"2024-05-26T15:39:37.503806+0000","last_became_peered":"2024-05-26T15:39:37.503806+0000","last_unstale":"2024-05-26T15:39:39.293090+0000","last_undegraded":"2024-05-26T15:39:39.293090+0000","last_fullsized":"2024-05-26T15:39:39.293090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:30:13.888101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.494294+0000","last_change":"2024-05-26T15:39:32.924533+0000","last_active":"2024-05-26T15:39:37.494294+0000","last_peered":"2024-05-26T15:39:37.494294+0000","last_clean":"2024-05-26T15:39:37.494294+0000","last_became_active":"2024-05-26T15:39:32.924038+0000","last_became_peered":"2024-05-26T15:39:32.924038+0000","last_unstale":"2024-05-26T15:39:37.494294+0000","last_undegraded":"2024-05-26T15:39:37.494294+0000","last_fullsized":"2024-05-26T15:39:37.494294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:16:58.690646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:51.992714+0000","last_change":"2024-05-26T15:39:32.426312+0000","last_active":"2024-05-26T15:39:51.992714+0000","last_peered":"2024-05-26T15:39:51.992714+0000","last_clean":"2024-05-26T15:39:51.992714+0000","last_became_active":"2024-05-26T15:39:32.425989+0000","last_became_peered":"2024-05-26T15:39:32.425989+0000","last_unstale":"2024-05-26T15:39:51.992714+0000","last_undegraded":"2024-05-26T15:39:51.992714+0000","last_fullsized":"2024-05-26T15:39:51.992714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.291701+0000","last_change":"2024-05-26T15:39:37.405366+0000","last_active":"2024-05-26T15:39:38.291701+0000","last_peered":"2024-05-26T15:39:38.291701+0000","last_clean":"2024-05-26T15:39:38.291701+0000","last_became_active":"2024-05-26T15:39:37.405104+0000","last_became_peered":"2024-05-26T15:39:37.405104+0000","last_unstale":"2024-05-26T15:39:38.291701+0000","last_undegraded":"2024-05-26T15:39:38.291701+0000","last_fullsized":"2024-05-26T15:39:38.291701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:56:31.917292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.389859+0000","last_change":"2024-05-26T15:39:32.925841+0000","last_active":"2024-05-26T15:39:37.389859+0000","last_peered":"2024-05-26T15:39:37.389859+0000","last_clean":"2024-05-26T15:39:37.389859+0000","last_became_active":"2024-05-26T15:39:32.924690+0000","last_became_peered":"2024-05-26T15:39:32.924690+0000","last_unstale":"2024-05-26T15:39:37.389859+0000","last_undegraded":"2024-05-26T15:39:37.389859+0000","last_fullsized":"2024-05-26T15:39:37.389859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:26.362390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403757+0000","last_change":"2024-05-26T15:39:32.430740+0000","last_active":"2024-05-26T15:39:37.403757+0000","last_peered":"2024-05-26T15:39:37.403757+0000","last_clean":"2024-05-26T15:39:37.403757+0000","last_became_active":"2024-05-26T15:39:32.430438+0000","last_became_peered":"2024-05-26T15:39:32.430438+0000","last_unstale":"2024-05-26T15:39:37.403757+0000","last_undegraded":"2024-05-26T15:39:37.403757+0000","last_fullsized":"2024-05-26T15:39:37.403757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:25.042059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.882702+0000","last_change":"2024-05-26T15:39:37.410892+0000","last_active":"2024-05-26T15:39:37.882702+0000","last_peered":"2024-05-26T15:39:37.882702+0000","last_clean":"2024-05-26T15:39:37.882702+0000","last_became_active":"2024-05-26T15:39:37.410088+0000","last_became_peered":"2024-05-26T15:39:37.410088+0000","last_unstale":"2024-05-26T15:39:37.882702+0000","last_undegraded":"2024-05-26T15:39:37.882702+0000","last_fullsized":"2024-05-26T15:39:37.882702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:02:32.537310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386400+0000","last_change":"2024-05-26T15:39:32.931871+0000","last_active":"2024-05-26T15:39:37.386400+0000","last_peered":"2024-05-26T15:39:37.386400+0000","last_clean":"2024-05-26T15:39:37.386400+0000","last_became_active":"2024-05-26T15:39:32.931615+0000","last_became_peered":"2024-05-26T15:39:32.931615+0000","last_unstale":"2024-05-26T15:39:37.386400+0000","last_undegraded":"2024-05-26T15:39:37.386400+0000","last_fullsized":"2024-05-26T15:39:37.386400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406122+0000","last_change":"2024-05-26T15:39:32.438097+0000","last_active":"2024-05-26T15:39:37.406122+0000","last_peered":"2024-05-26T15:39:37.406122+0000","last_clean":"2024-05-26T15:39:37.406122+0000","last_became_active":"2024-05-26T15:39:32.437759+0000","last_became_peered":"2024-05-26T15:39:32.437759+0000","last_unstale":"2024-05-26T15:39:37.406122+0000","last_undegraded":"2024-05-26T15:39:37.406122+0000","last_fullsized":"2024-05-26T15:39:37.406122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288406+0000","last_change":"2024-05-26T15:39:37.408245+0000","last_active":"2024-05-26T15:39:39.288406+0000","last_peered":"2024-05-26T15:39:39.288406+0000","last_clean":"2024-05-26T15:39:39.288406+0000","last_became_active":"2024-05-26T15:39:37.407821+0000","last_became_peered":"2024-05-26T15:39:37.407821+0000","last_unstale":"2024-05-26T15:39:39.288406+0000","last_undegraded":"2024-05-26T15:39:39.288406+0000","last_fullsized":"2024-05-26T15:39:39.288406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:08:31.905617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406029+0000","last_change":"2024-05-26T15:39:32.935821+0000","last_active":"2024-05-26T15:39:37.406029+0000","last_peered":"2024-05-26T15:39:37.406029+0000","last_clean":"2024-05-26T15:39:37.406029+0000","last_became_active":"2024-05-26T15:39:32.935652+0000","last_became_peered":"2024-05-26T15:39:32.935652+0000","last_unstale":"2024-05-26T15:39:37.406029+0000","last_undegraded":"2024-05-26T15:39:37.406029+0000","last_fullsized":"2024-05-26T15:39:37.406029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:42:31.950324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.407942+0000","last_change":"2024-05-26T15:39:32.434154+0000","last_active":"2024-05-26T15:39:37.407942+0000","last_peered":"2024-05-26T15:39:37.407942+0000","last_clean":"2024-05-26T15:39:37.407942+0000","last_became_active":"2024-05-26T15:39:32.433569+0000","last_became_peered":"2024-05-26T15:39:32.433569+0000","last_unstale":"2024-05-26T15:39:37.407942+0000","last_undegraded":"2024-05-26T15:39:37.407942+0000","last_fullsized":"2024-05-26T15:39:37.407942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:24:19.292340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288095+0000","last_change":"2024-05-26T15:39:37.500616+0000","last_active":"2024-05-26T15:39:39.288095+0000","last_peered":"2024-05-26T15:39:39.288095+0000","last_clean":"2024-05-26T15:39:39.288095+0000","last_became_active":"2024-05-26T15:39:37.498904+0000","last_became_peered":"2024-05-26T15:39:37.498904+0000","last_unstale":"2024-05-26T15:39:39.288095+0000","last_undegraded":"2024-05-26T15:39:39.288095+0000","last_fullsized":"2024-05-26T15:39:39.288095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:41:02.121900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.059278+0000","last_change":"2024-05-26T15:39:37.496964+0000","last_active":"2024-05-26T15:39:39.059278+0000","last_peered":"2024-05-26T15:39:39.059278+0000","last_clean":"2024-05-26T15:39:39.059278+0000","last_became_active":"2024-05-26T15:39:37.496512+0000","last_became_peered":"2024-05-26T15:39:37.496512+0000","last_unstale":"2024-05-26T15:39:39.059278+0000","last_undegraded":"2024-05-26T15:39:39.059278+0000","last_fullsized":"2024-05-26T15:39:39.059278+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:00:08.087081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402612+0000","last_change":"2024-05-26T15:39:32.911606+0000","last_active":"2024-05-26T15:39:37.402612+0000","last_peered":"2024-05-26T15:39:37.402612+0000","last_clean":"2024-05-26T15:39:37.402612+0000","last_became_active":"2024-05-26T15:39:32.910333+0000","last_became_peered":"2024-05-26T15:39:32.910333+0000","last_unstale":"2024-05-26T15:39:37.402612+0000","last_undegraded":"2024-05-26T15:39:37.402612+0000","last_fullsized":"2024-05-26T15:39:37.402612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400770+0000","last_change":"2024-05-26T15:39:32.428197+0000","last_active":"2024-05-26T15:39:37.400770+0000","last_peered":"2024-05-26T15:39:37.400770+0000","last_clean":"2024-05-26T15:39:37.400770+0000","last_became_active":"2024-05-26T15:39:32.427494+0000","last_became_peered":"2024-05-26T15:39:32.427494+0000","last_unstale":"2024-05-26T15:39:37.400770+0000","last_undegraded":"2024-05-26T15:39:37.400770+0000","last_fullsized":"2024-05-26T15:39:37.400770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:54:40.776496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:38.003002+0000","last_change":"2024-05-26T15:39:37.416175+0000","last_active":"2024-05-26T15:39:38.003002+0000","last_peered":"2024-05-26T15:39:38.003002+0000","last_clean":"2024-05-26T15:39:38.003002+0000","last_became_active":"2024-05-26T15:39:37.415776+0000","last_became_peered":"2024-05-26T15:39:37.415776+0000","last_unstale":"2024-05-26T15:39:38.003002+0000","last_undegraded":"2024-05-26T15:39:38.003002+0000","last_fullsized":"2024-05-26T15:39:38.003002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:43:41.543097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377018+0000","last_change":"2024-05-26T15:39:32.916588+0000","last_active":"2024-05-26T15:39:37.377018+0000","last_peered":"2024-05-26T15:39:37.377018+0000","last_clean":"2024-05-26T15:39:37.377018+0000","last_became_active":"2024-05-26T15:39:32.916327+0000","last_became_peered":"2024-05-26T15:39:32.916327+0000","last_unstale":"2024-05-26T15:39:37.377018+0000","last_undegraded":"2024-05-26T15:39:37.377018+0000","last_fullsized":"2024-05-26T15:39:37.377018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:49:42.119038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381500+0000","last_change":"2024-05-26T15:39:32.429439+0000","last_active":"2024-05-26T15:39:37.381500+0000","last_peered":"2024-05-26T15:39:37.381500+0000","last_clean":"2024-05-26T15:39:37.381500+0000","last_became_active":"2024-05-26T15:39:32.428892+0000","last_became_peered":"2024-05-26T15:39:32.428892+0000","last_unstale":"2024-05-26T15:39:37.381500+0000","last_undegraded":"2024-05-26T15:39:37.381500+0000","last_fullsized":"2024-05-26T15:39:37.381500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:20:54.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.405154+0000","last_change":"2024-05-26T15:39:32.422718+0000","last_active":"2024-05-26T15:39:37.405154+0000","last_peered":"2024-05-26T15:39:37.405154+0000","last_clean":"2024-05-26T15:39:37.405154+0000","last_became_active":"2024-05-26T15:39:32.422398+0000","last_became_peered":"2024-05-26T15:39:32.422398+0000","last_unstale":"2024-05-26T15:39:37.405154+0000","last_undegraded":"2024-05-26T15:39:37.405154+0000","last_fullsized":"2024-05-26T15:39:37.405154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:43:28.692144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383126+0000","last_change":"2024-05-26T15:39:32.902434+0000","last_active":"2024-05-26T15:39:37.383126+0000","last_peered":"2024-05-26T15:39:37.383126+0000","last_clean":"2024-05-26T15:39:37.383126+0000","last_became_active":"2024-05-26T15:39:32.901505+0000","last_became_peered":"2024-05-26T15:39:32.901505+0000","last_unstale":"2024-05-26T15:39:37.383126+0000","last_undegraded":"2024-05-26T15:39:37.383126+0000","last_fullsized":"2024-05-26T15:39:37.383126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:21:37.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.877340+0000","last_change":"2024-05-26T15:39:37.405928+0000","last_active":"2024-05-26T15:39:37.877340+0000","last_peered":"2024-05-26T15:39:37.877340+0000","last_clean":"2024-05-26T15:39:37.877340+0000","last_became_active":"2024-05-26T15:39:37.405510+0000","last_became_peered":"2024-05-26T15:39:37.405510+0000","last_unstale":"2024-05-26T15:39:37.877340+0000","last_undegraded":"2024-05-26T15:39:37.877340+0000","last_fullsized":"2024-05-26T15:39:37.877340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:46.788301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.378799+0000","last_change":"2024-05-26T15:39:32.424810+0000","last_active":"2024-05-26T15:39:37.378799+0000","last_peered":"2024-05-26T15:39:37.378799+0000","last_clean":"2024-05-26T15:39:37.378799+0000","last_became_active":"2024-05-26T15:39:32.424518+0000","last_became_peered":"2024-05-26T15:39:32.424518+0000","last_unstale":"2024-05-26T15:39:37.378799+0000","last_undegraded":"2024-05-26T15:39:37.378799+0000","last_fullsized":"2024-05-26T15:39:37.378799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:31.370176+0000","last_clean_scrub_stamp":"2024-05-26T15:39:31.370176+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:15:06.794870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.386848+0000","last_change":"2024-05-26T15:39:32.913997+0000","last_active":"2024-05-26T15:39:37.386848+0000","last_peered":"2024-05-26T15:39:37.386848+0000","last_clean":"2024-05-26T15:39:37.386848+0000","last_became_active":"2024-05-26T15:39:32.911604+0000","last_became_peered":"2024-05-26T15:39:32.911604+0000","last_unstale":"2024-05-26T15:39:37.386848+0000","last_undegraded":"2024-05-26T15:39:37.386848+0000","last_fullsized":"2024-05-26T15:39:37.386848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:12:26.047859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-26T15:39:39.288573+0000","last_change":"2024-05-26T15:39:37.402731+0000","last_active":"2024-05-26T15:39:39.288573+0000","last_peered":"2024-05-26T15:39:39.288573+0000","last_clean":"2024-05-26T15:39:39.288573+0000","last_became_active":"2024-05-26T15:39:37.402227+0000","last_became_peered":"2024-05-26T15:39:37.402227+0000","last_unstale":"2024-05-26T15:39:39.288573+0000","last_undegraded":"2024-05-26T15:39:39.288573+0000","last_fullsized":"2024-05-26T15:39:39.288573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:36.346212+0000","last_clean_scrub_stamp":"2024-05-26T15:39:36.346212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:24:03.470160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401926+0000","last_change":"2024-05-26T15:39:32.924345+0000","last_active":"2024-05-26T15:39:37.401926+0000","last_peered":"2024-05-26T15:39:37.401926+0000","last_clean":"2024-05-26T15:39:37.401926+0000","last_became_active":"2024-05-26T15:39:32.921271+0000","last_became_peered":"2024-05-26T15:39:32.921271+0000","last_unstale":"2024-05-26T15:39:37.401926+0000","last_undegraded":"2024-05-26T15:39:37.401926+0000","last_fullsized":"2024-05-26T15:39:37.401926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.392856+0000","last_change":"2024-05-26T15:39:32.928371+0000","last_active":"2024-05-26T15:39:37.392856+0000","last_peered":"2024-05-26T15:39:37.392856+0000","last_clean":"2024-05-26T15:39:37.392856+0000","last_became_active":"2024-05-26T15:39:32.928159+0000","last_became_peered":"2024-05-26T15:39:32.928159+0000","last_unstale":"2024-05-26T15:39:37.392856+0000","last_undegraded":"2024-05-26T15:39:37.392856+0000","last_fullsized":"2024-05-26T15:39:37.392856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:13.695925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401469+0000","last_change":"2024-05-26T15:39:32.932867+0000","last_active":"2024-05-26T15:39:37.401469+0000","last_peered":"2024-05-26T15:39:37.401469+0000","last_clean":"2024-05-26T15:39:37.401469+0000","last_became_active":"2024-05-26T15:39:32.930753+0000","last_became_peered":"2024-05-26T15:39:32.930753+0000","last_unstale":"2024-05-26T15:39:37.401469+0000","last_undegraded":"2024-05-26T15:39:37.401469+0000","last_fullsized":"2024-05-26T15:39:37.401469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.382843+0000","last_change":"2024-05-26T15:39:32.904786+0000","last_active":"2024-05-26T15:39:37.382843+0000","last_peered":"2024-05-26T15:39:37.382843+0000","last_clean":"2024-05-26T15:39:37.382843+0000","last_became_active":"2024-05-26T15:39:32.904535+0000","last_became_peered":"2024-05-26T15:39:32.904535+0000","last_unstale":"2024-05-26T15:39:37.382843+0000","last_undegraded":"2024-05-26T15:39:37.382843+0000","last_fullsized":"2024-05-26T15:39:37.382843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:59:09.988548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.380690+0000","last_change":"2024-05-26T15:39:32.905236+0000","last_active":"2024-05-26T15:39:37.380690+0000","last_peered":"2024-05-26T15:39:37.380690+0000","last_clean":"2024-05-26T15:39:37.380690+0000","last_became_active":"2024-05-26T15:39:32.904896+0000","last_became_peered":"2024-05-26T15:39:32.904896+0000","last_unstale":"2024-05-26T15:39:37.380690+0000","last_undegraded":"2024-05-26T15:39:37.380690+0000","last_fullsized":"2024-05-26T15:39:37.380690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:29:01.645973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403711+0000","last_change":"2024-05-26T15:39:32.910981+0000","last_active":"2024-05-26T15:39:37.403711+0000","last_peered":"2024-05-26T15:39:37.403711+0000","last_clean":"2024-05-26T15:39:37.403711+0000","last_became_active":"2024-05-26T15:39:32.910706+0000","last_became_peered":"2024-05-26T15:39:32.910706+0000","last_unstale":"2024-05-26T15:39:37.403711+0000","last_undegraded":"2024-05-26T15:39:37.403711+0000","last_fullsized":"2024-05-26T15:39:37.403711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406819+0000","last_change":"2024-05-26T15:39:32.935119+0000","last_active":"2024-05-26T15:39:37.406819+0000","last_peered":"2024-05-26T15:39:37.406819+0000","last_clean":"2024-05-26T15:39:37.406819+0000","last_became_active":"2024-05-26T15:39:32.934919+0000","last_became_peered":"2024-05-26T15:39:32.934919+0000","last_unstale":"2024-05-26T15:39:37.406819+0000","last_undegraded":"2024-05-26T15:39:37.406819+0000","last_fullsized":"2024-05-26T15:39:37.406819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:31:43.397128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.379796+0000","last_change":"2024-05-26T15:39:32.913549+0000","last_active":"2024-05-26T15:39:37.379796+0000","last_peered":"2024-05-26T15:39:37.379796+0000","last_clean":"2024-05-26T15:39:37.379796+0000","last_became_active":"2024-05-26T15:39:32.913283+0000","last_became_peered":"2024-05-26T15:39:32.913283+0000","last_unstale":"2024-05-26T15:39:37.379796+0000","last_undegraded":"2024-05-26T15:39:37.379796+0000","last_fullsized":"2024-05-26T15:39:37.379796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400722+0000","last_change":"2024-05-26T15:39:32.934682+0000","last_active":"2024-05-26T15:39:37.400722+0000","last_peered":"2024-05-26T15:39:37.400722+0000","last_clean":"2024-05-26T15:39:37.400722+0000","last_became_active":"2024-05-26T15:39:32.934208+0000","last_became_peered":"2024-05-26T15:39:32.934208+0000","last_unstale":"2024-05-26T15:39:37.400722+0000","last_undegraded":"2024-05-26T15:39:37.400722+0000","last_fullsized":"2024-05-26T15:39:37.400722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381124+0000","last_change":"2024-05-26T15:39:32.902536+0000","last_active":"2024-05-26T15:39:37.381124+0000","last_peered":"2024-05-26T15:39:37.381124+0000","last_clean":"2024-05-26T15:39:37.381124+0000","last_became_active":"2024-05-26T15:39:32.901428+0000","last_became_peered":"2024-05-26T15:39:32.901428+0000","last_unstale":"2024-05-26T15:39:37.381124+0000","last_undegraded":"2024-05-26T15:39:37.381124+0000","last_fullsized":"2024-05-26T15:39:37.381124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401378+0000","last_change":"2024-05-26T15:39:32.933748+0000","last_active":"2024-05-26T15:39:37.401378+0000","last_peered":"2024-05-26T15:39:37.401378+0000","last_clean":"2024-05-26T15:39:37.401378+0000","last_became_active":"2024-05-26T15:39:32.933508+0000","last_became_peered":"2024-05-26T15:39:32.933508+0000","last_unstale":"2024-05-26T15:39:37.401378+0000","last_undegraded":"2024-05-26T15:39:37.401378+0000","last_fullsized":"2024-05-26T15:39:37.401378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:41:23.251027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.381893+0000","last_change":"2024-05-26T15:39:32.919340+0000","last_active":"2024-05-26T15:39:37.381893+0000","last_peered":"2024-05-26T15:39:37.381893+0000","last_clean":"2024-05-26T15:39:37.381893+0000","last_became_active":"2024-05-26T15:39:32.919090+0000","last_became_peered":"2024-05-26T15:39:32.919090+0000","last_unstale":"2024-05-26T15:39:37.381893+0000","last_undegraded":"2024-05-26T15:39:37.381893+0000","last_fullsized":"2024-05-26T15:39:37.381893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:13:27.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.404517+0000","last_change":"2024-05-26T15:39:32.931353+0000","last_active":"2024-05-26T15:39:37.404517+0000","last_peered":"2024-05-26T15:39:37.404517+0000","last_clean":"2024-05-26T15:39:37.404517+0000","last_became_active":"2024-05-26T15:39:32.931035+0000","last_became_peered":"2024-05-26T15:39:32.931035+0000","last_unstale":"2024-05-26T15:39:37.404517+0000","last_undegraded":"2024-05-26T15:39:37.404517+0000","last_fullsized":"2024-05-26T15:39:37.404517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495006+0000","last_change":"2024-05-26T15:39:32.924340+0000","last_active":"2024-05-26T15:39:37.495006+0000","last_peered":"2024-05-26T15:39:37.495006+0000","last_clean":"2024-05-26T15:39:37.495006+0000","last_became_active":"2024-05-26T15:39:32.923614+0000","last_became_peered":"2024-05-26T15:39:32.923614+0000","last_unstale":"2024-05-26T15:39:37.495006+0000","last_undegraded":"2024-05-26T15:39:37.495006+0000","last_fullsized":"2024-05-26T15:39:37.495006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:49:42.119038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.394752+0000","last_change":"2024-05-26T15:39:32.919960+0000","last_active":"2024-05-26T15:39:37.394752+0000","last_peered":"2024-05-26T15:39:37.394752+0000","last_clean":"2024-05-26T15:39:37.394752+0000","last_became_active":"2024-05-26T15:39:32.919682+0000","last_became_peered":"2024-05-26T15:39:32.919682+0000","last_unstale":"2024-05-26T15:39:37.394752+0000","last_undegraded":"2024-05-26T15:39:37.394752+0000","last_fullsized":"2024-05-26T15:39:37.394752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:51:22.074231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.407162+0000","last_change":"2024-05-26T15:39:32.931526+0000","last_active":"2024-05-26T15:39:37.407162+0000","last_peered":"2024-05-26T15:39:37.407162+0000","last_clean":"2024-05-26T15:39:37.407162+0000","last_became_active":"2024-05-26T15:39:32.930641+0000","last_became_peered":"2024-05-26T15:39:32.930641+0000","last_unstale":"2024-05-26T15:39:37.407162+0000","last_undegraded":"2024-05-26T15:39:37.407162+0000","last_fullsized":"2024-05-26T15:39:37.407162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.400658+0000","last_change":"2024-05-26T15:39:32.935238+0000","last_active":"2024-05-26T15:39:37.400658+0000","last_peered":"2024-05-26T15:39:37.400658+0000","last_clean":"2024-05-26T15:39:37.400658+0000","last_became_active":"2024-05-26T15:39:32.934888+0000","last_became_peered":"2024-05-26T15:39:32.934888+0000","last_unstale":"2024-05-26T15:39:37.400658+0000","last_undegraded":"2024-05-26T15:39:37.400658+0000","last_fullsized":"2024-05-26T15:39:37.400658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:42:04.947576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402726+0000","last_change":"2024-05-26T15:39:32.912394+0000","last_active":"2024-05-26T15:39:37.402726+0000","last_peered":"2024-05-26T15:39:37.402726+0000","last_clean":"2024-05-26T15:39:37.402726+0000","last_became_active":"2024-05-26T15:39:32.911158+0000","last_became_peered":"2024-05-26T15:39:32.911158+0000","last_unstale":"2024-05-26T15:39:37.402726+0000","last_undegraded":"2024-05-26T15:39:37.402726+0000","last_fullsized":"2024-05-26T15:39:37.402726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:25:42.818065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.383741+0000","last_change":"2024-05-26T15:39:32.913949+0000","last_active":"2024-05-26T15:39:37.383741+0000","last_peered":"2024-05-26T15:39:37.383741+0000","last_clean":"2024-05-26T15:39:37.383741+0000","last_became_active":"2024-05-26T15:39:32.911597+0000","last_became_peered":"2024-05-26T15:39:32.911597+0000","last_unstale":"2024-05-26T15:39:37.383741+0000","last_undegraded":"2024-05-26T15:39:37.383741+0000","last_fullsized":"2024-05-26T15:39:37.383741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:13:14.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.377776+0000","last_change":"2024-05-26T15:39:32.923083+0000","last_active":"2024-05-26T15:39:37.377776+0000","last_peered":"2024-05-26T15:39:37.377776+0000","last_clean":"2024-05-26T15:39:37.377776+0000","last_became_active":"2024-05-26T15:39:32.921098+0000","last_became_peered":"2024-05-26T15:39:32.921098+0000","last_unstale":"2024-05-26T15:39:37.377776+0000","last_undegraded":"2024-05-26T15:39:37.377776+0000","last_fullsized":"2024-05-26T15:39:37.377776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:21:37.780571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.390272+0000","last_change":"2024-05-26T15:39:32.923188+0000","last_active":"2024-05-26T15:39:37.390272+0000","last_peered":"2024-05-26T15:39:37.390272+0000","last_clean":"2024-05-26T15:39:37.390272+0000","last_became_active":"2024-05-26T15:39:32.921678+0000","last_became_peered":"2024-05-26T15:39:32.921678+0000","last_unstale":"2024-05-26T15:39:37.390272+0000","last_undegraded":"2024-05-26T15:39:37.390272+0000","last_fullsized":"2024-05-26T15:39:37.390272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:09:13.695925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406882+0000","last_change":"2024-05-26T15:39:32.939084+0000","last_active":"2024-05-26T15:39:37.406882+0000","last_peered":"2024-05-26T15:39:37.406882+0000","last_clean":"2024-05-26T15:39:37.406882+0000","last_became_active":"2024-05-26T15:39:32.938713+0000","last_became_peered":"2024-05-26T15:39:32.938713+0000","last_unstale":"2024-05-26T15:39:37.406882+0000","last_undegraded":"2024-05-26T15:39:37.406882+0000","last_fullsized":"2024-05-26T15:39:37.406882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:05:05.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.406775+0000","last_change":"2024-05-26T15:39:32.939883+0000","last_active":"2024-05-26T15:39:37.406775+0000","last_peered":"2024-05-26T15:39:37.406775+0000","last_clean":"2024-05-26T15:39:37.406775+0000","last_became_active":"2024-05-26T15:39:32.937951+0000","last_became_peered":"2024-05-26T15:39:32.937951+0000","last_unstale":"2024-05-26T15:39:37.406775+0000","last_undegraded":"2024-05-26T15:39:37.406775+0000","last_fullsized":"2024-05-26T15:39:37.406775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:27:52.925834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.499084+0000","last_change":"2024-05-26T15:39:32.930657+0000","last_active":"2024-05-26T15:39:37.499084+0000","last_peered":"2024-05-26T15:39:37.499084+0000","last_clean":"2024-05-26T15:39:37.499084+0000","last_became_active":"2024-05-26T15:39:32.930382+0000","last_became_peered":"2024-05-26T15:39:32.930382+0000","last_unstale":"2024-05-26T15:39:37.499084+0000","last_undegraded":"2024-05-26T15:39:37.499084+0000","last_fullsized":"2024-05-26T15:39:37.499084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:24.160382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.375877+0000","last_change":"2024-05-26T15:39:32.930568+0000","last_active":"2024-05-26T15:39:37.375877+0000","last_peered":"2024-05-26T15:39:37.375877+0000","last_clean":"2024-05-26T15:39:37.375877+0000","last_became_active":"2024-05-26T15:39:32.930302+0000","last_became_peered":"2024-05-26T15:39:32.930302+0000","last_unstale":"2024-05-26T15:39:37.375877+0000","last_undegraded":"2024-05-26T15:39:37.375877+0000","last_fullsized":"2024-05-26T15:39:37.375877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.492015+0000","last_change":"2024-05-26T15:39:32.920604+0000","last_active":"2024-05-26T15:39:37.492015+0000","last_peered":"2024-05-26T15:39:37.492015+0000","last_clean":"2024-05-26T15:39:37.492015+0000","last_became_active":"2024-05-26T15:39:32.919836+0000","last_became_peered":"2024-05-26T15:39:32.919836+0000","last_unstale":"2024-05-26T15:39:37.492015+0000","last_undegraded":"2024-05-26T15:39:37.492015+0000","last_fullsized":"2024-05-26T15:39:37.492015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:07:02.159693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.401276+0000","last_change":"2024-05-26T15:39:32.937715+0000","last_active":"2024-05-26T15:39:37.401276+0000","last_peered":"2024-05-26T15:39:37.401276+0000","last_clean":"2024-05-26T15:39:37.401276+0000","last_became_active":"2024-05-26T15:39:32.937451+0000","last_became_peered":"2024-05-26T15:39:32.937451+0000","last_unstale":"2024-05-26T15:39:37.401276+0000","last_undegraded":"2024-05-26T15:39:37.401276+0000","last_fullsized":"2024-05-26T15:39:37.401276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:41:47.495136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.491613+0000","last_change":"2024-05-26T15:39:32.924295+0000","last_active":"2024-05-26T15:39:37.491613+0000","last_peered":"2024-05-26T15:39:37.491613+0000","last_clean":"2024-05-26T15:39:37.491613+0000","last_became_active":"2024-05-26T15:39:32.923812+0000","last_became_peered":"2024-05-26T15:39:32.923812+0000","last_unstale":"2024-05-26T15:39:37.491613+0000","last_undegraded":"2024-05-26T15:39:37.491613+0000","last_fullsized":"2024-05-26T15:39:37.491613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:42:31.950324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.402857+0000","last_change":"2024-05-26T15:39:32.936632+0000","last_active":"2024-05-26T15:39:37.402857+0000","last_peered":"2024-05-26T15:39:37.402857+0000","last_clean":"2024-05-26T15:39:37.402857+0000","last_became_active":"2024-05-26T15:39:32.934911+0000","last_became_peered":"2024-05-26T15:39:32.934911+0000","last_unstale":"2024-05-26T15:39:37.402857+0000","last_undegraded":"2024-05-26T15:39:37.402857+0000","last_fullsized":"2024-05-26T15:39:37.402857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:24.160382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.384458+0000","last_change":"2024-05-26T15:39:32.915854+0000","last_active":"2024-05-26T15:39:37.384458+0000","last_peered":"2024-05-26T15:39:37.384458+0000","last_clean":"2024-05-26T15:39:37.384458+0000","last_became_active":"2024-05-26T15:39:32.915514+0000","last_became_peered":"2024-05-26T15:39:32.915514+0000","last_unstale":"2024-05-26T15:39:37.384458+0000","last_undegraded":"2024-05-26T15:39:37.384458+0000","last_fullsized":"2024-05-26T15:39:37.384458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:03.619497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.403966+0000","last_change":"2024-05-26T15:39:32.919780+0000","last_active":"2024-05-26T15:39:37.403966+0000","last_peered":"2024-05-26T15:39:37.403966+0000","last_clean":"2024-05-26T15:39:37.403966+0000","last_became_active":"2024-05-26T15:39:32.919496+0000","last_became_peered":"2024-05-26T15:39:32.919496+0000","last_unstale":"2024-05-26T15:39:37.403966+0000","last_undegraded":"2024-05-26T15:39:37.403966+0000","last_fullsized":"2024-05-26T15:39:37.403966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:09:26.574956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-26T15:39:37.495449+0000","last_change":"2024-05-26T15:39:32.922248+0000","last_active":"2024-05-26T15:39:37.495449+0000","last_peered":"2024-05-26T15:39:37.495449+0000","last_clean":"2024-05-26T15:39:37.495449+0000","last_became_active":"2024-05-26T15:39:32.921988+0000","last_became_peered":"2024-05-26T15:39:32.921988+0000","last_unstale":"2024-05-26T15:39:37.495449+0000","last_undegraded":"2024-05-26T15:39:37.495449+0000","last_fullsized":"2024-05-26T15:39:37.495449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:32.375976+0000","last_clean_scrub_stamp":"2024-05-26T15:39:32.375976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:47:40.508265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":98851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.839}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.238}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":266240,"data_stored":103576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":98761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:40:09.026 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-26T15:40:09.027 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-26T15:40:09.027 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-26T15:40:09.027 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-26T15:40:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.270+0000 7ff632c00640 1 Processor -- start 2024-05-26T15:40:09.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.271+0000 7ff632c00640 1 -- start start 2024-05-26T15:40:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.272+0000 7ff632c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff62c0b1d30 0x7ff62c0b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.272+0000 7ff632c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c151b90 0x7ff62c0b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.272+0000 7ff632c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c15e5e0 con 0x7ff62c1517b0 2024-05-26T15:40:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.272+0000 7ff632c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62c15ec60 con 0x7ff62c0b1d30 2024-05-26T15:40:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.272+0000 7ff632c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0cbbe0 con 0x7ff62c151b90 2024-05-26T15:40:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.272+0000 7ff631800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff62c1517b0 0x7ff62c0cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60514/0 (socket says 172.21.15.8:60514) 2024-05-26T15:40:09.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.272+0000 7ff631800640 1 -- 172.21.15.8:0/2410764467 learned_addr learned my addr 172.21.15.8:0/2410764467 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff630e00640 1 --2- 172.21.15.8:0/2410764467 >> v2:172.21.15.47:3300/0 conn(0x7ff62c0b1d30 0x7ff62c0b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff632200640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c151b90 0x7ff62c0b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914459696 0 0) 0x7ff62c15e5e0 con 0x7ff62c1517b0 2024-05-26T15:40:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff614003520 con 0x7ff62c1517b0 2024-05-26T15:40:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4267878923 0 0) 0x7ff614003520 con 0x7ff62c1517b0 2024-05-26T15:40:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c151b90 msgr2=0x7ff62c0b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff62be00640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c151b90 0x7ff62c0b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 >> v2:172.21.15.47:3300/0 conn(0x7ff62c0b1d30 msgr2=0x7ff62c0b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff62be00640 1 --2- 172.21.15.8:0/2410764467 >> v2:172.21.15.47:3300/0 conn(0x7ff62c0b1d30 0x7ff62c0b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c15e880 con 0x7ff62c1517b0 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7ff620001670 con 0x7ff62c1517b0 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.273+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 >> v1:172.21.15.8:6789/0 conn(0x7ff62c1517b0 legacy=0x7ff62c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff62be00640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff614003970 0x7ff614003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff62be00640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6140047c0 0x7ff614004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff62be00640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c151b90 0x7ff614005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c15ec60 con 0x7ff6140047c0 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0cbbe0 con 0x7ff614003970 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61400b9d0 con 0x7ff62c151b90 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff630e00640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6140047c0 0x7ff614004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff632200640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c151b90 0x7ff614005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff631800640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff614003970 0x7ff614003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff630e00640 1 -- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c151b90 msgr2=0x7ff614005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff630e00640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c151b90 0x7ff614005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff630e00640 1 -- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff614003970 msgr2=0x7ff614003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff630e00640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff614003970 0x7ff614003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff630e00640 1 -- 172.21.15.8:0/2410764467 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614003520 con 0x7ff6140047c0 2024-05-26T15:40:09.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.274+0000 7ff631800640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff614003970 0x7ff614003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.275+0000 7ff630e00640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6140047c0 0x7ff614004c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff618009af0 tx=0x7ff6140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7526ffc9522bcd29 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.276+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618031400 con 0x7ff6140047c0 2024-05-26T15:40:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.276+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61802d050 con 0x7ff6140047c0 2024-05-26T15:40:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.276+0000 7ff62be00640 1 -- 172.21.15.8:0/2410764467 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618031580 con 0x7ff6140047c0 2024-05-26T15:40:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.276+0000 7ff632c00640 1 -- 172.21.15.8:0/2410764467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6140047c0 msgr2=0x7ff614004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.276+0000 7ff632c00640 1 --2- 172.21.15.8:0/2410764467 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6140047c0 0x7ff614004c40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff618009af0 tx=0x7ff6140057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.276+0000 7ff632200640 1 -- 172.21.15.8:0/2410764467 reap_dead start 2024-05-26T15:40:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.277+0000 7ff632c00640 1 -- 172.21.15.8:0/2410764467 shutdown_connections 2024-05-26T15:40:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.277+0000 7ff632c00640 1 -- 172.21.15.8:0/2410764467 >> 172.21.15.8:0/2410764467 conn(0x7ff62c098a50 msgr2=0x7ff62c0b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.277+0000 7ff632c00640 1 -- 172.21.15.8:0/2410764467 shutdown_connections 2024-05-26T15:40:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.277+0000 7ff632c00640 1 -- 172.21.15.8:0/2410764467 wait complete. 2024-05-26T15:40:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.278+0000 7ff632c00640 1 Processor -- start 2024-05-26T15:40:09.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.279+0000 7ff632c00640 1 -- start start 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.279+0000 7ff632c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6140047c0 0x7ff62c14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.279+0000 7ff632c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c14cb30 0x7ff62c14e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff632c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c1f1180 0x7ff62c14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff632c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c1f4880 con 0x7ff62c14cb30 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff632c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c1f3cd0 con 0x7ff6140047c0 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff632c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c1f3ee0 con 0x7ff62c1f1180 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff630e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c14cb30 0x7ff62c14e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff630e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c14cb30 0x7ff62c14e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47880/0 (socket says 172.21.15.8:47880) 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff630e00640 1 -- 172.21.15.8:0/623286987 learned_addr learned my addr 172.21.15.8:0/623286987 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff631800640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6140047c0 0x7ff62c14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff632200640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c1f1180 0x7ff62c14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff630e00640 1 -- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c1f1180 msgr2=0x7ff62c14eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff630e00640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c1f1180 0x7ff62c14eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff630e00640 1 -- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6140047c0 msgr2=0x7ff62c14c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff630e00640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6140047c0 0x7ff62c14c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.280+0000 7ff630e00640 1 -- 172.21.15.8:0/623286987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c1f41c0 con 0x7ff62c14cb30 2024-05-26T15:40:09.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.281+0000 7ff630e00640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c14cb30 0x7ff62c14e640 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff618009af0 tx=0x7ff618004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.281+0000 7ff629600640 1 -- 172.21.15.8:0/623286987 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6180038c0 con 0x7ff62c14cb30 2024-05-26T15:40:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.281+0000 7ff629600640 1 -- 172.21.15.8:0/623286987 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff618003a60 con 0x7ff62c14cb30 2024-05-26T15:40:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.281+0000 7ff629600640 1 -- 172.21.15.8:0/623286987 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618003e10 con 0x7ff62c14cb30 2024-05-26T15:40:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.281+0000 7ff632c00640 1 -- 172.21.15.8:0/623286987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c1f44a0 con 0x7ff62c14cb30 2024-05-26T15:40:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.281+0000 7ff632c00640 1 -- 172.21.15.8:0/623286987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62c14c800 con 0x7ff62c14cb30 2024-05-26T15:40:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.282+0000 7ff632c00640 1 -- 172.21.15.8:0/623286987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62c1f4020 con 0x7ff62c14cb30 2024-05-26T15:40:09.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.283+0000 7ff629600640 1 -- 172.21.15.8:0/623286987 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff618038070 con 0x7ff62c14cb30 2024-05-26T15:40:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.284+0000 7ff629600640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff60c06ac00 0x7ff60c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.284+0000 7ff629600640 1 -- 172.21.15.8:0/623286987 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6180a99b0 con 0x7ff62c14cb30 2024-05-26T15:40:09.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.285+0000 7ff631800640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff60c06ac00 0x7ff60c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.286+0000 7ff631800640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff60c06ac00 0x7ff60c06d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff620000c00 tx=0x7ff620009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:09.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.288+0000 7ff629600640 1 -- 172.21.15.8:0/623286987 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff62c1f4020 con 0x7ff62c14cb30 2024-05-26T15:40:09.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.532+0000 7ff632c00640 1 -- 172.21.15.8:0/623286987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff62c1f49c0 con 0x7ff62c14cb30 2024-05-26T15:40:09.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.533+0000 7ff629600640 1 -- 172.21.15.8:0/623286987 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff618036040 con 0x7ff62c14cb30 2024-05-26T15:40:09.531 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:09.531 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-26T15:40:09.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.535+0000 7ff632c00640 1 -- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff60c06ac00 msgr2=0x7ff60c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.535+0000 7ff632c00640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff60c06ac00 0x7ff60c06d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff620000c00 tx=0x7ff620009040 comp rx=0 tx=0).stop 2024-05-26T15:40:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.535+0000 7ff632c00640 1 -- 172.21.15.8:0/623286987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c14cb30 msgr2=0x7ff62c14e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.535+0000 7ff632c00640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c14cb30 0x7ff62c14e640 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff618009af0 tx=0x7ff618004730 comp rx=0 tx=0).stop 2024-05-26T15:40:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.536+0000 7ff632c00640 1 -- 172.21.15.8:0/623286987 shutdown_connections 2024-05-26T15:40:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.536+0000 7ff632c00640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff62c1f1180 0x7ff62c14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.536+0000 7ff632c00640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff62c14cb30 0x7ff62c14e640 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.536+0000 7ff632c00640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff60c06ac00 0x7ff60c06d0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.536+0000 7ff632c00640 1 --2- 172.21.15.8:0/623286987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff6140047c0 0x7ff62c14c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.536+0000 7ff632c00640 1 -- 172.21.15.8:0/623286987 >> 172.21.15.8:0/623286987 conn(0x7ff62c098a50 msgr2=0x7ff62c0b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.536+0000 7ff632c00640 1 -- 172.21.15.8:0/623286987 shutdown_connections 2024-05-26T15:40:09.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.536+0000 7ff632c00640 1 -- 172.21.15.8:0/623286987 wait complete. 2024-05-26T15:40:09.554 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-26T15:40:09.554 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.750+0000 7ff98f200640 1 Processor -- start 2024-05-26T15:40:09.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.751+0000 7ff98f200640 1 -- start start 2024-05-26T15:40:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.752+0000 7ff98f200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff9881600d0 0x7ff9880cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.752+0000 7ff98f200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff9880cfed0 0x7ff9880b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.752+0000 7ff98f200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9880b7eb0 con 0x7ff9880b8720 2024-05-26T15:40:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.752+0000 7ff98f200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9880d0ef0 con 0x7ff9880cfed0 2024-05-26T15:40:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.752+0000 7ff98f200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9880d0380 con 0x7ff9881600d0 2024-05-26T15:40:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.753+0000 7ff98e800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff9880cfed0 0x7ff9880b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.753+0000 7ff98e800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff9880cfed0 0x7ff9880b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47890/0 (socket says 172.21.15.8:47890) 2024-05-26T15:40:09.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.753+0000 7ff98e800640 1 -- 172.21.15.8:0/1241736596 learned_addr learned my addr 172.21.15.8:0/1241736596 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.753+0000 7ff98de00640 1 --2- 172.21.15.8:0/1241736596 >> v2:172.21.15.47:3300/0 conn(0x7ff9881600d0 0x7ff9880cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.753+0000 7ff98e800640 1 -- 172.21.15.8:0/1241736596 >> v2:172.21.15.47:3300/0 conn(0x7ff9881600d0 msgr2=0x7ff9880cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.753+0000 7ff98e800640 1 --2- 172.21.15.8:0/1241736596 >> v2:172.21.15.47:3300/0 conn(0x7ff9881600d0 0x7ff9880cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.753+0000 7ff98e800640 1 -- 172.21.15.8:0/1241736596 >> v1:172.21.15.47:6789/0 conn(0x7ff9880b8720 legacy=0x7ff9880d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.753+0000 7ff98e800640 1 -- 172.21.15.8:0/1241736596 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9881604b0 con 0x7ff9880cfed0 2024-05-26T15:40:09.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.753+0000 7ff98de00640 1 --2- 172.21.15.8:0/1241736596 >> v2:172.21.15.47:3300/0 conn(0x7ff9881600d0 0x7ff9880cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.754+0000 7ff98e800640 1 --2- 172.21.15.8:0/1241736596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880cfed0 0x7ff9880b6b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff9880b4d50 tx=0x7ff98402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794f41d29f99c4ac server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98ca00640 1 -- 172.21.15.8:0/1241736596 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984031600 con 0x7ff9880cfed0 2024-05-26T15:40:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98ca00640 1 -- 172.21.15.8:0/1241736596 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98402d050 con 0x7ff9880cfed0 2024-05-26T15:40:09.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98ca00640 1 -- 172.21.15.8:0/1241736596 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984031980 con 0x7ff9880cfed0 2024-05-26T15:40:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98f200640 1 -- 172.21.15.8:0/1241736596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880cfed0 msgr2=0x7ff9880b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98f200640 1 --2- 172.21.15.8:0/1241736596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880cfed0 0x7ff9880b6b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff9880b4d50 tx=0x7ff98402a660 comp rx=0 tx=0).stop 2024-05-26T15:40:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98f200640 1 -- 172.21.15.8:0/1241736596 shutdown_connections 2024-05-26T15:40:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98f200640 1 --2- 172.21.15.8:0/1241736596 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880cfed0 0x7ff9880b6b30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98f200640 1 --2- 172.21.15.8:0/1241736596 >> v2:172.21.15.47:3300/0 conn(0x7ff9881600d0 0x7ff9880cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98f200640 1 -- 172.21.15.8:0/1241736596 >> 172.21.15.8:0/1241736596 conn(0x7ff98806b750 msgr2=0x7ff98806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98f200640 1 -- 172.21.15.8:0/1241736596 shutdown_connections 2024-05-26T15:40:09.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.755+0000 7ff98f200640 1 -- 172.21.15.8:0/1241736596 wait complete. 2024-05-26T15:40:09.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.758+0000 7ff98f200640 1 Processor -- start 2024-05-26T15:40:09.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.758+0000 7ff98f200640 1 -- start start 2024-05-26T15:40:09.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.759+0000 7ff98f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880b8720 0x7ff9881521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.759+0000 7ff98f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9880cfed0 0x7ff9880c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.759+0000 7ff98f200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9881600d0 0x7ff988151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.759+0000 7ff98f200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9881518b0 con 0x7ff9880b8720 2024-05-26T15:40:09.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.759+0000 7ff98f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff988152c00 con 0x7ff9880cfed0 2024-05-26T15:40:09.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.759+0000 7ff98f200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff988152ee0 con 0x7ff9881600d0 2024-05-26T15:40:09.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.759+0000 7ff98de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880b8720 0x7ff9881521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.759+0000 7ff98de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880b8720 0x7ff9881521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47892/0 (socket says 172.21.15.8:47892) 2024-05-26T15:40:09.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.759+0000 7ff98de00640 1 -- 172.21.15.8:0/2412631953 learned_addr learned my addr 172.21.15.8:0/2412631953 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:09.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff98e800640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9881600d0 0x7ff988151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff98d400640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9880cfed0 0x7ff9880c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff98de00640 1 -- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9881600d0 msgr2=0x7ff988151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff98de00640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9881600d0 0x7ff988151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff98de00640 1 -- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9880cfed0 msgr2=0x7ff9880c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff98de00640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9880cfed0 0x7ff9880c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff98de00640 1 -- 172.21.15.8:0/2412631953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984009b30 con 0x7ff9880b8720 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff98d400640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9880cfed0 0x7ff9880c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff98de00640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880b8720 0x7ff9881521d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00c7f0 tx=0x7ff97c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff982000640 1 -- 172.21.15.8:0/2412631953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c007820 con 0x7ff9880b8720 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff982000640 1 -- 172.21.15.8:0/2412631953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c007980 con 0x7ff9880b8720 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff98f200640 1 -- 172.21.15.8:0/2412631953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9881531c0 con 0x7ff9880b8720 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.760+0000 7ff982000640 1 -- 172.21.15.8:0/2412631953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c007cf0 con 0x7ff9880b8720 2024-05-26T15:40:09.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.761+0000 7ff98f200640 1 -- 172.21.15.8:0/2412631953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9881527b0 con 0x7ff9880b8720 2024-05-26T15:40:09.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.762+0000 7ff98f200640 1 -- 172.21.15.8:0/2412631953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98804e260 con 0x7ff9880b8720 2024-05-26T15:40:09.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.762+0000 7ff982000640 1 -- 172.21.15.8:0/2412631953 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff97c0113f0 con 0x7ff9880b8720 2024-05-26T15:40:09.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.763+0000 7ff982000640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff96c06ac00 0x7ff96c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:09.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.763+0000 7ff982000640 1 -- 172.21.15.8:0/2412631953 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff97c0899b0 con 0x7ff9880b8720 2024-05-26T15:40:09.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.764+0000 7ff98d400640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff96c06ac00 0x7ff96c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:09.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.765+0000 7ff98d400640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff96c06ac00 0x7ff96c06d0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff988150720 tx=0x7ff978009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:09.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.768+0000 7ff982000640 1 -- 172.21.15.8:0/2412631953 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff97c0548a0 con 0x7ff9880b8720 2024-05-26T15:40:09.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.971+0000 7ff98f200640 1 -- 172.21.15.8:0/2412631953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff98806beb0 con 0x7ff9880b8720 2024-05-26T15:40:09.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.972+0000 7ff982000640 1 -- 172.21.15.8:0/2412631953 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7ff97c01f090 con 0x7ff9880b8720 2024-05-26T15:40:09.971 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:09.972 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 -- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff96c06ac00 msgr2=0x7ff96c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff96c06ac00 0x7ff96c06d0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff988150720 tx=0x7ff978009040 comp rx=0 tx=0).stop 2024-05-26T15:40:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 -- 172.21.15.8:0/2412631953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880b8720 msgr2=0x7ff9881521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880b8720 0x7ff9881521d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff97c00c7f0 tx=0x7ff97c00ccb0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 -- 172.21.15.8:0/2412631953 shutdown_connections 2024-05-26T15:40:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff9881600d0 0x7ff988151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff96c06ac00 0x7ff96c06d0c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff9880cfed0 0x7ff9880c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 --2- 172.21.15.8:0/2412631953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff9880b8720 0x7ff9881521d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:09.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 -- 172.21.15.8:0/2412631953 >> 172.21.15.8:0/2412631953 conn(0x7ff98806b750 msgr2=0x7ff9880d1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:09.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 -- 172.21.15.8:0/2412631953 shutdown_connections 2024-05-26T15:40:09.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:09.976+0000 7ff98f200640 1 -- 172.21.15.8:0/2412631953 wait complete. 2024-05-26T15:40:09.993 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:09.994 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:10.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.206+0000 7f0831c00640 1 Processor -- start 2024-05-26T15:40:10.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.206+0000 7f0831c00640 1 -- start start 2024-05-26T15:40:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.208+0000 7f0831c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f082c0cdd10 0x7f082c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.208+0000 7f0831c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c0cba60 con 0x7f082c15a9d0 2024-05-26T15:40:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.208+0000 7f0831c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c071610 con 0x7f082c06d970 2024-05-26T15:40:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.208+0000 7f0831c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082c0cbd00 con 0x7f082c0cdd10 2024-05-26T15:40:10.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.208+0000 7f082be00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f082c15a9d0 0x7f082c0cd600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60528/0 (socket says 172.21.15.8:60528) 2024-05-26T15:40:10.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.208+0000 7f082be00640 1 -- 172.21.15.8:0/3180552276 learned_addr learned my addr 172.21.15.8:0/3180552276 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:10.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.209+0000 7f082b400640 1 --2- 172.21.15.8:0/3180552276 >> v2:172.21.15.47:3300/0 conn(0x7f082c0cdd10 0x7f082c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.209+0000 7f082aa00640 1 -- 172.21.15.8:0/3180552276 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548361738 0 0) 0x7f082c0cba60 con 0x7f082c15a9d0 2024-05-26T15:40:10.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.209+0000 7f082aa00640 1 -- 172.21.15.8:0/3180552276 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0810003520 con 0x7f082c15a9d0 2024-05-26T15:40:10.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.209+0000 7f082b400640 1 -- 172.21.15.8:0/3180552276 >> v1:172.21.15.47:6789/0 conn(0x7f082c06d970 legacy=0x7f082c1643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.209+0000 7f082b400640 1 -- 172.21.15.8:0/3180552276 >> v1:172.21.15.8:6789/0 conn(0x7f082c15a9d0 legacy=0x7f082c0cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.209+0000 7f082b400640 1 -- 172.21.15.8:0/3180552276 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c070e10 con 0x7f082c0cdd10 2024-05-26T15:40:10.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.211+0000 7f082b400640 1 --2- 172.21.15.8:0/3180552276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f082c0cdd10 0x7f082c06dec0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08180097a0 tx=0x7f081802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8d3c6e66c02d09e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:10.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.211+0000 7f082aa00640 1 -- 172.21.15.8:0/3180552276 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818032440 con 0x7f082c0cdd10 2024-05-26T15:40:10.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.211+0000 7f082aa00640 1 -- 172.21.15.8:0/3180552276 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08180325a0 con 0x7f082c0cdd10 2024-05-26T15:40:10.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.211+0000 7f082aa00640 1 -- 172.21.15.8:0/3180552276 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818032910 con 0x7f082c0cdd10 2024-05-26T15:40:10.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.212+0000 7f0831c00640 1 -- 172.21.15.8:0/3180552276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f082c0cdd10 msgr2=0x7f082c06dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.212+0000 7f0831c00640 1 --2- 172.21.15.8:0/3180552276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f082c0cdd10 0x7f082c06dec0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08180097a0 tx=0x7f081802a1a0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.212+0000 7f0831c00640 1 -- 172.21.15.8:0/3180552276 shutdown_connections 2024-05-26T15:40:10.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.212+0000 7f0831c00640 1 --2- 172.21.15.8:0/3180552276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f082c0cdd10 0x7f082c06dec0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.212+0000 7f0831c00640 1 -- 172.21.15.8:0/3180552276 >> 172.21.15.8:0/3180552276 conn(0x7f082c0ce4f0 msgr2=0x7f082c0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:10.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.212+0000 7f0831c00640 1 -- 172.21.15.8:0/3180552276 shutdown_connections 2024-05-26T15:40:10.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.212+0000 7f0831c00640 1 -- 172.21.15.8:0/3180552276 wait complete. 2024-05-26T15:40:10.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.214+0000 7f0831c00640 1 Processor -- start 2024-05-26T15:40:10.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.214+0000 7f0831c00640 1 -- start start 2024-05-26T15:40:10.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f0831c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f082c06d970 0x7f082c1f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f0831c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f082c0cdd10 0x7f082c0a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f0831c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f082c15a9d0 0x7f082c0a9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f0831c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0aaef0 con 0x7f082c0cdd10 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f0831c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c153410 con 0x7f082c15a9d0 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f0831c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082c1f0c40 con 0x7f082c06d970 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f082b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f082c0cdd10 0x7f082c0a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f082b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f082c0cdd10 0x7f082c0a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47896/0 (socket says 172.21.15.8:47896) 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f082b400640 1 -- 172.21.15.8:0/3003123208 learned_addr learned my addr 172.21.15.8:0/3003123208 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f082be00640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f082c06d970 0x7f082c1f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f0831200640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f082c15a9d0 0x7f082c0a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f082b400640 1 -- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f082c06d970 msgr2=0x7f082c1f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f082b400640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f082c06d970 0x7f082c1f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f082b400640 1 -- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f082c15a9d0 msgr2=0x7f082c0a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f082b400640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f082c15a9d0 0x7f082c0a9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.215+0000 7f082b400640 1 -- 172.21.15.8:0/3003123208 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818009400 con 0x7f082c0cdd10 2024-05-26T15:40:10.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.216+0000 7f082b400640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f082c0cdd10 0x7f082c0a8a80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f08180097a0 tx=0x7f08180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:10.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.216+0000 7f0823e00640 1 -- 172.21.15.8:0/3003123208 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818032440 con 0x7f082c0cdd10 2024-05-26T15:40:10.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.216+0000 7f0823e00640 1 -- 172.21.15.8:0/3003123208 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818006e10 con 0x7f082c0cdd10 2024-05-26T15:40:10.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.216+0000 7f0823e00640 1 -- 172.21.15.8:0/3003123208 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818003810 con 0x7f082c0cdd10 2024-05-26T15:40:10.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.216+0000 7f0831c00640 1 -- 172.21.15.8:0/3003123208 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c0aa2e0 con 0x7f082c0cdd10 2024-05-26T15:40:10.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.216+0000 7f0831c00640 1 -- 172.21.15.8:0/3003123208 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c0aa8a0 con 0x7f082c0cdd10 2024-05-26T15:40:10.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.218+0000 7f0831c00640 1 -- 172.21.15.8:0/3003123208 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c0cb170 con 0x7f082c0cdd10 2024-05-26T15:40:10.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.218+0000 7f0823e00640 1 -- 172.21.15.8:0/3003123208 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0818039050 con 0x7f082c0cdd10 2024-05-26T15:40:10.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.219+0000 7f0823e00640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f080c06ac00 0x7f080c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.219+0000 7f0823e00640 1 -- 172.21.15.8:0/3003123208 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f08180aa060 con 0x7f082c0cdd10 2024-05-26T15:40:10.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.220+0000 7f082be00640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f080c06ac00 0x7f080c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.221+0000 7f082be00640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f080c06ac00 0x7f080c06d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f081c0011e0 tx=0x7f081c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:10.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.224+0000 7f0823e00640 1 -- 172.21.15.8:0/3003123208 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0818075070 con 0x7f082c0cdd10 2024-05-26T15:40:10.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.421+0000 7f0831c00640 1 -- 172.21.15.8:0/3003123208 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f082c04e210 con 0x7f082c0cdd10 2024-05-26T15:40:10.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.423+0000 7f0823e00640 1 -- 172.21.15.8:0/3003123208 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08180370a0 con 0x7f082c0cdd10 2024-05-26T15:40:10.421 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.425+0000 7f0831c00640 1 -- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f080c06ac00 msgr2=0x7f080c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.425+0000 7f0831c00640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f080c06ac00 0x7f080c06d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f081c0011e0 tx=0x7f081c009040 comp rx=0 tx=0).stop 2024-05-26T15:40:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.425+0000 7f0831c00640 1 -- 172.21.15.8:0/3003123208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f082c0cdd10 msgr2=0x7f082c0a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.425+0000 7f0831c00640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f082c0cdd10 0x7f082c0a8a80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f08180097a0 tx=0x7f08180046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.425+0000 7f0831c00640 1 -- 172.21.15.8:0/3003123208 shutdown_connections 2024-05-26T15:40:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.425+0000 7f0831c00640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f080c06ac00 0x7f080c06d0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.425+0000 7f0831c00640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f082c15a9d0 0x7f082c0a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.425+0000 7f0831c00640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f082c0cdd10 0x7f082c0a8a80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.425+0000 7f0831c00640 1 --2- 172.21.15.8:0/3003123208 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f082c06d970 0x7f082c1f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.425+0000 7f0831c00640 1 -- 172.21.15.8:0/3003123208 >> 172.21.15.8:0/3003123208 conn(0x7f082c0ce4f0 msgr2=0x7f082c156a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.426+0000 7f0831c00640 1 -- 172.21.15.8:0/3003123208 shutdown_connections 2024-05-26T15:40:10.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.426+0000 7f0831c00640 1 -- 172.21.15.8:0/3003123208 wait complete. 2024-05-26T15:40:10.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:10.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.655+0000 7f4f65600640 1 Processor -- start 2024-05-26T15:40:10.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.655+0000 7f4f65600640 1 -- start start 2024-05-26T15:40:10.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.657+0000 7f4f65600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f6015a9d0 0x7f4f6006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.657+0000 7f4f65600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4f600cdd10 0x7f4f601643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.657+0000 7f4f65600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f600cba60 con 0x7f4f6006d970 2024-05-26T15:40:10.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.657+0000 7f4f65600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f60071610 con 0x7f4f600cdd10 2024-05-26T15:40:10.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.657+0000 7f4f65600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600cbd00 con 0x7f4f6015a9d0 2024-05-26T15:40:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f5f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4f6006d970 0x7f4f600cd600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:60538/0 (socket says 172.21.15.8:60538) 2024-05-26T15:40:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f5f400640 1 -- 172.21.15.8:0/2533754056 learned_addr learned my addr 172.21.15.8:0/2533754056 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f64c00640 1 --2- 172.21.15.8:0/2533754056 >> v2:172.21.15.47:3300/0 conn(0x7f4f600cdd10 0x7f4f601643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f5fe00640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f6015a9d0 0x7f4f6006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389349304 0 0) 0x7f4f600cba60 con 0x7f4f6006d970 2024-05-26T15:40:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f44003520 con 0x7f4f6006d970 2024-05-26T15:40:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2092883538 0 0) 0x7f4f44003520 con 0x7f4f6006d970 2024-05-26T15:40:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f6015a9d0 msgr2=0x7f4f6006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:10.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f5ea00640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f6015a9d0 0x7f4f6006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 >> v2:172.21.15.47:3300/0 conn(0x7f4f600cdd10 msgr2=0x7f4f601643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.658+0000 7f4f5ea00640 1 --2- 172.21.15.8:0/2533754056 >> v2:172.21.15.47:3300/0 conn(0x7f4f600cdd10 0x7f4f601643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f60070e10 con 0x7f4f6006d970 2024-05-26T15:40:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f4f4c001670 con 0x7f4f6006d970 2024-05-26T15:40:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 >> v1:172.21.15.8:6789/0 conn(0x7f4f6006d970 legacy=0x7f4f600cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5ea00640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f44003970 0x7f4f44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5ea00640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f440047c0 0x7f4f44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5ea00640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f6015a9d0 0x7f4f44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60071610 con 0x7f4f44003970 2024-05-26T15:40:10.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600cbd00 con 0x7f4f440047c0 2024-05-26T15:40:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4400b9d0 con 0x7f4f6015a9d0 2024-05-26T15:40:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5fe00640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f44003970 0x7f4f44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5f400640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f440047c0 0x7f4f44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f64c00640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f6015a9d0 0x7f4f44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5fe00640 1 -- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f6015a9d0 msgr2=0x7f4f44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5fe00640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f6015a9d0 0x7f4f44005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5fe00640 1 -- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f440047c0 msgr2=0x7f4f44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5fe00640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f440047c0 0x7f4f44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.659+0000 7f4f5fe00640 1 -- 172.21.15.8:0/2533754056 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f44003520 con 0x7f4f44003970 2024-05-26T15:40:10.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.661+0000 7f4f5fe00640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f44003970 0x7f4f44003d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009af0 tx=0x7f4f440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d7f9196ce7cae4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:10.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.661+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50031400 con 0x7f4f44003970 2024-05-26T15:40:10.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.661+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5002d050 con 0x7f4f44003970 2024-05-26T15:40:10.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.661+0000 7f4f5ea00640 1 -- 172.21.15.8:0/2533754056 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50031780 con 0x7f4f44003970 2024-05-26T15:40:10.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.661+0000 7f4f65600640 1 -- 172.21.15.8:0/2533754056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f44003970 msgr2=0x7f4f44003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.661+0000 7f4f65600640 1 --2- 172.21.15.8:0/2533754056 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f44003970 0x7f4f44003d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009af0 tx=0x7f4f440057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.661+0000 7f4f64c00640 1 -- 172.21.15.8:0/2533754056 reap_dead start 2024-05-26T15:40:10.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.662+0000 7f4f65600640 1 -- 172.21.15.8:0/2533754056 shutdown_connections 2024-05-26T15:40:10.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.662+0000 7f4f65600640 1 -- 172.21.15.8:0/2533754056 >> 172.21.15.8:0/2533754056 conn(0x7f4f600ce4f0 msgr2=0x7f4f600ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:10.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.662+0000 7f4f65600640 1 -- 172.21.15.8:0/2533754056 shutdown_connections 2024-05-26T15:40:10.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.662+0000 7f4f65600640 1 -- 172.21.15.8:0/2533754056 wait complete. 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.664+0000 7f4f65600640 1 Processor -- start 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.664+0000 7f4f65600640 1 -- start start 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f65600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f44003970 0x7f4f600c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f65600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f60155870 0x7f4f60144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f65600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f60142690 0x7f4f60142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f65600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600c9190 con 0x7f4f60142690 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f65600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60145650 con 0x7f4f60155870 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f65600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60145090 con 0x7f4f44003970 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f64c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f60142690 0x7f4f60142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f64c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f60142690 0x7f4f60142b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47904/0 (socket says 172.21.15.8:47904) 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f64c00640 1 -- 172.21.15.8:0/3503542765 learned_addr learned my addr 172.21.15.8:0/3503542765 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:10.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f5fe00640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f44003970 0x7f4f600c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.665+0000 7f4f5f400640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f60155870 0x7f4f60144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f64c00640 1 -- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f44003970 msgr2=0x7f4f600c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f64c00640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f44003970 0x7f4f600c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f64c00640 1 -- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f60155870 msgr2=0x7f4f60144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f64c00640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f60155870 0x7f4f60144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f64c00640 1 -- 172.21.15.8:0/3503542765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f60145370 con 0x7f4f60142690 2024-05-26T15:40:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f64c00640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f60142690 0x7f4f60142b40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4f600ce120 tx=0x7f4f5800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f57e00640 1 -- 172.21.15.8:0/3503542765 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58017400 con 0x7f4f60142690 2024-05-26T15:40:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f57e00640 1 -- 172.21.15.8:0/3503542765 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f58011040 con 0x7f4f60142690 2024-05-26T15:40:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f65600640 1 -- 172.21.15.8:0/3503542765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f600c93c0 con 0x7f4f60142690 2024-05-26T15:40:10.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f57e00640 1 -- 172.21.15.8:0/3503542765 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f580177e0 con 0x7f4f60142690 2024-05-26T15:40:10.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.666+0000 7f4f65600640 1 -- 172.21.15.8:0/3503542765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f600c7950 con 0x7f4f60142690 2024-05-26T15:40:10.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.667+0000 7f4f65600640 1 -- 172.21.15.8:0/3503542765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f600c98e0 con 0x7f4f60142690 2024-05-26T15:40:10.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.668+0000 7f4f57e00640 1 -- 172.21.15.8:0/3503542765 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4f58017940 con 0x7f4f60142690 2024-05-26T15:40:10.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.669+0000 7f4f57e00640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f4006ac00 0x7f4f4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:10.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.670+0000 7f4f57e00640 1 -- 172.21.15.8:0/3503542765 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f58089be0 con 0x7f4f60142690 2024-05-26T15:40:10.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.670+0000 7f4f5fe00640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f4006ac00 0x7f4f4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:10.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.671+0000 7f4f5fe00640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f4006ac00 0x7f4f4006d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4f50033000 tx=0x7f4f50008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:10.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.674+0000 7f4f57e00640 1 -- 172.21.15.8:0/3503542765 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4f600c98e0 con 0x7f4f60142690 2024-05-26T15:40:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.869+0000 7f4f65600640 1 -- 172.21.15.8:0/3503542765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f600c98e0 con 0x7f4f60142690 2024-05-26T15:40:10.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.870+0000 7f4f57e00640 1 -- 172.21.15.8:0/3503542765 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f600c98e0 con 0x7f4f60142690 2024-05-26T15:40:10.869 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 -- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f4006ac00 msgr2=0x7f4f4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f4006ac00 0x7f4f4006d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4f50033000 tx=0x7f4f50008030 comp rx=0 tx=0).stop 2024-05-26T15:40:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 -- 172.21.15.8:0/3503542765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f60142690 msgr2=0x7f4f60142b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f60142690 0x7f4f60142b40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4f600ce120 tx=0x7f4f5800f4a0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 -- 172.21.15.8:0/3503542765 shutdown_connections 2024-05-26T15:40:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f60142690 0x7f4f60142b40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f4006ac00 0x7f4f4006d0c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f60155870 0x7f4f60144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 --2- 172.21.15.8:0/3503542765 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4f44003970 0x7f4f600c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 -- 172.21.15.8:0/3503542765 >> 172.21.15.8:0/3503542765 conn(0x7f4f600ce4f0 msgr2=0x7f4f60070360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 -- 172.21.15.8:0/3503542765 shutdown_connections 2024-05-26T15:40:10.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:10.873+0000 7f4f65600640 1 -- 172.21.15.8:0/3503542765 wait complete. 2024-05-26T15:40:10.890 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:11.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.104+0000 7ff361800640 1 Processor -- start 2024-05-26T15:40:11.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.105+0000 7ff361800640 1 -- start start 2024-05-26T15:40:11.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.106+0000 7ff361800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 0x7ff35c0d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.106+0000 7ff361800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff35c0d2df0 0x7ff35c0d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.106+0000 7ff361800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c0b6340 con 0x7ff35c0d13e0 2024-05-26T15:40:11.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.106+0000 7ff361800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c0b59b0 con 0x7ff35c0d2df0 2024-05-26T15:40:11.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.106+0000 7ff361800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0d3250 con 0x7ff35c160490 2024-05-26T15:40:11.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.107+0000 7ff35be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 0x7ff35c0d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.107+0000 7ff35be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 0x7ff35c0d28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:60778/0 (socket says 172.21.15.8:60778) 2024-05-26T15:40:11.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.107+0000 7ff35be00640 1 -- 172.21.15.8:0/365569004 learned_addr learned my addr 172.21.15.8:0/365569004 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:11.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.107+0000 7ff35b400640 1 --2- 172.21.15.8:0/365569004 >> v2:172.21.15.47:3300/0 conn(0x7ff35c0d2df0 0x7ff35c0d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.108+0000 7ff35be00640 1 -- 172.21.15.8:0/365569004 >> v2:172.21.15.47:3300/0 conn(0x7ff35c0d2df0 msgr2=0x7ff35c0d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:11.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.108+0000 7ff35be00640 1 --2- 172.21.15.8:0/365569004 >> v2:172.21.15.47:3300/0 conn(0x7ff35c0d2df0 0x7ff35c0d0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.108+0000 7ff35be00640 1 -- 172.21.15.8:0/365569004 >> v1:172.21.15.47:6789/0 conn(0x7ff35c0d13e0 legacy=0x7ff35c0cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.108+0000 7ff35be00640 1 -- 172.21.15.8:0/365569004 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c0b6010 con 0x7ff35c160490 2024-05-26T15:40:11.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.108+0000 7ff35aa00640 1 -- 172.21.15.8:0/365569004 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408305577 0 0) 0x7ff35c0b6340 con 0x7ff35c0d13e0 2024-05-26T15:40:11.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.109+0000 7ff35be00640 1 --2- 172.21.15.8:0/365569004 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 0x7ff35c0d28b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009870 tx=0x7ff34c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c737c3989f38f06b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:11.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.109+0000 7ff35aa00640 1 -- 172.21.15.8:0/365569004 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c032440 con 0x7ff35c160490 2024-05-26T15:40:11.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.110+0000 7ff35aa00640 1 -- 172.21.15.8:0/365569004 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c0325a0 con 0x7ff35c160490 2024-05-26T15:40:11.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.110+0000 7ff35aa00640 1 -- 172.21.15.8:0/365569004 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c032930 con 0x7ff35c160490 2024-05-26T15:40:11.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.110+0000 7ff361800640 1 -- 172.21.15.8:0/365569004 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 msgr2=0x7ff35c0d28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.110+0000 7ff361800640 1 --2- 172.21.15.8:0/365569004 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 0x7ff35c0d28b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009870 tx=0x7ff34c02a270 comp rx=0 tx=0).stop 2024-05-26T15:40:11.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.110+0000 7ff361800640 1 -- 172.21.15.8:0/365569004 shutdown_connections 2024-05-26T15:40:11.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.110+0000 7ff361800640 1 --2- 172.21.15.8:0/365569004 >> v2:172.21.15.47:3300/0 conn(0x7ff35c0d2df0 0x7ff35c0d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.110+0000 7ff361800640 1 --2- 172.21.15.8:0/365569004 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 0x7ff35c0d28b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.110+0000 7ff361800640 1 -- 172.21.15.8:0/365569004 >> 172.21.15.8:0/365569004 conn(0x7ff35c0715a0 msgr2=0x7ff35c0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:11.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.110+0000 7ff361800640 1 -- 172.21.15.8:0/365569004 shutdown_connections 2024-05-26T15:40:11.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.110+0000 7ff361800640 1 -- 172.21.15.8:0/365569004 wait complete. 2024-05-26T15:40:11.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.112+0000 7ff361800640 1 Processor -- start 2024-05-26T15:40:11.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.112+0000 7ff361800640 1 -- start start 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.113+0000 7ff361800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff35c0d13e0 0x7ff35c142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.113+0000 7ff361800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35c0d2df0 0x7ff35c154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.113+0000 7ff361800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 0x7ff35c156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.113+0000 7ff361800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c156460 con 0x7ff35c0d13e0 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.113+0000 7ff361800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c1430a0 con 0x7ff35c0d2df0 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.113+0000 7ff361800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c1553c0 con 0x7ff35c160490 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.113+0000 7ff35be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff35c0d13e0 0x7ff35c142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.113+0000 7ff35be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff35c0d13e0 0x7ff35c142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53156/0 (socket says 172.21.15.8:53156) 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.113+0000 7ff35be00640 1 -- 172.21.15.8:0/3212386797 learned_addr learned my addr 172.21.15.8:0/3212386797 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.114+0000 7ff360e00640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 0x7ff35c156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.114+0000 7ff35b400640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35c0d2df0 0x7ff35c154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.114+0000 7ff35be00640 1 -- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 msgr2=0x7ff35c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.114+0000 7ff35be00640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 0x7ff35c156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.114+0000 7ff35be00640 1 -- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35c0d2df0 msgr2=0x7ff35c154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.114+0000 7ff35be00640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35c0d2df0 0x7ff35c154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.114+0000 7ff35be00640 1 -- 172.21.15.8:0/3212386797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c0094d0 con 0x7ff35c0d13e0 2024-05-26T15:40:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.114+0000 7ff35be00640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff35c0d13e0 0x7ff35c142b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0090b0 tx=0x7ff34c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.115+0000 7ff353e00640 1 -- 172.21.15.8:0/3212386797 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c032440 con 0x7ff35c0d13e0 2024-05-26T15:40:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.115+0000 7ff353e00640 1 -- 172.21.15.8:0/3212386797 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c030ba0 con 0x7ff35c0d13e0 2024-05-26T15:40:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.115+0000 7ff353e00640 1 -- 172.21.15.8:0/3212386797 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c032e20 con 0x7ff35c0d13e0 2024-05-26T15:40:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.115+0000 7ff361800640 1 -- 172.21.15.8:0/3212386797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c1556a0 con 0x7ff35c0d13e0 2024-05-26T15:40:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.115+0000 7ff361800640 1 -- 172.21.15.8:0/3212386797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c155c60 con 0x7ff35c0d13e0 2024-05-26T15:40:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.116+0000 7ff361800640 1 -- 172.21.15.8:0/3212386797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c04e210 con 0x7ff35c0d13e0 2024-05-26T15:40:11.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.117+0000 7ff353e00640 1 -- 172.21.15.8:0/3212386797 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff34c039040 con 0x7ff35c0d13e0 2024-05-26T15:40:11.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.118+0000 7ff353e00640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff33806ac00 0x7ff33806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.118+0000 7ff353e00640 1 -- 172.21.15.8:0/3212386797 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff34c0aa190 con 0x7ff35c0d13e0 2024-05-26T15:40:11.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.118+0000 7ff35b400640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff33806ac00 0x7ff33806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.120+0000 7ff35b400640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff33806ac00 0x7ff33806d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff35c1f5f50 tx=0x7ff344008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:11.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.122+0000 7ff353e00640 1 -- 172.21.15.8:0/3212386797 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff34c0751a0 con 0x7ff35c0d13e0 2024-05-26T15:40:11.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.319+0000 7ff361800640 1 -- 172.21.15.8:0/3212386797 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff35c15e660 con 0x7ff35c0d13e0 2024-05-26T15:40:11.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.320+0000 7ff353e00640 1 -- 172.21.15.8:0/3212386797 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff34c0787c0 con 0x7ff35c0d13e0 2024-05-26T15:40:11.319 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:11.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 -- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff33806ac00 msgr2=0x7ff33806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff33806ac00 0x7ff33806d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff35c1f5f50 tx=0x7ff344008040 comp rx=0 tx=0).stop 2024-05-26T15:40:11.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 -- 172.21.15.8:0/3212386797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff35c0d13e0 msgr2=0x7ff35c142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff35c0d13e0 0x7ff35c142b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff34c0090b0 tx=0x7ff34c0046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 -- 172.21.15.8:0/3212386797 shutdown_connections 2024-05-26T15:40:11.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff35c160490 0x7ff35c156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff33806ac00 0x7ff33806d0c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff35c0d2df0 0x7ff35c154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 --2- 172.21.15.8:0/3212386797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff35c0d13e0 0x7ff35c142b60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 -- 172.21.15.8:0/3212386797 >> 172.21.15.8:0/3212386797 conn(0x7ff35c0715a0 msgr2=0x7ff35c0ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:11.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 -- 172.21.15.8:0/3212386797 shutdown_connections 2024-05-26T15:40:11.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.323+0000 7ff361800640 1 -- 172.21.15.8:0/3212386797 wait complete. 2024-05-26T15:40:11.342 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.558+0000 7fa119c00640 1 Processor -- start 2024-05-26T15:40:11.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.558+0000 7fa119c00640 1 -- start start 2024-05-26T15:40:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.559+0000 7fa119c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa1140b2ab0 0x7fa1140ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.559+0000 7fa119c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1140cb2f0 con 0x7fa11415f380 2024-05-26T15:40:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.559+0000 7fa119c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11415e8a0 con 0x7fa11415acc0 2024-05-26T15:40:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.559+0000 7fa119c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1140b65a0 con 0x7fa1140b2ab0 2024-05-26T15:40:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.560+0000 7fa112000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa11415f380 0x7fa1140b23a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46814/0 (socket says 172.21.15.8:46814) 2024-05-26T15:40:11.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.560+0000 7fa112000640 1 -- 172.21.15.8:0/1690649775 learned_addr learned my addr 172.21.15.8:0/1690649775 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:11.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.560+0000 7fa113400640 1 --2- 172.21.15.8:0/1690649775 >> v2:172.21.15.47:3300/0 conn(0x7fa1140b2ab0 0x7fa1140ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.560+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999015838 0 0) 0x7fa1140cb2f0 con 0x7fa11415f380 2024-05-26T15:40:11.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.560+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0f4003520 con 0x7fa11415f380 2024-05-26T15:40:11.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1998153707 0 0) 0x7fa0f4003520 con 0x7fa11415f380 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 >> v2:172.21.15.47:3300/0 conn(0x7fa1140b2ab0 msgr2=0x7fa1140ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 --2- 172.21.15.8:0/1690649775 >> v2:172.21.15.47:3300/0 conn(0x7fa1140b2ab0 0x7fa1140ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 >> v1:172.21.15.47:6789/0 conn(0x7fa11415acc0 legacy=0x7fa1140cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11415eb80 con 0x7fa11415f380 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fa0fc0019f0 con 0x7fa11415f380 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 >> v1:172.21.15.8:6789/0 conn(0x7fa11415f380 legacy=0x7fa1140b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0f40039e0 0x7fa0f4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0f40047c0 0x7fa0f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa0f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f400c080 con 0x7fa0f4005180 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f400c1f0 con 0x7fa0f40039e0 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f400c3b0 con 0x7fa0f40047c0 2024-05-26T15:40:11.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa113400640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa0f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa112a00640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0f40039e0 0x7fa0f4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.561+0000 7fa112000640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0f40047c0 0x7fa0f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.562+0000 7fa113400640 1 -- 172.21.15.8:0/1690649775 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0f40047c0 msgr2=0x7fa0f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.562+0000 7fa113400640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0f40047c0 0x7fa0f4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.562+0000 7fa113400640 1 -- 172.21.15.8:0/1690649775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0f40039e0 msgr2=0x7fa0f4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.562+0000 7fa113400640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0f40039e0 0x7fa0f4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.562+0000 7fa113400640 1 -- 172.21.15.8:0/1690649775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f4003520 con 0x7fa0f4005180 2024-05-26T15:40:11.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.563+0000 7fa113400640 1 -- 172.21.15.8:0/1690649775 reap_dead start 2024-05-26T15:40:11.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.563+0000 7fa113400640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa0f400b980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009a90 tx=0x7fa0f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a327c39f029b9d82 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:11.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.563+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c004020 con 0x7fa0f4005180 2024-05-26T15:40:11.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.563+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c02d050 con 0x7fa0f4005180 2024-05-26T15:40:11.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.563+0000 7fa111600640 1 -- 172.21.15.8:0/1690649775 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0043c0 con 0x7fa0f4005180 2024-05-26T15:40:11.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.564+0000 7fa119c00640 1 -- 172.21.15.8:0/1690649775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 msgr2=0x7fa0f400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.564+0000 7fa119c00640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa0f400b980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009a90 tx=0x7fa0f40057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.564+0000 7fa119c00640 1 -- 172.21.15.8:0/1690649775 shutdown_connections 2024-05-26T15:40:11.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.564+0000 7fa119c00640 1 --2- 172.21.15.8:0/1690649775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa0f400b980 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.564+0000 7fa119c00640 1 -- 172.21.15.8:0/1690649775 >> 172.21.15.8:0/1690649775 conn(0x7fa1140cd3a0 msgr2=0x7fa1140cd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:11.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.564+0000 7fa119c00640 1 -- 172.21.15.8:0/1690649775 shutdown_connections 2024-05-26T15:40:11.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.564+0000 7fa119c00640 1 -- 172.21.15.8:0/1690649775 wait complete. 2024-05-26T15:40:11.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.566+0000 7fa119c00640 1 Processor -- start 2024-05-26T15:40:11.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.566+0000 7fa119c00640 1 -- start start 2024-05-26T15:40:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.567+0000 7fa119c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa1140b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.567+0000 7fa119c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa1140c6fb0 0x7fa11406af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.567+0000 7fa119c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa11406b4c0 0x7fa1141f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.567+0000 7fa119c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11406b940 con 0x7fa0f4005180 2024-05-26T15:40:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.567+0000 7fa119c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11406bc00 con 0x7fa11406b4c0 2024-05-26T15:40:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.567+0000 7fa119c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11406bee0 con 0x7fa1140c6fb0 2024-05-26T15:40:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.567+0000 7fa112a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa1140b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.567+0000 7fa112a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa1140b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53178/0 (socket says 172.21.15.8:53178) 2024-05-26T15:40:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.567+0000 7fa112a00640 1 -- 172.21.15.8:0/3486988597 learned_addr learned my addr 172.21.15.8:0/3486988597 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:11.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa112000640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa1140c6fb0 0x7fa11406af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa112a00640 1 -- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa1140c6fb0 msgr2=0x7fa11406af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa113400640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa11406b4c0 0x7fa1141f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa112a00640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa1140c6fb0 0x7fa11406af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa112a00640 1 -- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa11406b4c0 msgr2=0x7fa1141f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa112a00640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa11406b4c0 0x7fa1141f1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa112a00640 1 -- 172.21.15.8:0/3486988597 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11406c1c0 con 0x7fa0f4005180 2024-05-26T15:40:11.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa112a00640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa1140b4cd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa10400e4d0 tx=0x7fa10400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:11.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa10aa00640 1 -- 172.21.15.8:0/3486988597 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1040052e0 con 0x7fa0f4005180 2024-05-26T15:40:11.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa10aa00640 1 -- 172.21.15.8:0/3486988597 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104005440 con 0x7fa0f4005180 2024-05-26T15:40:11.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa10aa00640 1 -- 172.21.15.8:0/3486988597 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa104003810 con 0x7fa0f4005180 2024-05-26T15:40:11.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.568+0000 7fa119c00640 1 -- 172.21.15.8:0/3486988597 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11406c4a0 con 0x7fa0f4005180 2024-05-26T15:40:11.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.569+0000 7fa119c00640 1 -- 172.21.15.8:0/3486988597 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1140b5210 con 0x7fa0f4005180 2024-05-26T15:40:11.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.570+0000 7fa119c00640 1 -- 172.21.15.8:0/3486988597 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa114067940 con 0x7fa0f4005180 2024-05-26T15:40:11.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.570+0000 7fa10aa00640 1 -- 172.21.15.8:0/3486988597 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa104003970 con 0x7fa0f4005180 2024-05-26T15:40:11.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.571+0000 7fa10aa00640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa0f006ac00 0x7fa0f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:11.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.572+0000 7fa10aa00640 1 -- 172.21.15.8:0/3486988597 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa1040893a0 con 0x7fa0f4005180 2024-05-26T15:40:11.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.572+0000 7fa112000640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa0f006ac00 0x7fa0f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:11.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.573+0000 7fa112000640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa0f006ac00 0x7fa0f006d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc001c60 tx=0x7fa0fc001250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:11.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.576+0000 7fa10aa00640 1 -- 172.21.15.8:0/3486988597 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa104054290 con 0x7fa0f4005180 2024-05-26T15:40:11.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.778+0000 7fa119c00640 1 -- 172.21.15.8:0/3486988597 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa11404e210 con 0x7fa0f4005180 2024-05-26T15:40:11.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.779+0000 7fa10aa00640 1 -- 172.21.15.8:0/3486988597 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa1040578b0 con 0x7fa0f4005180 2024-05-26T15:40:11.777 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 -- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa0f006ac00 msgr2=0x7fa0f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa0f006ac00 0x7fa0f006d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc001c60 tx=0x7fa0fc001250 comp rx=0 tx=0).stop 2024-05-26T15:40:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 -- 172.21.15.8:0/3486988597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 msgr2=0x7fa1140b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:11.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa1140b4cd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa10400e4d0 tx=0x7fa10400e990 comp rx=0 tx=0).stop 2024-05-26T15:40:11.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 -- 172.21.15.8:0/3486988597 shutdown_connections 2024-05-26T15:40:11.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa0f006ac00 0x7fa0f006d0c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa11406b4c0 0x7fa1141f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa1140c6fb0 0x7fa11406af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 --2- 172.21.15.8:0/3486988597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0f4005180 0x7fa1140b4cd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:11.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 -- 172.21.15.8:0/3486988597 >> 172.21.15.8:0/3486988597 conn(0x7fa1140cd3a0 msgr2=0x7fa1140d1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:11.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 -- 172.21.15.8:0/3486988597 shutdown_connections 2024-05-26T15:40:11.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:11.782+0000 7fa119c00640 1 -- 172.21.15.8:0/3486988597 wait complete. 2024-05-26T15:40:11.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:40:12.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.013+0000 7fc01ae00640 1 Processor -- start 2024-05-26T15:40:12.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.014+0000 7fc01ae00640 1 -- start start 2024-05-26T15:40:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.015+0000 7fc01ae00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc014154f50 0x7fc0140b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.015+0000 7fc01ae00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc01415ae70 0x7fc01415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.015+0000 7fc01ae00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc01415f0c0 0x7fc0140c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.015+0000 7fc01ae00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01415bee0 con 0x7fc01415f0c0 2024-05-26T15:40:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.015+0000 7fc01ae00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0140b0ba0 con 0x7fc014154f50 2024-05-26T15:40:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.015+0000 7fc01ae00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01415b640 con 0x7fc01415ae70 2024-05-26T15:40:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc01a400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc01415f0c0 0x7fc0140c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc01a400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc01415f0c0 0x7fc0140c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53194/0 (socket says 172.21.15.8:53194) 2024-05-26T15:40:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc01a400640 1 -- 172.21.15.8:0/3186294769 learned_addr learned my addr 172.21.15.8:0/3186294769 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:12.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc019a00640 1 --2- 172.21.15.8:0/3186294769 >> v2:172.21.15.47:3300/0 conn(0x7fc014154f50 0x7fc0140b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc019000640 1 --2- 172.21.15.8:0/3186294769 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc01415ae70 0x7fc01415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc01a400640 1 -- 172.21.15.8:0/3186294769 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc01415ae70 msgr2=0x7fc01415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc01a400640 1 --2- 172.21.15.8:0/3186294769 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc01415ae70 0x7fc01415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc01a400640 1 -- 172.21.15.8:0/3186294769 >> v2:172.21.15.47:3300/0 conn(0x7fc014154f50 msgr2=0x7fc0140b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc01a400640 1 --2- 172.21.15.8:0/3186294769 >> v2:172.21.15.47:3300/0 conn(0x7fc014154f50 0x7fc0140b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc01a400640 1 -- 172.21.15.8:0/3186294769 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01415b920 con 0x7fc01415f0c0 2024-05-26T15:40:12.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.016+0000 7fc019a00640 1 --2- 172.21.15.8:0/3186294769 >> v2:172.21.15.47:3300/0 conn(0x7fc014154f50 0x7fc0140b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:12.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.018+0000 7fc01a400640 1 --2- 172.21.15.8:0/3186294769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415f0c0 0x7fc0140c36c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc0140ce600 tx=0x7fc00c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea047d3bf165a986 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:12.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.018+0000 7fc013e00640 1 -- 172.21.15.8:0/3186294769 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c031600 con 0x7fc01415f0c0 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.018+0000 7fc013e00640 1 -- 172.21.15.8:0/3186294769 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c02d050 con 0x7fc01415f0c0 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.018+0000 7fc013e00640 1 -- 172.21.15.8:0/3186294769 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c031980 con 0x7fc01415f0c0 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.019+0000 7fc01ae00640 1 -- 172.21.15.8:0/3186294769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415f0c0 msgr2=0x7fc0140c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.019+0000 7fc01ae00640 1 --2- 172.21.15.8:0/3186294769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415f0c0 0x7fc0140c36c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc0140ce600 tx=0x7fc00c02a610 comp rx=0 tx=0).stop 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.019+0000 7fc01ae00640 1 -- 172.21.15.8:0/3186294769 shutdown_connections 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.019+0000 7fc01ae00640 1 --2- 172.21.15.8:0/3186294769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415f0c0 0x7fc0140c36c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.019+0000 7fc01ae00640 1 --2- 172.21.15.8:0/3186294769 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc01415ae70 0x7fc01415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.019+0000 7fc01ae00640 1 --2- 172.21.15.8:0/3186294769 >> v2:172.21.15.47:3300/0 conn(0x7fc014154f50 0x7fc0140b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.019+0000 7fc01ae00640 1 -- 172.21.15.8:0/3186294769 >> 172.21.15.8:0/3186294769 conn(0x7fc014070480 msgr2=0x7fc014070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.019+0000 7fc01ae00640 1 -- 172.21.15.8:0/3186294769 shutdown_connections 2024-05-26T15:40:12.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.019+0000 7fc01ae00640 1 -- 172.21.15.8:0/3186294769 wait complete. 2024-05-26T15:40:12.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.021+0000 7fc01ae00640 1 Processor -- start 2024-05-26T15:40:12.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.022+0000 7fc01ae00640 1 -- start start 2024-05-26T15:40:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.023+0000 7fc01ae00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc014154f50 0x7fc0140cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.023+0000 7fc01ae00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415ae70 0x7fc01414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.023+0000 7fc01ae00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc01415f0c0 0x7fc01414fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.023+0000 7fc01ae00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140c9d40 con 0x7fc01415ae70 2024-05-26T15:40:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.023+0000 7fc01ae00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140c8f80 con 0x7fc01415f0c0 2024-05-26T15:40:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.023+0000 7fc01ae00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140c9260 con 0x7fc014154f50 2024-05-26T15:40:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.023+0000 7fc019000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415ae70 0x7fc01414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.023+0000 7fc019000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415ae70 0x7fc01414f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53200/0 (socket says 172.21.15.8:53200) 2024-05-26T15:40:12.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.023+0000 7fc019000640 1 -- 172.21.15.8:0/583638823 learned_addr learned my addr 172.21.15.8:0/583638823 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.023+0000 7fc01a400640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc01415f0c0 0x7fc01414fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc019a00640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc014154f50 0x7fc0140cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc019000640 1 -- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc014154f50 msgr2=0x7fc0140cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc019000640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc014154f50 0x7fc0140cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc019000640 1 -- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc01415f0c0 msgr2=0x7fc01414fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc019000640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc01415f0c0 0x7fc01414fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc019000640 1 -- 172.21.15.8:0/583638823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c009b30 con 0x7fc01415ae70 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc01a400640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc01415f0c0 0x7fc01414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc019000640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415ae70 0x7fc01414f5e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc00000d5f0 tx=0x7fc00000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc011600640 1 -- 172.21.15.8:0/583638823 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0000125f0 con 0x7fc01415ae70 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc011600640 1 -- 172.21.15.8:0/583638823 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc000012750 con 0x7fc01415ae70 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc011600640 1 -- 172.21.15.8:0/583638823 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000012b00 con 0x7fc01415ae70 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.024+0000 7fc01ae00640 1 -- 172.21.15.8:0/583638823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0140c9540 con 0x7fc01415ae70 2024-05-26T15:40:12.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.025+0000 7fc01ae00640 1 -- 172.21.15.8:0/583638823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0140cd810 con 0x7fc01415ae70 2024-05-26T15:40:12.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.026+0000 7fc01ae00640 1 -- 172.21.15.8:0/583638823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01404e280 con 0x7fc01415ae70 2024-05-26T15:40:12.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.027+0000 7fc011600640 1 -- 172.21.15.8:0/583638823 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc000012c60 con 0x7fc01415ae70 2024-05-26T15:40:12.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.028+0000 7fc011600640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbff406ac00 0x7fbff406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.028+0000 7fc011600640 1 -- 172.21.15.8:0/583638823 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc000089b30 con 0x7fc01415ae70 2024-05-26T15:40:12.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.029+0000 7fc019a00640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbff406ac00 0x7fbff406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.030+0000 7fc019a00640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbff406ac00 0x7fbff406d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc008006fd0 tx=0x7fc008008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:12.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.036+0000 7fc011600640 1 -- 172.21.15.8:0/583638823 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc000054a20 con 0x7fc01415ae70 2024-05-26T15:40:12.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.284+0000 7fc01ae00640 1 -- 172.21.15.8:0/583638823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0140714a0 con 0x7fc01415ae70 2024-05-26T15:40:12.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.285+0000 7fc011600640 1 -- 172.21.15.8:0/583638823 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4718 (secure 0 0 0) 0x7fc000058040 con 0x7fc01415ae70 2024-05-26T15:40:12.284 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:12.284 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:39:32.881224+0000","modified":"2024-05-26T15:40:01.486240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-26T15:40:12.284 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2024-05-26T15:40:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 -- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbff406ac00 msgr2=0x7fbff406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbff406ac00 0x7fbff406d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc008006fd0 tx=0x7fc008008040 comp rx=0 tx=0).stop 2024-05-26T15:40:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 -- 172.21.15.8:0/583638823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415ae70 msgr2=0x7fc01414f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415ae70 0x7fc01414f5e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc00000d5f0 tx=0x7fc00000dab0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 -- 172.21.15.8:0/583638823 shutdown_connections 2024-05-26T15:40:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbff406ac00 0x7fbff406d0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc01415f0c0 0x7fc01414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc01415ae70 0x7fc01414f5e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 --2- 172.21.15.8:0/583638823 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc014154f50 0x7fc0140cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 -- 172.21.15.8:0/583638823 >> 172.21.15.8:0/583638823 conn(0x7fc014070480 msgr2=0x7fc01415c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 -- 172.21.15.8:0/583638823 shutdown_connections 2024-05-26T15:40:12.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.288+0000 7fc01ae00640 1 -- 172.21.15.8:0/583638823 wait complete. 2024-05-26T15:40:12.306 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.523+0000 7fae27200640 1 Processor -- start 2024-05-26T15:40:12.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.524+0000 7fae27200640 1 -- start start 2024-05-26T15:40:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.525+0000 7fae27200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fae2015cb60 0x7fae200d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.525+0000 7fae27200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fae200cdde0 0x7fae200b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.525+0000 7fae27200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae200d1440 con 0x7fae200b8470 2024-05-26T15:40:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.525+0000 7fae27200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae200d1720 con 0x7fae2015cb60 2024-05-26T15:40:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.525+0000 7fae27200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae200d1a00 con 0x7fae200cdde0 2024-05-26T15:40:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.526+0000 7fae25e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fae2015cb60 0x7fae200d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.526+0000 7fae25400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fae200b8470 0x7fae200cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46818/0 (socket says 172.21.15.8:46818) 2024-05-26T15:40:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.526+0000 7fae25400640 1 -- 172.21.15.8:0/3234452876 learned_addr learned my addr 172.21.15.8:0/3234452876 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:12.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.526+0000 7fae25e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fae2015cb60 0x7fae200d0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53206/0 (socket says 172.21.15.8:53206) 2024-05-26T15:40:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.526+0000 7fae26800640 1 --2- 172.21.15.8:0/3234452876 >> v2:172.21.15.47:3300/0 conn(0x7fae200cdde0 0x7fae200b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.526+0000 7fae25e00640 1 -- 172.21.15.8:0/3234452876 >> v2:172.21.15.47:3300/0 conn(0x7fae200cdde0 msgr2=0x7fae200b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.526+0000 7fae25e00640 1 --2- 172.21.15.8:0/3234452876 >> v2:172.21.15.47:3300/0 conn(0x7fae200cdde0 0x7fae200b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.526+0000 7fae25e00640 1 -- 172.21.15.8:0/3234452876 >> v1:172.21.15.8:6789/0 conn(0x7fae200b8470 legacy=0x7fae200cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.526+0000 7fae25e00640 1 -- 172.21.15.8:0/3234452876 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae200d1ce0 con 0x7fae2015cb60 2024-05-26T15:40:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.527+0000 7fae25e00640 1 --2- 172.21.15.8:0/3234452876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 0x7fae200d0ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fae200ce830 tx=0x7fae1402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d3fbfeeb3dbd75 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.528+0000 7fae24a00640 1 -- 172.21.15.8:0/3234452876 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14032440 con 0x7fae2015cb60 2024-05-26T15:40:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.528+0000 7fae24a00640 1 -- 172.21.15.8:0/3234452876 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae140325a0 con 0x7fae2015cb60 2024-05-26T15:40:12.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.528+0000 7fae24a00640 1 -- 172.21.15.8:0/3234452876 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14032930 con 0x7fae2015cb60 2024-05-26T15:40:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.528+0000 7fae27200640 1 -- 172.21.15.8:0/3234452876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 msgr2=0x7fae200d0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.528+0000 7fae27200640 1 --2- 172.21.15.8:0/3234452876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 0x7fae200d0ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fae200ce830 tx=0x7fae1402a1a0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.529+0000 7fae27200640 1 -- 172.21.15.8:0/3234452876 shutdown_connections 2024-05-26T15:40:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.529+0000 7fae27200640 1 --2- 172.21.15.8:0/3234452876 >> v2:172.21.15.47:3300/0 conn(0x7fae200cdde0 0x7fae200b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.529+0000 7fae27200640 1 --2- 172.21.15.8:0/3234452876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 0x7fae200d0ad0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.529+0000 7fae27200640 1 -- 172.21.15.8:0/3234452876 >> 172.21.15.8:0/3234452876 conn(0x7fae200cf480 msgr2=0x7fae200cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:12.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.529+0000 7fae27200640 1 -- 172.21.15.8:0/3234452876 shutdown_connections 2024-05-26T15:40:12.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.529+0000 7fae27200640 1 -- 172.21.15.8:0/3234452876 wait complete. 2024-05-26T15:40:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.531+0000 7fae27200640 1 Processor -- start 2024-05-26T15:40:12.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.531+0000 7fae27200640 1 -- start start 2024-05-26T15:40:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae27200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae200b8470 0x7fae201f66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae27200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae200cdde0 0x7fae2015f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae27200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 0x7fae200c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae27200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2014a3b0 con 0x7fae2015cb60 2024-05-26T15:40:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae27200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2015ece0 con 0x7fae200b8470 2024-05-26T15:40:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae27200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2015e3b0 con 0x7fae200cdde0 2024-05-26T15:40:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae26800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 0x7fae200c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae26800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 0x7fae200c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53220/0 (socket says 172.21.15.8:53220) 2024-05-26T15:40:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae26800640 1 -- 172.21.15.8:0/489230904 learned_addr learned my addr 172.21.15.8:0/489230904 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae25e00640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae200b8470 0x7fae201f66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae25400640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae200cdde0 0x7fae2015f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae26800640 1 -- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae200cdde0 msgr2=0x7fae2015f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae26800640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae200cdde0 0x7fae2015f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae26800640 1 -- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae200b8470 msgr2=0x7fae201f66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae26800640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae200b8470 0x7fae201f66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae26800640 1 -- 172.21.15.8:0/489230904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae14009400 con 0x7fae2015cb60 2024-05-26T15:40:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.533+0000 7fae25400640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae200cdde0 0x7fae2015f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.534+0000 7fae26800640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 0x7fae200c9ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fae1c007e40 tx=0x7fae1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.534+0000 7fae1a000640 1 -- 172.21.15.8:0/489230904 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c014620 con 0x7fae2015cb60 2024-05-26T15:40:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.534+0000 7fae1a000640 1 -- 172.21.15.8:0/489230904 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c00ee90 con 0x7fae2015cb60 2024-05-26T15:40:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.534+0000 7fae1a000640 1 -- 172.21.15.8:0/489230904 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c0149e0 con 0x7fae2015cb60 2024-05-26T15:40:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.534+0000 7fae27200640 1 -- 172.21.15.8:0/489230904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2015e690 con 0x7fae2015cb60 2024-05-26T15:40:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.534+0000 7fae27200640 1 -- 172.21.15.8:0/489230904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2015f6b0 con 0x7fae2015cb60 2024-05-26T15:40:12.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.535+0000 7fae27200640 1 -- 172.21.15.8:0/489230904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2015ee50 con 0x7fae2015cb60 2024-05-26T15:40:12.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.537+0000 7fae1a000640 1 -- 172.21.15.8:0/489230904 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fae1c014b40 con 0x7fae2015cb60 2024-05-26T15:40:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.538+0000 7fae1a000640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae0006ac50 0x7fae0006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.538+0000 7fae1a000640 1 -- 172.21.15.8:0/489230904 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae1c089ff0 con 0x7fae2015cb60 2024-05-26T15:40:12.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.539+0000 7fae25e00640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae0006ac50 0x7fae0006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.540+0000 7fae25e00640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae0006ac50 0x7fae0006d110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fae14034000 tx=0x7fae1402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:12.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.542+0000 7fae1a000640 1 -- 172.21.15.8:0/489230904 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fae1c054ec0 con 0x7fae2015cb60 2024-05-26T15:40:12.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.742+0000 7fae27200640 1 -- 172.21.15.8:0/489230904 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae2004e280 con 0x7fae2015cb60 2024-05-26T15:40:12.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.743+0000 7fae1a000640 1 -- 172.21.15.8:0/489230904 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17782 (secure 0 0 0) 0x7fae1c0584e0 con 0x7fae2015cb60 2024-05-26T15:40:12.742 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:12.742 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:39:37.869641+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:12.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.746+0000 7fae27200640 1 -- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae0006ac50 msgr2=0x7fae0006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.746+0000 7fae27200640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae0006ac50 0x7fae0006d110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fae14034000 tx=0x7fae1402e000 comp rx=0 tx=0).stop 2024-05-26T15:40:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.746+0000 7fae27200640 1 -- 172.21.15.8:0/489230904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 msgr2=0x7fae200c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.746+0000 7fae27200640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 0x7fae200c9ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fae1c007e40 tx=0x7fae1c00e4b0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.747+0000 7fae27200640 1 -- 172.21.15.8:0/489230904 shutdown_connections 2024-05-26T15:40:12.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.747+0000 7fae27200640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae2015cb60 0x7fae200c9ad0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.747+0000 7fae27200640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fae200cdde0 0x7fae2015f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.747+0000 7fae27200640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fae0006ac50 0x7fae0006d110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.747+0000 7fae27200640 1 --2- 172.21.15.8:0/489230904 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae200b8470 0x7fae201f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.747+0000 7fae27200640 1 -- 172.21.15.8:0/489230904 >> 172.21.15.8:0/489230904 conn(0x7fae200cf480 msgr2=0x7fae200b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:12.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.747+0000 7fae27200640 1 -- 172.21.15.8:0/489230904 shutdown_connections 2024-05-26T15:40:12.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.747+0000 7fae27200640 1 -- 172.21.15.8:0/489230904 wait complete. 2024-05-26T15:40:12.766 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:12.766 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:12.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.984+0000 7f5b7be00640 1 Processor -- start 2024-05-26T15:40:12.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.985+0000 7f5b7be00640 1 -- start start 2024-05-26T15:40:12.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.986+0000 7f5b7be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b7c15a9d0 0x7f5b7c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.986+0000 7f5b7be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c06d970 0x7f5b7c0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.987+0000 7f5b7be00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c0cba60 con 0x7f5b7c0cdb40 2024-05-26T15:40:12.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.987+0000 7f5b7be00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0cdfd0 con 0x7f5b7c15a9d0 2024-05-26T15:40:12.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.987+0000 7f5b7be00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c071610 con 0x7f5b7c06d970 2024-05-26T15:40:12.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.987+0000 7f5b7b400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5b7c0cdb40 0x7f5b7c06c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46832/0 (socket says 172.21.15.8:46832) 2024-05-26T15:40:12.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.987+0000 7f5b7b400640 1 -- 172.21.15.8:0/3131069896 learned_addr learned my addr 172.21.15.8:0/3131069896 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:12.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.987+0000 7f5b7a000640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c06d970 0x7f5b7c0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.987+0000 7f5b7aa00640 1 --2- 172.21.15.8:0/3131069896 >> v2:172.21.15.47:3300/0 conn(0x7f5b7c15a9d0 0x7f5b7c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.987+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246666142 0 0) 0x7f5b7c0cba60 con 0x7f5b7c0cdb40 2024-05-26T15:40:12.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b60003520 con 0x7f5b7c0cdb40 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3553637609 0 0) 0x7f5b60003520 con 0x7f5b7c0cdb40 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c06d970 msgr2=0x7f5b7c0cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c06d970 0x7f5b7c0cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 >> v2:172.21.15.47:3300/0 conn(0x7f5b7c15a9d0 msgr2=0x7f5b7c06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 --2- 172.21.15.8:0/3131069896 >> v2:172.21.15.47:3300/0 conn(0x7f5b7c15a9d0 0x7f5b7c06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0cbd00 con 0x7f5b7c0cdb40 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f5b74001670 con 0x7f5b7c0cdb40 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 >> v1:172.21.15.8:6789/0 conn(0x7f5b7c0cdb40 legacy=0x7f5b7c06c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b60003970 0x7f5b60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 0x7f5b60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c06d970 0x7f5b60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0cdfd0 con 0x7f5b600047c0 2024-05-26T15:40:12.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c071610 con 0x7f5b60003970 2024-05-26T15:40:12.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.988+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6000b9d0 con 0x7f5b7c06d970 2024-05-26T15:40:12.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.989+0000 7f5b7a000640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 0x7f5b60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.989+0000 7f5b7aa00640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b60003970 0x7f5b60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.989+0000 7f5b7b400640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c06d970 0x7f5b60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.989+0000 7f5b7a000640 1 -- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c06d970 msgr2=0x7f5b60005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:12.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.989+0000 7f5b7a000640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c06d970 0x7f5b60005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.989+0000 7f5b7a000640 1 -- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b60003970 msgr2=0x7f5b60003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:12.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.989+0000 7f5b7a000640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b60003970 0x7f5b60003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.989+0000 7f5b7a000640 1 -- 172.21.15.8:0/3131069896 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b60003520 con 0x7f5b600047c0 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.990+0000 7f5b7a000640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 0x7f5b60004c40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009af0 tx=0x7f5b600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86a9c05dcaaf617 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.990+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64031400 con 0x7f5b600047c0 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.990+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6402d050 con 0x7f5b600047c0 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.991+0000 7f5b79600640 1 -- 172.21.15.8:0/3131069896 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64031780 con 0x7f5b600047c0 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.991+0000 7f5b7be00640 1 -- 172.21.15.8:0/3131069896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 msgr2=0x7f5b60004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.991+0000 7f5b7be00640 1 --2- 172.21.15.8:0/3131069896 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 0x7f5b60004c40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009af0 tx=0x7f5b600057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.991+0000 7f5b7b400640 1 -- 172.21.15.8:0/3131069896 reap_dead start 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.991+0000 7f5b7be00640 1 -- 172.21.15.8:0/3131069896 shutdown_connections 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.991+0000 7f5b7be00640 1 -- 172.21.15.8:0/3131069896 >> 172.21.15.8:0/3131069896 conn(0x7f5b7c0ce4f0 msgr2=0x7f5b7c0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.991+0000 7f5b7be00640 1 -- 172.21.15.8:0/3131069896 shutdown_connections 2024-05-26T15:40:12.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.991+0000 7f5b7be00640 1 -- 172.21.15.8:0/3131069896 wait complete. 2024-05-26T15:40:12.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.993+0000 7f5b7be00640 1 Processor -- start 2024-05-26T15:40:12.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.993+0000 7f5b7be00640 1 -- start start 2024-05-26T15:40:12.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.994+0000 7f5b7be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 0x7f5b7c14c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.994+0000 7f5b7be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c159830 0x7f5b7c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b7c1543b0 0x7f5b7c154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c15a1f0 con 0x7f5b600047c0 2024-05-26T15:40:12.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1550e0 con 0x7f5b7c1543b0 2024-05-26T15:40:12.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7be00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1553c0 con 0x7f5b7c159830 2024-05-26T15:40:12.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 0x7f5b7c14c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7aa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 0x7f5b7c14c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53240/0 (socket says 172.21.15.8:53240) 2024-05-26T15:40:12.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7aa00640 1 -- 172.21.15.8:0/2251888389 learned_addr learned my addr 172.21.15.8:0/2251888389 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:12.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7a000640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c159830 0x7f5b7c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7b400640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b7c1543b0 0x7f5b7c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7aa00640 1 -- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c159830 msgr2=0x7f5b7c159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7aa00640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c159830 0x7f5b7c159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7aa00640 1 -- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b7c1543b0 msgr2=0x7f5b7c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7aa00640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b7c1543b0 0x7f5b7c154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.995+0000 7f5b7aa00640 1 -- 172.21.15.8:0/2251888389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c157120 con 0x7f5b600047c0 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.996+0000 7f5b7aa00640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 0x7f5b7c14c980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c007f30 tx=0x7f5b6c011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.996+0000 7f5b73400640 1 -- 172.21.15.8:0/2251888389 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00e030 con 0x7f5b600047c0 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.996+0000 7f5b73400640 1 -- 172.21.15.8:0/2251888389 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c016470 con 0x7f5b600047c0 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.996+0000 7f5b7be00640 1 -- 172.21.15.8:0/2251888389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c157400 con 0x7f5b600047c0 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.996+0000 7f5b73400640 1 -- 172.21.15.8:0/2251888389 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c016820 con 0x7f5b600047c0 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.996+0000 7f5b7be00640 1 -- 172.21.15.8:0/2251888389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c154d70 con 0x7f5b600047c0 2024-05-26T15:40:12.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.997+0000 7f5b7be00640 1 -- 172.21.15.8:0/2251888389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c04e210 con 0x7f5b600047c0 2024-05-26T15:40:12.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.998+0000 7f5b73400640 1 -- 172.21.15.8:0/2251888389 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b6c016980 con 0x7f5b600047c0 2024-05-26T15:40:12.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:12.999+0000 7f5b73400640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5b5806ac00 0x7f5b5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:12.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.000+0000 7f5b73400640 1 -- 172.21.15.8:0/2251888389 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b6c00f070 con 0x7f5b600047c0 2024-05-26T15:40:12.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.000+0000 7f5b7a000640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5b5806ac00 0x7f5b5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:12.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.001+0000 7f5b7a000640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5b5806ac00 0x7f5b5806d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b64033000 tx=0x7f5b64008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:13.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.004+0000 7f5b73400640 1 -- 172.21.15.8:0/2251888389 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5b6c055590 con 0x7f5b600047c0 2024-05-26T15:40:13.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.211+0000 7f5b7be00640 1 -- 172.21.15.8:0/2251888389 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b7c0cb0e0 con 0x7f5b600047c0 2024-05-26T15:40:13.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.212+0000 7f5b73400640 1 -- 172.21.15.8:0/2251888389 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b6c058bb0 con 0x7f5b600047c0 2024-05-26T15:40:13.210 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:13.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 -- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5b5806ac00 msgr2=0x7f5b5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5b5806ac00 0x7f5b5806d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5b64033000 tx=0x7f5b64008030 comp rx=0 tx=0).stop 2024-05-26T15:40:13.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 -- 172.21.15.8:0/2251888389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 msgr2=0x7f5b7c14c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 0x7f5b7c14c980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c007f30 tx=0x7f5b6c011660 comp rx=0 tx=0).stop 2024-05-26T15:40:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 -- 172.21.15.8:0/2251888389 shutdown_connections 2024-05-26T15:40:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5b5806ac00 0x7f5b5806d0c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b7c1543b0 0x7f5b7c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5b7c159830 0x7f5b7c159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 --2- 172.21.15.8:0/2251888389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b600047c0 0x7f5b7c14c980 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 -- 172.21.15.8:0/2251888389 >> 172.21.15.8:0/2251888389 conn(0x7f5b7c0ce4f0 msgr2=0x7f5b7c0b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 -- 172.21.15.8:0/2251888389 shutdown_connections 2024-05-26T15:40:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.215+0000 7f5b7be00640 1 -- 172.21.15.8:0/2251888389 wait complete. 2024-05-26T15:40:13.233 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:13.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.451+0000 7fccae800640 1 Processor -- start 2024-05-26T15:40:13.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.452+0000 7fccae800640 1 -- start start 2024-05-26T15:40:13.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.453+0000 7fccae800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcca815cab0 0x7fcca80b8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.453+0000 7fccae800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcca80b1b70 0x7fcca80d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.453+0000 7fccae800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca80d0da0 con 0x7fcca80d2340 2024-05-26T15:40:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.453+0000 7fccae800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca80d19e0 con 0x7fcca815cab0 2024-05-26T15:40:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.453+0000 7fccae800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80d1040 con 0x7fcca80b1b70 2024-05-26T15:40:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.454+0000 7fccad400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcca815cab0 0x7fcca80b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.454+0000 7fccade00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fcca80d2340 0x7fcca80cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46840/0 (socket says 172.21.15.8:46840) 2024-05-26T15:40:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.454+0000 7fccad400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcca815cab0 0x7fcca80b8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53254/0 (socket says 172.21.15.8:53254) 2024-05-26T15:40:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.454+0000 7fccade00640 1 -- 172.21.15.8:0/1582111023 learned_addr learned my addr 172.21.15.8:0/1582111023 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.454+0000 7fccaca00640 1 --2- 172.21.15.8:0/1582111023 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcca80b1b70 0x7fcca80d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:13.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.454+0000 7fccad400640 1 -- 172.21.15.8:0/1582111023 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcca80b1b70 msgr2=0x7fcca80d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:13.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.454+0000 7fccad400640 1 --2- 172.21.15.8:0/1582111023 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcca80b1b70 0x7fcca80d1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.454+0000 7fccad400640 1 -- 172.21.15.8:0/1582111023 >> v1:172.21.15.8:6789/0 conn(0x7fcca80d2340 legacy=0x7fcca80cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.454+0000 7fccad400640 1 -- 172.21.15.8:0/1582111023 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80d1320 con 0x7fcca815cab0 2024-05-26T15:40:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.455+0000 7fccad400640 1 --2- 172.21.15.8:0/1582111023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca815cab0 0x7fcca80b8250 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcc980097a0 tx=0x7fcc9802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653d0a1c7fd331d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.456+0000 7fcca7e00640 1 -- 172.21.15.8:0/1582111023 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9802adb0 con 0x7fcca815cab0 2024-05-26T15:40:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.456+0000 7fcca7e00640 1 -- 172.21.15.8:0/1582111023 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc98032440 con 0x7fcca815cab0 2024-05-26T15:40:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.456+0000 7fcca7e00640 1 -- 172.21.15.8:0/1582111023 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc980327d0 con 0x7fcca815cab0 2024-05-26T15:40:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.456+0000 7fccae800640 1 -- 172.21.15.8:0/1582111023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca815cab0 msgr2=0x7fcca80b8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.456+0000 7fccae800640 1 --2- 172.21.15.8:0/1582111023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca815cab0 0x7fcca80b8250 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcc980097a0 tx=0x7fcc9802a060 comp rx=0 tx=0).stop 2024-05-26T15:40:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.457+0000 7fccae800640 1 -- 172.21.15.8:0/1582111023 shutdown_connections 2024-05-26T15:40:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.457+0000 7fccae800640 1 --2- 172.21.15.8:0/1582111023 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcca80b1b70 0x7fcca80d1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.457+0000 7fccae800640 1 --2- 172.21.15.8:0/1582111023 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca815cab0 0x7fcca80b8250 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.457+0000 7fccae800640 1 -- 172.21.15.8:0/1582111023 >> 172.21.15.8:0/1582111023 conn(0x7fcca806b640 msgr2=0x7fcca806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.457+0000 7fccae800640 1 -- 172.21.15.8:0/1582111023 shutdown_connections 2024-05-26T15:40:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.457+0000 7fccae800640 1 -- 172.21.15.8:0/1582111023 wait complete. 2024-05-26T15:40:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.459+0000 7fccae800640 1 Processor -- start 2024-05-26T15:40:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.459+0000 7fccae800640 1 -- start start 2024-05-26T15:40:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccae800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca80b1b70 0x7fcca8159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccae800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcca80d2340 0x7fcca81553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccae800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca815cab0 0x7fcca81f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccae800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80caf70 con 0x7fcca80b1b70 2024-05-26T15:40:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccae800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80cb250 con 0x7fcca815cab0 2024-05-26T15:40:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccae800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80cb530 con 0x7fcca80d2340 2024-05-26T15:40:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccad400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca80b1b70 0x7fcca8159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccad400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca80b1b70 0x7fcca8159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53258/0 (socket says 172.21.15.8:53258) 2024-05-26T15:40:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccad400640 1 -- 172.21.15.8:0/1511300457 learned_addr learned my addr 172.21.15.8:0/1511300457 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccaca00640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcca80d2340 0x7fcca81553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccad400640 1 -- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcca80d2340 msgr2=0x7fcca81553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccad400640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcca80d2340 0x7fcca81553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccad400640 1 -- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca815cab0 msgr2=0x7fcca81f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.460+0000 7fccad400640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca815cab0 0x7fcca81f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.461+0000 7fccad400640 1 -- 172.21.15.8:0/1511300457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98009400 con 0x7fcca80b1b70 2024-05-26T15:40:13.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.461+0000 7fccad400640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca80b1b70 0x7fcca8159500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcc98035040 tx=0x7fcc980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:13.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.461+0000 7fcca5600640 1 -- 172.21.15.8:0/1511300457 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9803d710 con 0x7fcca80b1b70 2024-05-26T15:40:13.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.461+0000 7fcca5600640 1 -- 172.21.15.8:0/1511300457 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9803d890 con 0x7fcca80b1b70 2024-05-26T15:40:13.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.461+0000 7fcca5600640 1 -- 172.21.15.8:0/1511300457 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9803dc40 con 0x7fcca80b1b70 2024-05-26T15:40:13.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.461+0000 7fccae800640 1 -- 172.21.15.8:0/1511300457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca80cb810 con 0x7fcca80b1b70 2024-05-26T15:40:13.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.461+0000 7fccae800640 1 -- 172.21.15.8:0/1511300457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca8155910 con 0x7fcca80b1b70 2024-05-26T15:40:13.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.462+0000 7fccae800640 1 -- 172.21.15.8:0/1511300457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca804e210 con 0x7fcca80b1b70 2024-05-26T15:40:13.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.463+0000 7fcca5600640 1 -- 172.21.15.8:0/1511300457 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcc98039040 con 0x7fcca80b1b70 2024-05-26T15:40:13.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.464+0000 7fcca5600640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcc8806ac00 0x7fcc8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.464+0000 7fcca5600640 1 -- 172.21.15.8:0/1511300457 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcc980a9f00 con 0x7fcca80b1b70 2024-05-26T15:40:13.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.465+0000 7fccaca00640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcc8806ac00 0x7fcc8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:13.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.466+0000 7fccaca00640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcc8806ac00 0x7fcc8806d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc94006fd0 tx=0x7fcc94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:13.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.469+0000 7fcca5600640 1 -- 172.21.15.8:0/1511300457 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcc98074df0 con 0x7fcca80b1b70 2024-05-26T15:40:13.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.667+0000 7fccae800640 1 -- 172.21.15.8:0/1511300457 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcca80b7470 con 0x7fcca80b1b70 2024-05-26T15:40:13.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.668+0000 7fcca5600640 1 -- 172.21.15.8:0/1511300457 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc98078410 con 0x7fcca80b1b70 2024-05-26T15:40:13.667 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.671+0000 7fccae800640 1 -- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcc8806ac00 msgr2=0x7fcc8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.671+0000 7fccae800640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcc8806ac00 0x7fcc8806d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc94006fd0 tx=0x7fcc94008040 comp rx=0 tx=0).stop 2024-05-26T15:40:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.672+0000 7fccae800640 1 -- 172.21.15.8:0/1511300457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca80b1b70 msgr2=0x7fcca8159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.672+0000 7fccae800640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca80b1b70 0x7fcca8159500 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcc98035040 tx=0x7fcc980046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.672+0000 7fccae800640 1 -- 172.21.15.8:0/1511300457 shutdown_connections 2024-05-26T15:40:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.672+0000 7fccae800640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fcc8806ac00 0x7fcc8806d0c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.672+0000 7fccae800640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcca815cab0 0x7fcca81f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.672+0000 7fccae800640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fcca80d2340 0x7fcca81553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.672+0000 7fccae800640 1 --2- 172.21.15.8:0/1511300457 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcca80b1b70 0x7fcca8159500 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.672+0000 7fccae800640 1 -- 172.21.15.8:0/1511300457 >> 172.21.15.8:0/1511300457 conn(0x7fcca806b640 msgr2=0x7fcca80cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.672+0000 7fccae800640 1 -- 172.21.15.8:0/1511300457 shutdown_connections 2024-05-26T15:40:13.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.672+0000 7fccae800640 1 -- 172.21.15.8:0/1511300457 wait complete. 2024-05-26T15:40:13.690 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.906+0000 7ff43d200640 1 Processor -- start 2024-05-26T15:40:13.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.906+0000 7ff43d200640 1 -- start start 2024-05-26T15:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.907+0000 7ff43d200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4380cfb10 0x7ff4380cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.908+0000 7ff43d200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4380b21d0 con 0x7ff4380cdef0 2024-05-26T15:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.908+0000 7ff43d200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4380ce320 con 0x7ff43815d0b0 2024-05-26T15:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.908+0000 7ff43d200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4381615a0 con 0x7ff4380cfb10 2024-05-26T15:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.908+0000 7ff436a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff4380cfb10 0x7ff4380cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:13.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.908+0000 7ff437e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff4380cdef0 0x7ff4380d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46852/0 (socket says 172.21.15.8:46852) 2024-05-26T15:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.908+0000 7ff437e00640 1 -- 172.21.15.8:0/3033422682 learned_addr learned my addr 172.21.15.8:0/3033422682 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.908+0000 7ff436a00640 1 -- 172.21.15.8:0/3033422682 >> v1:172.21.15.47:6789/0 conn(0x7ff43815d0b0 legacy=0x7ff4380b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.908+0000 7ff436a00640 1 -- 172.21.15.8:0/3033422682 >> v1:172.21.15.8:6789/0 conn(0x7ff4380cdef0 legacy=0x7ff4380d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.909+0000 7ff436a00640 1 -- 172.21.15.8:0/3033422682 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff438160c00 con 0x7ff4380cfb10 2024-05-26T15:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.910+0000 7ff436a00640 1 --2- 172.21.15.8:0/3033422682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cfb10 0x7ff4380cd9b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff428009d90 tx=0x7ff42802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7630fb953ae7fb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.910+0000 7ff436000640 1 -- 172.21.15.8:0/3033422682 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428007740 con 0x7ff4380cfb10 2024-05-26T15:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.910+0000 7ff436000640 1 -- 172.21.15.8:0/3033422682 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42802d050 con 0x7ff4380cfb10 2024-05-26T15:40:13.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.910+0000 7ff436000640 1 -- 172.21.15.8:0/3033422682 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff428007ac0 con 0x7ff4380cfb10 2024-05-26T15:40:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.911+0000 7ff43d200640 1 -- 172.21.15.8:0/3033422682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cfb10 msgr2=0x7ff4380cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.911+0000 7ff43d200640 1 --2- 172.21.15.8:0/3033422682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cfb10 0x7ff4380cd9b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff428009d90 tx=0x7ff42802a660 comp rx=0 tx=0).stop 2024-05-26T15:40:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.911+0000 7ff43d200640 1 -- 172.21.15.8:0/3033422682 shutdown_connections 2024-05-26T15:40:13.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.911+0000 7ff43d200640 1 --2- 172.21.15.8:0/3033422682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cfb10 0x7ff4380cd9b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.911+0000 7ff43d200640 1 -- 172.21.15.8:0/3033422682 >> 172.21.15.8:0/3033422682 conn(0x7ff43806b160 msgr2=0x7ff43806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:13.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.911+0000 7ff43d200640 1 -- 172.21.15.8:0/3033422682 shutdown_connections 2024-05-26T15:40:13.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.911+0000 7ff43d200640 1 -- 172.21.15.8:0/3033422682 wait complete. 2024-05-26T15:40:13.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.913+0000 7ff43d200640 1 Processor -- start 2024-05-26T15:40:13.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.913+0000 7ff43d200640 1 -- start start 2024-05-26T15:40:13.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.914+0000 7ff43d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cdef0 0x7ff43814cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.914+0000 7ff43d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4380cfb10 0x7ff4380b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.914+0000 7ff43d200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff43815d0b0 0x7ff4380b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.914+0000 7ff43d200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380c8b40 con 0x7ff4380cdef0 2024-05-26T15:40:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.914+0000 7ff43d200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43814d1a0 con 0x7ff4380cfb10 2024-05-26T15:40:13.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.914+0000 7ff43d200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4380c7f30 con 0x7ff43815d0b0 2024-05-26T15:40:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff437400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cdef0 0x7ff43814cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff437400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cdef0 0x7ff43814cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53274/0 (socket says 172.21.15.8:53274) 2024-05-26T15:40:13.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff437400640 1 -- 172.21.15.8:0/924016252 learned_addr learned my addr 172.21.15.8:0/924016252 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff436a00640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4380cfb10 0x7ff4380b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff437e00640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff43815d0b0 0x7ff4380b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff437400640 1 -- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff43815d0b0 msgr2=0x7ff4380b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff437400640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff43815d0b0 0x7ff4380b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff437400640 1 -- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4380cfb10 msgr2=0x7ff4380b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff437400640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4380cfb10 0x7ff4380b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff437400640 1 -- 172.21.15.8:0/924016252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff428009a70 con 0x7ff4380cdef0 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.915+0000 7ff436a00640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4380cfb10 0x7ff4380b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.916+0000 7ff437400640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cdef0 0x7ff43814cc60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff42000c450 tx=0x7ff42000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.916+0000 7ff42f400640 1 -- 172.21.15.8:0/924016252 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4200052d0 con 0x7ff4380cdef0 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.916+0000 7ff43d200640 1 -- 172.21.15.8:0/924016252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4380c8210 con 0x7ff4380cdef0 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.916+0000 7ff43d200640 1 -- 172.21.15.8:0/924016252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4380c87d0 con 0x7ff4380cdef0 2024-05-26T15:40:13.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.916+0000 7ff42f400640 1 -- 172.21.15.8:0/924016252 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4200011e0 con 0x7ff4380cdef0 2024-05-26T15:40:13.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.916+0000 7ff42f400640 1 -- 172.21.15.8:0/924016252 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420012630 con 0x7ff4380cdef0 2024-05-26T15:40:13.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.917+0000 7ff43d200640 1 -- 172.21.15.8:0/924016252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff410005250 con 0x7ff4380cdef0 2024-05-26T15:40:13.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.918+0000 7ff42f400640 1 -- 172.21.15.8:0/924016252 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff420012790 con 0x7ff4380cdef0 2024-05-26T15:40:13.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.919+0000 7ff42f400640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff41406ac00 0x7ff41406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:13.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.919+0000 7ff42f400640 1 -- 172.21.15.8:0/924016252 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff420089240 con 0x7ff4380cdef0 2024-05-26T15:40:13.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.920+0000 7ff436a00640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff41406ac00 0x7ff41406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:13.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.921+0000 7ff436a00640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff41406ac00 0x7ff41406d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff428034000 tx=0x7ff42802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:13.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:13.924+0000 7ff42f400640 1 -- 172.21.15.8:0/924016252 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff420057b30 con 0x7ff4380cdef0 2024-05-26T15:40:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.122+0000 7ff43d200640 1 -- 172.21.15.8:0/924016252 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff410005a80 con 0x7ff4380cdef0 2024-05-26T15:40:14.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.123+0000 7ff42f400640 1 -- 172.21.15.8:0/924016252 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4200576c0 con 0x7ff4380cdef0 2024-05-26T15:40:14.122 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:14.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.125+0000 7ff43d200640 1 -- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff41406ac00 msgr2=0x7ff41406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.125+0000 7ff43d200640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff41406ac00 0x7ff41406d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff428034000 tx=0x7ff42802f000 comp rx=0 tx=0).stop 2024-05-26T15:40:14.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.125+0000 7ff43d200640 1 -- 172.21.15.8:0/924016252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cdef0 msgr2=0x7ff43814cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.125+0000 7ff43d200640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cdef0 0x7ff43814cc60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff42000c450 tx=0x7ff42000c910 comp rx=0 tx=0).stop 2024-05-26T15:40:14.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.126+0000 7ff43d200640 1 -- 172.21.15.8:0/924016252 shutdown_connections 2024-05-26T15:40:14.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.126+0000 7ff43d200640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff43815d0b0 0x7ff4380b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.126+0000 7ff43d200640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff41406ac00 0x7ff41406d0c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.126+0000 7ff43d200640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4380cfb10 0x7ff4380b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.126+0000 7ff43d200640 1 --2- 172.21.15.8:0/924016252 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4380cdef0 0x7ff43814cc60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.126+0000 7ff43d200640 1 -- 172.21.15.8:0/924016252 >> 172.21.15.8:0/924016252 conn(0x7ff43806b160 msgr2=0x7ff4380d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:14.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.126+0000 7ff43d200640 1 -- 172.21.15.8:0/924016252 shutdown_connections 2024-05-26T15:40:14.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.126+0000 7ff43d200640 1 -- 172.21.15.8:0/924016252 wait complete. 2024-05-26T15:40:14.145 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:14.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.363+0000 7fe737200640 1 Processor -- start 2024-05-26T15:40:14.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.364+0000 7fe737200640 1 -- start start 2024-05-26T15:40:14.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.365+0000 7fe737200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe7380ad5a0 0x7fe7380acc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.365+0000 7fe737200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7380ac7e0 con 0x7fe738070a70 2024-05-26T15:40:14.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.365+0000 7fe737200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7380abc10 con 0x7fe73815cb00 2024-05-26T15:40:14.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.365+0000 7fe737200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7380adff0 con 0x7fe7380ad5a0 2024-05-26T15:40:14.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.366+0000 7fe72fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe738070a70 0x7fe73806c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46864/0 (socket says 172.21.15.8:46864) 2024-05-26T15:40:14.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.366+0000 7fe72fe00640 1 -- 172.21.15.8:0/3516656720 learned_addr learned my addr 172.21.15.8:0/3516656720 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:14.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.366+0000 7fe736800640 1 --2- 172.21.15.8:0/3516656720 >> v2:172.21.15.8:3300/0 conn(0x7fe7380ad5a0 0x7fe7380acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.366+0000 7fe735400640 1 -- 172.21.15.8:0/3516656720 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604782490 0 0) 0x7fe7380ac7e0 con 0x7fe738070a70 2024-05-26T15:40:14.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.366+0000 7fe736800640 1 -- 172.21.15.8:0/3516656720 >> v1:172.21.15.47:6789/0 conn(0x7fe73815cb00 legacy=0x7fe738070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.366+0000 7fe736800640 1 -- 172.21.15.8:0/3516656720 >> v1:172.21.15.8:6789/0 conn(0x7fe738070a70 legacy=0x7fe73806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.366+0000 7fe736800640 1 -- 172.21.15.8:0/3516656720 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7380abeb0 con 0x7fe7380ad5a0 2024-05-26T15:40:14.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.368+0000 7fe736800640 1 --2- 172.21.15.8:0/3516656720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7380ad5a0 0x7fe7380acc70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe730009d90 tx=0x7fe73002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed39992c8c0bd1d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:14.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.368+0000 7fe735400640 1 -- 172.21.15.8:0/3516656720 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730007740 con 0x7fe7380ad5a0 2024-05-26T15:40:14.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.368+0000 7fe735400640 1 -- 172.21.15.8:0/3516656720 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73002d050 con 0x7fe7380ad5a0 2024-05-26T15:40:14.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.368+0000 7fe735400640 1 -- 172.21.15.8:0/3516656720 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730007ac0 con 0x7fe7380ad5a0 2024-05-26T15:40:14.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.368+0000 7fe737200640 1 -- 172.21.15.8:0/3516656720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7380ad5a0 msgr2=0x7fe7380acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.368+0000 7fe737200640 1 --2- 172.21.15.8:0/3516656720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7380ad5a0 0x7fe7380acc70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe730009d90 tx=0x7fe73002a660 comp rx=0 tx=0).stop 2024-05-26T15:40:14.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.369+0000 7fe737200640 1 -- 172.21.15.8:0/3516656720 shutdown_connections 2024-05-26T15:40:14.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.369+0000 7fe737200640 1 --2- 172.21.15.8:0/3516656720 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe7380ad5a0 0x7fe7380acc70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.369+0000 7fe737200640 1 -- 172.21.15.8:0/3516656720 >> 172.21.15.8:0/3516656720 conn(0x7fe7380ce4f0 msgr2=0x7fe7380ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:14.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.369+0000 7fe737200640 1 -- 172.21.15.8:0/3516656720 shutdown_connections 2024-05-26T15:40:14.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.369+0000 7fe737200640 1 -- 172.21.15.8:0/3516656720 wait complete. 2024-05-26T15:40:14.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.370+0000 7fe737200640 1 Processor -- start 2024-05-26T15:40:14.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.371+0000 7fe737200640 1 -- start start 2024-05-26T15:40:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.371+0000 7fe737200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe738070a70 0x7fe73814afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.371+0000 7fe737200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe7380ad5a0 0x7fe738154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.371+0000 7fe737200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73815cb00 0x7fe7380cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.371+0000 7fe737200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7381545a0 con 0x7fe73815cb00 2024-05-26T15:40:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.371+0000 7fe737200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe738155850 con 0x7fe738070a70 2024-05-26T15:40:14.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.371+0000 7fe737200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe738153c70 con 0x7fe7380ad5a0 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.372+0000 7fe736800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73815cb00 0x7fe7380cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.372+0000 7fe736800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73815cb00 0x7fe7380cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53284/0 (socket says 172.21.15.8:53284) 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.372+0000 7fe736800640 1 -- 172.21.15.8:0/3502221394 learned_addr learned my addr 172.21.15.8:0/3502221394 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.372+0000 7fe72fe00640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe7380ad5a0 0x7fe738154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.372+0000 7fe735e00640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe738070a70 0x7fe73814afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe736800640 1 -- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe7380ad5a0 msgr2=0x7fe738154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe736800640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe7380ad5a0 0x7fe738154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe736800640 1 -- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe738070a70 msgr2=0x7fe73814afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe736800640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe738070a70 0x7fe73814afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe736800640 1 -- 172.21.15.8:0/3502221394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe730009a70 con 0x7fe73815cb00 2024-05-26T15:40:14.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe736800640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73815cb00 0x7fe7380cbd10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe730009d90 tx=0x7fe730004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:14.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe72e000640 1 -- 172.21.15.8:0/3502221394 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730031910 con 0x7fe73815cb00 2024-05-26T15:40:14.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe72e000640 1 -- 172.21.15.8:0/3502221394 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe730031a70 con 0x7fe73815cb00 2024-05-26T15:40:14.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe737200640 1 -- 172.21.15.8:0/3502221394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe738153f50 con 0x7fe73815cb00 2024-05-26T15:40:14.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe72e000640 1 -- 172.21.15.8:0/3502221394 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730031de0 con 0x7fe73815cb00 2024-05-26T15:40:14.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.373+0000 7fe737200640 1 -- 172.21.15.8:0/3502221394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe738154a30 con 0x7fe73815cb00 2024-05-26T15:40:14.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.374+0000 7fe737200640 1 -- 172.21.15.8:0/3502221394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe738154710 con 0x7fe73815cb00 2024-05-26T15:40:14.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.375+0000 7fe72e000640 1 -- 172.21.15.8:0/3502221394 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe73003c420 con 0x7fe73815cb00 2024-05-26T15:40:14.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.376+0000 7fe72e000640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe71406ac00 0x7fe71406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.376+0000 7fe72e000640 1 -- 172.21.15.8:0/3502221394 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe7300ab070 con 0x7fe73815cb00 2024-05-26T15:40:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.377+0000 7fe735e00640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe71406ac00 0x7fe71406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.378+0000 7fe735e00640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe71406ac00 0x7fe71406d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe728000f60 tx=0x7fe728009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:14.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.380+0000 7fe72e000640 1 -- 172.21.15.8:0/3502221394 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe7300de900 con 0x7fe73815cb00 2024-05-26T15:40:14.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.576+0000 7fe737200640 1 -- 172.21.15.8:0/3502221394 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe7380ad180 con 0x7fe73815cb00 2024-05-26T15:40:14.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.578+0000 7fe72e000640 1 -- 172.21.15.8:0/3502221394 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe730075f50 con 0x7fe73815cb00 2024-05-26T15:40:14.576 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:14.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.580+0000 7fe737200640 1 -- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe71406ac00 msgr2=0x7fe71406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.580+0000 7fe737200640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe71406ac00 0x7fe71406d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe728000f60 tx=0x7fe728009040 comp rx=0 tx=0).stop 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.580+0000 7fe737200640 1 -- 172.21.15.8:0/3502221394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73815cb00 msgr2=0x7fe7380cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.580+0000 7fe737200640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73815cb00 0x7fe7380cbd10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe730009d90 tx=0x7fe730004a40 comp rx=0 tx=0).stop 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.581+0000 7fe737200640 1 -- 172.21.15.8:0/3502221394 shutdown_connections 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.581+0000 7fe737200640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe73815cb00 0x7fe7380cbd10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.581+0000 7fe737200640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe7380ad5a0 0x7fe738154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.581+0000 7fe737200640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe71406ac00 0x7fe71406d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.581+0000 7fe737200640 1 --2- 172.21.15.8:0/3502221394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe738070a70 0x7fe73814afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.581+0000 7fe737200640 1 -- 172.21.15.8:0/3502221394 >> 172.21.15.8:0/3502221394 conn(0x7fe7380ce4f0 msgr2=0x7fe7380ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.581+0000 7fe737200640 1 -- 172.21.15.8:0/3502221394 shutdown_connections 2024-05-26T15:40:14.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.581+0000 7fe737200640 1 -- 172.21.15.8:0/3502221394 wait complete. 2024-05-26T15:40:14.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:40:14.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.792+0000 7f3707e00640 1 Processor -- start 2024-05-26T15:40:14.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.792+0000 7f3707e00640 1 -- start start 2024-05-26T15:40:14.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.794+0000 7f3707e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f370815d2e0 0x7f370813ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.794+0000 7f3707e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370815d850 con 0x7f370813c640 2024-05-26T15:40:14.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.794+0000 7f3707e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370815db30 con 0x7f370806d590 2024-05-26T15:40:14.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.794+0000 7f3707e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370815de10 con 0x7f370815d2e0 2024-05-26T15:40:14.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.794+0000 7f3706a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f370813c640 0x7f370813f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46866/0 (socket says 172.21.15.8:46866) 2024-05-26T15:40:14.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.794+0000 7f3706a00640 1 -- 172.21.15.8:0/3866407673 learned_addr learned my addr 172.21.15.8:0/3866407673 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:14.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f36fe000640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f370815d2e0 0x7f370813ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826895329 0 0) 0x7f370815d850 con 0x7f370813c640 2024-05-26T15:40:14.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36ec003520 con 0x7f370813c640 2024-05-26T15:40:14.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1954110570 0 0) 0x7f36ec003520 con 0x7f370813c640 2024-05-26T15:40:14.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f370815d2e0 msgr2=0x7f370813ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:14.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f370815d2e0 0x7f370813ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 >> v1:172.21.15.47:6789/0 conn(0x7f370806d590 legacy=0x7f370815a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370815e0f0 con 0x7f370813c640 2024-05-26T15:40:14.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f36f80019f0 con 0x7f370813c640 2024-05-26T15:40:14.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 >> v1:172.21.15.8:6789/0 conn(0x7f370813c640 legacy=0x7f370813f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36ec0039a0 0x7f36ec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f370815d2e0 0x7f36ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec004d00 0x7f36ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370815de10 con 0x7f36ec004d00 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec00ba60 con 0x7f36ec0039a0 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.795+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec00bc20 con 0x7f370815d2e0 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.796+0000 7f3707400640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec004d00 0x7f36ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.796+0000 7f3706a00640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36ec0039a0 0x7f36ec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.796+0000 7f36fe000640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f370815d2e0 0x7f36ec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.796+0000 7f3707400640 1 -- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f370815d2e0 msgr2=0x7f36ec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:14.796 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.796+0000 7f3707400640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f370815d2e0 0x7f36ec0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.796+0000 7f3707400640 1 -- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36ec0039a0 msgr2=0x7f36ec003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:14.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.796+0000 7f3707400640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36ec0039a0 0x7f36ec003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.796+0000 7f3707400640 1 -- 172.21.15.8:0/3866407673 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec003520 con 0x7f36ec004d00 2024-05-26T15:40:14.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.797+0000 7f3707400640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec004d00 0x7f36ec005180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3700001330 tx=0x7f36ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c979f6b3a68247f server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:14.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.798+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370002cd90 con 0x7f36ec004d00 2024-05-26T15:40:14.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.798+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37000050d0 con 0x7f36ec004d00 2024-05-26T15:40:14.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.798+0000 7f3706000640 1 -- 172.21.15.8:0/3866407673 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700005480 con 0x7f36ec004d00 2024-05-26T15:40:14.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.798+0000 7f3707e00640 1 -- 172.21.15.8:0/3866407673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec004d00 msgr2=0x7f36ec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.798+0000 7f3707e00640 1 --2- 172.21.15.8:0/3866407673 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f36ec004d00 0x7f36ec005180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3700001330 tx=0x7f36ec0057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.798+0000 7f3707400640 1 -- 172.21.15.8:0/3866407673 reap_dead start 2024-05-26T15:40:14.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.798+0000 7f3707e00640 1 -- 172.21.15.8:0/3866407673 shutdown_connections 2024-05-26T15:40:14.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.798+0000 7f3707e00640 1 -- 172.21.15.8:0/3866407673 >> 172.21.15.8:0/3866407673 conn(0x7f3708070480 msgr2=0x7f3708070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:14.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.799+0000 7f3707e00640 1 -- 172.21.15.8:0/3866407673 shutdown_connections 2024-05-26T15:40:14.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.799+0000 7f3707e00640 1 -- 172.21.15.8:0/3866407673 wait complete. 2024-05-26T15:40:14.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.800+0000 7f3707e00640 1 Processor -- start 2024-05-26T15:40:14.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.801+0000 7f3707e00640 1 -- start start 2024-05-26T15:40:14.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.801+0000 7f3707e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3708152ad0 0x7f37080b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.801+0000 7f3707e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3708157d40 0x7f3708156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.801+0000 7f3707e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37081581c0 0x7f3708157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.801+0000 7f3707e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37081578d0 con 0x7f3708152ad0 2024-05-26T15:40:14.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.801+0000 7f3707e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37080b31c0 con 0x7f37081581c0 2024-05-26T15:40:14.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.801+0000 7f3707e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37080b34a0 con 0x7f3708157d40 2024-05-26T15:40:14.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.802+0000 7f3706a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3708152ad0 0x7f37080b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.802+0000 7f3706a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3708152ad0 0x7f37080b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53288/0 (socket says 172.21.15.8:53288) 2024-05-26T15:40:14.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.802+0000 7f3706a00640 1 -- 172.21.15.8:0/2265857311 learned_addr learned my addr 172.21.15.8:0/2265857311 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:14.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.802+0000 7f3707400640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37081581c0 0x7f3708157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.802+0000 7f36fe000640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3708157d40 0x7f3708156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.802+0000 7f3706a00640 1 -- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3708157d40 msgr2=0x7f3708156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.802+0000 7f3706a00640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3708157d40 0x7f3708156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.802+0000 7f3706a00640 1 -- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37081581c0 msgr2=0x7f3708157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:14.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.802+0000 7f3706a00640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37081581c0 0x7f3708157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:14.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.802+0000 7f3706a00640 1 -- 172.21.15.8:0/2265857311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080b3780 con 0x7f3708152ad0 2024-05-26T15:40:14.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.803+0000 7f3706a00640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3708152ad0 0x7f37080b4260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36f8001580 tx=0x7f36f800e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:14.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.803+0000 7f36ff400640 1 -- 172.21.15.8:0/2265857311 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f800ee80 con 0x7f3708152ad0 2024-05-26T15:40:14.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.803+0000 7f36ff400640 1 -- 172.21.15.8:0/2265857311 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f8013420 con 0x7f3708152ad0 2024-05-26T15:40:14.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.803+0000 7f36ff400640 1 -- 172.21.15.8:0/2265857311 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80137b0 con 0x7f3708152ad0 2024-05-26T15:40:14.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.803+0000 7f3707e00640 1 -- 172.21.15.8:0/2265857311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37080b3a60 con 0x7f3708152ad0 2024-05-26T15:40:14.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.803+0000 7f3707e00640 1 -- 172.21.15.8:0/2265857311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37080b2de0 con 0x7f3708152ad0 2024-05-26T15:40:14.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.804+0000 7f3707e00640 1 -- 172.21.15.8:0/2265857311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37080b3f80 con 0x7f3708152ad0 2024-05-26T15:40:14.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.805+0000 7f36ff400640 1 -- 172.21.15.8:0/2265857311 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f36f8013910 con 0x7f3708152ad0 2024-05-26T15:40:14.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.806+0000 7f36ff400640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f36e406ac00 0x7f36e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:14.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.806+0000 7f36ff400640 1 -- 172.21.15.8:0/2265857311 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f36f8089f50 con 0x7f3708152ad0 2024-05-26T15:40:14.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.807+0000 7f36fe000640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f36e406ac00 0x7f36e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:14.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.808+0000 7f36fe000640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f36e406ac00 0x7f36e406d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f370813abf0 tx=0x7f36f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:14.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:14.810+0000 7f36ff400640 1 -- 172.21.15.8:0/2265857311 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f37080b3f80 con 0x7f3708152ad0 2024-05-26T15:40:15.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.049+0000 7f3707e00640 1 -- 172.21.15.8:0/2265857311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37080b2f70 con 0x7f3708152ad0 2024-05-26T15:40:15.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.050+0000 7f36ff400640 1 -- 172.21.15.8:0/2265857311 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4718 (secure 0 0 0) 0x7f36f8054de0 con 0x7f3708152ad0 2024-05-26T15:40:15.049 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:15.049 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:39:32.881224+0000","modified":"2024-05-26T15:40:01.486240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-26T15:40:15.049 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2024-05-26T15:40:15.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 -- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f36e406ac00 msgr2=0x7f36e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f36e406ac00 0x7f36e406d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f370813abf0 tx=0x7f36f0008040 comp rx=0 tx=0).stop 2024-05-26T15:40:15.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 -- 172.21.15.8:0/2265857311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3708152ad0 msgr2=0x7f37080b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3708152ad0 0x7f37080b4260 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36f8001580 tx=0x7f36f800e4d0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 -- 172.21.15.8:0/2265857311 shutdown_connections 2024-05-26T15:40:15.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f36e406ac00 0x7f36e406d0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f37081581c0 0x7f3708157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3708157d40 0x7f3708156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 --2- 172.21.15.8:0/2265857311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3708152ad0 0x7f37080b4260 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 -- 172.21.15.8:0/2265857311 >> 172.21.15.8:0/2265857311 conn(0x7f3708070480 msgr2=0x7f370815ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:15.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 -- 172.21.15.8:0/2265857311 shutdown_connections 2024-05-26T15:40:15.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.053+0000 7f3707e00640 1 -- 172.21.15.8:0/2265857311 wait complete. 2024-05-26T15:40:15.070 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.277+0000 7f892ee00640 1 Processor -- start 2024-05-26T15:40:15.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.277+0000 7f892ee00640 1 -- start start 2024-05-26T15:40:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.278+0000 7f892ee00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8928154f50 0x7f89280b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892ee00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f892815ae70 0x7f892815eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892ee00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f892815f0c0 0x7f89280c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892ee00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892815bee0 con 0x7f892815ae70 2024-05-26T15:40:15.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892ee00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89280b0ba0 con 0x7f892815f0c0 2024-05-26T15:40:15.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892ee00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892815b640 con 0x7f8928154f50 2024-05-26T15:40:15.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892d000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f892815ae70 0x7f892815eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892d000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f892815ae70 0x7f892815eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53300/0 (socket says 172.21.15.8:53300) 2024-05-26T15:40:15.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892d000640 1 -- 172.21.15.8:0/1393401740 learned_addr learned my addr 172.21.15.8:0/1393401740 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:15.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892da00640 1 --2- 172.21.15.8:0/1393401740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8928154f50 0x7f89280b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892d000640 1 -- 172.21.15.8:0/1393401740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8928154f50 msgr2=0x7f89280b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:15.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892e400640 1 --2- 172.21.15.8:0/1393401740 >> v2:172.21.15.47:3300/0 conn(0x7f892815f0c0 0x7f89280c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892d000640 1 --2- 172.21.15.8:0/1393401740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8928154f50 0x7f89280b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892d000640 1 -- 172.21.15.8:0/1393401740 >> v2:172.21.15.47:3300/0 conn(0x7f892815f0c0 msgr2=0x7f89280c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:15.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892d000640 1 --2- 172.21.15.8:0/1393401740 >> v2:172.21.15.47:3300/0 conn(0x7f892815f0c0 0x7f89280c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.279+0000 7f892d000640 1 -- 172.21.15.8:0/1393401740 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892815b920 con 0x7f892815ae70 2024-05-26T15:40:15.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.280+0000 7f892da00640 1 --2- 172.21.15.8:0/1393401740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8928154f50 0x7f89280b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:15.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.280+0000 7f892d000640 1 --2- 172.21.15.8:0/1393401740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 0x7f892815eb80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8928070fa0 tx=0x7f891802a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d783fb1cd5b41ce server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:15.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.281+0000 7f8927e00640 1 -- 172.21.15.8:0/1393401740 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918031600 con 0x7f892815ae70 2024-05-26T15:40:15.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.281+0000 7f8927e00640 1 -- 172.21.15.8:0/1393401740 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891802d050 con 0x7f892815ae70 2024-05-26T15:40:15.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.281+0000 7f8927e00640 1 -- 172.21.15.8:0/1393401740 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918031980 con 0x7f892815ae70 2024-05-26T15:40:15.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.281+0000 7f892ee00640 1 -- 172.21.15.8:0/1393401740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 msgr2=0x7f892815eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.281+0000 7f892ee00640 1 --2- 172.21.15.8:0/1393401740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 0x7f892815eb80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8928070fa0 tx=0x7f891802a600 comp rx=0 tx=0).stop 2024-05-26T15:40:15.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.282+0000 7f892ee00640 1 -- 172.21.15.8:0/1393401740 shutdown_connections 2024-05-26T15:40:15.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.282+0000 7f892ee00640 1 --2- 172.21.15.8:0/1393401740 >> v2:172.21.15.47:3300/0 conn(0x7f892815f0c0 0x7f89280c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.282+0000 7f892ee00640 1 --2- 172.21.15.8:0/1393401740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 0x7f892815eb80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.282+0000 7f892ee00640 1 --2- 172.21.15.8:0/1393401740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8928154f50 0x7f89280b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.282+0000 7f892ee00640 1 -- 172.21.15.8:0/1393401740 >> 172.21.15.8:0/1393401740 conn(0x7f8928070480 msgr2=0x7f8928070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:15.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.282+0000 7f892ee00640 1 -- 172.21.15.8:0/1393401740 shutdown_connections 2024-05-26T15:40:15.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.282+0000 7f892ee00640 1 -- 172.21.15.8:0/1393401740 wait complete. 2024-05-26T15:40:15.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.284+0000 7f892ee00640 1 Processor -- start 2024-05-26T15:40:15.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.284+0000 7f892ee00640 1 -- start start 2024-05-26T15:40:15.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.285+0000 7f892ee00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8928154f50 0x7f89281502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.285+0000 7f892ee00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 0x7f89281f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892ee00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f892815f0c0 0x7f89281f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892ee00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280cb290 con 0x7f892815ae70 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892ee00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89281f28a0 con 0x7f8928154f50 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892ee00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89281f6920 con 0x7f892815f0c0 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892d000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 0x7f89281f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892d000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 0x7f89281f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53304/0 (socket says 172.21.15.8:53304) 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892d000640 1 -- 172.21.15.8:0/1642116488 learned_addr learned my addr 172.21.15.8:0/1642116488 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892e400640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f892815f0c0 0x7f89281f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892da00640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8928154f50 0x7f89281502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892d000640 1 -- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f892815f0c0 msgr2=0x7f89281f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892d000640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f892815f0c0 0x7f89281f63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892d000640 1 -- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8928154f50 msgr2=0x7f89281502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892d000640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8928154f50 0x7f89281502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.286+0000 7f892d000640 1 -- 172.21.15.8:0/1642116488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918009b30 con 0x7f892815ae70 2024-05-26T15:40:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.287+0000 7f892d000640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 0x7f89281f2360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8918034040 tx=0x7f8918004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:15.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.287+0000 7f8925600640 1 -- 172.21.15.8:0/1642116488 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891803b810 con 0x7f892815ae70 2024-05-26T15:40:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.287+0000 7f8925600640 1 -- 172.21.15.8:0/1642116488 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891803b970 con 0x7f892815ae70 2024-05-26T15:40:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.287+0000 7f8925600640 1 -- 172.21.15.8:0/1642116488 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891803bd20 con 0x7f892815ae70 2024-05-26T15:40:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.287+0000 7f892ee00640 1 -- 172.21.15.8:0/1642116488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89281f3360 con 0x7f892815ae70 2024-05-26T15:40:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.287+0000 7f892ee00640 1 -- 172.21.15.8:0/1642116488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89281f2da0 con 0x7f892815ae70 2024-05-26T15:40:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.288+0000 7f892ee00640 1 -- 172.21.15.8:0/1642116488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89280cb3d0 con 0x7f892815ae70 2024-05-26T15:40:15.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.289+0000 7f8925600640 1 -- 172.21.15.8:0/1642116488 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f891803a3a0 con 0x7f892815ae70 2024-05-26T15:40:15.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.290+0000 7f8925600640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f890c06ac00 0x7f890c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.290+0000 7f8925600640 1 -- 172.21.15.8:0/1642116488 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f89180aa4e0 con 0x7f892815ae70 2024-05-26T15:40:15.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.291+0000 7f892da00640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f890c06ac00 0x7f890c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.292+0000 7f892da00640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f890c06ac00 0x7f890c06d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f891c00b7c0 tx=0x7f891c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:15.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.294+0000 7f8925600640 1 -- 172.21.15.8:0/1642116488 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f89280cb3d0 con 0x7f892815ae70 2024-05-26T15:40:15.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.492+0000 7f892ee00640 1 -- 172.21.15.8:0/1642116488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89280cb3d0 con 0x7f892815ae70 2024-05-26T15:40:15.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.494+0000 7f8925600640 1 -- 172.21.15.8:0/1642116488 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18218 (secure 0 0 0) 0x7f89280cb3d0 con 0x7f892815ae70 2024-05-26T15:40:15.493 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:15.493 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":25,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:14.603572+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:15.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 -- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f890c06ac00 msgr2=0x7f890c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f890c06ac00 0x7f890c06d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f891c00b7c0 tx=0x7f891c008040 comp rx=0 tx=0).stop 2024-05-26T15:40:15.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 -- 172.21.15.8:0/1642116488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 msgr2=0x7f89281f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 0x7f89281f2360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8918034040 tx=0x7f8918004a40 comp rx=0 tx=0).stop 2024-05-26T15:40:15.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 -- 172.21.15.8:0/1642116488 shutdown_connections 2024-05-26T15:40:15.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f892815f0c0 0x7f89281f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f892815ae70 0x7f89281f2360 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f890c06ac00 0x7f890c06d0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 --2- 172.21.15.8:0/1642116488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8928154f50 0x7f89281502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 -- 172.21.15.8:0/1642116488 >> 172.21.15.8:0/1642116488 conn(0x7f8928070480 msgr2=0x7f89280b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:15.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 -- 172.21.15.8:0/1642116488 shutdown_connections 2024-05-26T15:40:15.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.497+0000 7f892ee00640 1 -- 172.21.15.8:0/1642116488 wait complete. 2024-05-26T15:40:15.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:40:15.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.737+0000 7f65ff200640 1 Processor -- start 2024-05-26T15:40:15.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.737+0000 7f65ff200640 1 -- start start 2024-05-26T15:40:15.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.739+0000 7f65ff200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f65f8144150 0x7f65f80b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.739+0000 7f65ff200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65f8070d70 0x7f65f80cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.739+0000 7f65ff200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f80b1db0 con 0x7f65f8144530 2024-05-26T15:40:15.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.739+0000 7f65ff200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f80cc8f0 con 0x7f65f8144150 2024-05-26T15:40:15.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.739+0000 7f65ff200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f80cbac0 con 0x7f65f8070d70 2024-05-26T15:40:15.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.739+0000 7f65fd200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65f8070d70 0x7f65f80cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.740+0000 7f65f7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f65f8144150 0x7f65f80b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.740+0000 7f65ef400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f65f8144530 0x7f65f8070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:43220/0 (socket says 172.21.15.8:43220) 2024-05-26T15:40:15.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.740+0000 7f65ef400640 1 -- 172.21.15.8:0/3814802436 learned_addr learned my addr 172.21.15.8:0/3814802436 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:15.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.740+0000 7f65f7e00640 1 -- 172.21.15.8:0/3814802436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65f8070d70 msgr2=0x7f65f80cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:15.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.740+0000 7f65f7e00640 1 --2- 172.21.15.8:0/3814802436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65f8070d70 0x7f65f80cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.740+0000 7f65f7e00640 1 -- 172.21.15.8:0/3814802436 >> v1:172.21.15.47:6789/0 conn(0x7f65f8144530 legacy=0x7f65f8070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.740+0000 7f65f7e00640 1 -- 172.21.15.8:0/3814802436 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f80ccb90 con 0x7f65f8144150 2024-05-26T15:40:15.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.742+0000 7f65f7e00640 1 --2- 172.21.15.8:0/3814802436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65f8144150 0x7f65f80b1870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f65e80097a0 tx=0x7f65e802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57fb447002a87938 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:15.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.742+0000 7f65f7400640 1 -- 172.21.15.8:0/3814802436 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8032440 con 0x7f65f8144150 2024-05-26T15:40:15.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.742+0000 7f65f7400640 1 -- 172.21.15.8:0/3814802436 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e80325a0 con 0x7f65f8144150 2024-05-26T15:40:15.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.742+0000 7f65f7400640 1 -- 172.21.15.8:0/3814802436 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8032930 con 0x7f65f8144150 2024-05-26T15:40:15.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.743+0000 7f65ff200640 1 -- 172.21.15.8:0/3814802436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65f8144150 msgr2=0x7f65f80b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.743+0000 7f65ff200640 1 --2- 172.21.15.8:0/3814802436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65f8144150 0x7f65f80b1870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f65e80097a0 tx=0x7f65e802a180 comp rx=0 tx=0).stop 2024-05-26T15:40:15.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.743+0000 7f65ff200640 1 -- 172.21.15.8:0/3814802436 shutdown_connections 2024-05-26T15:40:15.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.743+0000 7f65ff200640 1 --2- 172.21.15.8:0/3814802436 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65f8070d70 0x7f65f80cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.743+0000 7f65ff200640 1 --2- 172.21.15.8:0/3814802436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65f8144150 0x7f65f80b1870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.743+0000 7f65ff200640 1 -- 172.21.15.8:0/3814802436 >> 172.21.15.8:0/3814802436 conn(0x7f65f80b0570 msgr2=0x7f65f80b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:15.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.743+0000 7f65ff200640 1 -- 172.21.15.8:0/3814802436 shutdown_connections 2024-05-26T15:40:15.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.743+0000 7f65ff200640 1 -- 172.21.15.8:0/3814802436 wait complete. 2024-05-26T15:40:15.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.745+0000 7f65ff200640 1 Processor -- start 2024-05-26T15:40:15.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.745+0000 7f65ff200640 1 -- start start 2024-05-26T15:40:15.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65ff200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65f8070d70 0x7f65f81e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65ff200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65f8144150 0x7f65f8156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65ff200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65f8144530 0x7f65f80ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65ff200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f81e38e0 con 0x7f65f8144150 2024-05-26T15:40:15.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65ff200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8156880 con 0x7f65f8070d70 2024-05-26T15:40:15.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65ff200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f80aeaa0 con 0x7f65f8144530 2024-05-26T15:40:15.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65ef400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65f8144150 0x7f65f8156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65ef400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65f8144150 0x7f65f8156340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53306/0 (socket says 172.21.15.8:53306) 2024-05-26T15:40:15.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65ef400640 1 -- 172.21.15.8:0/543242463 learned_addr learned my addr 172.21.15.8:0/543242463 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:15.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65f7e00640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65f8070d70 0x7f65f81e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.746+0000 7f65fd200640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65f8144530 0x7f65f80ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.747+0000 7f65ef400640 1 -- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65f8144530 msgr2=0x7f65f80ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.747+0000 7f65ef400640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65f8144530 0x7f65f80ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.747+0000 7f65ef400640 1 -- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65f8070d70 msgr2=0x7f65f81e33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:15.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.747+0000 7f65ef400640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65f8070d70 0x7f65f81e33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:15.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.747+0000 7f65ef400640 1 -- 172.21.15.8:0/543242463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8009400 con 0x7f65f8144150 2024-05-26T15:40:15.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.747+0000 7f65ef400640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65f8144150 0x7f65f8156340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c3c0 tx=0x7f65e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:15.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.747+0000 7f65f4c00640 1 -- 172.21.15.8:0/543242463 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0005ce0 con 0x7f65f8144150 2024-05-26T15:40:15.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.747+0000 7f65f4c00640 1 -- 172.21.15.8:0/543242463 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0005e40 con 0x7f65f8144150 2024-05-26T15:40:15.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.747+0000 7f65f4c00640 1 -- 172.21.15.8:0/543242463 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00072d0 con 0x7f65f8144150 2024-05-26T15:40:15.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.747+0000 7f65ff200640 1 -- 172.21.15.8:0/543242463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f80aed80 con 0x7f65f8144150 2024-05-26T15:40:15.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.748+0000 7f65ff200640 1 -- 172.21.15.8:0/543242463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f81e7660 con 0x7f65f8144150 2024-05-26T15:40:15.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.749+0000 7f65ff200640 1 -- 172.21.15.8:0/543242463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f81e74c0 con 0x7f65f8144150 2024-05-26T15:40:15.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.750+0000 7f65f4c00640 1 -- 172.21.15.8:0/543242463 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f65e00074f0 con 0x7f65f8144150 2024-05-26T15:40:15.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.751+0000 7f65f4c00640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f65d406ac00 0x7f65d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:15.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.751+0000 7f65f4c00640 1 -- 172.21.15.8:0/543242463 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f65e0088c40 con 0x7f65f8144150 2024-05-26T15:40:15.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.752+0000 7f65f7e00640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f65d406ac00 0x7f65d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:15.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.753+0000 7f65f7e00640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f65d406ac00 0x7f65d406d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65e8034000 tx=0x7f65e802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:15.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:15.755+0000 7f65f4c00640 1 -- 172.21.15.8:0/543242463 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f65f81e74c0 con 0x7f65f8144150 2024-05-26T15:40:16.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.001+0000 7f65ff200640 1 -- 172.21.15.8:0/543242463 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65f81e74c0 con 0x7f65f8144150 2024-05-26T15:40:16.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.003+0000 7f65f4c00640 1 -- 172.21.15.8:0/543242463 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4718 (secure 0 0 0) 0x7f65f81e74c0 con 0x7f65f8144150 2024-05-26T15:40:16.001 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:16.001 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:39:32.881224+0000","modified":"2024-05-26T15:40:01.486240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-26T15:40:16.002 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2024-05-26T15:40:16.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 -- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f65d406ac00 msgr2=0x7f65d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f65d406ac00 0x7f65d406d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65e8034000 tx=0x7f65e802e000 comp rx=0 tx=0).stop 2024-05-26T15:40:16.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 -- 172.21.15.8:0/543242463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65f8144150 msgr2=0x7f65f8156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65f8144150 0x7f65f8156340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c3c0 tx=0x7f65e000c880 comp rx=0 tx=0).stop 2024-05-26T15:40:16.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 -- 172.21.15.8:0/543242463 shutdown_connections 2024-05-26T15:40:16.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65f8144530 0x7f65f80ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65f8144150 0x7f65f8156340 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f65d406ac00 0x7f65d406d0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 --2- 172.21.15.8:0/543242463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65f8070d70 0x7f65f81e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 -- 172.21.15.8:0/543242463 >> 172.21.15.8:0/543242463 conn(0x7f65f80b0570 msgr2=0x7f65f813ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 -- 172.21.15.8:0/543242463 shutdown_connections 2024-05-26T15:40:16.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.006+0000 7f65ff200640 1 -- 172.21.15.8:0/543242463 wait complete. 2024-05-26T15:40:16.427 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-26T15:39:32.881224+0000', 'modified': '2024-05-26T15:40:01.486240+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.47:6837/1464782370', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6835', 'nonce': 1464782370}, {'type': 'v1', 'addr': '172.21.15.47:6837', 'nonce': 1464782370}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-26T15:40:16.427 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-26T15:40:16.427 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-26T15:40:16.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.651+0000 7f0442400640 1 Processor -- start 2024-05-26T15:40:16.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.652+0000 7f0442400640 1 -- start start 2024-05-26T15:40:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.653+0000 7f0442400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f043c0cdb20 0x7f043c0cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.653+0000 7f0442400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f043c0cb210 0x7f043c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.653+0000 7f0442400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c0cd340 con 0x7f043c161800 2024-05-26T15:40:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.653+0000 7f0442400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c162370 con 0x7f043c0cb210 2024-05-26T15:40:16.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.653+0000 7f0442400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1656e0 con 0x7f043c0cdb20 2024-05-26T15:40:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.654+0000 7f043be00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f043c161800 0x7f043c161c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46868/0 (socket says 172.21.15.8:46868) 2024-05-26T15:40:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.654+0000 7f043be00640 1 -- 172.21.15.8:0/2549084060 learned_addr learned my addr 172.21.15.8:0/2549084060 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.654+0000 7f043b400640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f043c0cdb20 0x7f043c0cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.654+0000 7f0433e00640 1 --2- 172.21.15.8:0/2549084060 >> v2:172.21.15.47:3300/0 conn(0x7f043c0cb210 0x7f043c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.654+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265566179 0 0) 0x7f043c0cd340 con 0x7f043c161800 2024-05-26T15:40:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.654+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0420003520 con 0x7f043c161800 2024-05-26T15:40:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 754202148 0 0) 0x7f0420003520 con 0x7f043c161800 2024-05-26T15:40:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f043c0cdb20 msgr2=0x7f043c0cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f043c0cdb20 0x7f043c0cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 >> v2:172.21.15.47:3300/0 conn(0x7f043c0cb210 msgr2=0x7f043c0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 --2- 172.21.15.8:0/2549084060 >> v2:172.21.15.47:3300/0 conn(0x7f043c0cb210 0x7f043c0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0cbb90 con 0x7f043c161800 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f04340019f0 con 0x7f043c161800 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f0433e00640 1 --2- 172.21.15.8:0/2549084060 >> v2:172.21.15.47:3300/0 conn(0x7f043c0cb210 0x7f043c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 >> v1:172.21.15.8:6789/0 conn(0x7f043c161800 legacy=0x7f043c161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0420003970 0x7f0420003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04200047c0 0x7f0420004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f043c0cdb20 0x7f0420005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c162370 con 0x7f04200047c0 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1656e0 con 0x7f0420003970 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042000b980 con 0x7f043c0cdb20 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f0433e00640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04200047c0 0x7f0420004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.655+0000 7f043b400640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0420003970 0x7f0420003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.656+0000 7f043be00640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f043c0cdb20 0x7f0420005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.656+0000 7f0433e00640 1 -- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f043c0cdb20 msgr2=0x7f0420005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.656+0000 7f0433e00640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f043c0cdb20 0x7f0420005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.656+0000 7f0433e00640 1 -- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0420003970 msgr2=0x7f0420003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.656+0000 7f0433e00640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0420003970 0x7f0420003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.656+0000 7f0433e00640 1 -- 172.21.15.8:0/2549084060 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420003520 con 0x7f04200047c0 2024-05-26T15:40:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.656+0000 7f043be00640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f043c0cdb20 0x7f0420005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.657+0000 7f0433e00640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04200047c0 0x7f0420004c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f04240098a0 tx=0x7f04200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394d2e8b0f215341 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.658+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042402ad20 con 0x7f04200047c0 2024-05-26T15:40:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.658+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042402ae80 con 0x7f04200047c0 2024-05-26T15:40:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.658+0000 7f043aa00640 1 -- 172.21.15.8:0/2549084060 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424004250 con 0x7f04200047c0 2024-05-26T15:40:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.658+0000 7f0442400640 1 -- 172.21.15.8:0/2549084060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04200047c0 msgr2=0x7f0420004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.658+0000 7f0442400640 1 --2- 172.21.15.8:0/2549084060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04200047c0 0x7f0420004c40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f04240098a0 tx=0x7f04200057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.658+0000 7f043be00640 1 -- 172.21.15.8:0/2549084060 reap_dead start 2024-05-26T15:40:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.658+0000 7f0442400640 1 -- 172.21.15.8:0/2549084060 shutdown_connections 2024-05-26T15:40:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.658+0000 7f0442400640 1 -- 172.21.15.8:0/2549084060 >> 172.21.15.8:0/2549084060 conn(0x7f043c0b0570 msgr2=0x7f043c0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.659+0000 7f0442400640 1 -- 172.21.15.8:0/2549084060 shutdown_connections 2024-05-26T15:40:16.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.659+0000 7f0442400640 1 -- 172.21.15.8:0/2549084060 wait complete. 2024-05-26T15:40:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.660+0000 7f0442400640 1 Processor -- start 2024-05-26T15:40:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.661+0000 7f0442400640 1 -- start start 2024-05-26T15:40:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.661+0000 7f0442400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04200047c0 0x7f043c14e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.661+0000 7f0442400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043c14afb0 0x7f043c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.661+0000 7f0442400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f043c1478e0 0x7f043c147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.661+0000 7f0442400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1faf60 con 0x7f043c14afb0 2024-05-26T15:40:16.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.661+0000 7f0442400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1482a0 con 0x7f043c1478e0 2024-05-26T15:40:16.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.661+0000 7f0442400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1fa2e0 con 0x7f04200047c0 2024-05-26T15:40:16.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.662+0000 7f0433e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043c14afb0 0x7f043c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.662+0000 7f0433e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043c14afb0 0x7f043c06d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53320/0 (socket says 172.21.15.8:53320) 2024-05-26T15:40:16.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.662+0000 7f0433e00640 1 -- 172.21.15.8:0/2462873550 learned_addr learned my addr 172.21.15.8:0/2462873550 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.662+0000 7f043be00640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f043c1478e0 0x7f043c147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.662+0000 7f043b400640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04200047c0 0x7f043c14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.662+0000 7f0433e00640 1 -- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04200047c0 msgr2=0x7f043c14e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.662+0000 7f0433e00640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04200047c0 0x7f043c14e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.662+0000 7f0433e00640 1 -- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f043c1478e0 msgr2=0x7f043c147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.662+0000 7f0433e00640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f043c1478e0 0x7f043c147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.662+0000 7f0433e00640 1 -- 172.21.15.8:0/2462873550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c1fa5c0 con 0x7f043c14afb0 2024-05-26T15:40:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.663+0000 7f0433e00640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043c14afb0 0x7f043c06d060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f042402a740 tx=0x7f0424004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.663+0000 7f0433400640 1 -- 172.21.15.8:0/2462873550 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04240044d0 con 0x7f043c14afb0 2024-05-26T15:40:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.663+0000 7f0433400640 1 -- 172.21.15.8:0/2462873550 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0424003c50 con 0x7f043c14afb0 2024-05-26T15:40:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.663+0000 7f0433400640 1 -- 172.21.15.8:0/2462873550 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042403d440 con 0x7f043c14afb0 2024-05-26T15:40:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.663+0000 7f0442400640 1 -- 172.21.15.8:0/2462873550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c1fa8a0 con 0x7f043c14afb0 2024-05-26T15:40:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.663+0000 7f0442400640 1 -- 172.21.15.8:0/2462873550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c14b430 con 0x7f043c14afb0 2024-05-26T15:40:16.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.665+0000 7f0433400640 1 -- 172.21.15.8:0/2462873550 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f042403d5a0 con 0x7f043c14afb0 2024-05-26T15:40:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.666+0000 7f0433400640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041806ac80 0x7f041806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.666+0000 7f0433400640 1 -- 172.21.15.8:0/2462873550 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f04240a9f50 con 0x7f043c14afb0 2024-05-26T15:40:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.667+0000 7f043b400640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041806ac80 0x7f041806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.667+0000 7f0445377740 1 Processor -- start 2024-05-26T15:40:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.667+0000 7f0445377740 1 -- start start 2024-05-26T15:40:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.668+0000 7f043b400640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041806ac80 0x7f041806d140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f042c009a20 tx=0x7f042c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.668+0000 7f0445377740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f1190 0x55c17e6d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.668+0000 7f0445377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 0x55c17e6a7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.668+0000 7f0445377740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6a7970 0x55c17e6a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.668+0000 7f0445377740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c17e612a70 con 0x55c17e6a7970 2024-05-26T15:40:16.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.668+0000 7f0445377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c17e610200 con 0x55c17e6f17a0 2024-05-26T15:40:16.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.668+0000 7f0445377740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c17e60baf0 con 0x55c17e6f1190 2024-05-26T15:40:16.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.669+0000 7f043be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6a7970 0x55c17e6a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.669+0000 7f043b400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f1190 0x55c17e6d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.669+0000 7f043be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6a7970 0x55c17e6a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53330/0 (socket says 172.21.15.8:53330) 2024-05-26T15:40:16.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.669+0000 7f0433e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 0x55c17e6a7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.669+0000 7f043be00640 1 -- 172.21.15.8:0/2072148238 learned_addr learned my addr 172.21.15.8:0/2072148238 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.669+0000 7f043be00640 1 -- 172.21.15.8:0/2072148238 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f1190 msgr2=0x55c17e6d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.669+0000 7f043be00640 1 --2- 172.21.15.8:0/2072148238 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f1190 0x55c17e6d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.669+0000 7f043be00640 1 -- 172.21.15.8:0/2072148238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 msgr2=0x55c17e6a7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.669+0000 7f043be00640 1 --2- 172.21.15.8:0/2072148238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 0x55c17e6a7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.669+0000 7f043be00640 1 -- 172.21.15.8:0/2072148238 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c17e5d6b90 con 0x55c17e6a7970 2024-05-26T15:40:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.670+0000 7f043be00640 1 --2- 172.21.15.8:0/2072148238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6a7970 0x55c17e6a8a80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f043c0ae4b0 tx=0x7f0434005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db952352ca3320b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.670+0000 7f042be00640 1 -- 172.21.15.8:0/2072148238 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04340076a0 con 0x55c17e6a7970 2024-05-26T15:40:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.670+0000 7f042be00640 1 -- 172.21.15.8:0/2072148238 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434007800 con 0x55c17e6a7970 2024-05-26T15:40:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.670+0000 7f042be00640 1 -- 172.21.15.8:0/2072148238 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434014400 con 0x55c17e6a7970 2024-05-26T15:40:16.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.671+0000 7f0445377740 1 -- 172.21.15.8:0/2072148238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6a7970 msgr2=0x55c17e6a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.671+0000 7f0445377740 1 --2- 172.21.15.8:0/2072148238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6a7970 0x55c17e6a8a80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f043c0ae4b0 tx=0x7f0434005f40 comp rx=0 tx=0).stop 2024-05-26T15:40:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.671+0000 7f0445377740 1 -- 172.21.15.8:0/2072148238 shutdown_connections 2024-05-26T15:40:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.671+0000 7f0445377740 1 --2- 172.21.15.8:0/2072148238 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6a7970 0x55c17e6a8a80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.671+0000 7f0445377740 1 --2- 172.21.15.8:0/2072148238 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 0x55c17e6a7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.671+0000 7f0445377740 1 --2- 172.21.15.8:0/2072148238 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f1190 0x55c17e6d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.671+0000 7f0445377740 1 -- 172.21.15.8:0/2072148238 >> 172.21.15.8:0/2072148238 conn(0x55c17e6a5e90 msgr2=0x55c17e6ee730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.671+0000 7f0445377740 1 -- 172.21.15.8:0/2072148238 shutdown_connections 2024-05-26T15:40:16.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.671+0000 7f0445377740 1 -- 172.21.15.8:0/2072148238 wait complete. 2024-05-26T15:40:16.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.672+0000 7f0445377740 1 -- start start 2024-05-26T15:40:16.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.672+0000 7f0445377740 1 Processor -- start 2024-05-26T15:40:16.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f0445377740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f1190 0x55c17e6c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f0445377740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f17a0 0x55c17e6c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f0445377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6c91b0 0x55c17e6efea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f0445377740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c17e5ad220 con 0x55c17e6f17a0 2024-05-26T15:40:16.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f0445377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c17e5acec0 con 0x55c17e6c91b0 2024-05-26T15:40:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f0445377740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c17e372f20 con 0x55c17e6f1190 2024-05-26T15:40:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f0445377740 10 client.0 _ll_register_callbacks cb 0x55c17e605160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:40:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f0433e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f17a0 0x55c17e6c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f0433e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f17a0 0x55c17e6c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53334/0 (socket says 172.21.15.8:53334) 2024-05-26T15:40:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f0433e00640 1 -- 172.21.15.8:0/3695010065 learned_addr learned my addr 172.21.15.8:0/3695010065 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.673+0000 7f043b400640 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f1190 0x55c17e6c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f043be00640 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6c91b0 0x55c17e6efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0433e00640 1 -- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f1190 msgr2=0x55c17e6c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0433e00640 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f1190 0x55c17e6c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0433e00640 1 -- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6c91b0 msgr2=0x55c17e6efea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0433e00640 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6c91b0 0x55c17e6efea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0433e00640 1 -- 172.21.15.8:0/3695010065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043400f040 con 0x55c17e6f17a0 2024-05-26T15:40:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0433e00640 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f17a0 0x55c17e6c8c70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f04240a8080 tx=0x7f04240791b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72000097744f6f79 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:16.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0428c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:40:16.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0428c00640 1 -- 172.21.15.8:0/3695010065 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04240780e0 con 0x55c17e6f17a0 2024-05-26T15:40:16.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0445377740 1 -- 172.21.15.8:0/3695010065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c17e635c90 con 0x55c17e6f17a0 2024-05-26T15:40:16.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0428c00640 1 -- 172.21.15.8:0/3695010065 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0424080de0 con 0x55c17e6f17a0 2024-05-26T15:40:16.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0428c00640 1 -- 172.21.15.8:0/3695010065 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0424090170 con 0x55c17e6f17a0 2024-05-26T15:40:16.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0445377740 10 client.4812 fetch_fsmap learned FSMap version 8 2024-05-26T15:40:16.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.674+0000 7f0445377740 1 -- 172.21.15.8:0/3695010065 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c17e60a170 con 0x55c17e6f17a0 2024-05-26T15:40:16.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.675+0000 7f0428c00640 1 -- 172.21.15.8:0/3695010065 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c17e635c90 con 0x55c17e6f17a0 2024-05-26T15:40:16.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.675+0000 7f0428c00640 1 -- 172.21.15.8:0/3695010065 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f042403a050 con 0x55c17e6f17a0 2024-05-26T15:40:16.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.675+0000 7f0445377740 10 client.4812 fetch_fsmap finished waiting for FSMap version 8 2024-05-26T15:40:16.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.675+0000 7f0445377740 10 client.4812 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-26T15:40:16.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.675+0000 7f0445377740 20 client.4812 populate_metadata read hostname 'smithi008' 2024-05-26T15:40:16.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.675+0000 7f0445377740 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x55c17e6ce540 0x55c17e6c6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.675+0000 7f0445377740 4 client.4812 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-26T15:40:16.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.675+0000 7f0445377740 1 -- 172.21.15.8:0/3695010065 --> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c17e2ff3c0 con 0x55c17e6ce540 2024-05-26T15:40:16.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.676+0000 7f043b400640 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x55c17e6ce540 0x55c17e6c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.677+0000 7f043b400640 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x55c17e6ce540 0x55c17e6c6780 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a040252b26249d server_cookie=73be7ff0f08b0da2 in_seq=0 out_seq=0 2024-05-26T15:40:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.677+0000 7f0428c00640 10 client.4812 ms_handle_connect on v2:172.21.15.47:6835/1464782370 2024-05-26T15:40:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0428c00640 1 -- 172.21.15.8:0/3695010065 <== mds.0 v2:172.21.15.47:6835/1464782370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c17e2ff3c0 con 0x55c17e6ce540 2024-05-26T15:40:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0428c00640 10 client.4812 handle_command_reply: tid=0 2024-05-26T15:40:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 client.4812 shutdown 2024-05-26T15:40:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 -- 172.21.15.8:0/3695010065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f17a0 msgr2=0x55c17e6c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f17a0 0x55c17e6c8c70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f04240a8080 tx=0x7f04240791b0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 -- 172.21.15.8:0/3695010065 shutdown_connections 2024-05-26T15:40:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x55c17e6ce540 0x55c17e6c6780 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6c91b0 0x55c17e6efea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f17a0 0x55c17e6c8c70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 --2- 172.21.15.8:0/3695010065 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f1190 0x55c17e6c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 -- 172.21.15.8:0/3695010065 >> 172.21.15.8:0/3695010065 conn(0x55c17e6a7970 msgr2=0x55c17e6ef750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0428c00640 0 client.4812 ms_handle_reset on v2:172.21.15.47:6835/1464782370 2024-05-26T15:40:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 -- 172.21.15.8:0/3695010065 shutdown_connections 2024-05-26T15:40:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.679+0000 7f0445377740 1 -- 172.21.15.8:0/3695010065 wait complete. 2024-05-26T15:40:16.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.680+0000 7f0445377740 20 client.4812 trim_cache size 0 max 16384 2024-05-26T15:40:16.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.697+0000 7f0445377740 1 Processor -- start 2024-05-26T15:40:16.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.697+0000 7f0445377740 1 -- start start 2024-05-26T15:40:16.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f0445377740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6c91b0 0x55c17e6ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f0445377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f1190 0x55c17e6c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f0445377740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f17a0 0x55c17e6c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f0445377740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c17e6c7b60 con 0x55c17e6c91b0 2024-05-26T15:40:16.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f0445377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c17e6caea0 con 0x55c17e6f1190 2024-05-26T15:40:16.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f0445377740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c17e6cf400 con 0x55c17e6f17a0 2024-05-26T15:40:16.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f043b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6c91b0 0x55c17e6ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f043b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6c91b0 0x55c17e6ee8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53350/0 (socket says 172.21.15.8:53350) 2024-05-26T15:40:16.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f043b400640 1 -- 172.21.15.8:0/315686486 learned_addr learned my addr 172.21.15.8:0/315686486 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f043b400640 1 -- 172.21.15.8:0/315686486 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f17a0 msgr2=0x55c17e6c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f0433e00640 1 --2- 172.21.15.8:0/315686486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f1190 0x55c17e6c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f043b400640 1 --2- 172.21.15.8:0/315686486 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f17a0 0x55c17e6c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f043b400640 1 -- 172.21.15.8:0/315686486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f1190 msgr2=0x55c17e6c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f043b400640 1 --2- 172.21.15.8:0/315686486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f1190 0x55c17e6c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f043b400640 1 -- 172.21.15.8:0/315686486 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c17e63f130 con 0x55c17e6c91b0 2024-05-26T15:40:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.698+0000 7f0433e00640 1 --2- 172.21.15.8:0/315686486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f1190 0x55c17e6c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:16.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.699+0000 7f043b400640 1 --2- 172.21.15.8:0/315686486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6c91b0 0x55c17e6ee8b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55c17e6a4170 tx=0x7f042c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952b993bee0663e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:16.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.699+0000 7f0430c00640 1 -- 172.21.15.8:0/315686486 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c02b070 con 0x55c17e6c91b0 2024-05-26T15:40:16.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.699+0000 7f0430c00640 1 -- 172.21.15.8:0/315686486 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c0260d0 con 0x55c17e6c91b0 2024-05-26T15:40:16.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.699+0000 7f0430c00640 1 -- 172.21.15.8:0/315686486 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c026240 con 0x55c17e6c91b0 2024-05-26T15:40:16.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.700+0000 7f0445377740 1 -- 172.21.15.8:0/315686486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6c91b0 msgr2=0x55c17e6ee8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.700+0000 7f0445377740 1 --2- 172.21.15.8:0/315686486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6c91b0 0x55c17e6ee8b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55c17e6a4170 tx=0x7f042c017000 comp rx=0 tx=0).stop 2024-05-26T15:40:16.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.700+0000 7f0445377740 1 -- 172.21.15.8:0/315686486 shutdown_connections 2024-05-26T15:40:16.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.700+0000 7f0445377740 1 --2- 172.21.15.8:0/315686486 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6f17a0 0x55c17e6c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.700+0000 7f0445377740 1 --2- 172.21.15.8:0/315686486 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f1190 0x55c17e6c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.700+0000 7f0445377740 1 --2- 172.21.15.8:0/315686486 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6c91b0 0x55c17e6ee8b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.700+0000 7f0445377740 1 -- 172.21.15.8:0/315686486 >> 172.21.15.8:0/315686486 conn(0x55c17e6a7970 msgr2=0x55c17e710930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:16.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.700+0000 7f0445377740 1 -- 172.21.15.8:0/315686486 shutdown_connections 2024-05-26T15:40:16.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.700+0000 7f0445377740 1 -- 172.21.15.8:0/315686486 wait complete. 2024-05-26T15:40:16.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.701+0000 7f0445377740 1 -- start start 2024-05-26T15:40:16.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.701+0000 7f0445377740 1 Processor -- start 2024-05-26T15:40:16.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0445377740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6c91b0 0x55c17e6f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0445377740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f1190 0x55c17e707220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0445377740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 0x55c17e707760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0445377740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c17e752ed0 con 0x55c17e6f1190 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0445377740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c17e6c5d30 con 0x55c17e6f17a0 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0445377740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c17e6c5a80 con 0x55c17e6c91b0 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0445377740 10 client.0 _ll_register_callbacks cb 0x7f0424078530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0433e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f1190 0x55c17e707220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0433e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f1190 0x55c17e707220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53366/0 (socket says 172.21.15.8:53366) 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0433e00640 1 -- 172.21.15.8:0/3125527605 learned_addr learned my addr 172.21.15.8:0/3125527605 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f043be00640 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 0x55c17e707760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f043b400640 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6c91b0 0x55c17e6f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0433e00640 1 -- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6c91b0 msgr2=0x55c17e6f27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0433e00640 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6c91b0 0x55c17e6f27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0433e00640 1 -- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 msgr2=0x55c17e707760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:16.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0433e00640 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 0x55c17e707760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f0433e00640 1 -- 172.21.15.8:0/3125527605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c0149d0 con 0x55c17e6f1190 2024-05-26T15:40:16.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.702+0000 7f043be00640 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 0x55c17e707760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:16.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0433e00640 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f1190 0x55c17e707220 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0424076d40 tx=0x7f04240a7f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c515b7459512e53d server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:16.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0428c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:40:16.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0428c00640 1 -- 172.21.15.8:0/3125527605 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04240749e0 con 0x55c17e6f1190 2024-05-26T15:40:16.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0428c00640 1 -- 172.21.15.8:0/3125527605 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0424074b40 con 0x55c17e6f1190 2024-05-26T15:40:16.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0445377740 1 -- 172.21.15.8:0/3125527605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c17e6cec90 con 0x55c17e6f1190 2024-05-26T15:40:16.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0428c00640 1 -- 172.21.15.8:0/3125527605 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f042400f040 con 0x55c17e6f1190 2024-05-26T15:40:16.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0445377740 10 client.4818 fetch_fsmap learned FSMap version 8 2024-05-26T15:40:16.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0445377740 1 -- 172.21.15.8:0/3125527605 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c17e5ac430 con 0x55c17e6f1190 2024-05-26T15:40:16.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0428c00640 1 -- 172.21.15.8:0/3125527605 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c17e6cec90 con 0x55c17e6f1190 2024-05-26T15:40:16.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0428c00640 1 -- 172.21.15.8:0/3125527605 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0424097340 con 0x55c17e6f1190 2024-05-26T15:40:16.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0445377740 10 client.4818 fetch_fsmap finished waiting for FSMap version 8 2024-05-26T15:40:16.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0445377740 10 client.4818 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-26T15:40:16.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0445377740 20 client.4818 populate_metadata read hostname 'smithi008' 2024-05-26T15:40:16.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0445377740 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x55c17e751c30 0x55c17e752010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0445377740 4 client.4818 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-26T15:40:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.703+0000 7f0445377740 1 -- 172.21.15.8:0/3125527605 --> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f0434007800 con 0x55c17e751c30 2024-05-26T15:40:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.704+0000 7f043b400640 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x55c17e751c30 0x55c17e752010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.705+0000 7f043b400640 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x55c17e751c30 0x55c17e752010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d50d0b474296375 server_cookie=b8f786002121c891 in_seq=0 out_seq=0 2024-05-26T15:40:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.705+0000 7f0428c00640 10 client.4818 ms_handle_connect on v2:172.21.15.47:6835/1464782370 2024-05-26T15:40:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0428c00640 1 -- 172.21.15.8:0/3125527605 <== mds.0 v2:172.21.15.47:6835/1464782370 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7f0434007800 con 0x55c17e751c30 2024-05-26T15:40:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0428c00640 10 client.4818 handle_command_reply: tid=0 2024-05-26T15:40:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 client.4818 shutdown 2024-05-26T15:40:16.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 -- 172.21.15.8:0/3125527605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f1190 msgr2=0x55c17e707220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f1190 0x55c17e707220 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0424076d40 tx=0x7f04240a7f50 comp rx=0 tx=0).stop 2024-05-26T15:40:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 -- 172.21.15.8:0/3125527605 shutdown_connections 2024-05-26T15:40:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:6835/1464782370,v1:172.21.15.47:6837/1464782370] conn(0x55c17e751c30 0x55c17e752010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55c17e6f17a0 0x55c17e707760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55c17e6f1190 0x55c17e707220 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 --2- 172.21.15.8:0/3125527605 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55c17e6c91b0 0x55c17e6f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 -- 172.21.15.8:0/3125527605 >> 172.21.15.8:0/3125527605 conn(0x55c17e6a7970 msgr2=0x55c17e6ef3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:16.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0428c00640 0 client.4818 ms_handle_reset on v2:172.21.15.47:6835/1464782370 2024-05-26T15:40:16.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 -- 172.21.15.8:0/3125527605 shutdown_connections 2024-05-26T15:40:16.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 1 -- 172.21.15.8:0/3125527605 wait complete. 2024-05-26T15:40:16.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.706+0000 7f0445377740 20 client.4818 trim_cache size 0 max 16384 2024-05-26T15:40:16.713 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:40:16.713 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "03132396-4584-4cf0-b2e0-b5ae6040045e", 2024-05-26T15:40:16.713 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2024-05-26T15:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 4273, 2024-05-26T15:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-05-26T15:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-05-26T15:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-05-26T15:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 43.818726634999997, 2024-05-26T15:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 8, 2024-05-26T15:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 26, 2024-05-26T15:40:16.714 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 24, 2024-05-26T15:40:16.715 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 48.427356060999998 2024-05-26T15:40:16.715 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:40:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 -- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041806ac80 msgr2=0x7f041806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041806ac80 0x7f041806d140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f042c009a20 tx=0x7f042c008040 comp rx=0 tx=0).stop 2024-05-26T15:40:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 -- 172.21.15.8:0/2462873550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043c14afb0 msgr2=0x7f043c06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043c14afb0 0x7f043c06d060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f042402a740 tx=0x7f0424004730 comp rx=0 tx=0).stop 2024-05-26T15:40:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 -- 172.21.15.8:0/2462873550 shutdown_connections 2024-05-26T15:40:16.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041806ac80 0x7f041806d140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f043c1478e0 0x7f043c147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043c14afb0 0x7f043c06d060 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 --2- 172.21.15.8:0/2462873550 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04200047c0 0x7f043c14e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 -- 172.21.15.8:0/2462873550 >> 172.21.15.8:0/2462873550 conn(0x7f043c0b0570 msgr2=0x7f043c1609d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 -- 172.21.15.8:0/2462873550 shutdown_connections 2024-05-26T15:40:16.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:16.707+0000 7f0442400640 1 -- 172.21.15.8:0/2462873550 wait complete. 2024-05-26T15:40:16.725 INFO:teuthology.run_tasks:Running task sequential... 2024-05-26T15:40:16.733 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-26T15:40:16.734 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-26T15:40:16.734 INFO:teuthology.task.print:Enabling mgr modules 2024-05-26T15:40:16.734 INFO:teuthology.run_tasks:Running task kclient... 2024-05-26T15:40:16.813 INFO:tasks.kclient:Mounting kernel clients... 2024-05-26T15:40:16.813 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-26T15:40:16.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:16.814 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-05-26T15:40:16.873 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-26T15:40:16.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:16.875 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-26T15:40:16.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:16.976 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2024-05-26T15:40:17.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:17.081 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-05-26T15:40:17.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:17.124 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2024-05-26T15:40:17.250 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2024-05-26T15:40:17.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:40:17.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:17.255 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-26T15:40:17.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:17.317 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-26T15:40:17.417 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-05-26T15:40:17.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:40:17.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:17.502 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-26T15:40:17.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:17.567 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-26T15:40:17.663 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-05-26T15:40:17.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:40:17.668 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-26T15:40:17.668 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-26T15:40:17.668 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-26T15:40:17.668 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-26T15:40:17.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.890+0000 7fb3b0600640 1 Processor -- start 2024-05-26T15:40:17.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.890+0000 7fb3b0600640 1 -- start start 2024-05-26T15:40:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.892+0000 7fb3b0600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb3a81430f0 0x7fb3a815d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.892+0000 7fb3b0600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80b1950 0x7fb3a80cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.892+0000 7fb3b0600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a80cbbc0 con 0x7fb3a80cb790 2024-05-26T15:40:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.892+0000 7fb3b0600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a806c760 con 0x7fb3a81430f0 2024-05-26T15:40:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.892+0000 7fb3b0600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a806dc20 con 0x7fb3a80b1950 2024-05-26T15:40:17.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.892+0000 7fb3ae600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb3a80cb790 0x7fb3a80cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:46880/0 (socket says 172.21.15.8:46880) 2024-05-26T15:40:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.892+0000 7fb3ae600640 1 -- 172.21.15.8:0/1959537539 learned_addr learned my addr 172.21.15.8:0/1959537539 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3ad200640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80b1950 0x7fb3a80cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3adc00640 1 --2- 172.21.15.8:0/1959537539 >> v2:172.21.15.47:3300/0 conn(0x7fb3a81430f0 0x7fb3a815d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488614648 0 0) 0x7fb3a80cbbc0 con 0x7fb3a80cb790 2024-05-26T15:40:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb390003520 con 0x7fb3a80cb790 2024-05-26T15:40:17.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2611882731 0 0) 0x7fb390003520 con 0x7fb3a80cb790 2024-05-26T15:40:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80b1950 msgr2=0x7fb3a80cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80b1950 0x7fb3a80cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 >> v2:172.21.15.47:3300/0 conn(0x7fb3a81430f0 msgr2=0x7fb3a815d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 --2- 172.21.15.8:0/1959537539 >> v2:172.21.15.47:3300/0 conn(0x7fb3a81430f0 0x7fb3a815d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a815dc40 con 0x7fb3a80cb790 2024-05-26T15:40:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fb3a00019f0 con 0x7fb3a80cb790 2024-05-26T15:40:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 >> v1:172.21.15.8:6789/0 conn(0x7fb3a80cb790 legacy=0x7fb3a80cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80b1950 0x7fb390003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb390003ef0 0x7fb3900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:17.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb390004d00 0x7fb390005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a806c760 con 0x7fb390004d00 2024-05-26T15:40:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a806dc20 con 0x7fb390003ef0 2024-05-26T15:40:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.893+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39000b980 con 0x7fb3a80b1950 2024-05-26T15:40:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.894+0000 7fb3ae600640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb390004d00 0x7fb390005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.894+0000 7fb3ad200640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb390003ef0 0x7fb3900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.894+0000 7fb3adc00640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80b1950 0x7fb390003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.894+0000 7fb3ae600640 1 -- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80b1950 msgr2=0x7fb390003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.894+0000 7fb3ae600640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80b1950 0x7fb390003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:17.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.894+0000 7fb3ae600640 1 -- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb390003ef0 msgr2=0x7fb3900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.894+0000 7fb3ae600640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb390003ef0 0x7fb3900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.894+0000 7fb3ae600640 1 -- 172.21.15.8:0/1959537539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb390003520 con 0x7fb390004d00 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.894+0000 7fb3adc00640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80b1950 0x7fb390003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.895+0000 7fb3ae600640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb390004d00 0x7fb390005180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000a860 tx=0x7fb3900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeebeb8e49bfc9e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.896+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a002ba60 con 0x7fb390004d00 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.896+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a002bbc0 con 0x7fb390004d00 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.896+0000 7fb3a7e00640 1 -- 172.21.15.8:0/1959537539 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0034470 con 0x7fb390004d00 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.896+0000 7fb3b0600640 1 -- 172.21.15.8:0/1959537539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb390004d00 msgr2=0x7fb390005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.896+0000 7fb3b0600640 1 --2- 172.21.15.8:0/1959537539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb390004d00 0x7fb390005180 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000a860 tx=0x7fb3900057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.896+0000 7fb3ae600640 1 -- 172.21.15.8:0/1959537539 reap_dead start 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.896+0000 7fb3b0600640 1 -- 172.21.15.8:0/1959537539 shutdown_connections 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.896+0000 7fb3b0600640 1 -- 172.21.15.8:0/1959537539 >> 172.21.15.8:0/1959537539 conn(0x7fb3a80b0570 msgr2=0x7fb3a80b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:17.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.896+0000 7fb3b0600640 1 -- 172.21.15.8:0/1959537539 shutdown_connections 2024-05-26T15:40:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.896+0000 7fb3b0600640 1 -- 172.21.15.8:0/1959537539 wait complete. 2024-05-26T15:40:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.898+0000 7fb3b0600640 1 Processor -- start 2024-05-26T15:40:17.901 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.899+0000 7fb3b0600640 1 -- start start 2024-05-26T15:40:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3b0600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb390004d00 0x7fb3a81f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3b0600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a80a7e90 0x7fb3a80a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3b0600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80a8310 0x7fb3a80a9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3b0600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a815a070 con 0x7fb3a80a7e90 2024-05-26T15:40:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3b0600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a815a630 con 0x7fb390004d00 2024-05-26T15:40:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3b0600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a813dfa0 con 0x7fb3a80a8310 2024-05-26T15:40:17.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3ad200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a80a7e90 0x7fb3a80a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3ad200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a80a7e90 0x7fb3a80a9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:53390/0 (socket says 172.21.15.8:53390) 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3ad200640 1 -- 172.21.15.8:0/2095354679 learned_addr learned my addr 172.21.15.8:0/2095354679 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3adc00640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb390004d00 0x7fb3a81f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3ae600640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80a8310 0x7fb3a80a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3ad200640 1 -- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80a8310 msgr2=0x7fb3a80a9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3ad200640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80a8310 0x7fb3a80a9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3ad200640 1 -- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb390004d00 msgr2=0x7fb3a81f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3ad200640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb390004d00 0x7fb3a81f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.900+0000 7fb3ad200640 1 -- 172.21.15.8:0/2095354679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a813e280 con 0x7fb3a80a7e90 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.901+0000 7fb3ad200640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a80a7e90 0x7fb3a80a9010 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb394011630 tx=0x7fb394011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:17.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.901+0000 7fb3a5600640 1 -- 172.21.15.8:0/2095354679 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39400f920 con 0x7fb3a80a7e90 2024-05-26T15:40:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.901+0000 7fb3a5600640 1 -- 172.21.15.8:0/2095354679 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39400fa80 con 0x7fb3a80a7e90 2024-05-26T15:40:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.901+0000 7fb3b0600640 1 -- 172.21.15.8:0/2095354679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a813e560 con 0x7fb3a80a7e90 2024-05-26T15:40:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.901+0000 7fb3a5600640 1 -- 172.21.15.8:0/2095354679 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39400fdf0 con 0x7fb3a80a7e90 2024-05-26T15:40:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.901+0000 7fb3b0600640 1 -- 172.21.15.8:0/2095354679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a80af310 con 0x7fb3a80a7e90 2024-05-26T15:40:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.902+0000 7fb3b0600640 1 -- 172.21.15.8:0/2095354679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a813e7a0 con 0x7fb3a80a7e90 2024-05-26T15:40:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.903+0000 7fb3a5600640 1 -- 172.21.15.8:0/2095354679 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb394015460 con 0x7fb3a80a7e90 2024-05-26T15:40:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.904+0000 7fb3a5600640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb38806ac30 0x7fb38806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.904+0000 7fb3a5600640 1 -- 172.21.15.8:0/2095354679 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb394089f10 con 0x7fb3a80a7e90 2024-05-26T15:40:17.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.905+0000 7fb3adc00640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb38806ac30 0x7fb38806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.906+0000 7fb3adc00640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb38806ac30 0x7fb38806d0f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80af620 tx=0x7fb39c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:17.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:17.909+0000 7fb3a5600640 1 -- 172.21.15.8:0/2095354679 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb394054da0 con 0x7fb3a80a7e90 2024-05-26T15:40:18.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.149+0000 7fb3b0600640 1 -- 172.21.15.8:0/2095354679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb3a80681d0 con 0x7fb3a80a7e90 2024-05-26T15:40:18.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.150+0000 7fb3a5600640 1 -- 172.21.15.8:0/2095354679 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb3940583c0 con 0x7fb3a80a7e90 2024-05-26T15:40:18.149 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-26T15:40:18.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 -- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb38806ac30 msgr2=0x7fb38806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:18.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb38806ac30 0x7fb38806d0f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80af620 tx=0x7fb39c008040 comp rx=0 tx=0).stop 2024-05-26T15:40:18.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 -- 172.21.15.8:0/2095354679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a80a7e90 msgr2=0x7fb3a80a9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:18.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a80a7e90 0x7fb3a80a9010 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb394011630 tx=0x7fb394011af0 comp rx=0 tx=0).stop 2024-05-26T15:40:18.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 -- 172.21.15.8:0/2095354679 shutdown_connections 2024-05-26T15:40:18.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3a80a8310 0x7fb3a80a9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:18.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3a80a7e90 0x7fb3a80a9010 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:18.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb38806ac30 0x7fb38806d0f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:18.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 --2- 172.21.15.8:0/2095354679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb390004d00 0x7fb3a81f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:18.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 -- 172.21.15.8:0/2095354679 >> 172.21.15.8:0/2095354679 conn(0x7fb3a80b0570 msgr2=0x7fb3a80caa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:18.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 -- 172.21.15.8:0/2095354679 shutdown_connections 2024-05-26T15:40:18.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:18.153+0000 7fb3b0600640 1 -- 172.21.15.8:0/2095354679 wait complete. 2024-05-26T15:40:18.173 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-26T15:40:18.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-26T15:40:18.173 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2024-05-26T15:40:18.173 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-26T15:40:18.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-26T15:40:18.173 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-26T15:40:18.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-26T15:40:18.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-26T15:40:18.173 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-26T15:40:18.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:18.174 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2024-05-26T15:40:18.226 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:40:18.226 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2024-05-26T15:40:18.227 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-26T15:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42582sec preferred_lft 42582sec 2024-05-26T15:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2024-05-26T15:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:18.228 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2024-05-26T15:40:18.229 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-26T15:40:18.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:18.229 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:40:18.229 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:40:18.229 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add name ceph-brx type bridge 2024-05-26T15:40:18.229 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr flush dev ceph-brx 2024-05-26T15:40:18.229 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set ceph-brx up 2024-05-26T15:40:18.229 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-26T15:40:18.230 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:40:18.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:18.420 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-26T15:40:18.490 INFO:teuthology.orchestra.run.smithi008.stdout:1 2024-05-26T15:40:18.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:18.494 DEBUG:teuthology.orchestra.run.smithi008:> route 2024-05-26T15:40:18.548 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2024-05-26T15:40:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-26T15:40:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-26T15:40:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-26T15:40:18.549 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-26T15:40:18.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:18.549 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:40:18.549 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:40:18.549 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-26T15:40:18.549 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-26T15:40:18.549 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-26T15:40:18.550 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:40:18.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:18.704 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-05-26T15:40:18.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:18.762 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2024-05-26T15:40:18.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:18.820 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:40:18.820 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:40:18.820 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-26T15:40:18.820 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-26T15:40:18.820 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:40:18.950 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-26T15:40:18.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:18.951 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:40:18.951 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:40:18.951 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-26T15:40:18.952 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-26T15:40:18.952 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-26T15:40:18.952 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-26T15:40:18.952 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-26T15:40:18.952 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:40:19.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:19.171 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:40:19.171 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:40:19.171 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2024-05-26T15:40:19.171 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.0 master ceph-brx 2024-05-26T15:40:19.172 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:40:19.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:40:19.322 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-26T15:40:19.369 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-26T15:40:19.369 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:40:19.370 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-26T15:40:19.422 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-26T15:40:19.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:19.422 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:40:19.556 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:40:19.557 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-26T15:40:19.557 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:40:20.275 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:40:20.275 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-26T15:40:20.275 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:40:20.275 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:40:20.275 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:40:20.318 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:40:20.318 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-26T15:40:20.318 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:40:20.318 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:40:20.318 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:40:20.318 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790" 2024-05-26T15:40:20.318 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790:/ 2024-05-26T15:40:20.318 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=03132396-4584-4cf0-b2e0-b5ae6040045e" will pass to kernel 2024-05-26T15:40:20.326 INFO:teuthology.orchestra.run.smithi008.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-26T15:40:20.327 INFO:teuthology.orchestra.run.smithi008.stdout: You just mounted a file system that supports labels which does not 2024-05-26T15:40:20.327 INFO:teuthology.orchestra.run.smithi008.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-26T15:40:20.327 INFO:teuthology.orchestra.run.smithi008.stdout: applications will generate AVC messages and not be allowed access to 2024-05-26T15:40:20.327 INFO:teuthology.orchestra.run.smithi008.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-26T15:40:20.331 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-26T15:40:20.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:20.331 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-26T15:40:20.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:20.425 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:20.486 INFO:teuthology.orchestra.run.smithi008.stdout:client4708 2024-05-26T15:40:20.486 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:40:20.486 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:20.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:20.537 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:20.593 INFO:teuthology.orchestra.run.smithi008.stdout:client4708 2024-05-26T15:40:20.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:20.593 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:20.643 INFO:teuthology.orchestra.run.smithi008.stdout:client4708 2024-05-26T15:40:20.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:20.644 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/03132396-4584-4cf0-b2e0-b5ae6040045e.client4708/status') 2024-05-26T15:40:20.714 INFO:teuthology.orchestra.run.smithi008.stdout:instance: client.4708 (3)172.21.15.8:0/3578632028 2024-05-26T15:40:20.714 INFO:teuthology.orchestra.run.smithi008.stdout:blocklisted: false 2024-05-26T15:40:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records in 2024-05-26T15:40:20.714 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records out 2024-05-26T15:40:20.715 INFO:teuthology.orchestra.run.smithi008.stderr:69 bytes copied, 7.3045e-05 s, 945 kB/s 2024-05-26T15:40:20.718 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-05-26T15:40:20.718 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-26T15:40:20.718 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-26T15:40:20.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-26T15:40:20.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.932+0000 7f64b6e00640 1 Processor -- start 2024-05-26T15:40:20.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.933+0000 7f64b6e00640 1 -- start start 2024-05-26T15:40:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.934+0000 7f64b6e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f64b00b0f60 0x7f64b015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.934+0000 7f64b6e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f64b015f0c0 0x7f64b00c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.934+0000 7f64b6e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b015b640 con 0x7f64b0154f50 2024-05-26T15:40:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.934+0000 7f64b6e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b015bee0 con 0x7f64b00b0f60 2024-05-26T15:40:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.934+0000 7f64b6e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00b0ba0 con 0x7f64b015f0c0 2024-05-26T15:40:20.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.935+0000 7f64b5000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f64b00b0f60 0x7f64b015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:20.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.935+0000 7f64b5000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f64b00b0f60 0x7f64b015eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43078/0 (socket says 172.21.15.8:43078) 2024-05-26T15:40:20.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.935+0000 7f64b5000640 1 -- 172.21.15.8:0/24654281 learned_addr learned my addr 172.21.15.8:0/24654281 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:20.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.935+0000 7f64b6400640 1 --2- 172.21.15.8:0/24654281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f64b015f0c0 0x7f64b00c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:20.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.935+0000 7f64b5000640 1 -- 172.21.15.8:0/24654281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f64b015f0c0 msgr2=0x7f64b00c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:20.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.935+0000 7f64b5000640 1 --2- 172.21.15.8:0/24654281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f64b015f0c0 0x7f64b00c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:20.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.935+0000 7f64b5000640 1 -- 172.21.15.8:0/24654281 >> v1:172.21.15.47:6789/0 conn(0x7f64b0154f50 legacy=0x7f64b015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:20.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.935+0000 7f64b5000640 1 -- 172.21.15.8:0/24654281 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b015b920 con 0x7f64b00b0f60 2024-05-26T15:40:20.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.936+0000 7f64b5000640 1 --2- 172.21.15.8:0/24654281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b00b0f60 0x7f64b015eb80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f64a40098a0 tx=0x7f64a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee521784e5e1054 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:20.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.937+0000 7f64afe00640 1 -- 172.21.15.8:0/24654281 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4032440 con 0x7f64b00b0f60 2024-05-26T15:40:20.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.937+0000 7f64afe00640 1 -- 172.21.15.8:0/24654281 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a40325a0 con 0x7f64b00b0f60 2024-05-26T15:40:20.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.937+0000 7f64afe00640 1 -- 172.21.15.8:0/24654281 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4032930 con 0x7f64b00b0f60 2024-05-26T15:40:20.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.938+0000 7f64b6e00640 1 -- 172.21.15.8:0/24654281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b00b0f60 msgr2=0x7f64b015eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:20.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.938+0000 7f64b6e00640 1 --2- 172.21.15.8:0/24654281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b00b0f60 0x7f64b015eb80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f64a40098a0 tx=0x7f64a402a1a0 comp rx=0 tx=0).stop 2024-05-26T15:40:20.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.938+0000 7f64b6e00640 1 -- 172.21.15.8:0/24654281 shutdown_connections 2024-05-26T15:40:20.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.938+0000 7f64b6e00640 1 --2- 172.21.15.8:0/24654281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f64b015f0c0 0x7f64b00c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:20.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.938+0000 7f64b6e00640 1 --2- 172.21.15.8:0/24654281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b00b0f60 0x7f64b015eb80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:20.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.938+0000 7f64b6e00640 1 -- 172.21.15.8:0/24654281 >> 172.21.15.8:0/24654281 conn(0x7f64b0070480 msgr2=0x7f64b0070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:20.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.938+0000 7f64b6e00640 1 -- 172.21.15.8:0/24654281 shutdown_connections 2024-05-26T15:40:20.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.938+0000 7f64b6e00640 1 -- 172.21.15.8:0/24654281 wait complete. 2024-05-26T15:40:20.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.940+0000 7f64b6e00640 1 Processor -- start 2024-05-26T15:40:20.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.940+0000 7f64b6e00640 1 -- start start 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64b00b0f60 0x7f64b0150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f64b0154f50 0x7f64b00c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b015f0c0 0x7f64b01598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00a74b0 con 0x7f64b015f0c0 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00c6c20 con 0x7f64b00b0f60 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00c6f00 con 0x7f64b0154f50 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b015f0c0 0x7f64b01598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b015f0c0 0x7f64b01598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43080/0 (socket says 172.21.15.8:43080) 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6400640 1 -- 172.21.15.8:0/869430141 learned_addr learned my addr 172.21.15.8:0/869430141 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b5a00640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64b00b0f60 0x7f64b0150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:20.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b5000640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f64b0154f50 0x7f64b00c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6400640 1 -- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f64b0154f50 msgr2=0x7f64b00c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6400640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f64b0154f50 0x7f64b00c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6400640 1 -- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64b00b0f60 msgr2=0x7f64b0150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6400640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64b00b0f60 0x7f64b0150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.942+0000 7f64b6400640 1 -- 172.21.15.8:0/869430141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a40094d0 con 0x7f64b015f0c0 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.943+0000 7f64b6400640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b015f0c0 0x7f64b01598c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f64a8007e60 tx=0x7f64a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.943+0000 7f64ad600640 1 -- 172.21.15.8:0/869430141 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8014420 con 0x7f64b015f0c0 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.943+0000 7f64ad600640 1 -- 172.21.15.8:0/869430141 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a80145a0 con 0x7f64b015f0c0 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.943+0000 7f64ad600640 1 -- 172.21.15.8:0/869430141 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8014950 con 0x7f64b015f0c0 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.943+0000 7f64b6e00640 1 -- 172.21.15.8:0/869430141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b00c71e0 con 0x7f64b015f0c0 2024-05-26T15:40:20.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.943+0000 7f64b6e00640 1 -- 172.21.15.8:0/869430141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b00c77a0 con 0x7f64b015f0c0 2024-05-26T15:40:20.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.944+0000 7f64b6e00640 1 -- 172.21.15.8:0/869430141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b004e280 con 0x7f64b015f0c0 2024-05-26T15:40:20.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.945+0000 7f64ad600640 1 -- 172.21.15.8:0/869430141 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f64a8014ab0 con 0x7f64b015f0c0 2024-05-26T15:40:20.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.946+0000 7f64ad600640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f649006ac00 0x7f649006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:20.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.946+0000 7f64ad600640 1 -- 172.21.15.8:0/869430141 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f64a808a170 con 0x7f64b015f0c0 2024-05-26T15:40:20.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.947+0000 7f64b5a00640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f649006ac00 0x7f649006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:20.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.948+0000 7f64b5a00640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f649006ac00 0x7f649006d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f649c004ea0 tx=0x7f649c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:20.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:20.952+0000 7f64ad600640 1 -- 172.21.15.8:0/869430141 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f64a8054e40 con 0x7f64b015f0c0 2024-05-26T15:40:21.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.193+0000 7f64b6e00640 1 -- 172.21.15.8:0/869430141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64b00714a0 con 0x7f64b015f0c0 2024-05-26T15:40:21.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.194+0000 7f64ad600640 1 -- 172.21.15.8:0/869430141 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f64a8058460 con 0x7f64b015f0c0 2024-05-26T15:40:21.192 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-26T15:40:21.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.196+0000 7f64b6e00640 1 -- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f649006ac00 msgr2=0x7f649006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:21.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.196+0000 7f64b6e00640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f649006ac00 0x7f649006d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f649c004ea0 tx=0x7f649c009040 comp rx=0 tx=0).stop 2024-05-26T15:40:21.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.196+0000 7f64b6e00640 1 -- 172.21.15.8:0/869430141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b015f0c0 msgr2=0x7f64b01598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:21.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.196+0000 7f64b6e00640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b015f0c0 0x7f64b01598c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f64a8007e60 tx=0x7f64a800e4b0 comp rx=0 tx=0).stop 2024-05-26T15:40:21.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.197+0000 7f64b6e00640 1 -- 172.21.15.8:0/869430141 shutdown_connections 2024-05-26T15:40:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.197+0000 7f64b6e00640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64b015f0c0 0x7f64b01598c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.197+0000 7f64b6e00640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f64b0154f50 0x7f64b00c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.197+0000 7f64b6e00640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f649006ac00 0x7f649006d0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.197+0000 7f64b6e00640 1 --2- 172.21.15.8:0/869430141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f64b00b0f60 0x7f64b0150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.197+0000 7f64b6e00640 1 -- 172.21.15.8:0/869430141 >> 172.21.15.8:0/869430141 conn(0x7f64b0070480 msgr2=0x7f64b00c56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.197+0000 7f64b6e00640 1 -- 172.21.15.8:0/869430141 shutdown_connections 2024-05-26T15:40:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:21.197+0000 7f64b6e00640 1 -- 172.21.15.8:0/869430141 wait complete. 2024-05-26T15:40:21.215 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-26T15:40:21.215 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-26T15:40:21.215 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2024-05-26T15:40:21.215 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-26T15:40:21.215 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-26T15:40:21.216 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-26T15:40:21.216 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-26T15:40:21.216 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-26T15:40:21.216 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-26T15:40:21.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:21.216 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2024-05-26T15:40:21.271 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:40:21.271 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:40:21.271 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:40:21.271 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.271 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2024-05-26T15:40:21.271 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.272 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:21.272 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:21.272 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2024-05-26T15:40:21.272 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:21.272 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:21.272 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2024-05-26T15:40:21.272 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-26T15:40:21.272 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:21.272 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2024-05-26T15:40:21.272 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42579sec preferred_lft 42579sec 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether f6:a8:54:01:f3:ce brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.273 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::10c6:16ff:feae:cd5d/64 scope link 2024-05-26T15:40:21.274 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.274 INFO:teuthology.orchestra.run.smithi008.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-26T15:40:21.274 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether f6:a8:54:01:f3:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-26T15:40:21.274 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::f4a8:54ff:fe01:f3ce/64 scope link 2024-05-26T15:40:21.274 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:21.275 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-26T15:40:21.362 INFO:teuthology.orchestra.run.smithi008.stdout:1 2024-05-26T15:40:21.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:21.366 DEBUG:teuthology.orchestra.run.smithi008:> route 2024-05-26T15:40:21.420 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2024-05-26T15:40:21.421 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-26T15:40:21.421 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-26T15:40:21.421 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-26T15:40:21.421 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-26T15:40:21.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:21.422 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:40:21.422 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:40:21.422 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-26T15:40:21.423 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-26T15:40:21.423 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-26T15:40:21.423 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:40:21.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:21.579 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-05-26T15:40:21.631 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-26T15:40:21.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:21.632 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list-id 2024-05-26T15:40:21.684 INFO:teuthology.orchestra.run.smithi008.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-26T15:40:21.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:21.686 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:40:21.686 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:40:21.686 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-26T15:40:21.689 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-26T15:40:21.690 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:40:21.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:21.816 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-26T15:40:21.897 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2024-05-26T15:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-26T15:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 36:f4:35:65:59:90 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-26T15:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-26T15:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.898 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::34f4:35ff:fe65:5990/64 scope link 2024-05-26T15:40:21.899 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:21.902 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-26T15:40:21.994 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:40:21.994 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:40:21.994 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:40:21.994 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.994 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2024-05-26T15:40:21.995 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.995 INFO:teuthology.orchestra.run.smithi008.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-26T15:40:21.995 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 36:f4:35:65:59:90 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-26T15:40:21.995 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-26T15:40:21.995 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.995 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::34f4:35ff:fe65:5990/64 scope link 2024-05-26T15:40:21.995 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:21.999 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-26T15:40:21.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:21.999 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:40:21.999 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:40:21.999 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-26T15:40:21.999 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-26T15:40:22.000 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-26T15:40:22.000 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-26T15:40:22.000 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-26T15:40:22.000 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:40:22.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:22.235 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:40:22.236 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:40:22.236 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.1 up 2024-05-26T15:40:22.236 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set dev brx.1 master ceph-brx 2024-05-26T15:40:22.236 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:40:22.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:40:22.394 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-26T15:40:22.448 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-26T15:40:22.448 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:40:22.449 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-26T15:40:22.501 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-26T15:40:22.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:22.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-26T15:40:22.636 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-26T15:40:22.636 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-26T15:40:22.636 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:40:22.660 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-26T15:40:22.660 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-26T15:40:22.660 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:40:22.660 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:40:22.660 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:40:22.691 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-05-26T15:40:22.691 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-05-26T15:40:22.691 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:40:22.691 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:40:22.691 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:40:22.691 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790" 2024-05-26T15:40:22.692 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790:/ 2024-05-26T15:40:22.692 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=03132396-4584-4cf0-b2e0-b5ae6040045e" will pass to kernel 2024-05-26T15:40:22.694 INFO:teuthology.orchestra.run.smithi008.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-26T15:40:22.694 INFO:teuthology.orchestra.run.smithi008.stdout: You just mounted a file system that supports labels which does not 2024-05-26T15:40:22.694 INFO:teuthology.orchestra.run.smithi008.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-26T15:40:22.694 INFO:teuthology.orchestra.run.smithi008.stdout: applications will generate AVC messages and not be allowed access to 2024-05-26T15:40:22.694 INFO:teuthology.orchestra.run.smithi008.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-26T15:40:22.700 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-26T15:40:22.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:22.700 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-26T15:40:22.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:22.787 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:22.850 INFO:teuthology.orchestra.run.smithi008.stdout:client4589 2024-05-26T15:40:22.851 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:40:22.851 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:22.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:22.909 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:22.971 INFO:teuthology.orchestra.run.smithi008.stdout:client4589 2024-05-26T15:40:22.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:22.972 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:23.031 INFO:teuthology.orchestra.run.smithi008.stdout:client4589 2024-05-26T15:40:23.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:23.032 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/03132396-4584-4cf0-b2e0-b5ae6040045e.client4589/status') 2024-05-26T15:40:23.118 INFO:teuthology.orchestra.run.smithi008.stdout:instance: client.4589 (3)172.21.15.8:0/3764054360 2024-05-26T15:40:23.118 INFO:teuthology.orchestra.run.smithi008.stdout:blocklisted: false 2024-05-26T15:40:23.118 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records in 2024-05-26T15:40:23.118 INFO:teuthology.orchestra.run.smithi008.stderr:0+1 records out 2024-05-26T15:40:23.118 INFO:teuthology.orchestra.run.smithi008.stderr:69 bytes copied, 8.6935e-05 s, 794 kB/s 2024-05-26T15:40:23.122 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-05-26T15:40:23.122 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-26T15:40:23.122 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-26T15:40:23.122 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-26T15:40:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.338+0000 7f296d400640 1 Processor -- start 2024-05-26T15:40:23.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.339+0000 7f296d400640 1 -- start start 2024-05-26T15:40:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.340+0000 7f296d400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f296815cb80 0x7f29680cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f296d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f296815cf60 0x7f2968160920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f296d400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29681617e0 con 0x7f2968160e60 2024-05-26T15:40:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f296d400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29681612b0 con 0x7f296815cf60 2024-05-26T15:40:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f296d400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29680cce00 con 0x7f296815cb80 2024-05-26T15:40:23.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f2965e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f296815cf60 0x7f2968160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:23.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f2965e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f296815cf60 0x7f2968160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43084/0 (socket says 172.21.15.8:43084) 2024-05-26T15:40:23.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f2965e00640 1 -- 172.21.15.8:0/3848561715 learned_addr learned my addr 172.21.15.8:0/3848561715 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:23.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f2966800640 1 --2- 172.21.15.8:0/3848561715 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f296815cb80 0x7f29680cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:23.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f2965e00640 1 -- 172.21.15.8:0/3848561715 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f296815cb80 msgr2=0x7f29680cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:23.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f2965e00640 1 --2- 172.21.15.8:0/3848561715 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f296815cb80 0x7f29680cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:23.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f2965e00640 1 -- 172.21.15.8:0/3848561715 >> v1:172.21.15.47:6789/0 conn(0x7f2968160e60 legacy=0x7f29680cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:23.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.341+0000 7f2965e00640 1 -- 172.21.15.8:0/3848561715 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2968161500 con 0x7f296815cf60 2024-05-26T15:40:23.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.343+0000 7f2965e00640 1 --2- 172.21.15.8:0/3848561715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 0x7f2968160920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2950009870 tx=0x7f295002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7611da9b460131 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:23.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.343+0000 7f2965400640 1 -- 172.21.15.8:0/3848561715 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295002ae90 con 0x7f296815cf60 2024-05-26T15:40:23.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.343+0000 7f2965400640 1 -- 172.21.15.8:0/3848561715 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2950032440 con 0x7f296815cf60 2024-05-26T15:40:23.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.343+0000 7f2965400640 1 -- 172.21.15.8:0/3848561715 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29500327d0 con 0x7f296815cf60 2024-05-26T15:40:23.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.344+0000 7f296d400640 1 -- 172.21.15.8:0/3848561715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 msgr2=0x7f2968160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:23.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.344+0000 7f296d400640 1 --2- 172.21.15.8:0/3848561715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 0x7f2968160920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2950009870 tx=0x7f295002a180 comp rx=0 tx=0).stop 2024-05-26T15:40:23.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.344+0000 7f296d400640 1 -- 172.21.15.8:0/3848561715 shutdown_connections 2024-05-26T15:40:23.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.344+0000 7f296d400640 1 --2- 172.21.15.8:0/3848561715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 0x7f2968160920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:23.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.344+0000 7f296d400640 1 --2- 172.21.15.8:0/3848561715 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f296815cb80 0x7f29680cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:23.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.344+0000 7f296d400640 1 -- 172.21.15.8:0/3848561715 >> 172.21.15.8:0/3848561715 conn(0x7f29680b0570 msgr2=0x7f29680b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:23.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.344+0000 7f296d400640 1 -- 172.21.15.8:0/3848561715 shutdown_connections 2024-05-26T15:40:23.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.344+0000 7f296d400640 1 -- 172.21.15.8:0/3848561715 wait complete. 2024-05-26T15:40:23.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.346+0000 7f296d400640 1 Processor -- start 2024-05-26T15:40:23.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.346+0000 7f296d400640 1 -- start start 2024-05-26T15:40:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f296d400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f296815cb80 0x7f296814e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f296d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 0x7f29680afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f296d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2968160e60 0x7f29680aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f296d400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968152aa0 con 0x7f296815cf60 2024-05-26T15:40:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f296d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2968152cf0 con 0x7f2968160e60 2024-05-26T15:40:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f296d400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2968152fd0 con 0x7f296815cb80 2024-05-26T15:40:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f2965e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 0x7f29680afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f2965e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 0x7f29680afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43098/0 (socket says 172.21.15.8:43098) 2024-05-26T15:40:23.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f2965e00640 1 -- 172.21.15.8:0/2922311615 learned_addr learned my addr 172.21.15.8:0/2922311615 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f2966800640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f296815cb80 0x7f296814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.347+0000 7f2967200640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2968160e60 0x7f29680aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f2965e00640 1 -- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f296815cb80 msgr2=0x7f296814e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f2965e00640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f296815cb80 0x7f296814e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f2965e00640 1 -- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2968160e60 msgr2=0x7f29680aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f2965e00640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2968160e60 0x7f29680aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:23.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f2965e00640 1 -- 172.21.15.8:0/2922311615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500094d0 con 0x7f296815cf60 2024-05-26T15:40:23.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f2965e00640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 0x7f29680afa20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2950009870 tx=0x7f29500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:23.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f295ea00640 1 -- 172.21.15.8:0/2922311615 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950030850 con 0x7f296815cf60 2024-05-26T15:40:23.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f295ea00640 1 -- 172.21.15.8:0/2922311615 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500309b0 con 0x7f296815cf60 2024-05-26T15:40:23.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f295ea00640 1 -- 172.21.15.8:0/2922311615 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950030d60 con 0x7f296815cf60 2024-05-26T15:40:23.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f296d400640 1 -- 172.21.15.8:0/2922311615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29681532b0 con 0x7f296815cf60 2024-05-26T15:40:23.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.348+0000 7f296d400640 1 -- 172.21.15.8:0/2922311615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2968157420 con 0x7f296815cf60 2024-05-26T15:40:23.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.350+0000 7f296d400640 1 -- 172.21.15.8:0/2922311615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29680681d0 con 0x7f296815cf60 2024-05-26T15:40:23.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.350+0000 7f295ea00640 1 -- 172.21.15.8:0/2922311615 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2950039040 con 0x7f296815cf60 2024-05-26T15:40:23.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.351+0000 7f295ea00640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f294406ac00 0x7f294406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:23.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.351+0000 7f295ea00640 1 -- 172.21.15.8:0/2922311615 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f29500aa260 con 0x7f296815cf60 2024-05-26T15:40:23.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.352+0000 7f2966800640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f294406ac00 0x7f294406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:23.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.353+0000 7f2966800640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f294406ac00 0x7f294406d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2958006fd0 tx=0x7f2958008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:23.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.356+0000 7f295ea00640 1 -- 172.21.15.8:0/2922311615 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2950075170 con 0x7f296815cf60 2024-05-26T15:40:23.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.598+0000 7f296d400640 1 -- 172.21.15.8:0/2922311615 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2968153110 con 0x7f296815cf60 2024-05-26T15:40:23.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.599+0000 7f295ea00640 1 -- 172.21.15.8:0/2922311615 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2968153110 con 0x7f296815cf60 2024-05-26T15:40:23.597 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-26T15:40:23.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.601+0000 7f296d400640 1 -- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f294406ac00 msgr2=0x7f294406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:23.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.601+0000 7f296d400640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f294406ac00 0x7f294406d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2958006fd0 tx=0x7f2958008040 comp rx=0 tx=0).stop 2024-05-26T15:40:23.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.601+0000 7f296d400640 1 -- 172.21.15.8:0/2922311615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 msgr2=0x7f29680afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:23.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.601+0000 7f296d400640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 0x7f29680afa20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2950009870 tx=0x7f29500046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:23.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.601+0000 7f296d400640 1 -- 172.21.15.8:0/2922311615 shutdown_connections 2024-05-26T15:40:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.601+0000 7f296d400640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f294406ac00 0x7f294406d0c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.601+0000 7f296d400640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2968160e60 0x7f29680aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.601+0000 7f296d400640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f296815cf60 0x7f29680afa20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.601+0000 7f296d400640 1 --2- 172.21.15.8:0/2922311615 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f296815cb80 0x7f296814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.601+0000 7f296d400640 1 -- 172.21.15.8:0/2922311615 >> 172.21.15.8:0/2922311615 conn(0x7f29680b0570 msgr2=0x7f29681563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.602+0000 7f296d400640 1 -- 172.21.15.8:0/2922311615 shutdown_connections 2024-05-26T15:40:23.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:23.602+0000 7f296d400640 1 -- 172.21.15.8:0/2922311615 wait complete. 2024-05-26T15:40:23.619 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-26T15:40:23.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-26T15:40:23.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-05-26T15:40:23.620 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-26T15:40:23.620 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-26T15:40:23.620 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-26T15:40:23.620 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-26T15:40:23.620 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-26T15:40:23.620 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-26T15:40:23.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:23.620 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-05-26T15:40:23.681 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:40:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:40:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:40:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42563sec preferred_lft 42563sec 2024-05-26T15:40:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-05-26T15:40:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:23.683 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-05-26T15:40:23.684 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-26T15:40:23.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:23.684 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-26T15:40:23.684 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-26T15:40:23.684 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-05-26T15:40:23.684 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-05-26T15:40:23.684 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-05-26T15:40:23.684 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-26T15:40:23.684 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-26T15:40:24.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:24.106 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-26T15:40:24.180 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-26T15:40:24.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:24.184 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-05-26T15:40:24.243 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-05-26T15:40:24.243 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-26T15:40:24.243 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-26T15:40:24.244 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-26T15:40:24.244 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-26T15:40:24.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:24.245 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-26T15:40:24.245 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-26T15:40:24.245 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-26T15:40:24.245 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-26T15:40:24.245 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-26T15:40:24.245 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-26T15:40:25.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:25.021 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-26T15:40:25.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:25.070 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-05-26T15:40:25.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:25.114 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-26T15:40:25.114 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-26T15:40:25.115 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-26T15:40:25.115 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-26T15:40:25.115 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-26T15:40:25.271 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-26T15:40:25.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:25.271 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-26T15:40:25.271 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-26T15:40:25.272 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-26T15:40:25.272 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-26T15:40:25.272 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-26T15:40:25.272 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-26T15:40:25.272 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-26T15:40:25.272 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-26T15:40:25.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:25.498 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-26T15:40:25.498 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-26T15:40:25.498 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-05-26T15:40:25.499 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-05-26T15:40:25.499 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-26T15:40:25.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:40:25.631 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-26T15:40:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-26T15:40:25.676 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:40:25.676 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-26T15:40:25.763 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-26T15:40:25.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:25.764 DEBUG:teuthology.orchestra.run.smithi047:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-26T15:40:25.946 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-26T15:40:25.946 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-26T15:40:25.946 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-05-26T15:40:26.615 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-26T15:40:26.616 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-26T15:40:26.616 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-05-26T15:40:26.616 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:40:26.616 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:40:26.657 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-05-26T15:40:26.657 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-05-26T15:40:26.657 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-05-26T15:40:26.657 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:40:26.657 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:40:26.657 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790" 2024-05-26T15:40:26.657 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790:/ 2024-05-26T15:40:26.657 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=03132396-4584-4cf0-b2e0-b5ae6040045e" will pass to kernel 2024-05-26T15:40:26.663 INFO:teuthology.orchestra.run.smithi047.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-26T15:40:26.663 INFO:teuthology.orchestra.run.smithi047.stdout: You just mounted a file system that supports labels which does not 2024-05-26T15:40:26.664 INFO:teuthology.orchestra.run.smithi047.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-26T15:40:26.664 INFO:teuthology.orchestra.run.smithi047.stdout: applications will generate AVC messages and not be allowed access to 2024-05-26T15:40:26.664 INFO:teuthology.orchestra.run.smithi047.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-26T15:40:26.671 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-26T15:40:26.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:26.672 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-26T15:40:26.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:26.763 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:26.826 INFO:teuthology.orchestra.run.smithi047.stdout:client4839 2024-05-26T15:40:26.826 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:40:26.826 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:26.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:26.884 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:26.945 INFO:teuthology.orchestra.run.smithi047.stdout:client4839 2024-05-26T15:40:26.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:26.946 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:27.006 INFO:teuthology.orchestra.run.smithi047.stdout:client4839 2024-05-26T15:40:27.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:27.006 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/03132396-4584-4cf0-b2e0-b5ae6040045e.client4839/status') 2024-05-26T15:40:27.090 INFO:teuthology.orchestra.run.smithi047.stdout:instance: client.4839 (3)172.21.15.47:0/3807133640 2024-05-26T15:40:27.090 INFO:teuthology.orchestra.run.smithi047.stdout:blocklisted: false 2024-05-26T15:40:27.091 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records in 2024-05-26T15:40:27.091 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records out 2024-05-26T15:40:27.091 INFO:teuthology.orchestra.run.smithi047.stderr:70 bytes copied, 8.6934e-05 s, 805 kB/s 2024-05-26T15:40:27.094 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-05-26T15:40:27.095 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-26T15:40:27.095 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-26T15:40:27.095 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-26T15:40:27.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.321+0000 7fd046c00640 1 Processor -- start 2024-05-26T15:40:27.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.322+0000 7fd046c00640 1 -- start start 2024-05-26T15:40:27.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.323+0000 7fd046c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd040161030 0x7fd0400cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:27.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.323+0000 7fd046c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 0x7fd0400cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:27.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.323+0000 7fd046c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0401617e0 con 0x7fd04015cb80 2024-05-26T15:40:27.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.323+0000 7fd046c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0400cce00 con 0x7fd040161030 2024-05-26T15:40:27.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.323+0000 7fd046c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd040161500 con 0x7fd04015cf60 2024-05-26T15:40:27.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.324+0000 7fd03f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd040161030 0x7fd0400cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:27.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.324+0000 7fd03f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd040161030 0x7fd0400cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43114/0 (socket says 172.21.15.8:43114) 2024-05-26T15:40:27.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.324+0000 7fd03f400640 1 -- 172.21.15.8:0/1190869466 learned_addr learned my addr 172.21.15.8:0/1190869466 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:27.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.324+0000 7fd044c00640 1 --2- 172.21.15.8:0/1190869466 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 0x7fd0400cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:27.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.324+0000 7fd03f400640 1 -- 172.21.15.8:0/1190869466 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 msgr2=0x7fd0400cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:27.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.324+0000 7fd03f400640 1 --2- 172.21.15.8:0/1190869466 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 0x7fd0400cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:27.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.324+0000 7fd03f400640 1 -- 172.21.15.8:0/1190869466 >> v1:172.21.15.47:6789/0 conn(0x7fd04015cb80 legacy=0x7fd040160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:27.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.324+0000 7fd03f400640 1 -- 172.21.15.8:0/1190869466 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0400cd470 con 0x7fd040161030 2024-05-26T15:40:27.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.324+0000 7fd044c00640 1 --2- 172.21.15.8:0/1190869466 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 0x7fd0400cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:27.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.326+0000 7fd03f400640 1 --2- 172.21.15.8:0/1190869466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 0x7fd0400cdf50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd028009870 tx=0x7fd02802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c235db8db6af18 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:27.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.326+0000 7fd03ea00640 1 -- 172.21.15.8:0/1190869466 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02802ae90 con 0x7fd040161030 2024-05-26T15:40:27.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.326+0000 7fd03ea00640 1 -- 172.21.15.8:0/1190869466 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd028032440 con 0x7fd040161030 2024-05-26T15:40:27.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.326+0000 7fd03ea00640 1 -- 172.21.15.8:0/1190869466 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0280327d0 con 0x7fd040161030 2024-05-26T15:40:27.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.327+0000 7fd046c00640 1 -- 172.21.15.8:0/1190869466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 msgr2=0x7fd0400cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:27.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.327+0000 7fd046c00640 1 --2- 172.21.15.8:0/1190869466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 0x7fd0400cdf50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd028009870 tx=0x7fd02802a180 comp rx=0 tx=0).stop 2024-05-26T15:40:27.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.327+0000 7fd046c00640 1 -- 172.21.15.8:0/1190869466 shutdown_connections 2024-05-26T15:40:27.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.327+0000 7fd046c00640 1 --2- 172.21.15.8:0/1190869466 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 0x7fd0400cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:27.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.327+0000 7fd046c00640 1 --2- 172.21.15.8:0/1190869466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 0x7fd0400cdf50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:27.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.327+0000 7fd046c00640 1 -- 172.21.15.8:0/1190869466 >> 172.21.15.8:0/1190869466 conn(0x7fd0400b0570 msgr2=0x7fd0400b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:27.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.327+0000 7fd046c00640 1 -- 172.21.15.8:0/1190869466 shutdown_connections 2024-05-26T15:40:27.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.327+0000 7fd046c00640 1 -- 172.21.15.8:0/1190869466 wait complete. 2024-05-26T15:40:27.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.329+0000 7fd046c00640 1 Processor -- start 2024-05-26T15:40:27.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.329+0000 7fd046c00640 1 -- start start 2024-05-26T15:40:27.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd046c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd04015cb80 0x7fd040152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:27.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd046c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 0x7fd040152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:27.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd046c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 0x7fd0400af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:27.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd046c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400b0430 con 0x7fd040161030 2024-05-26T15:40:27.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd046c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd040152780 con 0x7fd04015cb80 2024-05-26T15:40:27.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd046c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0400afe70 con 0x7fd04015cf60 2024-05-26T15:40:27.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd044c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 0x7fd0400af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:27.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd044c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 0x7fd0400af3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43122/0 (socket says 172.21.15.8:43122) 2024-05-26T15:40:27.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd044c00640 1 -- 172.21.15.8:0/558173770 learned_addr learned my addr 172.21.15.8:0/558173770 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:27.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd03f400640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 0x7fd040152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:27.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd03fe00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd04015cb80 0x7fd040152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd044c00640 1 -- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 msgr2=0x7fd040152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd044c00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 0x7fd040152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.330+0000 7fd044c00640 1 -- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd04015cb80 msgr2=0x7fd040152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.331+0000 7fd044c00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd04015cb80 0x7fd040152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.331+0000 7fd044c00640 1 -- 172.21.15.8:0/558173770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0280094d0 con 0x7fd040161030 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.331+0000 7fd044c00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 0x7fd0400af3b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd03800ce80 tx=0x7fd03800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.331+0000 7fd037e00640 1 -- 172.21.15.8:0/558173770 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03800d840 con 0x7fd040161030 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.331+0000 7fd037e00640 1 -- 172.21.15.8:0/558173770 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03800d9e0 con 0x7fd040161030 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.331+0000 7fd046c00640 1 -- 172.21.15.8:0/558173770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0400b0150 con 0x7fd040161030 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.331+0000 7fd037e00640 1 -- 172.21.15.8:0/558173770 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03800dd90 con 0x7fd040161030 2024-05-26T15:40:27.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.331+0000 7fd046c00640 1 -- 172.21.15.8:0/558173770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04015a5f0 con 0x7fd040161030 2024-05-26T15:40:27.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.332+0000 7fd046c00640 1 -- 172.21.15.8:0/558173770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04015a170 con 0x7fd040161030 2024-05-26T15:40:27.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.333+0000 7fd037e00640 1 -- 172.21.15.8:0/558173770 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd038015440 con 0x7fd040161030 2024-05-26T15:40:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.334+0000 7fd037e00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd01c06ac00 0x7fd01c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.334+0000 7fd037e00640 1 -- 172.21.15.8:0/558173770 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd03808a060 con 0x7fd040161030 2024-05-26T15:40:27.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.335+0000 7fd03fe00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd01c06ac00 0x7fd01c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:27.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.336+0000 7fd03fe00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd01c06ac00 0x7fd01c06d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd04006eaa0 tx=0x7fd030009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:27.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.339+0000 7fd037e00640 1 -- 172.21.15.8:0/558173770 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd0380bd900 con 0x7fd040161030 2024-05-26T15:40:27.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.579+0000 7fd046c00640 1 -- 172.21.15.8:0/558173770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd04015a810 con 0x7fd040161030 2024-05-26T15:40:27.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.580+0000 7fd037e00640 1 -- 172.21.15.8:0/558173770 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd03801a020 con 0x7fd040161030 2024-05-26T15:40:27.579 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-26T15:40:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 -- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd01c06ac00 msgr2=0x7fd01c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd01c06ac00 0x7fd01c06d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd04006eaa0 tx=0x7fd030009040 comp rx=0 tx=0).stop 2024-05-26T15:40:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 -- 172.21.15.8:0/558173770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 msgr2=0x7fd0400af3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 0x7fd0400af3b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd03800ce80 tx=0x7fd03800a710 comp rx=0 tx=0).stop 2024-05-26T15:40:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 -- 172.21.15.8:0/558173770 shutdown_connections 2024-05-26T15:40:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd040161030 0x7fd0400af3b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd04015cf60 0x7fd040152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd01c06ac00 0x7fd01c06d0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:27.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 --2- 172.21.15.8:0/558173770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd04015cb80 0x7fd040152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:27.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 -- 172.21.15.8:0/558173770 >> 172.21.15.8:0/558173770 conn(0x7fd0400b0570 msgr2=0x7fd0400cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:27.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 -- 172.21.15.8:0/558173770 shutdown_connections 2024-05-26T15:40:27.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:27.583+0000 7fd046c00640 1 -- 172.21.15.8:0/558173770 wait complete. 2024-05-26T15:40:27.601 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-26T15:40:27.601 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-26T15:40:27.601 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-05-26T15:40:27.601 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-26T15:40:27.601 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-26T15:40:27.601 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-26T15:40:27.602 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-26T15:40:27.602 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-26T15:40:27.602 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-26T15:40:27.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:27.602 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-05-26T15:40:27.663 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:40:27.663 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:40:27.663 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:40:27.663 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:27.663 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-26T15:40:27.663 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:27.663 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:27.663 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:27.663 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42559sec preferred_lft 42559sec 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link noprefixroute 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:27.664 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-05-26T15:40:27.665 INFO:teuthology.orchestra.run.smithi047.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-26T15:40:27.665 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether d2:f0:8b:57:7d:4c brd ff:ff:ff:ff:ff:ff 2024-05-26T15:40:27.665 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-26T15:40:27.665 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:27.665 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::d864:28ff:fe7c:383c/64 scope link 2024-05-26T15:40:27.665 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:27.665 INFO:teuthology.orchestra.run.smithi047.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-26T15:40:27.665 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether d2:f0:8b:57:7d:4c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-26T15:40:27.665 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::d0f0:8bff:fe57:7d4c/64 scope link 2024-05-26T15:40:27.665 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:27.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:27.667 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-26T15:40:27.749 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-26T15:40:27.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:27.754 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-05-26T15:40:27.811 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-05-26T15:40:27.813 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-26T15:40:27.813 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-26T15:40:27.813 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-26T15:40:27.814 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-26T15:40:27.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:27.814 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-26T15:40:27.814 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-26T15:40:27.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-26T15:40:27.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-26T15:40:27.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-26T15:40:27.814 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-26T15:40:27.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:27.970 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-26T15:40:28.024 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-26T15:40:28.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:28.025 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-05-26T15:40:28.079 INFO:teuthology.orchestra.run.smithi047.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-26T15:40:28.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:28.080 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-26T15:40:28.080 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-26T15:40:28.081 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-26T15:40:28.081 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-26T15:40:28.081 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-26T15:40:28.179 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:40:28.188 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:40:28.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:28.205 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-26T15:40:28.320 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:40:28.320 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:40:28.320 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:40:28.320 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:28.320 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-26T15:40:28.320 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:28.321 INFO:teuthology.orchestra.run.smithi047.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-26T15:40:28.321 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 66:3d:76:82:6e:f3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-26T15:40:28.321 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-26T15:40:28.321 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:28.321 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::643d:76ff:fe82:6ef3/64 scope link 2024-05-26T15:40:28.321 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:28.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:28.324 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-26T15:40:28.461 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 66:3d:76:82:6e:f3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::643d:76ff:fe82:6ef3/64 scope link 2024-05-26T15:40:28.462 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:40:28.466 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-26T15:40:28.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:28.466 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-26T15:40:28.466 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-26T15:40:28.466 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-26T15:40:28.466 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-26T15:40:28.466 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-26T15:40:28.466 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-26T15:40:28.466 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-26T15:40:28.467 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-26T15:40:28.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:28.702 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-26T15:40:28.702 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-26T15:40:28.702 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.1 up 2024-05-26T15:40:28.702 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.1 master ceph-brx 2024-05-26T15:40:28.702 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-26T15:40:28.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:40:28.856 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-26T15:40:28.906 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-26T15:40:28.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:40:28.907 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-26T15:40:28.961 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-26T15:40:28.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:28.962 DEBUG:teuthology.orchestra.run.smithi047:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-26T15:40:29.093 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-26T15:40:29.093 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-26T15:40:29.093 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-05-26T15:40:29.115 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-26T15:40:29.116 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-26T15:40:29.116 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-05-26T15:40:29.116 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:40:29.116 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:40:29.142 INFO:teuthology.orchestra.run.smithi047.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-05-26T15:40:29.142 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-05-26T15:40:29.142 INFO:teuthology.orchestra.run.smithi047.stdout:invalid new device string format 2024-05-26T15:40:29.142 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:40:29.142 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:40:29.142 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790" 2024-05-26T15:40:29.142 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790:/ 2024-05-26T15:40:29.142 INFO:teuthology.orchestra.run.smithi047.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=03132396-4584-4cf0-b2e0-b5ae6040045e" will pass to kernel 2024-05-26T15:40:29.144 INFO:teuthology.orchestra.run.smithi047.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-26T15:40:29.144 INFO:teuthology.orchestra.run.smithi047.stdout: You just mounted a file system that supports labels which does not 2024-05-26T15:40:29.144 INFO:teuthology.orchestra.run.smithi047.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-26T15:40:29.144 INFO:teuthology.orchestra.run.smithi047.stdout: applications will generate AVC messages and not be allowed access to 2024-05-26T15:40:29.144 INFO:teuthology.orchestra.run.smithi047.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-26T15:40:29.148 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-26T15:40:29.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:29.148 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-26T15:40:29.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:29.227 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:29.284 INFO:teuthology.orchestra.run.smithi047.stdout:client4717 2024-05-26T15:40:29.284 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:40:29.284 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:29.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:29.339 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:29.397 INFO:teuthology.orchestra.run.smithi047.stdout:client4717 2024-05-26T15:40:29.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:29.397 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:40:29.456 INFO:teuthology.orchestra.run.smithi047.stdout:client4717 2024-05-26T15:40:29.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:29.457 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/03132396-4584-4cf0-b2e0-b5ae6040045e.client4717/status') 2024-05-26T15:40:29.539 INFO:teuthology.orchestra.run.smithi047.stdout:instance: client.4717 (3)192.168.0.2:0/63626858 2024-05-26T15:40:29.539 INFO:teuthology.orchestra.run.smithi047.stdout:blocklisted: false 2024-05-26T15:40:29.539 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records in 2024-05-26T15:40:29.540 INFO:teuthology.orchestra.run.smithi047.stderr:0+1 records out 2024-05-26T15:40:29.540 INFO:teuthology.orchestra.run.smithi047.stderr:67 bytes copied, 0.000113295 s, 591 kB/s 2024-05-26T15:40:29.543 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-26T15:40:29.559 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:29.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.775+0000 7fabd7000640 1 Processor -- start 2024-05-26T15:40:29.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.775+0000 7fabd7000640 1 -- start start 2024-05-26T15:40:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.777+0000 7fabd7000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 0x7fabd00cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.777+0000 7fabd7000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fabd00b8720 0x7fabd00cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.777+0000 7fabd7000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00b7eb0 con 0x7fabd00d1310 2024-05-26T15:40:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.777+0000 7fabd7000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd00d0ef0 con 0x7fabd00b8720 2024-05-26T15:40:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.777+0000 7fabd7000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd01604b0 con 0x7fabd01600d0 2024-05-26T15:40:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.777+0000 7fabd5200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fabd00b8720 0x7fabd00cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.777+0000 7fabd5200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fabd00b8720 0x7fabd00cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43138/0 (socket says 172.21.15.8:43138) 2024-05-26T15:40:29.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.777+0000 7fabd5200640 1 -- 172.21.15.8:0/78841309 learned_addr learned my addr 172.21.15.8:0/78841309 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.778+0000 7fabd5c00640 1 --2- 172.21.15.8:0/78841309 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 0x7fabd00cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.778+0000 7fabd5200640 1 -- 172.21.15.8:0/78841309 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 msgr2=0x7fabd00cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.778+0000 7fabd5200640 1 --2- 172.21.15.8:0/78841309 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 0x7fabd00cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.778+0000 7fabd5200640 1 -- 172.21.15.8:0/78841309 >> v1:172.21.15.47:6789/0 conn(0x7fabd00d1310 legacy=0x7fabd00d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.778+0000 7fabd5200640 1 -- 172.21.15.8:0/78841309 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00b7610 con 0x7fabd00b8720 2024-05-26T15:40:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.778+0000 7fabd5c00640 1 --2- 172.21.15.8:0/78841309 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 0x7fabd00cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:29.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.779+0000 7fabd5200640 1 --2- 172.21.15.8:0/78841309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00b8720 0x7fabd00cfed0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009870 tx=0x7fabbc02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2dc8af7eedf8649 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:29.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.779+0000 7fabcfe00640 1 -- 172.21.15.8:0/78841309 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc032440 con 0x7fabd00b8720 2024-05-26T15:40:29.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.779+0000 7fabcfe00640 1 -- 172.21.15.8:0/78841309 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc0325a0 con 0x7fabd00b8720 2024-05-26T15:40:29.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.779+0000 7fabcfe00640 1 -- 172.21.15.8:0/78841309 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc032930 con 0x7fabd00b8720 2024-05-26T15:40:29.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.780+0000 7fabd7000640 1 -- 172.21.15.8:0/78841309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00b8720 msgr2=0x7fabd00cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:29.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.780+0000 7fabd7000640 1 --2- 172.21.15.8:0/78841309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00b8720 0x7fabd00cfed0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009870 tx=0x7fabbc02a200 comp rx=0 tx=0).stop 2024-05-26T15:40:29.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.780+0000 7fabd7000640 1 -- 172.21.15.8:0/78841309 shutdown_connections 2024-05-26T15:40:29.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.780+0000 7fabd7000640 1 --2- 172.21.15.8:0/78841309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00b8720 0x7fabd00cfed0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:29.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.780+0000 7fabd7000640 1 --2- 172.21.15.8:0/78841309 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 0x7fabd00cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:29.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.780+0000 7fabd7000640 1 -- 172.21.15.8:0/78841309 >> 172.21.15.8:0/78841309 conn(0x7fabd006b750 msgr2=0x7fabd006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:29.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.780+0000 7fabd7000640 1 -- 172.21.15.8:0/78841309 shutdown_connections 2024-05-26T15:40:29.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.780+0000 7fabd7000640 1 -- 172.21.15.8:0/78841309 wait complete. 2024-05-26T15:40:29.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.782+0000 7fabd7000640 1 Processor -- start 2024-05-26T15:40:29.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.782+0000 7fabd7000640 1 -- start start 2024-05-26T15:40:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.783+0000 7fabd7000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabd00b8720 0x7fabd00b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.783+0000 7fabd7000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00d1310 0x7fabd01f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.783+0000 7fabd7000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 0x7fabd0156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.783+0000 7fabd7000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0156a60 con 0x7fabd00d1310 2024-05-26T15:40:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.783+0000 7fabd7000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0156cc0 con 0x7fabd00b8720 2024-05-26T15:40:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.783+0000 7fabd7000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0156fa0 con 0x7fabd01600d0 2024-05-26T15:40:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.783+0000 7fabd5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00d1310 0x7fabd01f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.783+0000 7fabd5200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00d1310 0x7fabd01f3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43144/0 (socket says 172.21.15.8:43144) 2024-05-26T15:40:29.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.783+0000 7fabd5200640 1 -- 172.21.15.8:0/1956779730 learned_addr learned my addr 172.21.15.8:0/1956779730 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:29.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.784+0000 7fabd5c00640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabd00b8720 0x7fabd00b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:29.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.784+0000 7fabd6600640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 0x7fabd0156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.784+0000 7fabd5200640 1 -- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 msgr2=0x7fabd0156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.784+0000 7fabd5200640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 0x7fabd0156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.784+0000 7fabd5200640 1 -- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabd00b8720 msgr2=0x7fabd00b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.784+0000 7fabd5200640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabd00b8720 0x7fabd00b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.784+0000 7fabd5200640 1 -- 172.21.15.8:0/1956779730 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0094d0 con 0x7fabd00d1310 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.784+0000 7fabd5c00640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabd00b8720 0x7fabd00b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.784+0000 7fabd6600640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 0x7fabd0156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.784+0000 7fabd5200640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00d1310 0x7fabd01f3170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009870 tx=0x7fabbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.785+0000 7fabcd600640 1 -- 172.21.15.8:0/1956779730 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc030b00 con 0x7fabd00d1310 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.785+0000 7fabcd600640 1 -- 172.21.15.8:0/1956779730 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabbc030c60 con 0x7fabd00d1310 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.785+0000 7fabcd600640 1 -- 172.21.15.8:0/1956779730 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabbc03d420 con 0x7fabd00d1310 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.785+0000 7fabd7000640 1 -- 172.21.15.8:0/1956779730 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd0157280 con 0x7fabd00d1310 2024-05-26T15:40:29.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.785+0000 7fabd7000640 1 -- 172.21.15.8:0/1956779730 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd0157840 con 0x7fabd00d1310 2024-05-26T15:40:29.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.786+0000 7fabd7000640 1 -- 172.21.15.8:0/1956779730 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd01570e0 con 0x7fabd00d1310 2024-05-26T15:40:29.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.787+0000 7fabcd600640 1 -- 172.21.15.8:0/1956779730 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabbc039040 con 0x7fabd00d1310 2024-05-26T15:40:29.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.788+0000 7fabcd600640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fabb006ac00 0x7fabb006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.788+0000 7fabcd600640 1 -- 172.21.15.8:0/1956779730 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fabbc0aa560 con 0x7fabd00d1310 2024-05-26T15:40:29.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.789+0000 7fabd5c00640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fabb006ac00 0x7fabb006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:29.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.790+0000 7fabd5c00640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fabb006ac00 0x7fabb006d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fabc4006fd0 tx=0x7fabc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:29.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.793+0000 7fabcd600640 1 -- 172.21.15.8:0/1956779730 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fabd01570e0 con 0x7fabd00d1310 2024-05-26T15:40:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.990+0000 7fabd7000640 1 -- 172.21.15.8:0/1956779730 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabd01570e0 con 0x7fabd00d1310 2024-05-26T15:40:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.993+0000 7fabcd600640 1 -- 172.21.15.8:0/1956779730 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7fabd01570e0 con 0x7fabd00d1310 2024-05-26T15:40:29.992 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:29.992 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 -- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fabb006ac00 msgr2=0x7fabb006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fabb006ac00 0x7fabb006d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fabc4006fd0 tx=0x7fabc4008040 comp rx=0 tx=0).stop 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 -- 172.21.15.8:0/1956779730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00d1310 msgr2=0x7fabd01f3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00d1310 0x7fabd01f3170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fabbc009870 tx=0x7fabbc0046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 -- 172.21.15.8:0/1956779730 shutdown_connections 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fabd01600d0 0x7fabd0156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fabd00d1310 0x7fabd01f3170 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fabb006ac00 0x7fabb006d0c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 --2- 172.21.15.8:0/1956779730 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fabd00b8720 0x7fabd00b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 -- 172.21.15.8:0/1956779730 >> 172.21.15.8:0/1956779730 conn(0x7fabd006b750 msgr2=0x7fabd00c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 -- 172.21.15.8:0/1956779730 shutdown_connections 2024-05-26T15:40:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:29.996+0000 7fabd7000640 1 -- 172.21.15.8:0/1956779730 wait complete. 2024-05-26T15:40:30.017 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:30.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:30.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.209+0000 7f094fe00640 1 Processor -- start 2024-05-26T15:40:30.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.209+0000 7f094fe00640 1 -- start start 2024-05-26T15:40:30.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.211+0000 7f094fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f09500cd5d0 0x7f09500cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.211+0000 7f094fe00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500d16d0 con 0x7f095015cf70 2024-05-26T15:40:30.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.211+0000 7f094fe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500cdef0 con 0x7f09500b5a30 2024-05-26T15:40:30.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.211+0000 7f094fe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09500d0ac0 con 0x7f09500cd5d0 2024-05-26T15:40:30.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.211+0000 7f094e000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f095015cf70 0x7f09500b8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:49000/0 (socket says 172.21.15.8:49000) 2024-05-26T15:40:30.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.211+0000 7f094e000640 1 -- 172.21.15.8:0/2127101340 learned_addr learned my addr 172.21.15.8:0/2127101340 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.211+0000 7f094ea00640 1 --2- 172.21.15.8:0/2127101340 >> v2:172.21.15.47:3300/0 conn(0x7f09500cd5d0 0x7f09500cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.211+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960069240 0 0) 0x7f09500d16d0 con 0x7f095015cf70 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0934003520 con 0x7f095015cf70 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1763793756 0 0) 0x7f0934003520 con 0x7f095015cf70 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 >> v2:172.21.15.47:3300/0 conn(0x7f09500cd5d0 msgr2=0x7f09500cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 --2- 172.21.15.8:0/2127101340 >> v2:172.21.15.47:3300/0 conn(0x7f09500cd5d0 0x7f09500cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 >> v1:172.21.15.47:6789/0 conn(0x7f09500b5a30 legacy=0x7f09500d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500d0da0 con 0x7f095015cf70 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f093c0017f0 con 0x7f095015cf70 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 >> v1:172.21.15.8:6789/0 conn(0x7f095015cf70 legacy=0x7f09500b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09340039c0 0x7f0934003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f09340047c0 0x7f0934004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0934005180 0x7f093400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500d0ac0 con 0x7f09340039c0 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093400c060 con 0x7f0934005180 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093400c220 con 0x7f09340047c0 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.212+0000 7f094ea00640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09340039c0 0x7f0934003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.213+0000 7f094e000640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f09340047c0 0x7f0934004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.213+0000 7f094ea00640 1 -- 172.21.15.8:0/2127101340 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f09340047c0 msgr2=0x7f0934004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.213+0000 7f094ea00640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f09340047c0 0x7f0934004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.213+0000 7f094ea00640 1 -- 172.21.15.8:0/2127101340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0934005180 msgr2=0x7f093400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.213+0000 7f094f400640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0934005180 0x7f093400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.213+0000 7f094ea00640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0934005180 0x7f093400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.213+0000 7f094ea00640 1 -- 172.21.15.8:0/2127101340 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0934003520 con 0x7f09340039c0 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.213+0000 7f094f400640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0934005180 0x7f093400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:30.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.213+0000 7f094f400640 1 -- 172.21.15.8:0/2127101340 reap_dead start 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.214+0000 7f094ea00640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09340039c0 0x7f0934003de0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0940009ac0 tx=0x7f09340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd14e5e399c69a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.214+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940031400 con 0x7f09340039c0 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.214+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094002d050 con 0x7f09340039c0 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.214+0000 7f094d600640 1 -- 172.21.15.8:0/2127101340 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940031780 con 0x7f09340039c0 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.215+0000 7f094fe00640 1 -- 172.21.15.8:0/2127101340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09340039c0 msgr2=0x7f0934003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.215+0000 7f094fe00640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09340039c0 0x7f0934003de0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0940009ac0 tx=0x7f09340057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.215+0000 7f094fe00640 1 -- 172.21.15.8:0/2127101340 shutdown_connections 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.215+0000 7f094fe00640 1 --2- 172.21.15.8:0/2127101340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09340039c0 0x7f0934003de0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.215+0000 7f094fe00640 1 -- 172.21.15.8:0/2127101340 >> 172.21.15.8:0/2127101340 conn(0x7f09500719c0 msgr2=0x7f0950071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.215+0000 7f094fe00640 1 -- 172.21.15.8:0/2127101340 shutdown_connections 2024-05-26T15:40:30.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.215+0000 7f094fe00640 1 -- 172.21.15.8:0/2127101340 wait complete. 2024-05-26T15:40:30.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.217+0000 7f094fe00640 1 Processor -- start 2024-05-26T15:40:30.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.217+0000 7f094fe00640 1 -- start start 2024-05-26T15:40:30.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.218+0000 7f094fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09340039c0 0x7f0950152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.218+0000 7f094fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09500cbc70 0x7f09500cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.218+0000 7f094fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0950154240 0x7f09501546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.218+0000 7f094fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0950154c00 con 0x7f09500cbc70 2024-05-26T15:40:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.218+0000 7f094fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500cc7e0 con 0x7f09340039c0 2024-05-26T15:40:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.218+0000 7f094fe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0950152570 con 0x7f0950154240 2024-05-26T15:40:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.218+0000 7f094e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09500cbc70 0x7f09500cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.218+0000 7f094e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09500cbc70 0x7f09500cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43174/0 (socket says 172.21.15.8:43174) 2024-05-26T15:40:30.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.218+0000 7f094e000640 1 -- 172.21.15.8:0/4033302040 learned_addr learned my addr 172.21.15.8:0/4033302040 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f094e000640 1 -- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0950154240 msgr2=0x7f09501546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f094e000640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0950154240 0x7f09501546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f094e000640 1 -- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09340039c0 msgr2=0x7f0950152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f094ea00640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09340039c0 0x7f0950152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f094e000640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09340039c0 0x7f0950152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f094e000640 1 -- 172.21.15.8:0/4033302040 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500cb7e0 con 0x7f09500cbc70 2024-05-26T15:40:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f094e000640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09500cbc70 0x7f09500cc0f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f093c00d7d0 tx=0x7f093c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f0946a00640 1 -- 172.21.15.8:0/4033302040 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c007270 con 0x7f09500cbc70 2024-05-26T15:40:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f0946a00640 1 -- 172.21.15.8:0/4033302040 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c0073d0 con 0x7f09500cbc70 2024-05-26T15:40:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f094fe00640 1 -- 172.21.15.8:0/4033302040 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09500ca4a0 con 0x7f09500cbc70 2024-05-26T15:40:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f0946a00640 1 -- 172.21.15.8:0/4033302040 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c0057a0 con 0x7f09500cbc70 2024-05-26T15:40:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.219+0000 7f094fe00640 1 -- 172.21.15.8:0/4033302040 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09500caa60 con 0x7f09500cbc70 2024-05-26T15:40:30.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.221+0000 7f094fe00640 1 -- 172.21.15.8:0/4033302040 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095004e210 con 0x7f09500cbc70 2024-05-26T15:40:30.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.222+0000 7f0946a00640 1 -- 172.21.15.8:0/4033302040 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f093c005900 con 0x7f09500cbc70 2024-05-26T15:40:30.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.224+0000 7f0946a00640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f093006ac00 0x7f093006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.224+0000 7f0946a00640 1 -- 172.21.15.8:0/4033302040 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f093c089950 con 0x7f09500cbc70 2024-05-26T15:40:30.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.224+0000 7f094ea00640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f093006ac00 0x7f093006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.226+0000 7f094ea00640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f093006ac00 0x7f093006d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0940033000 tx=0x7f0940008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:30.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.228+0000 7f0946a00640 1 -- 172.21.15.8:0/4033302040 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f093c058140 con 0x7f09500cbc70 2024-05-26T15:40:30.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.430+0000 7f094fe00640 1 -- 172.21.15.8:0/4033302040 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09500b6e20 con 0x7f09500cbc70 2024-05-26T15:40:30.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.431+0000 7f0946a00640 1 -- 172.21.15.8:0/4033302040 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f093c057cd0 con 0x7f09500cbc70 2024-05-26T15:40:30.434 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:30.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 -- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f093006ac00 msgr2=0x7f093006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f093006ac00 0x7f093006d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0940033000 tx=0x7f0940008030 comp rx=0 tx=0).stop 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 -- 172.21.15.8:0/4033302040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09500cbc70 msgr2=0x7f09500cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09500cbc70 0x7f09500cc0f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f093c00d7d0 tx=0x7f093c00dc90 comp rx=0 tx=0).stop 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 -- 172.21.15.8:0/4033302040 shutdown_connections 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0950154240 0x7f09501546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f09500cbc70 0x7f09500cc0f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f093006ac00 0x7f093006d0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 --2- 172.21.15.8:0/4033302040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09340039c0 0x7f0950152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 -- 172.21.15.8:0/4033302040 >> 172.21.15.8:0/4033302040 conn(0x7f09500719c0 msgr2=0x7f09500b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.433+0000 7f094fe00640 1 -- 172.21.15.8:0/4033302040 shutdown_connections 2024-05-26T15:40:30.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.434+0000 7f094fe00640 1 -- 172.21.15.8:0/4033302040 wait complete. 2024-05-26T15:40:30.450 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.662+0000 7f1d77e00640 1 Processor -- start 2024-05-26T15:40:30.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.663+0000 7f1d77e00640 1 -- start start 2024-05-26T15:40:30.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.664+0000 7f1d77e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1d780cdd10 0x7f1d7806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.664+0000 7f1d77e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1d7806d970 0x7f1d781643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.664+0000 7f1d77e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d780cba60 con 0x7f1d7815a9d0 2024-05-26T15:40:30.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.665+0000 7f1d77e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d78071610 con 0x7f1d7806d970 2024-05-26T15:40:30.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.665+0000 7f1d77e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780cbd00 con 0x7f1d780cdd10 2024-05-26T15:40:30.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.665+0000 7f1d77400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1d7806d970 0x7f1d781643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.665+0000 7f1d77400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1d7806d970 0x7f1d781643b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:36230/0 (socket says 172.21.15.8:36230) 2024-05-26T15:40:30.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.665+0000 7f1d77400640 1 -- 172.21.15.8:0/2985540721 learned_addr learned my addr 172.21.15.8:0/2985540721 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:30.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.665+0000 7f1d76a00640 1 --1- 172.21.15.8:0/2985540721 >> v1:172.21.15.47:6789/0 conn(0x7f1d7815a9d0 0x7f1d780cd600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:32818/0 (socket says 172.21.15.8:32818) 2024-05-26T15:40:30.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.665+0000 7f1d6fe00640 1 --2- 172.21.15.8:0/2985540721 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1d780cdd10 0x7f1d7806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.666+0000 7f1d77400640 1 -- 172.21.15.8:0/2985540721 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1d780cdd10 msgr2=0x7f1d7806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:30.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.666+0000 7f1d77400640 1 --2- 172.21.15.8:0/2985540721 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1d780cdd10 0x7f1d7806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.666+0000 7f1d77400640 1 -- 172.21.15.8:0/2985540721 >> v1:172.21.15.47:6789/0 conn(0x7f1d7815a9d0 legacy=0x7f1d780cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.666+0000 7f1d77400640 1 -- 172.21.15.8:0/2985540721 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78070e10 con 0x7f1d7806d970 2024-05-26T15:40:30.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.667+0000 7f1d77400640 1 --2- 172.21.15.8:0/2985540721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d7806d970 0x7f1d781643b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009e50 tx=0x7f1d7002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f8f09bdb182c05 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.668+0000 7f1d76000640 1 -- 172.21.15.8:0/2985540721 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7002aea0 con 0x7f1d7806d970 2024-05-26T15:40:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.668+0000 7f1d76000640 1 -- 172.21.15.8:0/2985540721 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7002d050 con 0x7f1d7806d970 2024-05-26T15:40:30.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.668+0000 7f1d76000640 1 -- 172.21.15.8:0/2985540721 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70031820 con 0x7f1d7806d970 2024-05-26T15:40:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.668+0000 7f1d77e00640 1 -- 172.21.15.8:0/2985540721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d7806d970 msgr2=0x7f1d781643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.668+0000 7f1d77e00640 1 --2- 172.21.15.8:0/2985540721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d7806d970 0x7f1d781643b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009e50 tx=0x7f1d7002a680 comp rx=0 tx=0).stop 2024-05-26T15:40:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.669+0000 7f1d77e00640 1 -- 172.21.15.8:0/2985540721 shutdown_connections 2024-05-26T15:40:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.669+0000 7f1d77e00640 1 --2- 172.21.15.8:0/2985540721 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d7806d970 0x7f1d781643b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.669+0000 7f1d77e00640 1 --2- 172.21.15.8:0/2985540721 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1d780cdd10 0x7f1d7806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.669+0000 7f1d77e00640 1 -- 172.21.15.8:0/2985540721 >> 172.21.15.8:0/2985540721 conn(0x7f1d780ce4f0 msgr2=0x7f1d780ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:30.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.669+0000 7f1d77e00640 1 -- 172.21.15.8:0/2985540721 shutdown_connections 2024-05-26T15:40:30.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.669+0000 7f1d77e00640 1 -- 172.21.15.8:0/2985540721 wait complete. 2024-05-26T15:40:30.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.670+0000 7f1d77e00640 1 Processor -- start 2024-05-26T15:40:30.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.671+0000 7f1d77e00640 1 -- start start 2024-05-26T15:40:30.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.671+0000 7f1d77e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1d7806d970 0x7f1d780ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.671+0000 7f1d77e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d780cdd10 0x7f1d7814aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.671+0000 7f1d77e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d7815a9d0 0x7f1d78157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.671+0000 7f1d77e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7815a2b0 con 0x7f1d780cdd10 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.671+0000 7f1d77e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7814b3f0 con 0x7f1d7815a9d0 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.671+0000 7f1d77e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d780abfc0 con 0x7f1d7806d970 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.672+0000 7f1d6fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d780cdd10 0x7f1d7814aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.672+0000 7f1d6fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d780cdd10 0x7f1d7814aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43176/0 (socket says 172.21.15.8:43176) 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.672+0000 7f1d6fe00640 1 -- 172.21.15.8:0/814616163 learned_addr learned my addr 172.21.15.8:0/814616163 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.672+0000 7f1d77400640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d7815a9d0 0x7f1d78157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.672+0000 7f1d76a00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1d7806d970 0x7f1d780ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.672+0000 7f1d6fe00640 1 -- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1d7806d970 msgr2=0x7f1d780ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.672+0000 7f1d6fe00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1d7806d970 0x7f1d780ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.672+0000 7f1d6fe00640 1 -- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d7815a9d0 msgr2=0x7f1d78157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.672+0000 7f1d6fe00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d7815a9d0 0x7f1d78157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.672+0000 7f1d6fe00640 1 -- 172.21.15.8:0/814616163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70009b30 con 0x7f1d780cdd10 2024-05-26T15:40:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.673+0000 7f1d6fe00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d780cdd10 0x7f1d7814aeb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000e870 tx=0x7f1d6000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:30.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.673+0000 7f1d6f400640 1 -- 172.21.15.8:0/814616163 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d600094f0 con 0x7f1d780cdd10 2024-05-26T15:40:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.673+0000 7f1d6f400640 1 -- 172.21.15.8:0/814616163 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6000c940 con 0x7f1d780cdd10 2024-05-26T15:40:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.673+0000 7f1d6f400640 1 -- 172.21.15.8:0/814616163 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000ccf0 con 0x7f1d780cdd10 2024-05-26T15:40:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.673+0000 7f1d77e00640 1 -- 172.21.15.8:0/814616163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d780ac2a0 con 0x7f1d780cdd10 2024-05-26T15:40:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.673+0000 7f1d77e00640 1 -- 172.21.15.8:0/814616163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d780ac860 con 0x7f1d780cdd10 2024-05-26T15:40:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.675+0000 7f1d77e00640 1 -- 172.21.15.8:0/814616163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7804e210 con 0x7f1d780cdd10 2024-05-26T15:40:30.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.675+0000 7f1d6f400640 1 -- 172.21.15.8:0/814616163 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d60013470 con 0x7f1d780cdd10 2024-05-26T15:40:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.676+0000 7f1d6f400640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d5406ac30 0x7f1d5406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:30.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.676+0000 7f1d6f400640 1 -- 172.21.15.8:0/814616163 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1d60089790 con 0x7f1d780cdd10 2024-05-26T15:40:30.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.677+0000 7f1d76a00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d5406ac30 0x7f1d5406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:30.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.678+0000 7f1d76a00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d5406ac30 0x7f1d5406d0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d68000f60 tx=0x7f1d68007c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:30.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.681+0000 7f1d6f400640 1 -- 172.21.15.8:0/814616163 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1d60054620 con 0x7f1d780cdd10 2024-05-26T15:40:30.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.871+0000 7f1d77e00640 1 -- 172.21.15.8:0/814616163 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d780af200 con 0x7f1d780cdd10 2024-05-26T15:40:30.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.872+0000 7f1d6f400640 1 -- 172.21.15.8:0/814616163 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d60057c40 con 0x7f1d780cdd10 2024-05-26T15:40:30.871 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:30.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 -- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d5406ac30 msgr2=0x7f1d5406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d5406ac30 0x7f1d5406d0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d68000f60 tx=0x7f1d68007c80 comp rx=0 tx=0).stop 2024-05-26T15:40:30.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 -- 172.21.15.8:0/814616163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d780cdd10 msgr2=0x7f1d7814aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:30.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d780cdd10 0x7f1d7814aeb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000e870 tx=0x7f1d6000ed30 comp rx=0 tx=0).stop 2024-05-26T15:40:30.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 -- 172.21.15.8:0/814616163 shutdown_connections 2024-05-26T15:40:30.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d5406ac30 0x7f1d5406d0f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d7815a9d0 0x7f1d78157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d780cdd10 0x7f1d7814aeb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 --2- 172.21.15.8:0/814616163 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1d7806d970 0x7f1d780ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:30.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 -- 172.21.15.8:0/814616163 >> 172.21.15.8:0/814616163 conn(0x7f1d780ce4f0 msgr2=0x7f1d78154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:30.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.875+0000 7f1d77e00640 1 -- 172.21.15.8:0/814616163 shutdown_connections 2024-05-26T15:40:30.875 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:30.876+0000 7f1d77e00640 1 -- 172.21.15.8:0/814616163 wait complete. 2024-05-26T15:40:30.891 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:31.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.097+0000 7f7f83e00640 1 Processor -- start 2024-05-26T15:40:31.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.097+0000 7f7f83e00640 1 -- start start 2024-05-26T15:40:31.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.099+0000 7f7f83e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7f8406c3d0 0x7f7f840703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:31.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.099+0000 7f7f83e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8415f140 con 0x7f7f8413d860 2024-05-26T15:40:31.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.099+0000 7f7f83e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f84070d20 con 0x7f7f840708f0 2024-05-26T15:40:31.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.099+0000 7f7f83e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8415e550 con 0x7f7f8406c3d0 2024-05-26T15:40:31.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.099+0000 7f7f82a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7f8413d860 0x7f7f840ccb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48696/0 (socket says 172.21.15.8:48696) 2024-05-26T15:40:31.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.099+0000 7f7f82a00640 1 -- 172.21.15.8:0/2770173303 learned_addr learned my addr 172.21.15.8:0/2770173303 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:31.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.099+0000 7f7f82000640 1 --2- 172.21.15.8:0/2770173303 >> v2:172.21.15.8:3300/0 conn(0x7f7f8406c3d0 0x7f7f840703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:31.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.100+0000 7f7f81600640 1 -- 172.21.15.8:0/2770173303 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033717223 0 0) 0x7f7f8415f140 con 0x7f7f8413d860 2024-05-26T15:40:31.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.100+0000 7f7f82000640 1 -- 172.21.15.8:0/2770173303 >> v1:172.21.15.47:6789/0 conn(0x7f7f840708f0 legacy=0x7f7f8413ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:31.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.100+0000 7f7f82000640 1 -- 172.21.15.8:0/2770173303 >> v1:172.21.15.8:6789/0 conn(0x7f7f8413d860 legacy=0x7f7f840ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.100+0000 7f7f82000640 1 -- 172.21.15.8:0/2770173303 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840cd240 con 0x7f7f8406c3d0 2024-05-26T15:40:31.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.101+0000 7f7f82000640 1 --2- 172.21.15.8:0/2770173303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f8406c3d0 0x7f7f840703b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7f840cd430 tx=0x7f7f7002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4f0cd06e6bc5c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:31.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.101+0000 7f7f81600640 1 -- 172.21.15.8:0/2770173303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70032440 con 0x7f7f8406c3d0 2024-05-26T15:40:31.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.101+0000 7f7f81600640 1 -- 172.21.15.8:0/2770173303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f700325a0 con 0x7f7f8406c3d0 2024-05-26T15:40:31.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.101+0000 7f7f81600640 1 -- 172.21.15.8:0/2770173303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70032930 con 0x7f7f8406c3d0 2024-05-26T15:40:31.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.102+0000 7f7f83e00640 1 -- 172.21.15.8:0/2770173303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f8406c3d0 msgr2=0x7f7f840703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.102+0000 7f7f83e00640 1 --2- 172.21.15.8:0/2770173303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f8406c3d0 0x7f7f840703b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7f840cd430 tx=0x7f7f7002a1c0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.102+0000 7f7f83e00640 1 -- 172.21.15.8:0/2770173303 shutdown_connections 2024-05-26T15:40:31.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.102+0000 7f7f83e00640 1 --2- 172.21.15.8:0/2770173303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f8406c3d0 0x7f7f840703b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.102+0000 7f7f83e00640 1 -- 172.21.15.8:0/2770173303 >> 172.21.15.8:0/2770173303 conn(0x7f7f84069e70 msgr2=0x7f7f8406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:31.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.102+0000 7f7f83e00640 1 -- 172.21.15.8:0/2770173303 shutdown_connections 2024-05-26T15:40:31.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.102+0000 7f7f83e00640 1 -- 172.21.15.8:0/2770173303 wait complete. 2024-05-26T15:40:31.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.104+0000 7f7f83e00640 1 Processor -- start 2024-05-26T15:40:31.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.104+0000 7f7f83e00640 1 -- start start 2024-05-26T15:40:31.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.105+0000 7f7f83e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f8406c3d0 0x7f7f84131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:31.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.105+0000 7f7f83e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f840708f0 0x7f7f84150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:31.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.105+0000 7f7f83e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f8413d860 0x7f7f84152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:31.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.105+0000 7f7f83e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84150fc0 con 0x7f7f840708f0 2024-05-26T15:40:31.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.105+0000 7f7f83e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84152ff0 con 0x7f7f8406c3d0 2024-05-26T15:40:31.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.105+0000 7f7f83e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f841532d0 con 0x7f7f8413d860 2024-05-26T15:40:31.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.105+0000 7f7f82000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f840708f0 0x7f7f84150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:31.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.105+0000 7f7f82000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f840708f0 0x7f7f84150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60990/0 (socket says 172.21.15.8:60990) 2024-05-26T15:40:31.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.105+0000 7f7f82000640 1 -- 172.21.15.8:0/1847173415 learned_addr learned my addr 172.21.15.8:0/1847173415 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:31.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.105+0000 7f7f82a00640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f8406c3d0 0x7f7f84131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.106+0000 7f7f82000640 1 -- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f8413d860 msgr2=0x7f7f84152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.106+0000 7f7f82000640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f8413d860 0x7f7f84152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.106+0000 7f7f82000640 1 -- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f8406c3d0 msgr2=0x7f7f84131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.106+0000 7f7f82000640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f8406c3d0 0x7f7f84131630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.106+0000 7f7f82000640 1 -- 172.21.15.8:0/1847173415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70009400 con 0x7f7f840708f0 2024-05-26T15:40:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.106+0000 7f7f82000640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f840708f0 0x7f7f84150a80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7f70000c00 tx=0x7f7f700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.106+0000 7f7f7aa00640 1 -- 172.21.15.8:0/1847173415 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70030b80 con 0x7f7f840708f0 2024-05-26T15:40:31.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.106+0000 7f7f7aa00640 1 -- 172.21.15.8:0/1847173415 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f70030d00 con 0x7f7f840708f0 2024-05-26T15:40:31.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.106+0000 7f7f7aa00640 1 -- 172.21.15.8:0/1847173415 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7003b640 con 0x7f7f840708f0 2024-05-26T15:40:31.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.106+0000 7f7f83e00640 1 -- 172.21.15.8:0/1847173415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f841535b0 con 0x7f7f840708f0 2024-05-26T15:40:31.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.107+0000 7f7f83e00640 1 -- 172.21.15.8:0/1847173415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f84153b70 con 0x7f7f840708f0 2024-05-26T15:40:31.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.108+0000 7f7f83e00640 1 -- 172.21.15.8:0/1847173415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f84071250 con 0x7f7f840708f0 2024-05-26T15:40:31.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.108+0000 7f7f7aa00640 1 -- 172.21.15.8:0/1847173415 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f70039040 con 0x7f7f840708f0 2024-05-26T15:40:31.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.109+0000 7f7f7aa00640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f6406ac30 0x7f7f6406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:31.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.109+0000 7f7f7aa00640 1 -- 172.21.15.8:0/1847173415 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7f700aa2d0 con 0x7f7f840708f0 2024-05-26T15:40:31.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.110+0000 7f7f82a00640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f6406ac30 0x7f7f6406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:31.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.111+0000 7f7f82a00640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f6406ac30 0x7f7f6406d0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f74000f60 tx=0x7f7f74007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:31.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.114+0000 7f7f7aa00640 1 -- 172.21.15.8:0/1847173415 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7f700751e0 con 0x7f7f840708f0 2024-05-26T15:40:31.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.315+0000 7f7f83e00640 1 -- 172.21.15.8:0/1847173415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f8404e210 con 0x7f7f840708f0 2024-05-26T15:40:31.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.316+0000 7f7f7aa00640 1 -- 172.21.15.8:0/1847173415 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f70006e10 con 0x7f7f840708f0 2024-05-26T15:40:31.314 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:31.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.318+0000 7f7f83e00640 1 -- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f6406ac30 msgr2=0x7f7f6406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.318+0000 7f7f83e00640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f6406ac30 0x7f7f6406d0f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7f74000f60 tx=0x7f7f74007b50 comp rx=0 tx=0).stop 2024-05-26T15:40:31.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.319+0000 7f7f83e00640 1 -- 172.21.15.8:0/1847173415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f840708f0 msgr2=0x7f7f84150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.319+0000 7f7f83e00640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f840708f0 0x7f7f84150a80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7f70000c00 tx=0x7f7f700046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.319+0000 7f7f83e00640 1 -- 172.21.15.8:0/1847173415 shutdown_connections 2024-05-26T15:40:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.319+0000 7f7f83e00640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f8413d860 0x7f7f84152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.319+0000 7f7f83e00640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f840708f0 0x7f7f84150a80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.319+0000 7f7f83e00640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f6406ac30 0x7f7f6406d0f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.319+0000 7f7f83e00640 1 --2- 172.21.15.8:0/1847173415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f8406c3d0 0x7f7f84131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.319+0000 7f7f83e00640 1 -- 172.21.15.8:0/1847173415 >> 172.21.15.8:0/1847173415 conn(0x7f7f84069e70 msgr2=0x7f7f8406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.319+0000 7f7f83e00640 1 -- 172.21.15.8:0/1847173415 shutdown_connections 2024-05-26T15:40:31.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.319+0000 7f7f83e00640 1 -- 172.21.15.8:0/1847173415 wait complete. 2024-05-26T15:40:31.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:31.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.557+0000 7f41d0a00640 1 Processor -- start 2024-05-26T15:40:31.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.557+0000 7f41d0a00640 1 -- start start 2024-05-26T15:40:31.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.558+0000 7f41d0a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f41cc15b500 0x7f41cc06f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:31.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.559+0000 7f41d0a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc0ae650 con 0x7f41cc06d670 2024-05-26T15:40:31.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.559+0000 7f41d0a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc06a010 con 0x7f41cc15aa10 2024-05-26T15:40:31.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.559+0000 7f41d0a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc0adaf0 con 0x7f41cc15b500 2024-05-26T15:40:31.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.559+0000 7f41c9400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f41cc06d670 0x7f41cc15adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48700/0 (socket says 172.21.15.8:48700) 2024-05-26T15:40:31.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.559+0000 7f41c9400640 1 -- 172.21.15.8:0/4123775106 learned_addr learned my addr 172.21.15.8:0/4123775106 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:31.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.559+0000 7f41ca800640 1 --2- 172.21.15.8:0/4123775106 >> v2:172.21.15.8:3300/0 conn(0x7f41cc15b500 0x7f41cc06f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:31.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.560+0000 7f41ca800640 1 -- 172.21.15.8:0/4123775106 >> v1:172.21.15.47:6789/0 conn(0x7f41cc15aa10 legacy=0x7f41cc06cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.560+0000 7f41ca800640 1 -- 172.21.15.8:0/4123775106 >> v1:172.21.15.8:6789/0 conn(0x7f41cc06d670 legacy=0x7f41cc15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.560+0000 7f41ca800640 1 -- 172.21.15.8:0/4123775106 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc06a2f0 con 0x7f41cc15b500 2024-05-26T15:40:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.560+0000 7f41c8a00640 1 -- 172.21.15.8:0/4123775106 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303969343 0 0) 0x7f41cc0ae650 con 0x7f41cc06d670 2024-05-26T15:40:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.561+0000 7f41ca800640 1 --2- 172.21.15.8:0/4123775106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc15b500 0x7f41cc06f200 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009d90 tx=0x7f41c402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e7cbff1464c9c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.561+0000 7f41c8a00640 1 -- 172.21.15.8:0/4123775106 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4007740 con 0x7f41cc15b500 2024-05-26T15:40:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.561+0000 7f41c8a00640 1 -- 172.21.15.8:0/4123775106 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c402d050 con 0x7f41cc15b500 2024-05-26T15:40:31.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.561+0000 7f41c8a00640 1 -- 172.21.15.8:0/4123775106 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4007ac0 con 0x7f41cc15b500 2024-05-26T15:40:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.561+0000 7f41d0a00640 1 -- 172.21.15.8:0/4123775106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc15b500 msgr2=0x7f41cc06f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.561+0000 7f41d0a00640 1 --2- 172.21.15.8:0/4123775106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc15b500 0x7f41cc06f200 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009d90 tx=0x7f41c402a6f0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.562+0000 7f41d0a00640 1 -- 172.21.15.8:0/4123775106 shutdown_connections 2024-05-26T15:40:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.562+0000 7f41d0a00640 1 --2- 172.21.15.8:0/4123775106 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc15b500 0x7f41cc06f200 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.562+0000 7f41d0a00640 1 -- 172.21.15.8:0/4123775106 >> 172.21.15.8:0/4123775106 conn(0x7f41cc0cf2c0 msgr2=0x7f41cc0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:31.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.562+0000 7f41d0a00640 1 -- 172.21.15.8:0/4123775106 shutdown_connections 2024-05-26T15:40:31.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.562+0000 7f41d0a00640 1 -- 172.21.15.8:0/4123775106 wait complete. 2024-05-26T15:40:31.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.563+0000 7f41d0a00640 1 Processor -- start 2024-05-26T15:40:31.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.564+0000 7f41d0a00640 1 -- start start 2024-05-26T15:40:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.564+0000 7f41d0a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc06d670 0x7f41cc148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.564+0000 7f41d0a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f41cc15aa10 0x7f41cc0c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.564+0000 7f41d0a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41cc15b500 0x7f41cc158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.564+0000 7f41d0a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc157110 con 0x7f41cc06d670 2024-05-26T15:40:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.564+0000 7f41d0a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc156500 con 0x7f41cc15b500 2024-05-26T15:40:31.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.564+0000 7f41d0a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc1567e0 con 0x7f41cc15aa10 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.565+0000 7f41c9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc06d670 0x7f41cc148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.565+0000 7f41c9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc06d670 0x7f41cc148a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32778/0 (socket says 172.21.15.8:32778) 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.565+0000 7f41c9e00640 1 -- 172.21.15.8:0/155167909 learned_addr learned my addr 172.21.15.8:0/155167909 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.565+0000 7f41c9400640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f41cc15aa10 0x7f41cc0c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.565+0000 7f41ca800640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41cc15b500 0x7f41cc158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.565+0000 7f41c9e00640 1 -- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f41cc15aa10 msgr2=0x7f41cc0c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.566+0000 7f41c9e00640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f41cc15aa10 0x7f41cc0c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.566+0000 7f41c9e00640 1 -- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41cc15b500 msgr2=0x7f41cc158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.566+0000 7f41c9e00640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41cc15b500 0x7f41cc158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.566+0000 7f41c9e00640 1 -- 172.21.15.8:0/155167909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c4009a70 con 0x7f41cc06d670 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.566+0000 7f41c9e00640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc06d670 0x7f41cc148a80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c450 tx=0x7f41bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:31.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.566+0000 7f41c2000640 1 -- 172.21.15.8:0/155167909 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc0052d0 con 0x7f41cc06d670 2024-05-26T15:40:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.566+0000 7f41c2000640 1 -- 172.21.15.8:0/155167909 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc005430 con 0x7f41cc06d670 2024-05-26T15:40:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.566+0000 7f41c2000640 1 -- 172.21.15.8:0/155167909 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc012870 con 0x7f41cc06d670 2024-05-26T15:40:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.566+0000 7f41d0a00640 1 -- 172.21.15.8:0/155167909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc156ac0 con 0x7f41cc06d670 2024-05-26T15:40:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.566+0000 7f41d0a00640 1 -- 172.21.15.8:0/155167909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc0c4c40 con 0x7f41cc06d670 2024-05-26T15:40:31.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.567+0000 7f41d0a00640 1 -- 172.21.15.8:0/155167909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc0663e0 con 0x7f41cc06d670 2024-05-26T15:40:31.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.569+0000 7f41c2000640 1 -- 172.21.15.8:0/155167909 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f41bc0129d0 con 0x7f41cc06d670 2024-05-26T15:40:31.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.570+0000 7f41c2000640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41a806ac30 0x7f41a806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:31.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.570+0000 7f41c2000640 1 -- 172.21.15.8:0/155167909 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f41bc089190 con 0x7f41cc06d670 2024-05-26T15:40:31.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.570+0000 7f41c9400640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41a806ac30 0x7f41a806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:31.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.572+0000 7f41c9400640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41a806ac30 0x7f41a806d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41cc069fe0 tx=0x7f41b4007bb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:31.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.574+0000 7f41c2000640 1 -- 172.21.15.8:0/155167909 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f41bc054020 con 0x7f41cc06d670 2024-05-26T15:40:31.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.775+0000 7f41d0a00640 1 -- 172.21.15.8:0/155167909 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f41cc04e210 con 0x7f41cc06d670 2024-05-26T15:40:31.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.776+0000 7f41c2000640 1 -- 172.21.15.8:0/155167909 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f41bc057640 con 0x7f41cc06d670 2024-05-26T15:40:31.775 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 -- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41a806ac30 msgr2=0x7f41a806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41a806ac30 0x7f41a806d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41cc069fe0 tx=0x7f41b4007bb0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 -- 172.21.15.8:0/155167909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc06d670 msgr2=0x7f41cc148a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc06d670 0x7f41cc148a80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c450 tx=0x7f41bc00c910 comp rx=0 tx=0).stop 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 -- 172.21.15.8:0/155167909 shutdown_connections 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41a806ac30 0x7f41a806d0f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41cc15b500 0x7f41cc158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f41cc15aa10 0x7f41cc0c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 --2- 172.21.15.8:0/155167909 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41cc06d670 0x7f41cc148a80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 -- 172.21.15.8:0/155167909 >> 172.21.15.8:0/155167909 conn(0x7f41cc0cf2c0 msgr2=0x7f41cc158570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:31.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 -- 172.21.15.8:0/155167909 shutdown_connections 2024-05-26T15:40:31.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:31.779+0000 7f41d0a00640 1 -- 172.21.15.8:0/155167909 wait complete. 2024-05-26T15:40:31.796 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:32.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.010+0000 7f35f3200640 1 Processor -- start 2024-05-26T15:40:32.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.011+0000 7f35f3200640 1 -- start start 2024-05-26T15:40:32.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.012+0000 7f35f3200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f35f406f130 0x7f35f415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.012+0000 7f35f3200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 0x7f35f415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.012+0000 7f35f3200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f415be30 con 0x7f35f41585c0 2024-05-26T15:40:32.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.012+0000 7f35f3200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f415b590 con 0x7f35f406f130 2024-05-26T15:40:32.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.012+0000 7f35f3200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f415b870 con 0x7f35f40b5ff0 2024-05-26T15:40:32.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.013+0000 7f35f1e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f35f41585c0 0x7f35f406ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48708/0 (socket says 172.21.15.8:48708) 2024-05-26T15:40:32.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.013+0000 7f35f1e00640 1 -- 172.21.15.8:0/1669451826 learned_addr learned my addr 172.21.15.8:0/1669451826 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:32.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.013+0000 7f35f1400640 1 --2- 172.21.15.8:0/1669451826 >> v2:172.21.15.8:3300/0 conn(0x7f35f406f130 0x7f35f415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.013+0000 7f35f2800640 1 --2- 172.21.15.8:0/1669451826 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 0x7f35f415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.013+0000 7f35f1400640 1 -- 172.21.15.8:0/1669451826 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 msgr2=0x7f35f415c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:32.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.013+0000 7f35f1400640 1 --2- 172.21.15.8:0/1669451826 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 0x7f35f415c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.013+0000 7f35f1400640 1 -- 172.21.15.8:0/1669451826 >> v1:172.21.15.8:6789/0 conn(0x7f35f41585c0 legacy=0x7f35f406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.013+0000 7f35f1400640 1 -- 172.21.15.8:0/1669451826 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f415b360 con 0x7f35f406f130 2024-05-26T15:40:32.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.013+0000 7f35f0a00640 1 -- 172.21.15.8:0/1669451826 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708399617 0 0) 0x7f35f415be30 con 0x7f35f41585c0 2024-05-26T15:40:32.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.013+0000 7f35f2800640 1 --2- 172.21.15.8:0/1669451826 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 0x7f35f415c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:32.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.014+0000 7f35f1400640 1 --2- 172.21.15.8:0/1669451826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 0x7f35f415ae20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009d90 tx=0x7f35dc02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0ad8b81e09ceb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:32.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.015+0000 7f35f0a00640 1 -- 172.21.15.8:0/1669451826 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc031600 con 0x7f35f406f130 2024-05-26T15:40:32.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.015+0000 7f35f0a00640 1 -- 172.21.15.8:0/1669451826 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc02d050 con 0x7f35f406f130 2024-05-26T15:40:32.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.015+0000 7f35f0a00640 1 -- 172.21.15.8:0/1669451826 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc031980 con 0x7f35f406f130 2024-05-26T15:40:32.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.015+0000 7f35f3200640 1 -- 172.21.15.8:0/1669451826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 msgr2=0x7f35f415ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.015+0000 7f35f3200640 1 --2- 172.21.15.8:0/1669451826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 0x7f35f415ae20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009d90 tx=0x7f35dc02a5d0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.015+0000 7f35f3200640 1 -- 172.21.15.8:0/1669451826 shutdown_connections 2024-05-26T15:40:32.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.015+0000 7f35f3200640 1 --2- 172.21.15.8:0/1669451826 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 0x7f35f415c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.015+0000 7f35f3200640 1 --2- 172.21.15.8:0/1669451826 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 0x7f35f415ae20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.015+0000 7f35f3200640 1 -- 172.21.15.8:0/1669451826 >> 172.21.15.8:0/1669451826 conn(0x7f35f406a050 msgr2=0x7f35f406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:32.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.015+0000 7f35f3200640 1 -- 172.21.15.8:0/1669451826 shutdown_connections 2024-05-26T15:40:32.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.016+0000 7f35f3200640 1 -- 172.21.15.8:0/1669451826 wait complete. 2024-05-26T15:40:32.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.017+0000 7f35f3200640 1 Processor -- start 2024-05-26T15:40:32.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.017+0000 7f35f3200640 1 -- start start 2024-05-26T15:40:32.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.018+0000 7f35f3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 0x7f35f4156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.018+0000 7f35f3200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 0x7f35f41599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.018+0000 7f35f3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35f41585c0 0x7f35f4159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.018+0000 7f35f3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40a74c0 con 0x7f35f406f130 2024-05-26T15:40:32.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.018+0000 7f35f3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40a7710 con 0x7f35f41585c0 2024-05-26T15:40:32.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.018+0000 7f35f3200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f40a79f0 con 0x7f35f40b5ff0 2024-05-26T15:40:32.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 0x7f35f4156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 0x7f35f4156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32802/0 (socket says 172.21.15.8:32802) 2024-05-26T15:40:32.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1e00640 1 -- 172.21.15.8:0/1159075775 learned_addr learned my addr 172.21.15.8:0/1159075775 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1400640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 0x7f35f41599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1e00640 1 -- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 msgr2=0x7f35f41599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1e00640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 0x7f35f41599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f2800640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35f41585c0 0x7f35f4159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1e00640 1 -- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35f41585c0 msgr2=0x7f35f4159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1e00640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35f41585c0 0x7f35f4159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1e00640 1 -- 172.21.15.8:0/1159075775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc009a70 con 0x7f35f406f130 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1400640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 0x7f35f41599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.019+0000 7f35f1e00640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 0x7f35f4156c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f35e400c4d0 tx=0x7f35e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.020+0000 7f35ea000640 1 -- 172.21.15.8:0/1159075775 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e40074e0 con 0x7f35f406f130 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.020+0000 7f35ea000640 1 -- 172.21.15.8:0/1159075775 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e4007660 con 0x7f35f406f130 2024-05-26T15:40:32.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.020+0000 7f35ea000640 1 -- 172.21.15.8:0/1159075775 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4004a20 con 0x7f35f406f130 2024-05-26T15:40:32.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.020+0000 7f35f3200640 1 -- 172.21.15.8:0/1159075775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f40a7cd0 con 0x7f35f406f130 2024-05-26T15:40:32.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.020+0000 7f35f3200640 1 -- 172.21.15.8:0/1159075775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f40a8290 con 0x7f35f406f130 2024-05-26T15:40:32.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.021+0000 7f35f3200640 1 -- 172.21.15.8:0/1159075775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f404e280 con 0x7f35f406f130 2024-05-26T15:40:32.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.022+0000 7f35ea000640 1 -- 172.21.15.8:0/1159075775 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f35e4004b80 con 0x7f35f406f130 2024-05-26T15:40:32.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.023+0000 7f35ea000640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35d006ac00 0x7f35d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.023+0000 7f35ea000640 1 -- 172.21.15.8:0/1159075775 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f35e40889e0 con 0x7f35f406f130 2024-05-26T15:40:32.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.024+0000 7f35f1400640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35d006ac00 0x7f35d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.025+0000 7f35f1400640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35d006ac00 0x7f35d006d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35dc034000 tx=0x7f35dc033040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:32.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.027+0000 7f35ea000640 1 -- 172.21.15.8:0/1159075775 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f35e4053740 con 0x7f35f406f130 2024-05-26T15:40:32.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.228+0000 7f35f3200640 1 -- 172.21.15.8:0/1159075775 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35f40ce010 con 0x7f35f406f130 2024-05-26T15:40:32.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.231+0000 7f35ea000640 1 -- 172.21.15.8:0/1159075775 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7f35e4018090 con 0x7f35f406f130 2024-05-26T15:40:32.230 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:32.230 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:32.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.234+0000 7f35f3200640 1 -- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35d006ac00 msgr2=0x7f35d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.234+0000 7f35f3200640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35d006ac00 0x7f35d006d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35dc034000 tx=0x7f35dc033040 comp rx=0 tx=0).stop 2024-05-26T15:40:32.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.235+0000 7f35f3200640 1 -- 172.21.15.8:0/1159075775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 msgr2=0x7f35f4156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.235+0000 7f35f3200640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 0x7f35f4156c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f35e400c4d0 tx=0x7f35e400c990 comp rx=0 tx=0).stop 2024-05-26T15:40:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.235+0000 7f35f3200640 1 -- 172.21.15.8:0/1159075775 shutdown_connections 2024-05-26T15:40:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.235+0000 7f35f3200640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35d006ac00 0x7f35d006d0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.235+0000 7f35f3200640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35f41585c0 0x7f35f4159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.235+0000 7f35f3200640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35f40b5ff0 0x7f35f41599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.235+0000 7f35f3200640 1 --2- 172.21.15.8:0/1159075775 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35f406f130 0x7f35f4156c20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.235+0000 7f35f3200640 1 -- 172.21.15.8:0/1159075775 >> 172.21.15.8:0/1159075775 conn(0x7f35f406a050 msgr2=0x7f35f415d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.235+0000 7f35f3200640 1 -- 172.21.15.8:0/1159075775 shutdown_connections 2024-05-26T15:40:32.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.235+0000 7f35f3200640 1 -- 172.21.15.8:0/1159075775 wait complete. 2024-05-26T15:40:32.252 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:32.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:32.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.457+0000 7f15c4c00640 1 Processor -- start 2024-05-26T15:40:32.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.457+0000 7f15c4c00640 1 -- start start 2024-05-26T15:40:32.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.459+0000 7f15c4c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f15c006d970 0x7f15c006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.459+0000 7f15c4c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c00cba60 con 0x7f15c015a9d0 2024-05-26T15:40:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.459+0000 7f15c4c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c0071610 con 0x7f15c00cdd10 2024-05-26T15:40:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.459+0000 7f15c4c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c00cbd00 con 0x7f15c006d970 2024-05-26T15:40:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.459+0000 7f15bf400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f15c015a9d0 0x7f15c00cd600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48710/0 (socket says 172.21.15.8:48710) 2024-05-26T15:40:32.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.459+0000 7f15bf400640 1 -- 172.21.15.8:0/1407264782 learned_addr learned my addr 172.21.15.8:0/1407264782 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318305224 0 0) 0x7f15c00cba60 con 0x7f15c015a9d0 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a4003520 con 0x7f15c015a9d0 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bfe00640 1 --2- 172.21.15.8:0/1407264782 >> v2:172.21.15.47:3300/0 conn(0x7f15c006d970 0x7f15c006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1638200827 0 0) 0x7f15a4003520 con 0x7f15c015a9d0 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 >> v2:172.21.15.47:3300/0 conn(0x7f15c006d970 msgr2=0x7f15c006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 --2- 172.21.15.8:0/1407264782 >> v2:172.21.15.47:3300/0 conn(0x7f15c006d970 0x7f15c006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 >> v1:172.21.15.47:6789/0 conn(0x7f15c00cdd10 legacy=0x7f15c01623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0070e10 con 0x7f15c015a9d0 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f15b0001670 con 0x7f15c015a9d0 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 >> v1:172.21.15.8:6789/0 conn(0x7f15c015a9d0 legacy=0x7f15c00cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a4003970 0x7f15a4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.460+0000 7f15bea00640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15a40047c0 0x7f15a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bea00640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a40052a0 0x7f15a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00cbd00 con 0x7f15a40052a0 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a400c1f0 con 0x7f15a4003970 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a400c3b0 con 0x7f15a40047c0 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bfe00640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a40052a0 0x7f15a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bf400640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a4003970 0x7f15a4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15b6a00640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15a40047c0 0x7f15a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bfe00640 1 -- 172.21.15.8:0/1407264782 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15a40047c0 msgr2=0x7f15a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bfe00640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15a40047c0 0x7f15a4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bfe00640 1 -- 172.21.15.8:0/1407264782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a4003970 msgr2=0x7f15a4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bfe00640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15a4003970 0x7f15a4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.461+0000 7f15bfe00640 1 -- 172.21.15.8:0/1407264782 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4003520 con 0x7f15a40052a0 2024-05-26T15:40:32.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.462+0000 7f15bfe00640 1 -- 172.21.15.8:0/1407264782 reap_dead start 2024-05-26T15:40:32.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.462+0000 7f15bfe00640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a40052a0 0x7f15a400b980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f15b8007330 tx=0x7f15a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1aa2a316eca4a3d server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.463+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8003b90 con 0x7f15a40052a0 2024-05-26T15:40:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.463+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b8003cf0 con 0x7f15a40052a0 2024-05-26T15:40:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.463+0000 7f15bea00640 1 -- 172.21.15.8:0/1407264782 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8004260 con 0x7f15a40052a0 2024-05-26T15:40:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.463+0000 7f15c4c00640 1 -- 172.21.15.8:0/1407264782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a40052a0 msgr2=0x7f15a400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.463+0000 7f15c4c00640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a40052a0 0x7f15a400b980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f15b8007330 tx=0x7f15a40057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.463+0000 7f15c4c00640 1 -- 172.21.15.8:0/1407264782 shutdown_connections 2024-05-26T15:40:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.463+0000 7f15c4c00640 1 --2- 172.21.15.8:0/1407264782 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15a40052a0 0x7f15a400b980 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.463+0000 7f15c4c00640 1 -- 172.21.15.8:0/1407264782 >> 172.21.15.8:0/1407264782 conn(0x7f15c00ce4f0 msgr2=0x7f15c00ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.464+0000 7f15c4c00640 1 -- 172.21.15.8:0/1407264782 shutdown_connections 2024-05-26T15:40:32.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.464+0000 7f15c4c00640 1 -- 172.21.15.8:0/1407264782 wait complete. 2024-05-26T15:40:32.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.465+0000 7f15c4c00640 1 Processor -- start 2024-05-26T15:40:32.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.466+0000 7f15c4c00640 1 -- start start 2024-05-26T15:40:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.466+0000 7f15c4c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15a40052a0 0x7f15c0155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15c4c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00a9240 0x7f15c01e36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15c4c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15c01e3c00 0x7f15c00aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15c4c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0155750 con 0x7f15c00a9240 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15c4c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00a7ec0 con 0x7f15c01e3c00 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15c4c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00a81a0 con 0x7f15a40052a0 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15b6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00a9240 0x7f15c01e36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15b6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00a9240 0x7f15c01e36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32824/0 (socket says 172.21.15.8:32824) 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15b6a00640 1 -- 172.21.15.8:0/3233299819 learned_addr learned my addr 172.21.15.8:0/3233299819 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15bf400640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15a40052a0 0x7f15c0155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15bfe00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15c01e3c00 0x7f15c00aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15b6a00640 1 -- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15a40052a0 msgr2=0x7f15c0155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15b6a00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15a40052a0 0x7f15c0155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15b6a00640 1 -- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15c01e3c00 msgr2=0x7f15c00aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15b6a00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15c01e3c00 0x7f15c00aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.467+0000 7f15b6a00640 1 -- 172.21.15.8:0/3233299819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c00a8480 con 0x7f15c00a9240 2024-05-26T15:40:32.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.468+0000 7f15b6a00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00a9240 0x7f15c01e36c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f15a800d4e0 tx=0x7f15a800d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.468+0000 7f15b7e00640 1 -- 172.21.15.8:0/3233299819 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8012800 con 0x7f15c00a9240 2024-05-26T15:40:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.468+0000 7f15b7e00640 1 -- 172.21.15.8:0/3233299819 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a8012960 con 0x7f15c00a9240 2024-05-26T15:40:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.468+0000 7f15b7e00640 1 -- 172.21.15.8:0/3233299819 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a8012d50 con 0x7f15c00a9240 2024-05-26T15:40:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.468+0000 7f15c4c00640 1 -- 172.21.15.8:0/3233299819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c00a8760 con 0x7f15c00a9240 2024-05-26T15:40:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.468+0000 7f15c4c00640 1 -- 172.21.15.8:0/3233299819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c00a8d20 con 0x7f15c00a9240 2024-05-26T15:40:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.469+0000 7f15c4c00640 1 -- 172.21.15.8:0/3233299819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c004e210 con 0x7f15c00a9240 2024-05-26T15:40:32.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.470+0000 7f15b7e00640 1 -- 172.21.15.8:0/3233299819 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15a80243a0 con 0x7f15c00a9240 2024-05-26T15:40:32.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.471+0000 7f15b7e00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f159c06ac00 0x7f159c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.471+0000 7f15b7e00640 1 -- 172.21.15.8:0/3233299819 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f15a8089ad0 con 0x7f15c00a9240 2024-05-26T15:40:32.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.472+0000 7f15bf400640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f159c06ac00 0x7f159c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.473+0000 7f15bf400640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f159c06ac00 0x7f159c06d0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f15b0001690 tx=0x7f15b0001d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:32.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.476+0000 7f15b7e00640 1 -- 172.21.15.8:0/3233299819 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f15a80548c0 con 0x7f15c00a9240 2024-05-26T15:40:32.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.681+0000 7f15c4c00640 1 -- 172.21.15.8:0/3233299819 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15c00ad3f0 con 0x7f15c00a9240 2024-05-26T15:40:32.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.682+0000 7f15b7e00640 1 -- 172.21.15.8:0/3233299819 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15a8020020 con 0x7f15c00a9240 2024-05-26T15:40:32.681 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:32.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 -- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f159c06ac00 msgr2=0x7f159c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f159c06ac00 0x7f159c06d0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f15b0001690 tx=0x7f15b0001d30 comp rx=0 tx=0).stop 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 -- 172.21.15.8:0/3233299819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00a9240 msgr2=0x7f15c01e36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00a9240 0x7f15c01e36c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f15a800d4e0 tx=0x7f15a800d9a0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 -- 172.21.15.8:0/3233299819 shutdown_connections 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f159c06ac00 0x7f159c06d0c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15c01e3c00 0x7f15c00aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15c00a9240 0x7f15c01e36c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 --2- 172.21.15.8:0/3233299819 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15a40052a0 0x7f15c0155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 -- 172.21.15.8:0/3233299819 >> 172.21.15.8:0/3233299819 conn(0x7f15c00ce4f0 msgr2=0x7f15c00cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 -- 172.21.15.8:0/3233299819 shutdown_connections 2024-05-26T15:40:32.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.685+0000 7f15c4c00640 1 -- 172.21.15.8:0/3233299819 wait complete. 2024-05-26T15:40:32.702 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.904+0000 7fd9d1000640 1 Processor -- start 2024-05-26T15:40:32.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.904+0000 7fd9d1000640 1 -- start start 2024-05-26T15:40:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.906+0000 7fd9d1000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd9cc1596c0 0x7fd9cc06de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.906+0000 7fd9d1000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd9cc159aa0 0x7fd9cc06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.906+0000 7fd9d1000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd9cc0b2c40 0x7fd9cc0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.906+0000 7fd9d1000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc0b1620 con 0x7fd9cc1596c0 2024-05-26T15:40:32.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.906+0000 7fd9d1000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc0b1900 con 0x7fd9cc159aa0 2024-05-26T15:40:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.906+0000 7fd9d1000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc0b1be0 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.906+0000 7fd9c9e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd9cc1596c0 0x7fd9cc06de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.907+0000 7fd9c9400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd9cc159aa0 0x7fd9cc06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.907+0000 7fd9c9400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd9cc159aa0 0x7fd9cc06e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:55436/0 (socket says 172.21.15.8:55436) 2024-05-26T15:40:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.907+0000 7fd9c9400640 1 -- 172.21.15.8:0/1575348525 learned_addr learned my addr 172.21.15.8:0/1575348525 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.907+0000 7fd9ca800640 1 --2- 172.21.15.8:0/1575348525 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd9cc0b2c40 0x7fd9cc0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.907+0000 7fd9c9400640 1 -- 172.21.15.8:0/1575348525 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd9cc0b2c40 msgr2=0x7fd9cc0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:32.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.907+0000 7fd9c9400640 1 --2- 172.21.15.8:0/1575348525 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd9cc0b2c40 0x7fd9cc0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.907+0000 7fd9c9400640 1 -- 172.21.15.8:0/1575348525 >> v2:172.21.15.8:3300/0 conn(0x7fd9cc1596c0 msgr2=0x7fd9cc06de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:32.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.907+0000 7fd9c9400640 1 --2- 172.21.15.8:0/1575348525 >> v2:172.21.15.8:3300/0 conn(0x7fd9cc1596c0 0x7fd9cc06de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.907+0000 7fd9c9400640 1 -- 172.21.15.8:0/1575348525 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc0b1ec0 con 0x7fd9cc159aa0 2024-05-26T15:40:32.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.909+0000 7fd9c9400640 1 --2- 172.21.15.8:0/1575348525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9cc159aa0 0x7fd9cc06e370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc067860 tx=0x7fd9b802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e228e377cc3ba129 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:32.907 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.909+0000 7fd9c8a00640 1 -- 172.21.15.8:0/1575348525 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8032440 con 0x7fd9cc159aa0 2024-05-26T15:40:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.909+0000 7fd9c8a00640 1 -- 172.21.15.8:0/1575348525 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b80325a0 con 0x7fd9cc159aa0 2024-05-26T15:40:32.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.909+0000 7fd9c8a00640 1 -- 172.21.15.8:0/1575348525 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8032930 con 0x7fd9cc159aa0 2024-05-26T15:40:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.910+0000 7fd9d1000640 1 -- 172.21.15.8:0/1575348525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9cc159aa0 msgr2=0x7fd9cc06e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.910+0000 7fd9d1000640 1 --2- 172.21.15.8:0/1575348525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9cc159aa0 0x7fd9cc06e370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc067860 tx=0x7fd9b802a1e0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.910+0000 7fd9d1000640 1 -- 172.21.15.8:0/1575348525 shutdown_connections 2024-05-26T15:40:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.910+0000 7fd9d1000640 1 --2- 172.21.15.8:0/1575348525 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd9cc0b2c40 0x7fd9cc0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.910+0000 7fd9d1000640 1 --2- 172.21.15.8:0/1575348525 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9cc159aa0 0x7fd9cc06e370 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.910+0000 7fd9d1000640 1 --2- 172.21.15.8:0/1575348525 >> v2:172.21.15.8:3300/0 conn(0x7fd9cc1596c0 0x7fd9cc06de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.910+0000 7fd9d1000640 1 -- 172.21.15.8:0/1575348525 >> 172.21.15.8:0/1575348525 conn(0x7fd9cc069e70 msgr2=0x7fd9cc06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.910+0000 7fd9d1000640 1 -- 172.21.15.8:0/1575348525 shutdown_connections 2024-05-26T15:40:32.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.910+0000 7fd9d1000640 1 -- 172.21.15.8:0/1575348525 wait complete. 2024-05-26T15:40:32.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.912+0000 7fd9d1000640 1 Processor -- start 2024-05-26T15:40:32.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.912+0000 7fd9d1000640 1 -- start start 2024-05-26T15:40:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.913+0000 7fd9d1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9cc0b2c40 0x7fd9cc13e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.913+0000 7fd9d1000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9cc1596c0 0x7fd9cc13d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.913+0000 7fd9d1000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd9cc159aa0 0x7fd9cc1401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.913+0000 7fd9d1000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc154550 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.913+0000 7fd9d1000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc1541e0 con 0x7fd9cc1596c0 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.913+0000 7fd9d1000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc15c6f0 con 0x7fd9cc159aa0 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9c9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9cc0b2c40 0x7fd9cc13e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9c9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9cc0b2c40 0x7fd9cc13e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32828/0 (socket says 172.21.15.8:32828) 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9c9e00640 1 -- 172.21.15.8:0/3152539342 learned_addr learned my addr 172.21.15.8:0/3152539342 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9c9400640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9cc1596c0 0x7fd9cc13d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9ca800640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd9cc159aa0 0x7fd9cc1401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9c9e00640 1 -- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd9cc159aa0 msgr2=0x7fd9cc1401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9c9e00640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd9cc159aa0 0x7fd9cc1401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9c9e00640 1 -- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9cc1596c0 msgr2=0x7fd9cc13d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9c9e00640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9cc1596c0 0x7fd9cc13d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:32.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9c9e00640 1 -- 172.21.15.8:0/3152539342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b80094d0 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.914+0000 7fd9c9e00640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9cc0b2c40 0x7fd9cc13e120 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00e9e0 tx=0x7fd9bc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:32.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.915+0000 7fd9c2000640 1 -- 172.21.15.8:0/3152539342 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc009670 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.915+0000 7fd9c2000640 1 -- 172.21.15.8:0/3152539342 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc00c9d0 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.915+0000 7fd9c2000640 1 -- 172.21.15.8:0/3152539342 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc00cd80 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.915+0000 7fd9d1000640 1 -- 172.21.15.8:0/3152539342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc15c9d0 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.915+0000 7fd9d1000640 1 -- 172.21.15.8:0/3152539342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc13e660 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.916+0000 7fd9d1000640 1 -- 172.21.15.8:0/3152539342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9cc0b13a0 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.917+0000 7fd9c2000640 1 -- 172.21.15.8:0/3152539342 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd9bc013470 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.918+0000 7fd9c2000640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd9ac06ac00 0x7fd9ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:32.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.918+0000 7fd9c2000640 1 -- 172.21.15.8:0/3152539342 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd9bc0899f0 con 0x7fd9cc0b2c40 2024-05-26T15:40:32.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.919+0000 7fd9c9400640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd9ac06ac00 0x7fd9ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:32.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.920+0000 7fd9c9400640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd9ac06ac00 0x7fd9ac06d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8034000 tx=0x7fd9b802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:32.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:32.922+0000 7fd9c2000640 1 -- 172.21.15.8:0/3152539342 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd9bc054750 con 0x7fd9cc0b2c40 2024-05-26T15:40:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.121+0000 7fd9d1000640 1 -- 172.21.15.8:0/3152539342 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9cc154320 con 0x7fd9cc0b2c40 2024-05-26T15:40:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.122+0000 7fd9c2000640 1 -- 172.21.15.8:0/3152539342 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9cc154320 con 0x7fd9cc0b2c40 2024-05-26T15:40:33.121 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.125+0000 7fd9d1000640 1 -- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd9ac06ac00 msgr2=0x7fd9ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.125+0000 7fd9d1000640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd9ac06ac00 0x7fd9ac06d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8034000 tx=0x7fd9b802e000 comp rx=0 tx=0).stop 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.125+0000 7fd9d1000640 1 -- 172.21.15.8:0/3152539342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9cc0b2c40 msgr2=0x7fd9cc13e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.125+0000 7fd9d1000640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9cc0b2c40 0x7fd9cc13e120 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00e9e0 tx=0x7fd9bc00eea0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.126+0000 7fd9d1000640 1 -- 172.21.15.8:0/3152539342 shutdown_connections 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.126+0000 7fd9d1000640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd9cc159aa0 0x7fd9cc1401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.126+0000 7fd9d1000640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd9ac06ac00 0x7fd9ac06d0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.126+0000 7fd9d1000640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd9cc1596c0 0x7fd9cc13d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.126+0000 7fd9d1000640 1 --2- 172.21.15.8:0/3152539342 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd9cc0b2c40 0x7fd9cc13e120 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.126+0000 7fd9d1000640 1 -- 172.21.15.8:0/3152539342 >> 172.21.15.8:0/3152539342 conn(0x7fd9cc069e70 msgr2=0x7fd9cc15da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.126+0000 7fd9d1000640 1 -- 172.21.15.8:0/3152539342 shutdown_connections 2024-05-26T15:40:33.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.126+0000 7fd9d1000640 1 -- 172.21.15.8:0/3152539342 wait complete. 2024-05-26T15:40:33.141 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:33.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.353+0000 7fd1ad400640 1 Processor -- start 2024-05-26T15:40:33.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.353+0000 7fd1ad400640 1 -- start start 2024-05-26T15:40:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.355+0000 7fd1ad400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd1a8146380 0x7fd1a806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.355+0000 7fd1ad400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a806cc20 con 0x7fd1a815e1e0 2024-05-26T15:40:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.355+0000 7fd1ad400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a806cf00 con 0x7fd1a80703b0 2024-05-26T15:40:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.355+0000 7fd1ad400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a815e630 con 0x7fd1a8146380 2024-05-26T15:40:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.356+0000 7fd1aca00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd1a815e1e0 0x7fd1a80ad530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48722/0 (socket says 172.21.15.8:48722) 2024-05-26T15:40:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.356+0000 7fd1aca00640 1 -- 172.21.15.8:0/2916667921 learned_addr learned my addr 172.21.15.8:0/2916667921 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:33.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.356+0000 7fd1a7e00640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd1a8146380 0x7fd1a806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.356+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128049203 0 0) 0x7fd1a806cc20 con 0x7fd1a815e1e0 2024-05-26T15:40:33.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.356+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd18c003520 con 0x7fd1a815e1e0 2024-05-26T15:40:33.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3002169561 0 0) 0x7fd18c003520 con 0x7fd1a815e1e0 2024-05-26T15:40:33.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd1a8146380 msgr2=0x7fd1a806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:33.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd1a8146380 0x7fd1a806c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 >> v1:172.21.15.47:6789/0 conn(0x7fd1a80703b0 legacy=0x7fd1a815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a806d1e0 con 0x7fd1a815e1e0 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fd1a00019f0 con 0x7fd1a815e1e0 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 >> v1:172.21.15.8:6789/0 conn(0x7fd1a815e1e0 legacy=0x7fd1a80ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd1a8146380 0x7fd18c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd18c003ee0 0x7fd18c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd18c004d00 0x7fd18c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a815e630 con 0x7fd18c003ee0 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c00ba30 con 0x7fd18c004d00 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c00bbf0 con 0x7fd1a8146380 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.357+0000 7fd1a7400640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd18c003ee0 0x7fd18c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.358+0000 7fd1a7e00640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd1a8146380 0x7fd18c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.358+0000 7fd1aca00640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd18c004d00 0x7fd18c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.358+0000 7fd1a7400640 1 -- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd1a8146380 msgr2=0x7fd18c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:33.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.358+0000 7fd1a7400640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd1a8146380 0x7fd18c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.358+0000 7fd1a7400640 1 -- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd18c004d00 msgr2=0x7fd18c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:33.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.358+0000 7fd1a7400640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd18c004d00 0x7fd18c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.358+0000 7fd1a7400640 1 -- 172.21.15.8:0/2916667921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c003520 con 0x7fd18c003ee0 2024-05-26T15:40:33.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.359+0000 7fd1a7400640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd18c003ee0 0x7fd18c0047c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd190001860 tx=0x7fd18c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c889682fc80bca6b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:33.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.359+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19002abd0 con 0x7fd18c003ee0 2024-05-26T15:40:33.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.359+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19002ad50 con 0x7fd18c003ee0 2024-05-26T15:40:33.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.359+0000 7fd1a6a00640 1 -- 172.21.15.8:0/2916667921 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190032680 con 0x7fd18c003ee0 2024-05-26T15:40:33.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.359+0000 7fd1ad400640 1 -- 172.21.15.8:0/2916667921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd18c003ee0 msgr2=0x7fd18c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.359+0000 7fd1ad400640 1 --2- 172.21.15.8:0/2916667921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd18c003ee0 0x7fd18c0047c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd190001860 tx=0x7fd18c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.360+0000 7fd1aca00640 1 -- 172.21.15.8:0/2916667921 reap_dead start 2024-05-26T15:40:33.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.360+0000 7fd1ad400640 1 -- 172.21.15.8:0/2916667921 shutdown_connections 2024-05-26T15:40:33.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.360+0000 7fd1ad400640 1 -- 172.21.15.8:0/2916667921 >> 172.21.15.8:0/2916667921 conn(0x7fd1a8069e70 msgr2=0x7fd1a806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:33.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.360+0000 7fd1ad400640 1 -- 172.21.15.8:0/2916667921 shutdown_connections 2024-05-26T15:40:33.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.360+0000 7fd1ad400640 1 -- 172.21.15.8:0/2916667921 wait complete. 2024-05-26T15:40:33.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.361+0000 7fd1ad400640 1 Processor -- start 2024-05-26T15:40:33.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.362+0000 7fd1ad400640 1 -- start start 2024-05-26T15:40:33.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.362+0000 7fd1ad400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd18c003ee0 0x7fd1a813c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.362+0000 7fd1ad400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a815cfa0 0x7fd1a815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.362+0000 7fd1ad400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a80cd1d0 0x7fd1a80cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.362+0000 7fd1ad400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a81f2ce0 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.362+0000 7fd1ad400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a815d960 con 0x7fd1a815cfa0 2024-05-26T15:40:33.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.362+0000 7fd1ad400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a813cd90 con 0x7fd18c003ee0 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.363+0000 7fd1aca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a80cd1d0 0x7fd1a80cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.363+0000 7fd1aca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a80cd1d0 0x7fd1a80cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32842/0 (socket says 172.21.15.8:32842) 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.363+0000 7fd1aca00640 1 -- 172.21.15.8:0/2708242527 learned_addr learned my addr 172.21.15.8:0/2708242527 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.363+0000 7fd1a7e00640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd18c003ee0 0x7fd1a813c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.363+0000 7fd1a7400640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a815cfa0 0x7fd1a815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.363+0000 7fd1aca00640 1 -- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd18c003ee0 msgr2=0x7fd1a813c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.363+0000 7fd1aca00640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd18c003ee0 0x7fd1a813c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.363+0000 7fd1aca00640 1 -- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a815cfa0 msgr2=0x7fd1a815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.363+0000 7fd1aca00640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a815cfa0 0x7fd1a815d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.363+0000 7fd1aca00640 1 -- 172.21.15.8:0/2708242527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80cdb90 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.364+0000 7fd1aca00640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a80cd1d0 0x7fd1a80cd650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80ab950 tx=0x7fd1a000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.364+0000 7fd19fe00640 1 -- 172.21.15.8:0/2708242527 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0004d60 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.364+0000 7fd19fe00640 1 -- 172.21.15.8:0/2708242527 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a000bb20 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.364+0000 7fd19fe00640 1 -- 172.21.15.8:0/2708242527 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000bed0 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.364+0000 7fd1ad400640 1 -- 172.21.15.8:0/2708242527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a81f20a0 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.364+0000 7fd1ad400640 1 -- 172.21.15.8:0/2708242527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a81f31d0 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.365+0000 7fd1ad400640 1 -- 172.21.15.8:0/2708242527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a804e210 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.366+0000 7fd19fe00640 1 -- 172.21.15.8:0/2708242527 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd1a0007110 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.368+0000 7fd19fe00640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd18406ac00 0x7fd18406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.368+0000 7fd19fe00640 1 -- 172.21.15.8:0/2708242527 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd1a00899b0 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.368+0000 7fd1a7e00640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd18406ac00 0x7fd18406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.370+0000 7fd1a7e00640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd18406ac00 0x7fd18406d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd198009a10 tx=0x7fd198008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:33.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.372+0000 7fd19fe00640 1 -- 172.21.15.8:0/2708242527 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd1a00547a0 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.570+0000 7fd1ad400640 1 -- 172.21.15.8:0/2708242527 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1a80cdb90 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.571+0000 7fd19fe00640 1 -- 172.21.15.8:0/2708242527 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd1a80cdb90 con 0x7fd1a80cd1d0 2024-05-26T15:40:33.570 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:33.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 -- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd18406ac00 msgr2=0x7fd18406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd18406ac00 0x7fd18406d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd198009a10 tx=0x7fd198008040 comp rx=0 tx=0).stop 2024-05-26T15:40:33.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 -- 172.21.15.8:0/2708242527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a80cd1d0 msgr2=0x7fd1a80cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a80cd1d0 0x7fd1a80cd650 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd1a80ab950 tx=0x7fd1a000b4a0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 -- 172.21.15.8:0/2708242527 shutdown_connections 2024-05-26T15:40:33.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1a80cd1d0 0x7fd1a80cd650 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd18406ac00 0x7fd18406d0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1a815cfa0 0x7fd1a815d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 --2- 172.21.15.8:0/2708242527 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd18c003ee0 0x7fd1a813c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 -- 172.21.15.8:0/2708242527 >> 172.21.15.8:0/2708242527 conn(0x7fd1a8069e70 msgr2=0x7fd1a80b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:33.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 -- 172.21.15.8:0/2708242527 shutdown_connections 2024-05-26T15:40:33.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.574+0000 7fd1ad400640 1 -- 172.21.15.8:0/2708242527 wait complete. 2024-05-26T15:40:33.590 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.799+0000 7f3516a00640 1 Processor -- start 2024-05-26T15:40:33.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.799+0000 7f3516a00640 1 -- start start 2024-05-26T15:40:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.801+0000 7f3516a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3510144140 0x7f35100cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.801+0000 7f3516a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 0x7f351006cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.801+0000 7f3516a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3510144520 con 0x7f35100cd7c0 2024-05-26T15:40:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.801+0000 7f3516a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35100cdd80 con 0x7f3510144140 2024-05-26T15:40:33.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.801+0000 7f3516a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35100ce060 con 0x7f3510070ba0 2024-05-26T15:40:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.802+0000 7f3514a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 0x7f351006cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.802+0000 7f3514a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 0x7f351006cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:36320/0 (socket says 172.21.15.8:36320) 2024-05-26T15:40:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.802+0000 7f3514a00640 1 -- 172.21.15.8:0/2555361118 learned_addr learned my addr 172.21.15.8:0/2555361118 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:33.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.802+0000 7f350fe00640 1 --2- 172.21.15.8:0/2555361118 >> v2:172.21.15.47:3300/0 conn(0x7f3510144140 0x7f35100cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.802+0000 7f3514a00640 1 -- 172.21.15.8:0/2555361118 >> v2:172.21.15.47:3300/0 conn(0x7f3510144140 msgr2=0x7f35100cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.802+0000 7f3514a00640 1 --2- 172.21.15.8:0/2555361118 >> v2:172.21.15.47:3300/0 conn(0x7f3510144140 0x7f35100cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.802+0000 7f3514a00640 1 -- 172.21.15.8:0/2555361118 >> v1:172.21.15.47:6789/0 conn(0x7f35100cd7c0 legacy=0x7f3510070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.802+0000 7f3514a00640 1 -- 172.21.15.8:0/2555361118 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100ce340 con 0x7f3510070ba0 2024-05-26T15:40:33.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.804+0000 7f3514a00640 1 --2- 172.21.15.8:0/2555361118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 0x7f351006cc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3508009e50 tx=0x7f350802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf8fd82f1b37effb server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:33.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.804+0000 7f350ea00640 1 -- 172.21.15.8:0/2555361118 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350802aea0 con 0x7f3510070ba0 2024-05-26T15:40:33.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.804+0000 7f350ea00640 1 -- 172.21.15.8:0/2555361118 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350802d050 con 0x7f3510070ba0 2024-05-26T15:40:33.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.804+0000 7f350ea00640 1 -- 172.21.15.8:0/2555361118 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508031820 con 0x7f3510070ba0 2024-05-26T15:40:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.805+0000 7f3516a00640 1 -- 172.21.15.8:0/2555361118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 msgr2=0x7f351006cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.805+0000 7f3516a00640 1 --2- 172.21.15.8:0/2555361118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 0x7f351006cc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3508009e50 tx=0x7f350802a680 comp rx=0 tx=0).stop 2024-05-26T15:40:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.805+0000 7f3516a00640 1 -- 172.21.15.8:0/2555361118 shutdown_connections 2024-05-26T15:40:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.805+0000 7f3516a00640 1 --2- 172.21.15.8:0/2555361118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 0x7f351006cc90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.805+0000 7f3516a00640 1 --2- 172.21.15.8:0/2555361118 >> v2:172.21.15.47:3300/0 conn(0x7f3510144140 0x7f35100cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.805+0000 7f3516a00640 1 -- 172.21.15.8:0/2555361118 >> 172.21.15.8:0/2555361118 conn(0x7f3510069e70 msgr2=0x7f351006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.806+0000 7f3516a00640 1 -- 172.21.15.8:0/2555361118 shutdown_connections 2024-05-26T15:40:33.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.806+0000 7f3516a00640 1 -- 172.21.15.8:0/2555361118 wait complete. 2024-05-26T15:40:33.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.808+0000 7f3516a00640 1 Processor -- start 2024-05-26T15:40:33.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.808+0000 7f3516a00640 1 -- start start 2024-05-26T15:40:33.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.810+0000 7f3516a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 0x7f35100b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.810+0000 7f3516a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35100cd7c0 0x7f351013bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.810+0000 7f3516a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3510144140 0x7f3510159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.810+0000 7f3516a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351013ece0 con 0x7f3510144140 2024-05-26T15:40:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.810+0000 7f3516a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351013ea00 con 0x7f35100cd7c0 2024-05-26T15:40:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.810+0000 7f3516a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351015b1d0 con 0x7f3510070ba0 2024-05-26T15:40:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.810+0000 7f3514a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3510144140 0x7f3510159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.810+0000 7f3514a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3510144140 0x7f3510159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32852/0 (socket says 172.21.15.8:32852) 2024-05-26T15:40:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.810+0000 7f3514a00640 1 -- 172.21.15.8:0/815699509 learned_addr learned my addr 172.21.15.8:0/815699509 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.810+0000 7f350fe00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 0x7f35100b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.811+0000 7f350f400640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35100cd7c0 0x7f351013bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.811+0000 7f3514a00640 1 -- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 msgr2=0x7f35100b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.811+0000 7f3514a00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 0x7f35100b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.811+0000 7f3514a00640 1 -- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35100cd7c0 msgr2=0x7f351013bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.811+0000 7f3514a00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35100cd7c0 0x7f351013bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.811+0000 7f3514a00640 1 -- 172.21.15.8:0/815699509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3508009b30 con 0x7f3510144140 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.811+0000 7f350f400640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35100cd7c0 0x7f351013bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.811+0000 7f3514a00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3510144140 0x7f3510159e00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3508009e50 tx=0x7f3508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.812+0000 7f3507e00640 1 -- 172.21.15.8:0/815699509 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350803d860 con 0x7f3510144140 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.812+0000 7f3507e00640 1 -- 172.21.15.8:0/815699509 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350803d9c0 con 0x7f3510144140 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.812+0000 7f3516a00640 1 -- 172.21.15.8:0/815699509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35100cefa0 con 0x7f3510144140 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.812+0000 7f3507e00640 1 -- 172.21.15.8:0/815699509 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350803dd70 con 0x7f3510144140 2024-05-26T15:40:33.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.812+0000 7f3516a00640 1 -- 172.21.15.8:0/815699509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351015b790 con 0x7f3510144140 2024-05-26T15:40:33.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.813+0000 7f3516a00640 1 -- 172.21.15.8:0/815699509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351004e210 con 0x7f3510144140 2024-05-26T15:40:33.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.814+0000 7f3507e00640 1 -- 172.21.15.8:0/815699509 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f350803b400 con 0x7f3510144140 2024-05-26T15:40:33.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.816+0000 7f3507e00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f34f006ac30 0x7f34f006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:33.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.816+0000 7f3507e00640 1 -- 172.21.15.8:0/815699509 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f35080aa3a0 con 0x7f3510144140 2024-05-26T15:40:33.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.816+0000 7f350fe00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f34f006ac30 0x7f34f006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:33.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.818+0000 7f350fe00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f34f006ac30 0x7f34f006d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3500009aa0 tx=0x7f3500009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:33.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:33.821+0000 7f3507e00640 1 -- 172.21.15.8:0/815699509 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3508075190 con 0x7f3510144140 2024-05-26T15:40:34.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.023+0000 7f3516a00640 1 -- 172.21.15.8:0/815699509 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f35100cb250 con 0x7f3510144140 2024-05-26T15:40:34.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.023+0000 7f3507e00640 1 -- 172.21.15.8:0/815699509 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3508009510 con 0x7f3510144140 2024-05-26T15:40:34.022 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:34.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 -- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f34f006ac30 msgr2=0x7f34f006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f34f006ac30 0x7f34f006d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3500009aa0 tx=0x7f3500009190 comp rx=0 tx=0).stop 2024-05-26T15:40:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 -- 172.21.15.8:0/815699509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3510144140 msgr2=0x7f3510159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3510144140 0x7f3510159e00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3508009e50 tx=0x7f3508004a40 comp rx=0 tx=0).stop 2024-05-26T15:40:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 -- 172.21.15.8:0/815699509 shutdown_connections 2024-05-26T15:40:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3510144140 0x7f3510159e00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f34f006ac30 0x7f34f006d0f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35100cd7c0 0x7f351013bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 --2- 172.21.15.8:0/815699509 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3510070ba0 0x7f35100b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 -- 172.21.15.8:0/815699509 >> 172.21.15.8:0/815699509 conn(0x7f3510069e70 msgr2=0x7f35100cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 -- 172.21.15.8:0/815699509 shutdown_connections 2024-05-26T15:40:34.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.027+0000 7f3516a00640 1 -- 172.21.15.8:0/815699509 wait complete. 2024-05-26T15:40:34.046 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.252+0000 7f6055e00640 1 Processor -- start 2024-05-26T15:40:34.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.252+0000 7f6055e00640 1 -- start start 2024-05-26T15:40:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.254+0000 7f6055e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6050154f50 0x7f60500b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.254+0000 7f6055e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605015b640 con 0x7f60500c36c0 2024-05-26T15:40:34.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.254+0000 7f6055e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605015b920 con 0x7f605015ae70 2024-05-26T15:40:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.254+0000 7f6055e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605015bee0 con 0x7f6050154f50 2024-05-26T15:40:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.254+0000 7f6055400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f60500c36c0 0x7f60500cd3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48726/0 (socket says 172.21.15.8:48726) 2024-05-26T15:40:34.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.254+0000 7f6055400640 1 -- 172.21.15.8:0/249740170 learned_addr learned my addr 172.21.15.8:0/249740170 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776739077 0 0) 0x7f605015b640 con 0x7f60500c36c0 2024-05-26T15:40:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6034003520 con 0x7f60500c36c0 2024-05-26T15:40:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f6054a00640 1 --2- 172.21.15.8:0/249740170 >> v2:172.21.15.47:3300/0 conn(0x7f6050154f50 0x7f60500b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1192990408 0 0) 0x7f6034003520 con 0x7f60500c36c0 2024-05-26T15:40:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 >> v2:172.21.15.47:3300/0 conn(0x7f6050154f50 msgr2=0x7f60500b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 --2- 172.21.15.8:0/249740170 >> v2:172.21.15.47:3300/0 conn(0x7f6050154f50 0x7f60500b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 >> v1:172.21.15.47:6789/0 conn(0x7f605015ae70 legacy=0x7f605015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605015bc00 con 0x7f60500c36c0 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f60480019f0 con 0x7f60500c36c0 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 >> v1:172.21.15.8:6789/0 conn(0x7f60500c36c0 legacy=0x7f60500cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60340039c0 0x7f6034003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60340047c0 0x7f6034004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60340051d0 0x7f603400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605015bee0 con 0x7f60340047c0 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603400c120 con 0x7f60340039c0 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603400c2e0 con 0x7f60340051d0 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.255+0000 7f6054a00640 1 --2- 172.21.15.8:0/249740170 >> v2:172.21.15.47:3300/0 conn(0x7f6050154f50 0x7f60500b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.256+0000 7f604fe00640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60340047c0 0x7f6034004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.256+0000 7f6055400640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60340051d0 0x7f603400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.256+0000 7f6054a00640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60340039c0 0x7f6034003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.256+0000 7f604fe00640 1 -- 172.21.15.8:0/249740170 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60340051d0 msgr2=0x7f603400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.256+0000 7f604fe00640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60340051d0 0x7f603400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.256+0000 7f604fe00640 1 -- 172.21.15.8:0/249740170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60340039c0 msgr2=0x7f6034003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.256+0000 7f604fe00640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60340039c0 0x7f6034003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.256+0000 7f604fe00640 1 -- 172.21.15.8:0/249740170 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034003520 con 0x7f60340047c0 2024-05-26T15:40:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.256+0000 7f6055400640 1 -- 172.21.15.8:0/249740170 reap_dead start 2024-05-26T15:40:34.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.256+0000 7f6054a00640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60340039c0 0x7f6034003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.257+0000 7f604fe00640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60340047c0 0x7f6034004c40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f603c001750 tx=0x7f60340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d058d7d1b022c24 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.258+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c0052d0 con 0x7f60340047c0 2024-05-26T15:40:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.258+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c005430 con 0x7f60340047c0 2024-05-26T15:40:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.258+0000 7f604f400640 1 -- 172.21.15.8:0/249740170 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c02abe0 con 0x7f60340047c0 2024-05-26T15:40:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.258+0000 7f6055e00640 1 -- 172.21.15.8:0/249740170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60340047c0 msgr2=0x7f6034004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.258+0000 7f6055e00640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60340047c0 0x7f6034004c40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f603c001750 tx=0x7f60340057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.258+0000 7f6055e00640 1 -- 172.21.15.8:0/249740170 shutdown_connections 2024-05-26T15:40:34.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.258+0000 7f6055e00640 1 --2- 172.21.15.8:0/249740170 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f60340047c0 0x7f6034004c40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.258+0000 7f6055e00640 1 -- 172.21.15.8:0/249740170 >> 172.21.15.8:0/249740170 conn(0x7f6050070480 msgr2=0x7f6050070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:34.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.258+0000 7f6055e00640 1 -- 172.21.15.8:0/249740170 shutdown_connections 2024-05-26T15:40:34.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.258+0000 7f6055e00640 1 -- 172.21.15.8:0/249740170 wait complete. 2024-05-26T15:40:34.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.260+0000 7f6055e00640 1 Processor -- start 2024-05-26T15:40:34.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.260+0000 7f6055e00640 1 -- start start 2024-05-26T15:40:34.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.261+0000 7f6055e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60340047c0 0x7f605014ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.261+0000 7f6055e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014d030 0x7f605014d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.261+0000 7f6055e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60500cd1b0 0x7f60500cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.261+0000 7f6055e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60500cdb70 con 0x7f605014d030 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.261+0000 7f6055e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605014e690 con 0x7f60340047c0 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.261+0000 7f6055e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605014b140 con 0x7f60500cd1b0 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.261+0000 7f604fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014d030 0x7f605014d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.262+0000 7f604fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014d030 0x7f605014d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32866/0 (socket says 172.21.15.8:32866) 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.262+0000 7f604fe00640 1 -- 172.21.15.8:0/1755448642 learned_addr learned my addr 172.21.15.8:0/1755448642 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.262+0000 7f6054a00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60340047c0 0x7f605014ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.262+0000 7f6055400640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60500cd1b0 0x7f60500cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.262+0000 7f604fe00640 1 -- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60500cd1b0 msgr2=0x7f60500cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.262+0000 7f604fe00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60500cd1b0 0x7f60500cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.262+0000 7f604fe00640 1 -- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60340047c0 msgr2=0x7f605014ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.262+0000 7f604fe00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60340047c0 0x7f605014ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.262+0000 7f604fe00640 1 -- 172.21.15.8:0/1755448642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605014da80 con 0x7f605014d030 2024-05-26T15:40:34.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.262+0000 7f604fe00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014d030 0x7f605014d490 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f603c02a4c0 tx=0x7f603c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:34.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.263+0000 7f604cc00640 1 -- 172.21.15.8:0/1755448642 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c007670 con 0x7f605014d030 2024-05-26T15:40:34.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.263+0000 7f604cc00640 1 -- 172.21.15.8:0/1755448642 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c007a30 con 0x7f605014d030 2024-05-26T15:40:34.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.263+0000 7f604cc00640 1 -- 172.21.15.8:0/1755448642 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c0069f0 con 0x7f605014d030 2024-05-26T15:40:34.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.263+0000 7f6055e00640 1 -- 172.21.15.8:0/1755448642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605014dd60 con 0x7f605014d030 2024-05-26T15:40:34.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.263+0000 7f6055e00640 1 -- 172.21.15.8:0/1755448642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605014e320 con 0x7f605014d030 2024-05-26T15:40:34.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.264+0000 7f6055e00640 1 -- 172.21.15.8:0/1755448642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605014e820 con 0x7f605014d030 2024-05-26T15:40:34.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.265+0000 7f604cc00640 1 -- 172.21.15.8:0/1755448642 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f603c006b50 con 0x7f605014d030 2024-05-26T15:40:34.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.266+0000 7f604cc00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f603006ac00 0x7f603006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.266+0000 7f604cc00640 1 -- 172.21.15.8:0/1755448642 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f603c0a9730 con 0x7f605014d030 2024-05-26T15:40:34.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.267+0000 7f6054a00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f603006ac00 0x7f603006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.268+0000 7f6054a00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f603006ac00 0x7f603006d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6040006fd0 tx=0x7f6040008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:34.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.270+0000 7f604cc00640 1 -- 172.21.15.8:0/1755448642 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f603c074400 con 0x7f605014d030 2024-05-26T15:40:34.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.471+0000 7f6055e00640 1 -- 172.21.15.8:0/1755448642 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f605014e4e0 con 0x7f605014d030 2024-05-26T15:40:34.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.475+0000 7f604cc00640 1 -- 172.21.15.8:0/1755448642 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7f603c077a20 con 0x7f605014d030 2024-05-26T15:40:34.473 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:34.474 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:34.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.477+0000 7f6055e00640 1 -- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f603006ac00 msgr2=0x7f603006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.477+0000 7f6055e00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f603006ac00 0x7f603006d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6040006fd0 tx=0x7f6040008040 comp rx=0 tx=0).stop 2024-05-26T15:40:34.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.477+0000 7f6055e00640 1 -- 172.21.15.8:0/1755448642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014d030 msgr2=0x7f605014d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.477+0000 7f6055e00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014d030 0x7f605014d490 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f603c02a4c0 tx=0x7f603c001120 comp rx=0 tx=0).stop 2024-05-26T15:40:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.478+0000 7f6055e00640 1 -- 172.21.15.8:0/1755448642 shutdown_connections 2024-05-26T15:40:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.478+0000 7f6055e00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f60500cd1b0 0x7f60500cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.478+0000 7f6055e00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f605014d030 0x7f605014d490 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.478+0000 7f6055e00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f603006ac00 0x7f603006d0c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.478+0000 7f6055e00640 1 --2- 172.21.15.8:0/1755448642 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f60340047c0 0x7f605014ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.478+0000 7f6055e00640 1 -- 172.21.15.8:0/1755448642 >> 172.21.15.8:0/1755448642 conn(0x7f6050070480 msgr2=0x7f60501598c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.478+0000 7f6055e00640 1 -- 172.21.15.8:0/1755448642 shutdown_connections 2024-05-26T15:40:34.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.478+0000 7f6055e00640 1 -- 172.21.15.8:0/1755448642 wait complete. 2024-05-26T15:40:34.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:34.497 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:34.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.713+0000 7fe506000640 1 Processor -- start 2024-05-26T15:40:34.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.714+0000 7fe506000640 1 -- start start 2024-05-26T15:40:34.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.715+0000 7fe506000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe500160100 0x7fe500160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.715+0000 7fe506000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe500145d60 0x7fe50006b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.715+0000 7fe506000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50006ab90 con 0x7fe50006b560 2024-05-26T15:40:34.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.715+0000 7fe506000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5000ae8e0 con 0x7fe500145d60 2024-05-26T15:40:34.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.715+0000 7fe506000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe500161510 con 0x7fe500160100 2024-05-26T15:40:34.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.716+0000 7fe4ffe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe500145d60 0x7fe50006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.716+0000 7fe505600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe50006b560 0x7fe5000cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48736/0 (socket says 172.21.15.8:48736) 2024-05-26T15:40:34.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.716+0000 7fe505600640 1 -- 172.21.15.8:0/4087834710 learned_addr learned my addr 172.21.15.8:0/4087834710 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:34.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.716+0000 7fe504c00640 1 --2- 172.21.15.8:0/4087834710 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe500160100 0x7fe500160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.716+0000 7fe4ffe00640 1 -- 172.21.15.8:0/4087834710 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe500160100 msgr2=0x7fe500160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:34.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.716+0000 7fe4ffe00640 1 --2- 172.21.15.8:0/4087834710 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe500160100 0x7fe500160fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.716+0000 7fe4ffe00640 1 -- 172.21.15.8:0/4087834710 >> v1:172.21.15.8:6789/0 conn(0x7fe50006b560 legacy=0x7fe5000cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.716+0000 7fe4ff400640 1 -- 172.21.15.8:0/4087834710 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934269272 0 0) 0x7fe50006ab90 con 0x7fe50006b560 2024-05-26T15:40:34.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.716+0000 7fe4ffe00640 1 -- 172.21.15.8:0/4087834710 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe500069f80 con 0x7fe500145d60 2024-05-26T15:40:34.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.717+0000 7fe4ffe00640 1 --2- 172.21.15.8:0/4087834710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe500145d60 0x7fe50006b020 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0097a0 tx=0x7fe4ec02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bc340a8309c706 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.718+0000 7fe4ff400640 1 -- 172.21.15.8:0/4087834710 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec02ae50 con 0x7fe500145d60 2024-05-26T15:40:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.718+0000 7fe4ff400640 1 -- 172.21.15.8:0/4087834710 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec032440 con 0x7fe500145d60 2024-05-26T15:40:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.718+0000 7fe4ff400640 1 -- 172.21.15.8:0/4087834710 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0327d0 con 0x7fe500145d60 2024-05-26T15:40:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.718+0000 7fe506000640 1 -- 172.21.15.8:0/4087834710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe500145d60 msgr2=0x7fe50006b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.718+0000 7fe506000640 1 --2- 172.21.15.8:0/4087834710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe500145d60 0x7fe50006b020 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0097a0 tx=0x7fe4ec02a100 comp rx=0 tx=0).stop 2024-05-26T15:40:34.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.719+0000 7fe506000640 1 -- 172.21.15.8:0/4087834710 shutdown_connections 2024-05-26T15:40:34.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.719+0000 7fe506000640 1 --2- 172.21.15.8:0/4087834710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe500145d60 0x7fe50006b020 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.719+0000 7fe506000640 1 --2- 172.21.15.8:0/4087834710 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe500160100 0x7fe500160fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.719+0000 7fe506000640 1 -- 172.21.15.8:0/4087834710 >> 172.21.15.8:0/4087834710 conn(0x7fe5000cb800 msgr2=0x7fe5000cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:34.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.719+0000 7fe506000640 1 -- 172.21.15.8:0/4087834710 shutdown_connections 2024-05-26T15:40:34.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.719+0000 7fe506000640 1 -- 172.21.15.8:0/4087834710 wait complete. 2024-05-26T15:40:34.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.721+0000 7fe506000640 1 Processor -- start 2024-05-26T15:40:34.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.721+0000 7fe506000640 1 -- start start 2024-05-26T15:40:34.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.723+0000 7fe506000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe50006b560 0x7fe5000c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.723+0000 7fe506000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe500145d60 0x7fe5000b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.723+0000 7fe506000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe500160100 0x7fe5001f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.723+0000 7fe506000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5000c4430 con 0x7fe50006b560 2024-05-26T15:40:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.723+0000 7fe506000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe500143b60 con 0x7fe500160100 2024-05-26T15:40:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.723+0000 7fe506000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe500143e40 con 0x7fe500145d60 2024-05-26T15:40:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.723+0000 7fe504c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe50006b560 0x7fe5000c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.723+0000 7fe504c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe50006b560 0x7fe5000c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32888/0 (socket says 172.21.15.8:32888) 2024-05-26T15:40:34.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.723+0000 7fe504c00640 1 -- 172.21.15.8:0/3952127898 learned_addr learned my addr 172.21.15.8:0/3952127898 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:34.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.724+0000 7fe4ffe00640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe500145d60 0x7fe5000b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.724+0000 7fe505600640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe500160100 0x7fe5001f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.724+0000 7fe504c00640 1 -- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe500145d60 msgr2=0x7fe5000b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.724+0000 7fe504c00640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe500145d60 0x7fe5000b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.724+0000 7fe504c00640 1 -- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe500160100 msgr2=0x7fe5001f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.724+0000 7fe504c00640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe500160100 0x7fe5001f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.724+0000 7fe504c00640 1 -- 172.21.15.8:0/3952127898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec009400 con 0x7fe50006b560 2024-05-26T15:40:34.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.724+0000 7fe504c00640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe50006b560 0x7fe5000c3d20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400d800 tx=0x7fe4f400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.724+0000 7fe4fcc00640 1 -- 172.21.15.8:0/3952127898 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400b6c0 con 0x7fe50006b560 2024-05-26T15:40:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.725+0000 7fe4fcc00640 1 -- 172.21.15.8:0/3952127898 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f400b820 con 0x7fe50006b560 2024-05-26T15:40:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.725+0000 7fe4fcc00640 1 -- 172.21.15.8:0/3952127898 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400bbb0 con 0x7fe50006b560 2024-05-26T15:40:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.725+0000 7fe506000640 1 -- 172.21.15.8:0/3952127898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe500144120 con 0x7fe50006b560 2024-05-26T15:40:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.725+0000 7fe506000640 1 -- 172.21.15.8:0/3952127898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe500144920 con 0x7fe50006b560 2024-05-26T15:40:34.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.726+0000 7fe506000640 1 -- 172.21.15.8:0/3952127898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50004e210 con 0x7fe50006b560 2024-05-26T15:40:34.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.727+0000 7fe4fcc00640 1 -- 172.21.15.8:0/3952127898 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe4f400bd10 con 0x7fe50006b560 2024-05-26T15:40:34.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.729+0000 7fe4fcc00640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe4e006ac00 0x7fe4e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:34.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.729+0000 7fe4fcc00640 1 -- 172.21.15.8:0/3952127898 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe4f4089d80 con 0x7fe50006b560 2024-05-26T15:40:34.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.730+0000 7fe4ffe00640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe4e006ac00 0x7fe4e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:34.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.732+0000 7fe4ffe00640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe4e006ac00 0x7fe4e006d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec034000 tx=0x7fe4ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:34.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.732+0000 7fe4fcc00640 1 -- 172.21.15.8:0/3952127898 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe4f4054ae0 con 0x7fe50006b560 2024-05-26T15:40:34.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.930+0000 7fe506000640 1 -- 172.21.15.8:0/3952127898 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5000c4570 con 0x7fe50006b560 2024-05-26T15:40:34.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.931+0000 7fe4fcc00640 1 -- 172.21.15.8:0/3952127898 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4f4058100 con 0x7fe50006b560 2024-05-26T15:40:34.930 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:34.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.934+0000 7fe506000640 1 -- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe4e006ac00 msgr2=0x7fe4e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.934+0000 7fe506000640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe4e006ac00 0x7fe4e006d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec034000 tx=0x7fe4ec02e000 comp rx=0 tx=0).stop 2024-05-26T15:40:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.934+0000 7fe506000640 1 -- 172.21.15.8:0/3952127898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe50006b560 msgr2=0x7fe5000c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.934+0000 7fe506000640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe50006b560 0x7fe5000c3d20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400d800 tx=0x7fe4f400dcc0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.934+0000 7fe506000640 1 -- 172.21.15.8:0/3952127898 shutdown_connections 2024-05-26T15:40:34.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.934+0000 7fe506000640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe4e006ac00 0x7fe4e006d0c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.934+0000 7fe506000640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe500160100 0x7fe5001f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.934+0000 7fe506000640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe500145d60 0x7fe5000b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.934+0000 7fe506000640 1 --2- 172.21.15.8:0/3952127898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe50006b560 0x7fe5000c3d20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.934+0000 7fe506000640 1 -- 172.21.15.8:0/3952127898 >> 172.21.15.8:0/3952127898 conn(0x7fe5000cb800 msgr2=0x7fe5000cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.935+0000 7fe506000640 1 -- 172.21.15.8:0/3952127898 shutdown_connections 2024-05-26T15:40:34.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:34.935+0000 7fe506000640 1 -- 172.21.15.8:0/3952127898 wait complete. 2024-05-26T15:40:34.953 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:35.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.165+0000 7fbc6b200640 1 Processor -- start 2024-05-26T15:40:35.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.165+0000 7fbc6b200640 1 -- start start 2024-05-26T15:40:35.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.166+0000 7fbc6b200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbc6c15cab0 0x7fbc6c0b8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.166+0000 7fbc6b200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc6c0cd700 0x7fbc6c0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.166+0000 7fbc6b200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c0ce080 con 0x7fbc6c0b1b70 2024-05-26T15:40:35.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.166+0000 7fbc6b200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c0d19e0 con 0x7fbc6c0cd700 2024-05-26T15:40:35.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.166+0000 7fbc6b200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c0d0da0 con 0x7fbc6c15cab0 2024-05-26T15:40:35.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.167+0000 7fbc6a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc6c0cd700 0x7fbc6c0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:35.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.167+0000 7fbc6a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbc6c0cd700 0x7fbc6c0cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32900/0 (socket says 172.21.15.8:32900) 2024-05-26T15:40:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.167+0000 7fbc6a800640 1 -- 172.21.15.8:0/3347768889 learned_addr learned my addr 172.21.15.8:0/3347768889 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.167+0000 7fbc6a800640 1 -- 172.21.15.8:0/3347768889 >> v2:172.21.15.47:3300/0 conn(0x7fbc6c15cab0 msgr2=0x7fbc6c0b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.167+0000 7fbc6a800640 1 --2- 172.21.15.8:0/3347768889 >> v2:172.21.15.47:3300/0 conn(0x7fbc6c15cab0 0x7fbc6c0b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.167+0000 7fbc6a800640 1 -- 172.21.15.8:0/3347768889 >> v1:172.21.15.47:6789/0 conn(0x7fbc6c0b1b70 legacy=0x7fbc6c0d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:35.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.167+0000 7fbc6a800640 1 -- 172.21.15.8:0/3347768889 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0d1040 con 0x7fbc6c0cd700 2024-05-26T15:40:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.169+0000 7fbc6a800640 1 --2- 172.21.15.8:0/3347768889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0cd700 0x7fbc6c0cdb40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c06c230 tx=0x7fbc6402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65e0ac236b42083 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.169+0000 7fbc68a00640 1 -- 172.21.15.8:0/3347768889 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64031600 con 0x7fbc6c0cd700 2024-05-26T15:40:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.169+0000 7fbc68a00640 1 -- 172.21.15.8:0/3347768889 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6402d050 con 0x7fbc6c0cd700 2024-05-26T15:40:35.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.169+0000 7fbc68a00640 1 -- 172.21.15.8:0/3347768889 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64031980 con 0x7fbc6c0cd700 2024-05-26T15:40:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.170+0000 7fbc6b200640 1 -- 172.21.15.8:0/3347768889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0cd700 msgr2=0x7fbc6c0cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.170+0000 7fbc6b200640 1 --2- 172.21.15.8:0/3347768889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0cd700 0x7fbc6c0cdb40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c06c230 tx=0x7fbc6402a5d0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.170+0000 7fbc6b200640 1 -- 172.21.15.8:0/3347768889 shutdown_connections 2024-05-26T15:40:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.170+0000 7fbc6b200640 1 --2- 172.21.15.8:0/3347768889 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c0cd700 0x7fbc6c0cdb40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.170+0000 7fbc6b200640 1 --2- 172.21.15.8:0/3347768889 >> v2:172.21.15.47:3300/0 conn(0x7fbc6c15cab0 0x7fbc6c0b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.170+0000 7fbc6b200640 1 -- 172.21.15.8:0/3347768889 >> 172.21.15.8:0/3347768889 conn(0x7fbc6c06b640 msgr2=0x7fbc6c06ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.170+0000 7fbc6b200640 1 -- 172.21.15.8:0/3347768889 shutdown_connections 2024-05-26T15:40:35.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.170+0000 7fbc6b200640 1 -- 172.21.15.8:0/3347768889 wait complete. 2024-05-26T15:40:35.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.172+0000 7fbc6b200640 1 Processor -- start 2024-05-26T15:40:35.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.172+0000 7fbc6b200640 1 -- start start 2024-05-26T15:40:35.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.173+0000 7fbc6b200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc6c0b1b70 0x7fbc6c0cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.173+0000 7fbc6b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc6c0cd700 0x7fbc6c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.173+0000 7fbc6b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c15cab0 0x7fbc6c157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.173+0000 7fbc6b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c153e70 con 0x7fbc6c15cab0 2024-05-26T15:40:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.173+0000 7fbc6b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c154df0 con 0x7fbc6c0cd700 2024-05-26T15:40:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.173+0000 7fbc6b200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c156d10 con 0x7fbc6c0b1b70 2024-05-26T15:40:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.173+0000 7fbc6a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c15cab0 0x7fbc6c157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.173+0000 7fbc6a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c15cab0 0x7fbc6c157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32914/0 (socket says 172.21.15.8:32914) 2024-05-26T15:40:35.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.173+0000 7fbc6a800640 1 -- 172.21.15.8:0/2115125670 learned_addr learned my addr 172.21.15.8:0/2115125670 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:35.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc69e00640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc6c0b1b70 0x7fbc6c0cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:35.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc6a800640 1 -- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc6c0b1b70 msgr2=0x7fbc6c0cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:35.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc69400640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc6c0cd700 0x7fbc6c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc6a800640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc6c0b1b70 0x7fbc6c0cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc6a800640 1 -- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc6c0cd700 msgr2=0x7fbc6c0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc6a800640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc6c0cd700 0x7fbc6c0cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc6a800640 1 -- 172.21.15.8:0/2115125670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc64009b30 con 0x7fbc6c15cab0 2024-05-26T15:40:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc6a800640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c15cab0 0x7fbc6c157480 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009f40 tx=0x7fbc64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc62000640 1 -- 172.21.15.8:0/2115125670 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6403c630 con 0x7fbc6c15cab0 2024-05-26T15:40:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc62000640 1 -- 172.21.15.8:0/2115125670 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6403c7b0 con 0x7fbc6c15cab0 2024-05-26T15:40:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc6b200640 1 -- 172.21.15.8:0/2115125670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c156ff0 con 0x7fbc6c15cab0 2024-05-26T15:40:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.174+0000 7fbc62000640 1 -- 172.21.15.8:0/2115125670 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6403cb60 con 0x7fbc6c15cab0 2024-05-26T15:40:35.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.175+0000 7fbc6b200640 1 -- 172.21.15.8:0/2115125670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c154830 con 0x7fbc6c15cab0 2024-05-26T15:40:35.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.176+0000 7fbc6b200640 1 -- 172.21.15.8:0/2115125670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6c157180 con 0x7fbc6c15cab0 2024-05-26T15:40:35.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.177+0000 7fbc62000640 1 -- 172.21.15.8:0/2115125670 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc6403ccc0 con 0x7fbc6c15cab0 2024-05-26T15:40:35.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.178+0000 7fbc62000640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc4806ac00 0x7fbc4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.178+0000 7fbc62000640 1 -- 172.21.15.8:0/2115125670 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbc640aa5b0 con 0x7fbc6c15cab0 2024-05-26T15:40:35.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.178+0000 7fbc69e00640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc4806ac00 0x7fbc4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:35.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.180+0000 7fbc69e00640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc4806ac00 0x7fbc4806d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00a770 tx=0x7fbc5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:35.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.182+0000 7fbc62000640 1 -- 172.21.15.8:0/2115125670 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbc64075340 con 0x7fbc6c15cab0 2024-05-26T15:40:35.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.381+0000 7fbc6b200640 1 -- 172.21.15.8:0/2115125670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc6c04e210 con 0x7fbc6c15cab0 2024-05-26T15:40:35.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.382+0000 7fbc62000640 1 -- 172.21.15.8:0/2115125670 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc64040020 con 0x7fbc6c15cab0 2024-05-26T15:40:35.380 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 -- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc4806ac00 msgr2=0x7fbc4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc4806ac00 0x7fbc4806d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00a770 tx=0x7fbc5c008040 comp rx=0 tx=0).stop 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 -- 172.21.15.8:0/2115125670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c15cab0 msgr2=0x7fbc6c157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c15cab0 0x7fbc6c157480 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbc64009f40 tx=0x7fbc64004a40 comp rx=0 tx=0).stop 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 -- 172.21.15.8:0/2115125670 shutdown_connections 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc6c15cab0 0x7fbc6c157480 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc4806ac00 0x7fbc4806d0c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc6c0cd700 0x7fbc6c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 --2- 172.21.15.8:0/2115125670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc6c0b1b70 0x7fbc6c0cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 -- 172.21.15.8:0/2115125670 >> 172.21.15.8:0/2115125670 conn(0x7fbc6c06b640 msgr2=0x7fbc6c0d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:35.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 -- 172.21.15.8:0/2115125670 shutdown_connections 2024-05-26T15:40:35.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.385+0000 7fbc6b200640 1 -- 172.21.15.8:0/2115125670 wait complete. 2024-05-26T15:40:35.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:35.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.611+0000 7f939b200640 1 Processor -- start 2024-05-26T15:40:35.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.612+0000 7f939b200640 1 -- start start 2024-05-26T15:40:35.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.613+0000 7f939b200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f939c13d860 0x7f939c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.613+0000 7f939b200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c0cd070 0x7f939c0703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.613+0000 7f939b200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939c15f140 con 0x7f939c06c3d0 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.613+0000 7f939b200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939c15e550 con 0x7f939c13d860 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.613+0000 7f939b200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c15e810 con 0x7f939c0cd070 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.614+0000 7f9399e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f939c13d860 0x7f939c0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.614+0000 7f9399e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f939c13d860 0x7f939c0ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32924/0 (socket says 172.21.15.8:32924) 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.614+0000 7f9399e00640 1 -- 172.21.15.8:0/720369235 learned_addr learned my addr 172.21.15.8:0/720369235 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.614+0000 7f9399400640 1 --2- 172.21.15.8:0/720369235 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c0cd070 0x7f939c0703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.614+0000 7f9399e00640 1 -- 172.21.15.8:0/720369235 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c0cd070 msgr2=0x7f939c0703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.614+0000 7f9399e00640 1 --2- 172.21.15.8:0/720369235 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c0cd070 0x7f939c0703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.614+0000 7f9399e00640 1 -- 172.21.15.8:0/720369235 >> v1:172.21.15.47:6789/0 conn(0x7f939c06c3d0 legacy=0x7f939c06d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:35.613 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.614+0000 7f9399e00640 1 -- 172.21.15.8:0/720369235 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c15eaf0 con 0x7f939c13d860 2024-05-26T15:40:35.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.616+0000 7f9399e00640 1 --2- 172.21.15.8:0/720369235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c13d860 0x7f939c0ccb30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f938c009870 tx=0x7f938c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6088e1cc731e543b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:35.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.616+0000 7f9398a00640 1 -- 172.21.15.8:0/720369235 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c02ae90 con 0x7f939c13d860 2024-05-26T15:40:35.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.616+0000 7f9398a00640 1 -- 172.21.15.8:0/720369235 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c032440 con 0x7f939c13d860 2024-05-26T15:40:35.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.616+0000 7f9398a00640 1 -- 172.21.15.8:0/720369235 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c0327d0 con 0x7f939c13d860 2024-05-26T15:40:35.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.617+0000 7f939b200640 1 -- 172.21.15.8:0/720369235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c13d860 msgr2=0x7f939c0ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:35.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.617+0000 7f939b200640 1 --2- 172.21.15.8:0/720369235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c13d860 0x7f939c0ccb30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f938c009870 tx=0x7f938c02a180 comp rx=0 tx=0).stop 2024-05-26T15:40:35.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.617+0000 7f939b200640 1 -- 172.21.15.8:0/720369235 shutdown_connections 2024-05-26T15:40:35.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.617+0000 7f939b200640 1 --2- 172.21.15.8:0/720369235 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c0cd070 0x7f939c0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.617+0000 7f939b200640 1 --2- 172.21.15.8:0/720369235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c13d860 0x7f939c0ccb30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.617+0000 7f939b200640 1 -- 172.21.15.8:0/720369235 >> 172.21.15.8:0/720369235 conn(0x7f939c069e70 msgr2=0x7f939c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:35.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.617+0000 7f939b200640 1 -- 172.21.15.8:0/720369235 shutdown_connections 2024-05-26T15:40:35.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.617+0000 7f939b200640 1 -- 172.21.15.8:0/720369235 wait complete. 2024-05-26T15:40:35.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.619+0000 7f939b200640 1 Processor -- start 2024-05-26T15:40:35.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.619+0000 7f939b200640 1 -- start start 2024-05-26T15:40:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.620+0000 7f939b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c06c3d0 0x7f939c0ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.620+0000 7f939b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f939c13d860 0x7f939c1ef740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.620+0000 7f939b200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c154800 0x7f939c154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.620+0000 7f939b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c1f3380 con 0x7f939c06c3d0 2024-05-26T15:40:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.620+0000 7f939b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c1551d0 con 0x7f939c13d860 2024-05-26T15:40:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.620+0000 7f939b200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c0acc20 con 0x7f939c154800 2024-05-26T15:40:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.621+0000 7f9399e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c06c3d0 0x7f939c0ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.621+0000 7f9399e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c06c3d0 0x7f939c0ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32930/0 (socket says 172.21.15.8:32930) 2024-05-26T15:40:35.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.621+0000 7f9399e00640 1 -- 172.21.15.8:0/1694206552 learned_addr learned my addr 172.21.15.8:0/1694206552 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:35.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.621+0000 7f939a800640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c154800 0x7f939c154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.621+0000 7f9399e00640 1 -- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c154800 msgr2=0x7f939c154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.621+0000 7f9399e00640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c154800 0x7f939c154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.621+0000 7f9399e00640 1 -- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f939c13d860 msgr2=0x7f939c1ef740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.621+0000 7f9399e00640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f939c13d860 0x7f939c1ef740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.621+0000 7f9399e00640 1 -- 172.21.15.8:0/1694206552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0094d0 con 0x7f939c06c3d0 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.621+0000 7f939a800640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c154800 0x7f939c154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.622+0000 7f9399e00640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c06c3d0 0x7f939c0ac6e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f938c009870 tx=0x7f938c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.622+0000 7f9392000640 1 -- 172.21.15.8:0/1694206552 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c030850 con 0x7f939c06c3d0 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.622+0000 7f9392000640 1 -- 172.21.15.8:0/1694206552 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c0309b0 con 0x7f939c06c3d0 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.622+0000 7f9392000640 1 -- 172.21.15.8:0/1694206552 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c030d60 con 0x7f939c06c3d0 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.622+0000 7f939b200640 1 -- 172.21.15.8:0/1694206552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939c1f30a0 con 0x7f939c06c3d0 2024-05-26T15:40:35.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.622+0000 7f939b200640 1 -- 172.21.15.8:0/1694206552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939c0abee0 con 0x7f939c06c3d0 2024-05-26T15:40:35.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.623+0000 7f939b200640 1 -- 172.21.15.8:0/1694206552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939c0aba60 con 0x7f939c06c3d0 2024-05-26T15:40:35.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.624+0000 7f9392000640 1 -- 172.21.15.8:0/1694206552 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f938c039040 con 0x7f939c06c3d0 2024-05-26T15:40:35.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.625+0000 7f9392000640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f937806ac00 0x7f937806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:35.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.625+0000 7f9392000640 1 -- 172.21.15.8:0/1694206552 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f938c0aa370 con 0x7f939c06c3d0 2024-05-26T15:40:35.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.626+0000 7f9399400640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f937806ac00 0x7f937806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:35.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.627+0000 7f9399400640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f937806ac00 0x7f937806d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f93840070b0 tx=0x7f9384007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:35.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.629+0000 7f9392000640 1 -- 172.21.15.8:0/1694206552 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f939c0aba60 con 0x7f939c06c3d0 2024-05-26T15:40:35.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.834+0000 7f939b200640 1 -- 172.21.15.8:0/1694206552 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f939c0aba60 con 0x7f939c06c3d0 2024-05-26T15:40:35.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.835+0000 7f9392000640 1 -- 172.21.15.8:0/1694206552 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f939c0aba60 con 0x7f939c06c3d0 2024-05-26T15:40:35.834 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:35.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 -- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f937806ac00 msgr2=0x7f937806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:35.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f937806ac00 0x7f937806d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f93840070b0 tx=0x7f9384007040 comp rx=0 tx=0).stop 2024-05-26T15:40:35.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 -- 172.21.15.8:0/1694206552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c06c3d0 msgr2=0x7f939c0ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:35.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c06c3d0 0x7f939c0ac6e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f938c009870 tx=0x7f938c0046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 -- 172.21.15.8:0/1694206552 shutdown_connections 2024-05-26T15:40:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f939c154800 0x7f939c154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f937806ac00 0x7f937806d0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f939c13d860 0x7f939c1ef740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 --2- 172.21.15.8:0/1694206552 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f939c06c3d0 0x7f939c0ac6e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 -- 172.21.15.8:0/1694206552 >> 172.21.15.8:0/1694206552 conn(0x7f939c069e70 msgr2=0x7f939c070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.838+0000 7f939b200640 1 -- 172.21.15.8:0/1694206552 shutdown_connections 2024-05-26T15:40:35.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:35.839+0000 7f939b200640 1 -- 172.21.15.8:0/1694206552 wait complete. 2024-05-26T15:40:35.857 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:36.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.077+0000 7f8627200640 1 Processor -- start 2024-05-26T15:40:36.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.077+0000 7f8627200640 1 -- start start 2024-05-26T15:40:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.078+0000 7f8627200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280d0020 0x7f86280d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.078+0000 7f8627200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f86280b82c0 0x7f86280b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.078+0000 7f8627200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86280d20d0 con 0x7f862815ca00 2024-05-26T15:40:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.078+0000 7f8627200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86280d06b0 con 0x7f86280b82c0 2024-05-26T15:40:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.078+0000 7f8627200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280d12b0 con 0x7f86280d0020 2024-05-26T15:40:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.079+0000 7f8625e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f862815ca00 0x7f86280cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48738/0 (socket says 172.21.15.8:48738) 2024-05-26T15:40:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.079+0000 7f8625e00640 1 -- 172.21.15.8:0/2225939242 learned_addr learned my addr 172.21.15.8:0/2225939242 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.079+0000 7f8626800640 1 --2- 172.21.15.8:0/2225939242 >> v2:172.21.15.47:3300/0 conn(0x7f86280b82c0 0x7f86280b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.079+0000 7f8625400640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280d0020 0x7f86280d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.079+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238564878 0 0) 0x7f86280d20d0 con 0x7f862815ca00 2024-05-26T15:40:36.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.079+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f860c003520 con 0x7f862815ca00 2024-05-26T15:40:36.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1121912250 0 0) 0x7f860c003520 con 0x7f862815ca00 2024-05-26T15:40:36.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280d0020 msgr2=0x7f86280d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:36.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280d0020 0x7f86280d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 >> v2:172.21.15.47:3300/0 conn(0x7f86280b82c0 msgr2=0x7f86280b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 --2- 172.21.15.8:0/2225939242 >> v2:172.21.15.47:3300/0 conn(0x7f86280b82c0 0x7f86280b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280d14c0 con 0x7f862815ca00 2024-05-26T15:40:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f8618001670 con 0x7f862815ca00 2024-05-26T15:40:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 >> v1:172.21.15.8:6789/0 conn(0x7f862815ca00 legacy=0x7f86280cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c003970 0x7f860c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280d0020 0x7f860c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860c004d00 0x7f860c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280d06b0 con 0x7f860c004d00 2024-05-26T15:40:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280d12b0 con 0x7f860c003970 2024-05-26T15:40:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c00b980 con 0x7f86280d0020 2024-05-26T15:40:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.080+0000 7f8626800640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860c004d00 0x7f860c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.081+0000 7f8625e00640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c003970 0x7f860c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.081+0000 7f8625400640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280d0020 0x7f860c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.081+0000 7f8626800640 1 -- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280d0020 msgr2=0x7f860c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:36.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.081+0000 7f8626800640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280d0020 0x7f860c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.081+0000 7f8626800640 1 -- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c003970 msgr2=0x7f860c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:36.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.081+0000 7f8626800640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c003970 0x7f860c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.081+0000 7f8626800640 1 -- 172.21.15.8:0/2225939242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c003520 con 0x7f860c004d00 2024-05-26T15:40:36.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.081+0000 7f8625e00640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c003970 0x7f860c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:36.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.082+0000 7f8626800640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860c004d00 0x7f860c005180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8620007360 tx=0x7f860c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50d304ab5896fa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:36.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.082+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862002e620 con 0x7f860c004d00 2024-05-26T15:40:36.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.082+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862002e780 con 0x7f860c004d00 2024-05-26T15:40:36.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.082+0000 7f8624a00640 1 -- 172.21.15.8:0/2225939242 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862002eb30 con 0x7f860c004d00 2024-05-26T15:40:36.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.083+0000 7f8627200640 1 -- 172.21.15.8:0/2225939242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860c004d00 msgr2=0x7f860c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.083+0000 7f8627200640 1 --2- 172.21.15.8:0/2225939242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f860c004d00 0x7f860c005180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8620007360 tx=0x7f860c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.083+0000 7f8626800640 1 -- 172.21.15.8:0/2225939242 reap_dead start 2024-05-26T15:40:36.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.083+0000 7f8627200640 1 -- 172.21.15.8:0/2225939242 shutdown_connections 2024-05-26T15:40:36.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.083+0000 7f8627200640 1 -- 172.21.15.8:0/2225939242 >> 172.21.15.8:0/2225939242 conn(0x7f862806b640 msgr2=0x7f862806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:36.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.083+0000 7f8627200640 1 -- 172.21.15.8:0/2225939242 shutdown_connections 2024-05-26T15:40:36.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.083+0000 7f8627200640 1 -- 172.21.15.8:0/2225939242 wait complete. 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.084+0000 7f8627200640 1 Processor -- start 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.085+0000 7f8627200640 1 -- start start 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.085+0000 7f8627200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c004d00 0x7f862814f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8627200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280b6c50 0x7f86280b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8627200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86280c7b40 0x7f86280c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8627200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862814f560 con 0x7f86280c7b40 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8627200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86280b7610 con 0x7f860c004d00 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8627200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86280c9a00 con 0x7f86280b6c50 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8626800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86280c7b40 0x7f86280c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8626800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86280c7b40 0x7f86280c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32950/0 (socket says 172.21.15.8:32950) 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8626800640 1 -- 172.21.15.8:0/319839074 learned_addr learned my addr 172.21.15.8:0/319839074 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8625e00640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c004d00 0x7f862814f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8625400640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280b6c50 0x7f86280b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8626800640 1 -- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280b6c50 msgr2=0x7f86280b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8626800640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280b6c50 0x7f86280b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8626800640 1 -- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c004d00 msgr2=0x7f862814f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8626800640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c004d00 0x7f862814f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8626800640 1 -- 172.21.15.8:0/319839074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86280c8850 con 0x7f86280c7b40 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.086+0000 7f8625e00640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c004d00 0x7f862814f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.087+0000 7f8626800640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86280c7b40 0x7f86280c7fc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8620007360 tx=0x7f8620004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.087+0000 7f861e000640 1 -- 172.21.15.8:0/319839074 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862003d070 con 0x7f86280c7b40 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.087+0000 7f861e000640 1 -- 172.21.15.8:0/319839074 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8620036610 con 0x7f86280c7b40 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.087+0000 7f861e000640 1 -- 172.21.15.8:0/319839074 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200369a0 con 0x7f86280c7b40 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.087+0000 7f8627200640 1 -- 172.21.15.8:0/319839074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86280c8b30 con 0x7f86280c7b40 2024-05-26T15:40:36.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.087+0000 7f8627200640 1 -- 172.21.15.8:0/319839074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86280c90f0 con 0x7f86280c7b40 2024-05-26T15:40:36.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.088+0000 7f8627200640 1 -- 172.21.15.8:0/319839074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862804e210 con 0x7f86280c7b40 2024-05-26T15:40:36.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.089+0000 7f861e000640 1 -- 172.21.15.8:0/319839074 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8620036b00 con 0x7f86280c7b40 2024-05-26T15:40:36.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.090+0000 7f861e000640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f860806ac30 0x7f860806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.090+0000 7f861e000640 1 -- 172.21.15.8:0/319839074 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f86200a97d0 con 0x7f86280c7b40 2024-05-26T15:40:36.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.091+0000 7f8625e00640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f860806ac30 0x7f860806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.092+0000 7f8625e00640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f860806ac30 0x7f860806d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8618000c00 tx=0x7f8618001500 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:36.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.094+0000 7f861e000640 1 -- 172.21.15.8:0/319839074 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f86200745c0 con 0x7f86280c7b40 2024-05-26T15:40:36.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.295+0000 7f8627200640 1 -- 172.21.15.8:0/319839074 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f86280c9b40 con 0x7f86280c7b40 2024-05-26T15:40:36.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.296+0000 7f861e000640 1 -- 172.21.15.8:0/319839074 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8620036db0 con 0x7f86280c7b40 2024-05-26T15:40:36.295 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 -- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f860806ac30 msgr2=0x7f860806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f860806ac30 0x7f860806d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8618000c00 tx=0x7f8618001500 comp rx=0 tx=0).stop 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 -- 172.21.15.8:0/319839074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86280c7b40 msgr2=0x7f86280c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86280c7b40 0x7f86280c7fc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8620007360 tx=0x7f8620004ab0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 -- 172.21.15.8:0/319839074 shutdown_connections 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f86280c7b40 0x7f86280c7fc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f86280b6c50 0x7f86280b70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f860806ac30 0x7f860806d0f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 --2- 172.21.15.8:0/319839074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f860c004d00 0x7f862814f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 -- 172.21.15.8:0/319839074 >> 172.21.15.8:0/319839074 conn(0x7f862806b640 msgr2=0x7f8628159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:36.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.299+0000 7f8627200640 1 -- 172.21.15.8:0/319839074 shutdown_connections 2024-05-26T15:40:36.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.300+0000 7f8627200640 1 -- 172.21.15.8:0/319839074 wait complete. 2024-05-26T15:40:36.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:36.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.533+0000 7fc3cea00640 1 Processor -- start 2024-05-26T15:40:36.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.533+0000 7fc3cea00640 1 -- start start 2024-05-26T15:40:36.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.535+0000 7fc3cea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc3c81571a0 0x7fc3c80caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.535+0000 7fc3cea00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3c815cfe0 0x7fc3c80b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.533 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.535+0000 7fc3cea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc3c80b0d20 0x7fc3c8160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.535+0000 7fc3cea00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c815e090 con 0x7fc3c80b0d20 2024-05-26T15:40:36.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.535+0000 7fc3cea00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c80b11d0 con 0x7fc3c81571a0 2024-05-26T15:40:36.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.535+0000 7fc3cea00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c8157580 con 0x7fc3c815cfe0 2024-05-26T15:40:36.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.535+0000 7fc3ce000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc3c80b0d20 0x7fc3c8160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.535+0000 7fc3ce000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc3c80b0d20 0x7fc3c8160620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32960/0 (socket says 172.21.15.8:32960) 2024-05-26T15:40:36.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.535+0000 7fc3ce000640 1 -- 172.21.15.8:0/3734833040 learned_addr learned my addr 172.21.15.8:0/3734833040 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:36.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.536+0000 7fc3ce000640 1 -- 172.21.15.8:0/3734833040 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3c815cfe0 msgr2=0x7fc3c80b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:36.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.536+0000 7fc3ce000640 1 --2- 172.21.15.8:0/3734833040 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3c815cfe0 0x7fc3c80b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.536+0000 7fc3cd600640 1 --2- 172.21.15.8:0/3734833040 >> v2:172.21.15.47:3300/0 conn(0x7fc3c81571a0 0x7fc3c80caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.536+0000 7fc3ce000640 1 -- 172.21.15.8:0/3734833040 >> v2:172.21.15.47:3300/0 conn(0x7fc3c81571a0 msgr2=0x7fc3c80caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:36.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.536+0000 7fc3ce000640 1 --2- 172.21.15.8:0/3734833040 >> v2:172.21.15.47:3300/0 conn(0x7fc3c81571a0 0x7fc3c80caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.535 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.536+0000 7fc3ce000640 1 -- 172.21.15.8:0/3734833040 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c815d480 con 0x7fc3c80b0d20 2024-05-26T15:40:36.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.537+0000 7fc3ce000640 1 --2- 172.21.15.8:0/3734833040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c80b0d20 0x7fc3c8160620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc3c81576c0 tx=0x7fc3c002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f806c33327eb7e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:36.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.537+0000 7fc3c7e00640 1 -- 172.21.15.8:0/3734833040 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c002aea0 con 0x7fc3c80b0d20 2024-05-26T15:40:36.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.537+0000 7fc3c7e00640 1 -- 172.21.15.8:0/3734833040 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c002d050 con 0x7fc3c80b0d20 2024-05-26T15:40:36.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.537+0000 7fc3c7e00640 1 -- 172.21.15.8:0/3734833040 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0031820 con 0x7fc3c80b0d20 2024-05-26T15:40:36.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.538+0000 7fc3cea00640 1 -- 172.21.15.8:0/3734833040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c80b0d20 msgr2=0x7fc3c8160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.536 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.538+0000 7fc3cea00640 1 --2- 172.21.15.8:0/3734833040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c80b0d20 0x7fc3c8160620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc3c81576c0 tx=0x7fc3c002a680 comp rx=0 tx=0).stop 2024-05-26T15:40:36.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.538+0000 7fc3cea00640 1 -- 172.21.15.8:0/3734833040 shutdown_connections 2024-05-26T15:40:36.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.538+0000 7fc3cea00640 1 --2- 172.21.15.8:0/3734833040 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c80b0d20 0x7fc3c8160620 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.538+0000 7fc3cea00640 1 --2- 172.21.15.8:0/3734833040 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3c815cfe0 0x7fc3c80b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.538+0000 7fc3cea00640 1 --2- 172.21.15.8:0/3734833040 >> v2:172.21.15.47:3300/0 conn(0x7fc3c81571a0 0x7fc3c80caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.538+0000 7fc3cea00640 1 -- 172.21.15.8:0/3734833040 >> 172.21.15.8:0/3734833040 conn(0x7fc3c8070480 msgr2=0x7fc3c8070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:36.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.538+0000 7fc3cea00640 1 -- 172.21.15.8:0/3734833040 shutdown_connections 2024-05-26T15:40:36.537 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.538+0000 7fc3cea00640 1 -- 172.21.15.8:0/3734833040 wait complete. 2024-05-26T15:40:36.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.540+0000 7fc3cea00640 1 Processor -- start 2024-05-26T15:40:36.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.540+0000 7fc3cea00640 1 -- start start 2024-05-26T15:40:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3cea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3c80b0d20 0x7fc3c814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3cea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c81571a0 0x7fc3c813a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3cea00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3c815cfe0 0x7fc3c813d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3cea00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c814d7f0 con 0x7fc3c81571a0 2024-05-26T15:40:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3cea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c813abf0 con 0x7fc3c80b0d20 2024-05-26T15:40:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3cea00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c8159d90 con 0x7fc3c815cfe0 2024-05-26T15:40:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3ccc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c81571a0 0x7fc3c813a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3ccc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c81571a0 0x7fc3c813a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32966/0 (socket says 172.21.15.8:32966) 2024-05-26T15:40:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3ccc00640 1 -- 172.21.15.8:0/3245780096 learned_addr learned my addr 172.21.15.8:0/3245780096 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:36.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3cd600640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3c80b0d20 0x7fc3c814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3ccc00640 1 -- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3c815cfe0 msgr2=0x7fc3c813d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3ccc00640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3c815cfe0 0x7fc3c813d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3ccc00640 1 -- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3c80b0d20 msgr2=0x7fc3c814b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3ccc00640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3c80b0d20 0x7fc3c814b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.541+0000 7fc3ccc00640 1 -- 172.21.15.8:0/3245780096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c0009b30 con 0x7fc3c81571a0 2024-05-26T15:40:36.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.542+0000 7fc3ccc00640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c81571a0 0x7fc3c813a6b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800b410 tx=0x7fc3b800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.542+0000 7fc3c5600640 1 -- 172.21.15.8:0/3245780096 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8011830 con 0x7fc3c81571a0 2024-05-26T15:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.542+0000 7fc3c5600640 1 -- 172.21.15.8:0/3245780096 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b80119b0 con 0x7fc3c81571a0 2024-05-26T15:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.542+0000 7fc3cea00640 1 -- 172.21.15.8:0/3245780096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c815a070 con 0x7fc3c81571a0 2024-05-26T15:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.542+0000 7fc3c5600640 1 -- 172.21.15.8:0/3245780096 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8011d60 con 0x7fc3c81571a0 2024-05-26T15:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.542+0000 7fc3cea00640 1 -- 172.21.15.8:0/3245780096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c813de80 con 0x7fc3c81571a0 2024-05-26T15:40:36.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.544+0000 7fc3cea00640 1 -- 172.21.15.8:0/3245780096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c814d930 con 0x7fc3c81571a0 2024-05-26T15:40:36.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.544+0000 7fc3c5600640 1 -- 172.21.15.8:0/3245780096 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc3b801a400 con 0x7fc3c81571a0 2024-05-26T15:40:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.545+0000 7fc3c5600640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc3ac06ac80 0x7fc3ac06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.545+0000 7fc3c5600640 1 -- 172.21.15.8:0/3245780096 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc3b8089870 con 0x7fc3c81571a0 2024-05-26T15:40:36.544 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.546+0000 7fc3cd600640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc3ac06ac80 0x7fc3ac06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.548+0000 7fc3cd600640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc3ac06ac80 0x7fc3ac06d140 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc006fd0 tx=0x7fc3bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:36.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.550+0000 7fc3c5600640 1 -- 172.21.15.8:0/3245780096 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc3c814d930 con 0x7fc3c81571a0 2024-05-26T15:40:36.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.755+0000 7fc3cea00640 1 -- 172.21.15.8:0/3245780096 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3c814d930 con 0x7fc3c81571a0 2024-05-26T15:40:36.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.758+0000 7fc3c5600640 1 -- 172.21.15.8:0/3245780096 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7fc3c814d930 con 0x7fc3c81571a0 2024-05-26T15:40:36.757 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:36.758 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.761+0000 7fc3cea00640 1 -- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc3ac06ac80 msgr2=0x7fc3ac06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.761+0000 7fc3cea00640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc3ac06ac80 0x7fc3ac06d140 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc006fd0 tx=0x7fc3bc008040 comp rx=0 tx=0).stop 2024-05-26T15:40:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.761+0000 7fc3cea00640 1 -- 172.21.15.8:0/3245780096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c81571a0 msgr2=0x7fc3c813a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.761+0000 7fc3cea00640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c81571a0 0x7fc3c813a6b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800b410 tx=0x7fc3b800b8d0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.761+0000 7fc3cea00640 1 -- 172.21.15.8:0/3245780096 shutdown_connections 2024-05-26T15:40:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.761+0000 7fc3cea00640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc3c815cfe0 0x7fc3c813d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.761+0000 7fc3cea00640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc3c81571a0 0x7fc3c813a6b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.761+0000 7fc3cea00640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc3ac06ac80 0x7fc3ac06d140 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.761+0000 7fc3cea00640 1 --2- 172.21.15.8:0/3245780096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3c80b0d20 0x7fc3c814b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.761+0000 7fc3cea00640 1 -- 172.21.15.8:0/3245780096 >> 172.21.15.8:0/3245780096 conn(0x7fc3c8070480 msgr2=0x7fc3c8154ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:36.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.762+0000 7fc3cea00640 1 -- 172.21.15.8:0/3245780096 shutdown_connections 2024-05-26T15:40:36.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.762+0000 7fc3cea00640 1 -- 172.21.15.8:0/3245780096 wait complete. 2024-05-26T15:40:36.778 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:36.779 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:36.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.990+0000 7ff60fe00640 1 Processor -- start 2024-05-26T15:40:36.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.990+0000 7ff60fe00640 1 -- start start 2024-05-26T15:40:36.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.992+0000 7ff60fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff6100cdd10 0x7ff61006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.992+0000 7ff60fe00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6100cba60 con 0x7ff61006d970 2024-05-26T15:40:36.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.992+0000 7ff60fe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff610071610 con 0x7ff61015a9d0 2024-05-26T15:40:36.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.992+0000 7ff60fe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6100cbd00 con 0x7ff6100cdd10 2024-05-26T15:40:36.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.993+0000 7ff60f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff61006d970 0x7ff6101643b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48744/0 (socket says 172.21.15.8:48744) 2024-05-26T15:40:36.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.993+0000 7ff60f400640 1 -- 172.21.15.8:0/3204977057 learned_addr learned my addr 172.21.15.8:0/3204977057 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:36.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.993+0000 7ff606000640 1 --2- 172.21.15.8:0/3204977057 >> v2:172.21.15.8:3300/0 conn(0x7ff6100cdd10 0x7ff61006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.993+0000 7ff606000640 1 -- 172.21.15.8:0/3204977057 >> v1:172.21.15.47:6789/0 conn(0x7ff61015a9d0 legacy=0x7ff6100cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:36.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.993+0000 7ff60e000640 1 -- 172.21.15.8:0/3204977057 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393675186 0 0) 0x7ff6100cba60 con 0x7ff61006d970 2024-05-26T15:40:36.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.993+0000 7ff606000640 1 -- 172.21.15.8:0/3204977057 >> v1:172.21.15.8:6789/0 conn(0x7ff61006d970 legacy=0x7ff6101643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.993+0000 7ff606000640 1 -- 172.21.15.8:0/3204977057 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff610070e10 con 0x7ff6100cdd10 2024-05-26T15:40:36.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.994+0000 7ff606000640 1 --2- 172.21.15.8:0/3204977057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6100cdd10 0x7ff61006dec0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80097a0 tx=0x7ff5f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07b8660397bc08f server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:36.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.995+0000 7ff60e000640 1 -- 172.21.15.8:0/3204977057 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8032440 con 0x7ff6100cdd10 2024-05-26T15:40:36.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.995+0000 7ff60e000640 1 -- 172.21.15.8:0/3204977057 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f80325a0 con 0x7ff6100cdd10 2024-05-26T15:40:36.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.995+0000 7ff60e000640 1 -- 172.21.15.8:0/3204977057 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8032930 con 0x7ff6100cdd10 2024-05-26T15:40:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.995+0000 7ff60fe00640 1 -- 172.21.15.8:0/3204977057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6100cdd10 msgr2=0x7ff61006dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.995+0000 7ff60fe00640 1 --2- 172.21.15.8:0/3204977057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6100cdd10 0x7ff61006dec0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80097a0 tx=0x7ff5f802a1a0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.995+0000 7ff60fe00640 1 -- 172.21.15.8:0/3204977057 shutdown_connections 2024-05-26T15:40:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.995+0000 7ff60fe00640 1 --2- 172.21.15.8:0/3204977057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff6100cdd10 0x7ff61006dec0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.995+0000 7ff60fe00640 1 -- 172.21.15.8:0/3204977057 >> 172.21.15.8:0/3204977057 conn(0x7ff6100ce4f0 msgr2=0x7ff6100ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.996+0000 7ff60fe00640 1 -- 172.21.15.8:0/3204977057 shutdown_connections 2024-05-26T15:40:36.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.996+0000 7ff60fe00640 1 -- 172.21.15.8:0/3204977057 wait complete. 2024-05-26T15:40:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.997+0000 7ff60fe00640 1 Processor -- start 2024-05-26T15:40:36.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.998+0000 7ff60fe00640 1 -- start start 2024-05-26T15:40:36.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.998+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff61006d970 0x7ff6100c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.998+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff61015a9d0 0x7ff6101f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.998+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff610157130 0x7ff6100af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.998+0000 7ff60fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6100c5cb0 con 0x7ff610157130 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6100c34d0 con 0x7ff61006d970 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60fe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6100c4330 con 0x7ff61015a9d0 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff610157130 0x7ff6100af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff610157130 0x7ff6100af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32976/0 (socket says 172.21.15.8:32976) 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60f400640 1 -- 172.21.15.8:0/962275710 learned_addr learned my addr 172.21.15.8:0/962275710 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60ea00640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff61006d970 0x7ff6100c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff606000640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff61015a9d0 0x7ff6101f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60f400640 1 -- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff61015a9d0 msgr2=0x7ff6101f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60f400640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff61015a9d0 0x7ff6101f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60f400640 1 -- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff61006d970 msgr2=0x7ff6100c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60f400640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff61006d970 0x7ff6100c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff60f400640 1 -- 172.21.15.8:0/962275710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009400 con 0x7ff610157130 2024-05-26T15:40:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:36.999+0000 7ff606000640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff61015a9d0 0x7ff6101f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:36.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.000+0000 7ff60f400640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff610157130 0x7ff6100af2e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff608001eb0 tx=0x7ff60800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.000+0000 7ff607400640 1 -- 172.21.15.8:0/962275710 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6080074e0 con 0x7ff610157130 2024-05-26T15:40:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.000+0000 7ff607400640 1 -- 172.21.15.8:0/962275710 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff608007640 con 0x7ff610157130 2024-05-26T15:40:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.000+0000 7ff607400640 1 -- 172.21.15.8:0/962275710 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6080049e0 con 0x7ff610157130 2024-05-26T15:40:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.000+0000 7ff60fe00640 1 -- 172.21.15.8:0/962275710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6100c3720 con 0x7ff610157130 2024-05-26T15:40:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.000+0000 7ff60fe00640 1 -- 172.21.15.8:0/962275710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6100c3ce0 con 0x7ff610157130 2024-05-26T15:40:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.001+0000 7ff60fe00640 1 -- 172.21.15.8:0/962275710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61004e210 con 0x7ff610157130 2024-05-26T15:40:37.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.002+0000 7ff607400640 1 -- 172.21.15.8:0/962275710 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff608004b40 con 0x7ff610157130 2024-05-26T15:40:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.003+0000 7ff607400640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff5ec06ac30 0x7ff5ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.003+0000 7ff607400640 1 -- 172.21.15.8:0/962275710 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff608089530 con 0x7ff610157130 2024-05-26T15:40:37.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.004+0000 7ff60ea00640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff5ec06ac30 0x7ff5ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.005+0000 7ff60ea00640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff5ec06ac30 0x7ff5ec06d0f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6100ad230 tx=0x7ff600009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:37.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.007+0000 7ff607400640 1 -- 172.21.15.8:0/962275710 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff608054290 con 0x7ff610157130 2024-05-26T15:40:37.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.208+0000 7ff60fe00640 1 -- 172.21.15.8:0/962275710 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6100c4470 con 0x7ff610157130 2024-05-26T15:40:37.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.209+0000 7ff607400640 1 -- 172.21.15.8:0/962275710 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6080578b0 con 0x7ff610157130 2024-05-26T15:40:37.207 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 -- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff5ec06ac30 msgr2=0x7ff5ec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff5ec06ac30 0x7ff5ec06d0f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6100ad230 tx=0x7ff600009040 comp rx=0 tx=0).stop 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 -- 172.21.15.8:0/962275710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff610157130 msgr2=0x7ff6100af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff610157130 0x7ff6100af2e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff608001eb0 tx=0x7ff60800c870 comp rx=0 tx=0).stop 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 -- 172.21.15.8:0/962275710 shutdown_connections 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff610157130 0x7ff6100af2e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff61015a9d0 0x7ff6101f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff5ec06ac30 0x7ff5ec06d0f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 --2- 172.21.15.8:0/962275710 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff61006d970 0x7ff6100c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 -- 172.21.15.8:0/962275710 >> 172.21.15.8:0/962275710 conn(0x7ff6100ce4f0 msgr2=0x7ff6100abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 -- 172.21.15.8:0/962275710 shutdown_connections 2024-05-26T15:40:37.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.212+0000 7ff60fe00640 1 -- 172.21.15.8:0/962275710 wait complete. 2024-05-26T15:40:37.229 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:37.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.438+0000 7f8a30a00640 1 Processor -- start 2024-05-26T15:40:37.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.438+0000 7f8a30a00640 1 -- start start 2024-05-26T15:40:37.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.440+0000 7f8a30a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8a2c15d300 0x7f8a2c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.440+0000 7f8a30a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c0cd570 con 0x7f8a2c06dbe0 2024-05-26T15:40:37.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.440+0000 7f8a30a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c0cc960 con 0x7f8a2c1599a0 2024-05-26T15:40:37.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.440+0000 7f8a30a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0ccc40 con 0x7f8a2c15d300 2024-05-26T15:40:37.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.440+0000 7f8a29e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8a2c06dbe0 0x7f8a2c0b1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48750/0 (socket says 172.21.15.8:48750) 2024-05-26T15:40:37.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.440+0000 7f8a29e00640 1 -- 172.21.15.8:0/2200489715 learned_addr learned my addr 172.21.15.8:0/2200489715 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a2b200640 1 --2- 172.21.15.8:0/2200489715 >> v2:172.21.15.47:3300/0 conn(0x7f8a2c15d300 0x7f8a2c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915538765 0 0) 0x7f8a2c0cd570 con 0x7f8a2c06dbe0 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a10003520 con 0x7f8a2c06dbe0 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944905751 0 0) 0x7f8a10003520 con 0x7f8a2c06dbe0 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 >> v2:172.21.15.47:3300/0 conn(0x7f8a2c15d300 msgr2=0x7f8a2c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 --2- 172.21.15.8:0/2200489715 >> v2:172.21.15.47:3300/0 conn(0x7f8a2c15d300 0x7f8a2c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 >> v1:172.21.15.47:6789/0 conn(0x7f8a2c1599a0 legacy=0x7f8a2c06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0ccf20 con 0x7f8a2c06dbe0 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f8a18001670 con 0x7f8a2c06dbe0 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 >> v1:172.21.15.8:6789/0 conn(0x7f8a2c06dbe0 legacy=0x7f8a2c0b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a10003970 0x7f8a10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a100047c0 0x7f8a10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.441+0000 7f8a29400640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a10005180 0x7f8a1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0ccc40 con 0x7f8a100047c0 2024-05-26T15:40:37.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1000c120 con 0x7f8a10005180 2024-05-26T15:40:37.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1000c2e0 con 0x7f8a10003970 2024-05-26T15:40:37.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a29e00640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a100047c0 0x7f8a10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a2a800640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a10003970 0x7f8a10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a29e00640 1 -- 172.21.15.8:0/2200489715 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a10003970 msgr2=0x7f8a10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:37.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a29e00640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a10003970 0x7f8a10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a2b200640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a10005180 0x7f8a1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a29e00640 1 -- 172.21.15.8:0/2200489715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a10005180 msgr2=0x7f8a1000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:37.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a29e00640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a10005180 0x7f8a1000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a2b200640 1 -- 172.21.15.8:0/2200489715 reap_dead start 2024-05-26T15:40:37.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.442+0000 7f8a29e00640 1 -- 172.21.15.8:0/2200489715 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10003520 con 0x7f8a100047c0 2024-05-26T15:40:37.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.444+0000 7f8a29e00640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a100047c0 0x7f8a10004c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800c240 tx=0x7f8a100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7a4764b7e2c917 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:37.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.444+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18005ad0 con 0x7f8a100047c0 2024-05-26T15:40:37.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.444+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1802d070 con 0x7f8a100047c0 2024-05-26T15:40:37.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.444+0000 7f8a29400640 1 -- 172.21.15.8:0/2200489715 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18007070 con 0x7f8a100047c0 2024-05-26T15:40:37.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.444+0000 7f8a30a00640 1 -- 172.21.15.8:0/2200489715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a100047c0 msgr2=0x7f8a10004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.444+0000 7f8a30a00640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a100047c0 0x7f8a10004c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8a1800c240 tx=0x7f8a100057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.445+0000 7f8a30a00640 1 -- 172.21.15.8:0/2200489715 shutdown_connections 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.445+0000 7f8a30a00640 1 --2- 172.21.15.8:0/2200489715 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a100047c0 0x7f8a10004c40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.445+0000 7f8a30a00640 1 -- 172.21.15.8:0/2200489715 >> 172.21.15.8:0/2200489715 conn(0x7f8a2c0ce4f0 msgr2=0x7f8a2c0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.445+0000 7f8a30a00640 1 -- 172.21.15.8:0/2200489715 shutdown_connections 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.445+0000 7f8a30a00640 1 -- 172.21.15.8:0/2200489715 wait complete. 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.447+0000 7f8a30a00640 1 Processor -- start 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.447+0000 7f8a30a00640 1 -- start start 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a30a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a100047c0 0x7f8a2c0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a30a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a2c1488b0 0x7f8a2c0b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a30a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a2c1f6720 0x7f8a2c1f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a30a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c15a230 con 0x7f8a2c1488b0 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a30a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0b3720 con 0x7f8a2c1f6720 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a30a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0b3160 con 0x7f8a100047c0 2024-05-26T15:40:37.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a29e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a2c1488b0 0x7f8a2c0b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a29e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a2c1488b0 0x7f8a2c0b2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33008/0 (socket says 172.21.15.8:33008) 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a29e00640 1 -- 172.21.15.8:0/1670255450 learned_addr learned my addr 172.21.15.8:0/1670255450 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a2a800640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a100047c0 0x7f8a2c0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a2b200640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a2c1f6720 0x7f8a2c1f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a29e00640 1 -- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a100047c0 msgr2=0x7f8a2c0b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a29e00640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a100047c0 0x7f8a2c0b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a29e00640 1 -- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a2c1f6720 msgr2=0x7f8a2c1f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.448+0000 7f8a29e00640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a2c1f6720 0x7f8a2c1f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.449+0000 7f8a29e00640 1 -- 172.21.15.8:0/1670255450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0b3440 con 0x7f8a2c1488b0 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.449+0000 7f8a2b200640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a2c1f6720 0x7f8a2c1f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.449+0000 7f8a29e00640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a2c1488b0 0x7f8a2c0b2800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8a18001930 tx=0x7f8a18001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.449+0000 7f8a22a00640 1 -- 172.21.15.8:0/1670255450 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a180049e0 con 0x7f8a2c1488b0 2024-05-26T15:40:37.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.449+0000 7f8a22a00640 1 -- 172.21.15.8:0/1670255450 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a18004b60 con 0x7f8a2c1488b0 2024-05-26T15:40:37.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.449+0000 7f8a30a00640 1 -- 172.21.15.8:0/1670255450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c159ec0 con 0x7f8a2c1488b0 2024-05-26T15:40:37.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.449+0000 7f8a22a00640 1 -- 172.21.15.8:0/1670255450 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a18007070 con 0x7f8a2c1488b0 2024-05-26T15:40:37.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.449+0000 7f8a30a00640 1 -- 172.21.15.8:0/1670255450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c0b2d40 con 0x7f8a2c1488b0 2024-05-26T15:40:37.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.450+0000 7f8a30a00640 1 -- 172.21.15.8:0/1670255450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c15a3a0 con 0x7f8a2c1488b0 2024-05-26T15:40:37.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.451+0000 7f8a22a00640 1 -- 172.21.15.8:0/1670255450 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8a1802f030 con 0x7f8a2c1488b0 2024-05-26T15:40:37.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.452+0000 7f8a22a00640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a0c06ac80 0x7f8a0c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.452+0000 7f8a22a00640 1 -- 172.21.15.8:0/1670255450 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8a180a8de0 con 0x7f8a2c1488b0 2024-05-26T15:40:37.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.453+0000 7f8a2a800640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a0c06ac80 0x7f8a0c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.454+0000 7f8a2a800640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a0c06ac80 0x7f8a0c06d140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c14bba0 tx=0x7f8a1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:37.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.456+0000 7f8a22a00640 1 -- 172.21.15.8:0/1670255450 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8a18073c50 con 0x7f8a2c1488b0 2024-05-26T15:40:37.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.654+0000 7f8a30a00640 1 -- 172.21.15.8:0/1670255450 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a2c15a370 con 0x7f8a2c1488b0 2024-05-26T15:40:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.655+0000 7f8a22a00640 1 -- 172.21.15.8:0/1670255450 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a18077270 con 0x7f8a2c1488b0 2024-05-26T15:40:37.653 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:37.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 -- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a0c06ac80 msgr2=0x7f8a0c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a0c06ac80 0x7f8a0c06d140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c14bba0 tx=0x7f8a1c009040 comp rx=0 tx=0).stop 2024-05-26T15:40:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 -- 172.21.15.8:0/1670255450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a2c1488b0 msgr2=0x7f8a2c0b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a2c1488b0 0x7f8a2c0b2800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8a18001930 tx=0x7f8a18001a00 comp rx=0 tx=0).stop 2024-05-26T15:40:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 -- 172.21.15.8:0/1670255450 shutdown_connections 2024-05-26T15:40:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8a0c06ac80 0x7f8a0c06d140 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8a2c1f6720 0x7f8a2c1f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a2c1488b0 0x7f8a2c0b2800 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 --2- 172.21.15.8:0/1670255450 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8a100047c0 0x7f8a2c0b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 -- 172.21.15.8:0/1670255450 >> 172.21.15.8:0/1670255450 conn(0x7f8a2c0ce4f0 msgr2=0x7f8a2c0aec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 -- 172.21.15.8:0/1670255450 shutdown_connections 2024-05-26T15:40:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.658+0000 7f8a30a00640 1 -- 172.21.15.8:0/1670255450 wait complete. 2024-05-26T15:40:37.675 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.877+0000 7f1ff4a00640 1 Processor -- start 2024-05-26T15:40:37.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.877+0000 7f1ff4a00640 1 -- start start 2024-05-26T15:40:37.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.879+0000 7f1ff4a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1ff00caa00 0x7f1ff0159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.879+0000 7f1ff4a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff0070ba0 0x7f1ff014f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.879+0000 7f1ff4a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff006c4c0 con 0x7f1ff00b1580 2024-05-26T15:40:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.879+0000 7f1ff4a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff00cade0 con 0x7f1ff00caa00 2024-05-26T15:40:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.879+0000 7f1ff4a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00b1b40 con 0x7f1ff0070ba0 2024-05-26T15:40:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.880+0000 7f1fede00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1ff00caa00 0x7f1ff0159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.880+0000 7f1fed400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1ff00b1580 0x7f1ff0070490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:37718/0 (socket says 172.21.15.8:37718) 2024-05-26T15:40:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.880+0000 7f1fed400640 1 -- 172.21.15.8:0/2078497305 learned_addr learned my addr 172.21.15.8:0/2078497305 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.880+0000 7f1fee800640 1 --2- 172.21.15.8:0/2078497305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff0070ba0 0x7f1ff014f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.881+0000 7f1fee800640 1 -- 172.21.15.8:0/2078497305 >> v2:172.21.15.47:3300/0 conn(0x7f1ff00caa00 msgr2=0x7f1ff0159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.881+0000 7f1fee800640 1 --2- 172.21.15.8:0/2078497305 >> v2:172.21.15.47:3300/0 conn(0x7f1ff00caa00 0x7f1ff0159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.881+0000 7f1fee800640 1 -- 172.21.15.8:0/2078497305 >> v1:172.21.15.47:6789/0 conn(0x7f1ff00b1580 legacy=0x7f1ff0070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.881+0000 7f1fee800640 1 -- 172.21.15.8:0/2078497305 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00b1e20 con 0x7f1ff0070ba0 2024-05-26T15:40:37.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.882+0000 7f1fee800640 1 --2- 172.21.15.8:0/2078497305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff0070ba0 0x7f1ff014f8a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80097a0 tx=0x7f1fe802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2832d31ea0ba4ed9 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:37.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1feca00640 1 -- 172.21.15.8:0/2078497305 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe802ae50 con 0x7f1ff0070ba0 2024-05-26T15:40:37.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1feca00640 1 -- 172.21.15.8:0/2078497305 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8032440 con 0x7f1ff0070ba0 2024-05-26T15:40:37.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1feca00640 1 -- 172.21.15.8:0/2078497305 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80327d0 con 0x7f1ff0070ba0 2024-05-26T15:40:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1ff4a00640 1 -- 172.21.15.8:0/2078497305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff0070ba0 msgr2=0x7f1ff014f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1ff4a00640 1 --2- 172.21.15.8:0/2078497305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff0070ba0 0x7f1ff014f8a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80097a0 tx=0x7f1fe802a100 comp rx=0 tx=0).stop 2024-05-26T15:40:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1ff4a00640 1 -- 172.21.15.8:0/2078497305 shutdown_connections 2024-05-26T15:40:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1ff4a00640 1 --2- 172.21.15.8:0/2078497305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff0070ba0 0x7f1ff014f8a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1ff4a00640 1 --2- 172.21.15.8:0/2078497305 >> v2:172.21.15.47:3300/0 conn(0x7f1ff00caa00 0x7f1ff0159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1ff4a00640 1 -- 172.21.15.8:0/2078497305 >> 172.21.15.8:0/2078497305 conn(0x7f1ff0069e70 msgr2=0x7f1ff006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:37.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1ff4a00640 1 -- 172.21.15.8:0/2078497305 shutdown_connections 2024-05-26T15:40:37.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.883+0000 7f1ff4a00640 1 -- 172.21.15.8:0/2078497305 wait complete. 2024-05-26T15:40:37.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.885+0000 7f1ff4a00640 1 Processor -- start 2024-05-26T15:40:37.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.885+0000 7f1ff4a00640 1 -- start start 2024-05-26T15:40:37.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.886+0000 7f1ff4a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ff0070ba0 0x7f1ff014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.886+0000 7f1ff4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff00b1580 0x7f1ff015c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.886+0000 7f1ff4a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff00caa00 0x7f1ff014ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.886+0000 7f1ff4a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff015b970 con 0x7f1ff00b1580 2024-05-26T15:40:37.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.886+0000 7f1ff4a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff014c1b0 con 0x7f1ff0070ba0 2024-05-26T15:40:37.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.886+0000 7f1ff4a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff015b160 con 0x7f1ff00caa00 2024-05-26T15:40:37.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fed400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff00b1580 0x7f1ff015c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.886 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fed400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff00b1580 0x7f1ff015c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33012/0 (socket says 172.21.15.8:33012) 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fed400640 1 -- 172.21.15.8:0/579777699 learned_addr learned my addr 172.21.15.8:0/579777699 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fede00640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ff0070ba0 0x7f1ff014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fee800640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff00caa00 0x7f1ff014ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fed400640 1 -- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff00caa00 msgr2=0x7f1ff014ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fed400640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff00caa00 0x7f1ff014ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fed400640 1 -- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ff0070ba0 msgr2=0x7f1ff014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fed400640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ff0070ba0 0x7f1ff014bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fed400640 1 -- 172.21.15.8:0/579777699 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe8009400 con 0x7f1ff00b1580 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.887+0000 7f1fede00640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ff0070ba0 0x7f1ff014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.888+0000 7f1fed400640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff00b1580 0x7f1ff015c4e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800cb10 tx=0x7f1fd800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.888+0000 7f1fe6000640 1 -- 172.21.15.8:0/579777699 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800ac10 con 0x7f1ff00b1580 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.888+0000 7f1fe6000640 1 -- 172.21.15.8:0/579777699 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd800ad70 con 0x7f1ff00b1580 2024-05-26T15:40:37.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.888+0000 7f1fe6000640 1 -- 172.21.15.8:0/579777699 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8012620 con 0x7f1ff00b1580 2024-05-26T15:40:37.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.888+0000 7f1ff4a00640 1 -- 172.21.15.8:0/579777699 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff015b3b0 con 0x7f1ff00b1580 2024-05-26T15:40:37.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.888+0000 7f1ff4a00640 1 -- 172.21.15.8:0/579777699 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff0150220 con 0x7f1ff00b1580 2024-05-26T15:40:37.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.889+0000 7f1ff4a00640 1 -- 172.21.15.8:0/579777699 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff004e210 con 0x7f1ff00b1580 2024-05-26T15:40:37.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.891+0000 7f1fe6000640 1 -- 172.21.15.8:0/579777699 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1fd8007070 con 0x7f1ff00b1580 2024-05-26T15:40:37.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.892+0000 7f1fe6000640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1fcc06ac00 0x7f1fcc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:37.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.892+0000 7f1fe6000640 1 -- 172.21.15.8:0/579777699 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1fd8089700 con 0x7f1ff00b1580 2024-05-26T15:40:37.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.892+0000 7f1fede00640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1fcc06ac00 0x7f1fcc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:37.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.894+0000 7f1fede00640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1fcc06ac00 0x7f1fcc06d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00ad950 tx=0x7f1fe000f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:37.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:37.896+0000 7f1fe6000640 1 -- 172.21.15.8:0/579777699 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1fd8054460 con 0x7f1ff00b1580 2024-05-26T15:40:38.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.094+0000 7f1ff4a00640 1 -- 172.21.15.8:0/579777699 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ff0070840 con 0x7f1ff00b1580 2024-05-26T15:40:38.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.095+0000 7f1fe6000640 1 -- 172.21.15.8:0/579777699 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fd8017020 con 0x7f1ff00b1580 2024-05-26T15:40:38.093 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 -- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1fcc06ac00 msgr2=0x7f1fcc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1fcc06ac00 0x7f1fcc06d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00ad950 tx=0x7f1fe000f040 comp rx=0 tx=0).stop 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 -- 172.21.15.8:0/579777699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff00b1580 msgr2=0x7f1ff015c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff00b1580 0x7f1ff015c4e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800cb10 tx=0x7f1fd800a060 comp rx=0 tx=0).stop 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 -- 172.21.15.8:0/579777699 shutdown_connections 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ff00caa00 0x7f1ff014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ff00b1580 0x7f1ff015c4e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1fcc06ac00 0x7f1fcc06d0c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 --2- 172.21.15.8:0/579777699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ff0070ba0 0x7f1ff014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 -- 172.21.15.8:0/579777699 >> 172.21.15.8:0/579777699 conn(0x7f1ff0069e70 msgr2=0x7f1ff006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 -- 172.21.15.8:0/579777699 shutdown_connections 2024-05-26T15:40:38.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.098+0000 7f1ff4a00640 1 -- 172.21.15.8:0/579777699 wait complete. 2024-05-26T15:40:38.117 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:38.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.337+0000 7fc4fa200640 1 Processor -- start 2024-05-26T15:40:38.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.337+0000 7fc4fa200640 1 -- start start 2024-05-26T15:40:38.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.338+0000 7fc4fa200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc4f415a910 0x7fc4f40ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4fa200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4f40adba0 0x7fc4f40ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4fa200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc4f40ce8e0 0x7fc4f4070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4fa200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f40ced90 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4fa200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f41607c0 con 0x7fc4f415a910 2024-05-26T15:40:38.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4fa200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f4160a80 con 0x7fc4f40adba0 2024-05-26T15:40:38.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4f3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc4f40ce8e0 0x7fc4f4070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4f3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc4f40ce8e0 0x7fc4f4070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33020/0 (socket says 172.21.15.8:33020) 2024-05-26T15:40:38.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4f3e00640 1 -- 172.21.15.8:0/2742704200 learned_addr learned my addr 172.21.15.8:0/2742704200 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:38.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4f3400640 1 --2- 172.21.15.8:0/2742704200 >> v2:172.21.15.47:3300/0 conn(0x7fc4f415a910 0x7fc4f40ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4f2a00640 1 --2- 172.21.15.8:0/2742704200 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4f40adba0 0x7fc4f40ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4f3e00640 1 -- 172.21.15.8:0/2742704200 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4f40adba0 msgr2=0x7fc4f40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:38.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4f3e00640 1 --2- 172.21.15.8:0/2742704200 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4f40adba0 0x7fc4f40ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4f3e00640 1 -- 172.21.15.8:0/2742704200 >> v2:172.21.15.47:3300/0 conn(0x7fc4f415a910 msgr2=0x7fc4f40ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:38.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.339+0000 7fc4f3e00640 1 --2- 172.21.15.8:0/2742704200 >> v2:172.21.15.47:3300/0 conn(0x7fc4f415a910 0x7fc4f40ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.340+0000 7fc4f3e00640 1 -- 172.21.15.8:0/2742704200 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f4160d60 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.341+0000 7fc4f3e00640 1 --2- 172.21.15.8:0/2742704200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 0x7fc4f4070490 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40678e0 tx=0x7fc4ec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bc1d0133398994 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:38.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.341+0000 7fc4f2000640 1 -- 172.21.15.8:0/2742704200 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec031600 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.341+0000 7fc4f2000640 1 -- 172.21.15.8:0/2742704200 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec02d050 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.341+0000 7fc4f2000640 1 -- 172.21.15.8:0/2742704200 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec031980 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.342+0000 7fc4fa200640 1 -- 172.21.15.8:0/2742704200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 msgr2=0x7fc4f4070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:38.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.342+0000 7fc4fa200640 1 --2- 172.21.15.8:0/2742704200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 0x7fc4f4070490 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40678e0 tx=0x7fc4ec02a6a0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.342+0000 7fc4fa200640 1 -- 172.21.15.8:0/2742704200 shutdown_connections 2024-05-26T15:40:38.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.342+0000 7fc4fa200640 1 --2- 172.21.15.8:0/2742704200 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 0x7fc4f4070490 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.342+0000 7fc4fa200640 1 --2- 172.21.15.8:0/2742704200 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4f40adba0 0x7fc4f40ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.342+0000 7fc4fa200640 1 --2- 172.21.15.8:0/2742704200 >> v2:172.21.15.47:3300/0 conn(0x7fc4f415a910 0x7fc4f40ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.342+0000 7fc4fa200640 1 -- 172.21.15.8:0/2742704200 >> 172.21.15.8:0/2742704200 conn(0x7fc4f4069e70 msgr2=0x7fc4f406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:38.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.342+0000 7fc4fa200640 1 -- 172.21.15.8:0/2742704200 shutdown_connections 2024-05-26T15:40:38.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.342+0000 7fc4fa200640 1 -- 172.21.15.8:0/2742704200 wait complete. 2024-05-26T15:40:38.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.344+0000 7fc4fa200640 1 Processor -- start 2024-05-26T15:40:38.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.344+0000 7fc4fa200640 1 -- start start 2024-05-26T15:40:38.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4fa200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4f40adba0 0x7fc4f415c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4fa200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 0x7fc4f41f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4fa200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4f415a910 0x7fc4f40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4fa200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40cc280 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4fa200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f415cdc0 con 0x7fc4f40adba0 2024-05-26T15:40:38.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4fa200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40cba70 con 0x7fc4f415a910 2024-05-26T15:40:38.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4f2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 0x7fc4f41f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4f2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 0x7fc4f41f6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33024/0 (socket says 172.21.15.8:33024) 2024-05-26T15:40:38.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4f2a00640 1 -- 172.21.15.8:0/3038715806 learned_addr learned my addr 172.21.15.8:0/3038715806 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:38.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4f3400640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4f40adba0 0x7fc4f415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.345+0000 7fc4f3e00640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4f415a910 0x7fc4f40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.345 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4f2a00640 1 -- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4f415a910 msgr2=0x7fc4f40b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:38.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4f2a00640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4f415a910 0x7fc4f40b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4f2a00640 1 -- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4f40adba0 msgr2=0x7fc4f415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:38.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4f2a00640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4f40adba0 0x7fc4f415c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4f2a00640 1 -- 172.21.15.8:0/3038715806 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec009b30 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4f2a00640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 0x7fc4f41f6930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000c570 tx=0x7fc4e000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:38.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4eb400640 1 -- 172.21.15.8:0/3038715806 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0011800 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4eb400640 1 -- 172.21.15.8:0/3038715806 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e0011960 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4eb400640 1 -- 172.21.15.8:0/3038715806 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0011cd0 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4fa200640 1 -- 172.21.15.8:0/3038715806 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f41f6e70 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.346+0000 7fc4fa200640 1 -- 172.21.15.8:0/3038715806 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f40cd980 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.348+0000 7fc4fa200640 1 -- 172.21.15.8:0/3038715806 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f404e210 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.348+0000 7fc4eb400640 1 -- 172.21.15.8:0/3038715806 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc4e0022350 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.349+0000 7fc4eb400640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4d406ac00 0x7fc4d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.349+0000 7fc4eb400640 1 -- 172.21.15.8:0/3038715806 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc4e0089780 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.350+0000 7fc4f3400640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4d406ac00 0x7fc4d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.349 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.351+0000 7fc4f3400640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4d406ac00 0x7fc4d406d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4006fd0 tx=0x7fc4e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:38.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.354+0000 7fc4eb400640 1 -- 172.21.15.8:0/3038715806 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc4e00544e0 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.553+0000 7fc4fa200640 1 -- 172.21.15.8:0/3038715806 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc4f40b1c60 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.554+0000 7fc4eb400640 1 -- 172.21.15.8:0/3038715806 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc4e0057b00 con 0x7fc4f40ce8e0 2024-05-26T15:40:38.554 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 -- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4d406ac00 msgr2=0x7fc4d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4d406ac00 0x7fc4d406d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4006fd0 tx=0x7fc4e4008040 comp rx=0 tx=0).stop 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 -- 172.21.15.8:0/3038715806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 msgr2=0x7fc4f41f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 0x7fc4f41f6930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000c570 tx=0x7fc4e000ca30 comp rx=0 tx=0).stop 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 -- 172.21.15.8:0/3038715806 shutdown_connections 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4f415a910 0x7fc4f40b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4f40ce8e0 0x7fc4f41f6930 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4d406ac00 0x7fc4d406d0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 --2- 172.21.15.8:0/3038715806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4f40adba0 0x7fc4f415c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 -- 172.21.15.8:0/3038715806 >> 172.21.15.8:0/3038715806 conn(0x7fc4f4069e70 msgr2=0x7fc4f40b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 -- 172.21.15.8:0/3038715806 shutdown_connections 2024-05-26T15:40:38.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.557+0000 7fc4fa200640 1 -- 172.21.15.8:0/3038715806 wait complete. 2024-05-26T15:40:38.599 INFO:tasks.cephfs_test_runner:Starting test: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) The maximum number of openfiles omap objects keys are now equal to 2024-05-26T15:40:38.599 INFO:tasks.cephfs_test_runner:test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) 2024-05-26T15:40:38.600 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:38.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.817+0000 7fc80e800640 1 Processor -- start 2024-05-26T15:40:38.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.818+0000 7fc80e800640 1 -- start start 2024-05-26T15:40:38.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.819+0000 7fc80e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc808154f50 0x7fc8080b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.819+0000 7fc80e800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc80815ae70 0x7fc80815eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.819+0000 7fc80e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815f0c0 0x7fc8080c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.819+0000 7fc80e800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80815bee0 con 0x7fc80815ae70 2024-05-26T15:40:38.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.819+0000 7fc80e800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8080b0ba0 con 0x7fc808154f50 2024-05-26T15:40:38.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.819+0000 7fc80e800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80815b640 con 0x7fc80815f0c0 2024-05-26T15:40:38.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.820+0000 7fc80ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc80815ae70 0x7fc80815eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.820+0000 7fc80ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc80815ae70 0x7fc80815eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33032/0 (socket says 172.21.15.8:33032) 2024-05-26T15:40:38.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.820+0000 7fc80ca00640 1 -- 172.21.15.8:0/4136700904 learned_addr learned my addr 172.21.15.8:0/4136700904 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:38.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.820+0000 7fc80d400640 1 --2- 172.21.15.8:0/4136700904 >> v2:172.21.15.47:3300/0 conn(0x7fc808154f50 0x7fc8080b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.820+0000 7fc80de00640 1 --2- 172.21.15.8:0/4136700904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815f0c0 0x7fc8080c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.820+0000 7fc80ca00640 1 -- 172.21.15.8:0/4136700904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815f0c0 msgr2=0x7fc8080c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:38.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.820+0000 7fc80ca00640 1 --2- 172.21.15.8:0/4136700904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815f0c0 0x7fc8080c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.820+0000 7fc80ca00640 1 -- 172.21.15.8:0/4136700904 >> v2:172.21.15.47:3300/0 conn(0x7fc808154f50 msgr2=0x7fc8080b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:38.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.820+0000 7fc80ca00640 1 --2- 172.21.15.8:0/4136700904 >> v2:172.21.15.47:3300/0 conn(0x7fc808154f50 0x7fc8080b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.820+0000 7fc80ca00640 1 -- 172.21.15.8:0/4136700904 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80815b920 con 0x7fc80815ae70 2024-05-26T15:40:38.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.822+0000 7fc80ca00640 1 --2- 172.21.15.8:0/4136700904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc80815ae70 0x7fc80815eb80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc8080ce600 tx=0x7fc7f402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae57d8895968391 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:38.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.822+0000 7fc807e00640 1 -- 172.21.15.8:0/4136700904 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f402ae90 con 0x7fc80815ae70 2024-05-26T15:40:38.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.822+0000 7fc807e00640 1 -- 172.21.15.8:0/4136700904 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f4032440 con 0x7fc80815ae70 2024-05-26T15:40:38.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.822+0000 7fc807e00640 1 -- 172.21.15.8:0/4136700904 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40327d0 con 0x7fc80815ae70 2024-05-26T15:40:38.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.822+0000 7fc80e800640 1 -- 172.21.15.8:0/4136700904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc80815ae70 msgr2=0x7fc80815eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:38.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.822+0000 7fc80e800640 1 --2- 172.21.15.8:0/4136700904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc80815ae70 0x7fc80815eb80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc8080ce600 tx=0x7fc7f402a140 comp rx=0 tx=0).stop 2024-05-26T15:40:38.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.823+0000 7fc80e800640 1 -- 172.21.15.8:0/4136700904 shutdown_connections 2024-05-26T15:40:38.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.823+0000 7fc80e800640 1 --2- 172.21.15.8:0/4136700904 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815f0c0 0x7fc8080c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.823+0000 7fc80e800640 1 --2- 172.21.15.8:0/4136700904 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc80815ae70 0x7fc80815eb80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.823+0000 7fc80e800640 1 --2- 172.21.15.8:0/4136700904 >> v2:172.21.15.47:3300/0 conn(0x7fc808154f50 0x7fc8080b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.823+0000 7fc80e800640 1 -- 172.21.15.8:0/4136700904 >> 172.21.15.8:0/4136700904 conn(0x7fc808070480 msgr2=0x7fc808070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:38.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.823+0000 7fc80e800640 1 -- 172.21.15.8:0/4136700904 shutdown_connections 2024-05-26T15:40:38.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.823+0000 7fc80e800640 1 -- 172.21.15.8:0/4136700904 wait complete. 2024-05-26T15:40:38.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.824+0000 7fc80e800640 1 Processor -- start 2024-05-26T15:40:38.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.825+0000 7fc80e800640 1 -- start start 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc808154f50 0x7fc8081413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815ae70 0x7fc80814f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80815f0c0 0x7fc808152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80e800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080ca260 con 0x7fc808154f50 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80e800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc808141910 con 0x7fc80815f0c0 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80e800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080c9720 con 0x7fc80815ae70 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc808154f50 0x7fc8081413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc808154f50 0x7fc8081413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33038/0 (socket says 172.21.15.8:33038) 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80d400640 1 -- 172.21.15.8:0/267553384 learned_addr learned my addr 172.21.15.8:0/267553384 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80ca00640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815ae70 0x7fc80814f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80d400640 1 -- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815ae70 msgr2=0x7fc80814f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:38.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80d400640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815ae70 0x7fc80814f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80de00640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80815f0c0 0x7fc808152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80d400640 1 -- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80815f0c0 msgr2=0x7fc808152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:38.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80d400640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80815f0c0 0x7fc808152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:38.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80d400640 1 -- 172.21.15.8:0/267553384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f40094d0 con 0x7fc808154f50 2024-05-26T15:40:38.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.826+0000 7fc80ca00640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815ae70 0x7fc80814f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:38.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.827+0000 7fc80d400640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc808154f50 0x7fc8081413d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00e870 tx=0x7fc7fc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:38.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.827+0000 7fc805600640 1 -- 172.21.15.8:0/267553384 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00ee60 con 0x7fc808154f50 2024-05-26T15:40:38.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.827+0000 7fc805600640 1 -- 172.21.15.8:0/267553384 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc00c940 con 0x7fc808154f50 2024-05-26T15:40:38.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.827+0000 7fc805600640 1 -- 172.21.15.8:0/267553384 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00ccf0 con 0x7fc808154f50 2024-05-26T15:40:38.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.827+0000 7fc80e800640 1 -- 172.21.15.8:0/267553384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8080c99c0 con 0x7fc808154f50 2024-05-26T15:40:38.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.827+0000 7fc80e800640 1 -- 172.21.15.8:0/267553384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8080c9f80 con 0x7fc808154f50 2024-05-26T15:40:38.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.829+0000 7fc80e800640 1 -- 172.21.15.8:0/267553384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80804e280 con 0x7fc808154f50 2024-05-26T15:40:38.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.829+0000 7fc805600640 1 -- 172.21.15.8:0/267553384 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc7fc013470 con 0x7fc808154f50 2024-05-26T15:40:38.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.830+0000 7fc805600640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7e806ac00 0x7fc7e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.830+0000 7fc805600640 1 -- 172.21.15.8:0/267553384 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc7fc089830 con 0x7fc808154f50 2024-05-26T15:40:38.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.831+0000 7fc80ca00640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7e806ac00 0x7fc7e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:38.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.832+0000 7fc80ca00640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7e806ac00 0x7fc7e806d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4034000 tx=0x7fc7f402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:38.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:38.835+0000 7fc805600640 1 -- 172.21.15.8:0/267553384 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc7fc054630 con 0x7fc808154f50 2024-05-26T15:40:39.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.038+0000 7fc80e800640 1 -- 172.21.15.8:0/267553384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc80814ca30 con 0x7fc808154f50 2024-05-26T15:40:39.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.040+0000 7fc805600640 1 -- 172.21.15.8:0/267553384 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7fc7fc057c50 con 0x7fc808154f50 2024-05-26T15:40:39.039 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:39.039 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 -- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7e806ac00 msgr2=0x7fc7e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7e806ac00 0x7fc7e806d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4034000 tx=0x7fc7f402e000 comp rx=0 tx=0).stop 2024-05-26T15:40:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 -- 172.21.15.8:0/267553384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc808154f50 msgr2=0x7fc8081413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc808154f50 0x7fc8081413d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00e870 tx=0x7fc7fc00ed30 comp rx=0 tx=0).stop 2024-05-26T15:40:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 -- 172.21.15.8:0/267553384 shutdown_connections 2024-05-26T15:40:39.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7e806ac00 0x7fc7e806d0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc80815f0c0 0x7fc808152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc80815ae70 0x7fc80814f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 --2- 172.21.15.8:0/267553384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc808154f50 0x7fc8081413d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 -- 172.21.15.8:0/267553384 >> 172.21.15.8:0/267553384 conn(0x7fc808070480 msgr2=0x7fc808154200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 -- 172.21.15.8:0/267553384 shutdown_connections 2024-05-26T15:40:39.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.043+0000 7fc80e800640 1 -- 172.21.15.8:0/267553384 wait complete. 2024-05-26T15:40:39.060 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:39.060 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:39.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.273+0000 7fd2c9000640 1 Processor -- start 2024-05-26T15:40:39.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.274+0000 7fd2c9000640 1 -- start start 2024-05-26T15:40:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.275+0000 7fd2c9000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd2c41596c0 0x7fd2c406de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.275+0000 7fd2c9000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fd2c40b3350 0x7fd2c406e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.275+0000 7fd2c9000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c40b1620 con 0x7fd2c4159aa0 2024-05-26T15:40:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.275+0000 7fd2c9000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c40b1900 con 0x7fd2c40b3350 2024-05-26T15:40:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.275+0000 7fd2c9000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c40b1be0 con 0x7fd2c41596c0 2024-05-26T15:40:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.276+0000 7fd2c1400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd2c4159aa0 0x7fd2c40b2c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48754/0 (socket says 172.21.15.8:48754) 2024-05-26T15:40:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.276+0000 7fd2c1400640 1 -- 172.21.15.8:0/3899636954 learned_addr learned my addr 172.21.15.8:0/3899636954 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:39.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.276+0000 7fd2c2800640 1 --2- 172.21.15.8:0/3899636954 >> v2:172.21.15.8:3300/0 conn(0x7fd2c40b3350 0x7fd2c406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.276+0000 7fd2c1e00640 1 --2- 172.21.15.8:0/3899636954 >> v2:172.21.15.47:3300/0 conn(0x7fd2c41596c0 0x7fd2c406de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.276+0000 7fd2c0a00640 1 -- 172.21.15.8:0/3899636954 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540273528 0 0) 0x7fd2c40b1620 con 0x7fd2c4159aa0 2024-05-26T15:40:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.276+0000 7fd2c0a00640 1 -- 172.21.15.8:0/3899636954 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2a8003520 con 0x7fd2c4159aa0 2024-05-26T15:40:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.276+0000 7fd2c2800640 1 -- 172.21.15.8:0/3899636954 >> v2:172.21.15.47:3300/0 conn(0x7fd2c41596c0 msgr2=0x7fd2c406de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:39.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.276+0000 7fd2c2800640 1 --2- 172.21.15.8:0/3899636954 >> v2:172.21.15.47:3300/0 conn(0x7fd2c41596c0 0x7fd2c406de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.276+0000 7fd2c2800640 1 -- 172.21.15.8:0/3899636954 >> v1:172.21.15.8:6789/0 conn(0x7fd2c4159aa0 legacy=0x7fd2c40b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.276+0000 7fd2c2800640 1 -- 172.21.15.8:0/3899636954 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c40b1ec0 con 0x7fd2c40b3350 2024-05-26T15:40:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.278+0000 7fd2c2800640 1 --2- 172.21.15.8:0/3899636954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c40b3350 0x7fd2c406e370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4066ae0 tx=0x7fd2bc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e425f890612f45c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.278+0000 7fd2c0a00640 1 -- 172.21.15.8:0/3899636954 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc02aea0 con 0x7fd2c40b3350 2024-05-26T15:40:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.278+0000 7fd2c0a00640 1 -- 172.21.15.8:0/3899636954 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc02d050 con 0x7fd2c40b3350 2024-05-26T15:40:39.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.278+0000 7fd2c0a00640 1 -- 172.21.15.8:0/3899636954 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc007960 con 0x7fd2c40b3350 2024-05-26T15:40:39.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.278+0000 7fd2c9000640 1 -- 172.21.15.8:0/3899636954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c40b3350 msgr2=0x7fd2c406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.278+0000 7fd2c9000640 1 --2- 172.21.15.8:0/3899636954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c40b3350 0x7fd2c406e370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4066ae0 tx=0x7fd2bc02a680 comp rx=0 tx=0).stop 2024-05-26T15:40:39.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.278+0000 7fd2c9000640 1 -- 172.21.15.8:0/3899636954 shutdown_connections 2024-05-26T15:40:39.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.279+0000 7fd2c9000640 1 --2- 172.21.15.8:0/3899636954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c40b3350 0x7fd2c406e370 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.279+0000 7fd2c9000640 1 --2- 172.21.15.8:0/3899636954 >> v2:172.21.15.47:3300/0 conn(0x7fd2c41596c0 0x7fd2c406de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.279+0000 7fd2c9000640 1 -- 172.21.15.8:0/3899636954 >> 172.21.15.8:0/3899636954 conn(0x7fd2c4069e70 msgr2=0x7fd2c406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.279+0000 7fd2c9000640 1 -- 172.21.15.8:0/3899636954 shutdown_connections 2024-05-26T15:40:39.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.279+0000 7fd2c9000640 1 -- 172.21.15.8:0/3899636954 wait complete. 2024-05-26T15:40:39.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.280+0000 7fd2c9000640 1 Processor -- start 2024-05-26T15:40:39.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.281+0000 7fd2c9000640 1 -- start start 2024-05-26T15:40:39.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c9000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd2c40b3350 0x7fd2c414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c9000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c41596c0 0x7fd2c4142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2c4159aa0 0x7fd2c41461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c9000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c415b130 con 0x7fd2c41596c0 2024-05-26T15:40:39.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c9000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c4143f70 con 0x7fd2c4159aa0 2024-05-26T15:40:39.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c9000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c41436d0 con 0x7fd2c40b3350 2024-05-26T15:40:39.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c41596c0 0x7fd2c4142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c41596c0 0x7fd2c4142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33044/0 (socket says 172.21.15.8:33044) 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c1400640 1 -- 172.21.15.8:0/3252954011 learned_addr learned my addr 172.21.15.8:0/3252954011 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c1e00640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd2c40b3350 0x7fd2c414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.282+0000 7fd2c2800640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2c4159aa0 0x7fd2c41461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2c1400640 1 -- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd2c40b3350 msgr2=0x7fd2c414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2c1400640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd2c40b3350 0x7fd2c414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2c1400640 1 -- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2c4159aa0 msgr2=0x7fd2c41461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2c1400640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2c4159aa0 0x7fd2c41461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2c1400640 1 -- 172.21.15.8:0/3252954011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc009a70 con 0x7fd2c41596c0 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2c1e00640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd2c40b3350 0x7fd2c414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2c2800640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2c4159aa0 0x7fd2c41461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:39.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2c1400640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c41596c0 0x7fd2c4142360 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c410 tx=0x7fd2b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:39.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2ba000640 1 -- 172.21.15.8:0/3252954011 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0005ce0 con 0x7fd2c41596c0 2024-05-26T15:40:39.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2ba000640 1 -- 172.21.15.8:0/3252954011 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b0005e40 con 0x7fd2c41596c0 2024-05-26T15:40:39.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2ba000640 1 -- 172.21.15.8:0/3252954011 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00072f0 con 0x7fd2c41596c0 2024-05-26T15:40:39.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2c9000640 1 -- 172.21.15.8:0/3252954011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c41439b0 con 0x7fd2c41596c0 2024-05-26T15:40:39.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.283+0000 7fd2c9000640 1 -- 172.21.15.8:0/3252954011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c414fef0 con 0x7fd2c41596c0 2024-05-26T15:40:39.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.285+0000 7fd2c9000640 1 -- 172.21.15.8:0/3252954011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c415b2a0 con 0x7fd2c41596c0 2024-05-26T15:40:39.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.286+0000 7fd2ba000640 1 -- 172.21.15.8:0/3252954011 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd2b0007510 con 0x7fd2c41596c0 2024-05-26T15:40:39.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.286+0000 7fd2ba000640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd2a406ac00 0x7fd2a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.287+0000 7fd2ba000640 1 -- 172.21.15.8:0/3252954011 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd2b0088e50 con 0x7fd2c41596c0 2024-05-26T15:40:39.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.287+0000 7fd2c1e00640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd2a406ac00 0x7fd2a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.288+0000 7fd2c1e00640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd2a406ac00 0x7fd2a406d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4006fd0 tx=0x7fd2b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:39.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.291+0000 7fd2ba000640 1 -- 172.21.15.8:0/3252954011 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd2b0053c80 con 0x7fd2c41596c0 2024-05-26T15:40:39.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.490+0000 7fd2c9000640 1 -- 172.21.15.8:0/3252954011 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2c404e210 con 0x7fd2c41596c0 2024-05-26T15:40:39.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.491+0000 7fd2ba000640 1 -- 172.21.15.8:0/3252954011 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2b00572a0 con 0x7fd2c41596c0 2024-05-26T15:40:39.490 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:39.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.494+0000 7fd2c9000640 1 -- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd2a406ac00 msgr2=0x7fd2a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.494+0000 7fd2c9000640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd2a406ac00 0x7fd2a406d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4006fd0 tx=0x7fd2b4008040 comp rx=0 tx=0).stop 2024-05-26T15:40:39.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.494+0000 7fd2c9000640 1 -- 172.21.15.8:0/3252954011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c41596c0 msgr2=0x7fd2c4142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.494+0000 7fd2c9000640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c41596c0 0x7fd2c4142360 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd2b000c410 tx=0x7fd2b000c8d0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.494+0000 7fd2c9000640 1 -- 172.21.15.8:0/3252954011 shutdown_connections 2024-05-26T15:40:39.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.494+0000 7fd2c9000640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd2a406ac00 0x7fd2a406d0c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.494+0000 7fd2c9000640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2c4159aa0 0x7fd2c41461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.494+0000 7fd2c9000640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd2c41596c0 0x7fd2c4142360 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.494+0000 7fd2c9000640 1 --2- 172.21.15.8:0/3252954011 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd2c40b3350 0x7fd2c414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.494+0000 7fd2c9000640 1 -- 172.21.15.8:0/3252954011 >> 172.21.15.8:0/3252954011 conn(0x7fd2c4069e70 msgr2=0x7fd2c40ad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:39.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.495+0000 7fd2c9000640 1 -- 172.21.15.8:0/3252954011 shutdown_connections 2024-05-26T15:40:39.494 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.495+0000 7fd2c9000640 1 -- 172.21.15.8:0/3252954011 wait complete. 2024-05-26T15:40:39.511 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.729+0000 7fca95400640 1 Processor -- start 2024-05-26T15:40:39.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.729+0000 7fca95400640 1 -- start start 2024-05-26T15:40:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.731+0000 7fca95400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 0x7fca900ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.731+0000 7fca95400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fca900adba0 0x7fca900ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.731+0000 7fca95400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca901607c0 con 0x7fca900ce8e0 2024-05-26T15:40:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.731+0000 7fca95400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca900ced90 con 0x7fca900adba0 2024-05-26T15:40:39.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.731+0000 7fca95400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca90160a80 con 0x7fca9015a910 2024-05-26T15:40:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.732+0000 7fca8e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 0x7fca900ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.732+0000 7fca8e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 0x7fca900ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:36550/0 (socket says 172.21.15.8:36550) 2024-05-26T15:40:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.732+0000 7fca8e800640 1 -- 172.21.15.8:0/3514846228 learned_addr learned my addr 172.21.15.8:0/3514846228 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:39.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.732+0000 7fca87e00640 1 --2- 172.21.15.8:0/3514846228 >> v2:172.21.15.47:3300/0 conn(0x7fca900adba0 0x7fca900ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.732+0000 7fca8e800640 1 -- 172.21.15.8:0/3514846228 >> v2:172.21.15.47:3300/0 conn(0x7fca900adba0 msgr2=0x7fca900ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.732+0000 7fca8e800640 1 --2- 172.21.15.8:0/3514846228 >> v2:172.21.15.47:3300/0 conn(0x7fca900adba0 0x7fca900ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.732+0000 7fca8e800640 1 -- 172.21.15.8:0/3514846228 >> v1:172.21.15.47:6789/0 conn(0x7fca900ce8e0 legacy=0x7fca90070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.732+0000 7fca8e800640 1 -- 172.21.15.8:0/3514846228 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90160d60 con 0x7fca9015a910 2024-05-26T15:40:39.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.734+0000 7fca8e800640 1 --2- 172.21.15.8:0/3514846228 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 0x7fca900ad660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca80009870 tx=0x7fca8002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c30e4f0a34984f75 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:39.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.735+0000 7fca8de00640 1 -- 172.21.15.8:0/3514846228 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80032440 con 0x7fca9015a910 2024-05-26T15:40:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.735+0000 7fca8de00640 1 -- 172.21.15.8:0/3514846228 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca800325a0 con 0x7fca9015a910 2024-05-26T15:40:39.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.735+0000 7fca8de00640 1 -- 172.21.15.8:0/3514846228 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80032930 con 0x7fca9015a910 2024-05-26T15:40:39.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.736+0000 7fca95400640 1 -- 172.21.15.8:0/3514846228 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 msgr2=0x7fca900ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.736+0000 7fca95400640 1 --2- 172.21.15.8:0/3514846228 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 0x7fca900ad660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fca80009870 tx=0x7fca8002a270 comp rx=0 tx=0).stop 2024-05-26T15:40:39.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.736+0000 7fca95400640 1 -- 172.21.15.8:0/3514846228 shutdown_connections 2024-05-26T15:40:39.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.736+0000 7fca95400640 1 --2- 172.21.15.8:0/3514846228 >> v2:172.21.15.47:3300/0 conn(0x7fca900adba0 0x7fca900ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.736+0000 7fca95400640 1 --2- 172.21.15.8:0/3514846228 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 0x7fca900ad660 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.736+0000 7fca95400640 1 -- 172.21.15.8:0/3514846228 >> 172.21.15.8:0/3514846228 conn(0x7fca90069e70 msgr2=0x7fca9006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:39.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.736+0000 7fca95400640 1 -- 172.21.15.8:0/3514846228 shutdown_connections 2024-05-26T15:40:39.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.736+0000 7fca95400640 1 -- 172.21.15.8:0/3514846228 wait complete. 2024-05-26T15:40:39.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.739+0000 7fca95400640 1 Processor -- start 2024-05-26T15:40:39.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.739+0000 7fca95400640 1 -- start start 2024-05-26T15:40:39.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca95400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca900adba0 0x7fca9013e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca95400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca900ce8e0 0x7fca900cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca95400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 0x7fca900cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca95400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900cbeb0 con 0x7fca900ce8e0 2024-05-26T15:40:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca95400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900ccc90 con 0x7fca900adba0 2024-05-26T15:40:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca95400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9013e960 con 0x7fca9015a910 2024-05-26T15:40:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca87e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca900ce8e0 0x7fca900cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca87e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca900ce8e0 0x7fca900cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33050/0 (socket says 172.21.15.8:33050) 2024-05-26T15:40:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca87e00640 1 -- 172.21.15.8:0/134704299 learned_addr learned my addr 172.21.15.8:0/134704299 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca8e800640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca900adba0 0x7fca9013e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.741+0000 7fca8f200640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 0x7fca900cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.742+0000 7fca87e00640 1 -- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 msgr2=0x7fca900cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.742+0000 7fca87e00640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 0x7fca900cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.742+0000 7fca87e00640 1 -- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca900adba0 msgr2=0x7fca9013e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.742+0000 7fca87e00640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca900adba0 0x7fca9013e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.742+0000 7fca87e00640 1 -- 172.21.15.8:0/134704299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800094d0 con 0x7fca900ce8e0 2024-05-26T15:40:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.742+0000 7fca8e800640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca900adba0 0x7fca9013e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:39.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.742+0000 7fca87e00640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca900ce8e0 0x7fca900cb060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fca7800e840 tx=0x7fca7800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:39.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.743+0000 7fca86a00640 1 -- 172.21.15.8:0/134704299 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca780094f0 con 0x7fca900ce8e0 2024-05-26T15:40:39.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.743+0000 7fca86a00640 1 -- 172.21.15.8:0/134704299 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800c940 con 0x7fca900ce8e0 2024-05-26T15:40:39.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.743+0000 7fca86a00640 1 -- 172.21.15.8:0/134704299 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800ccd0 con 0x7fca900ce8e0 2024-05-26T15:40:39.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.744+0000 7fca95400640 1 -- 172.21.15.8:0/134704299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca900cbbd0 con 0x7fca900ce8e0 2024-05-26T15:40:39.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.744+0000 7fca95400640 1 -- 172.21.15.8:0/134704299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca900cd520 con 0x7fca900ce8e0 2024-05-26T15:40:39.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.745+0000 7fca95400640 1 -- 172.21.15.8:0/134704299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9004e210 con 0x7fca900ce8e0 2024-05-26T15:40:39.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.746+0000 7fca86a00640 1 -- 172.21.15.8:0/134704299 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fca78013470 con 0x7fca900ce8e0 2024-05-26T15:40:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.747+0000 7fca86a00640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fca6c06ac00 0x7fca6c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:39.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.747+0000 7fca86a00640 1 -- 172.21.15.8:0/134704299 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fca78089800 con 0x7fca900ce8e0 2024-05-26T15:40:39.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.748+0000 7fca8e800640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fca6c06ac00 0x7fca6c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:39.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.749+0000 7fca8e800640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fca6c06ac00 0x7fca6c06d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fca80034000 tx=0x7fca8002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:39.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.751+0000 7fca86a00640 1 -- 172.21.15.8:0/134704299 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fca780545f0 con 0x7fca900ce8e0 2024-05-26T15:40:39.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.954+0000 7fca95400640 1 -- 172.21.15.8:0/134704299 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca900b1c60 con 0x7fca900ce8e0 2024-05-26T15:40:39.953 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.955+0000 7fca86a00640 1 -- 172.21.15.8:0/134704299 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca78057c10 con 0x7fca900ce8e0 2024-05-26T15:40:39.953 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:39.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 -- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fca6c06ac00 msgr2=0x7fca6c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fca6c06ac00 0x7fca6c06d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fca80034000 tx=0x7fca8002e000 comp rx=0 tx=0).stop 2024-05-26T15:40:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 -- 172.21.15.8:0/134704299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca900ce8e0 msgr2=0x7fca900cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca900ce8e0 0x7fca900cb060 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fca7800e840 tx=0x7fca7800ed00 comp rx=0 tx=0).stop 2024-05-26T15:40:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 -- 172.21.15.8:0/134704299 shutdown_connections 2024-05-26T15:40:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fca9015a910 0x7fca900cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fca900ce8e0 0x7fca900cb060 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fca6c06ac00 0x7fca6c06d0c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 --2- 172.21.15.8:0/134704299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca900adba0 0x7fca9013e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 -- 172.21.15.8:0/134704299 >> 172.21.15.8:0/134704299 conn(0x7fca90069e70 msgr2=0x7fca9006d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 -- 172.21.15.8:0/134704299 shutdown_connections 2024-05-26T15:40:39.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:39.958+0000 7fca95400640 1 -- 172.21.15.8:0/134704299 wait complete. 2024-05-26T15:40:39.977 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:40.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.193+0000 7fb203e00640 1 Processor -- start 2024-05-26T15:40:40.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.194+0000 7fb203e00640 1 -- start start 2024-05-26T15:40:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.195+0000 7fb203e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb20415d0b0 0x7fb2040b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.195+0000 7fb203e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040b21d0 con 0x7fb2040ce0c0 2024-05-26T15:40:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.195+0000 7fb203e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040b1ab0 con 0x7fb2040cfb10 2024-05-26T15:40:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.195+0000 7fb203e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2041615a0 con 0x7fb20415d0b0 2024-05-26T15:40:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.196+0000 7fb202a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb20415d0b0 0x7fb2040b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.196+0000 7fb202a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb20415d0b0 0x7fb2040b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33064/0 (socket says 172.21.15.8:33064) 2024-05-26T15:40:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.196+0000 7fb202a00640 1 -- 172.21.15.8:0/724035665 learned_addr learned my addr 172.21.15.8:0/724035665 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:40.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.196+0000 7fb203400640 1 --1- 172.21.15.8:0/724035665 >> v1:172.21.15.8:6789/0 conn(0x7fb2040ce0c0 0x7fb2040d12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48764/0 (socket says 172.21.15.8:48764) 2024-05-26T15:40:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.196+0000 7fb202a00640 1 -- 172.21.15.8:0/724035665 >> v1:172.21.15.47:6789/0 conn(0x7fb2040cfb10 legacy=0x7fb2040cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.196+0000 7fb202a00640 1 -- 172.21.15.8:0/724035665 >> v1:172.21.15.8:6789/0 conn(0x7fb2040ce0c0 legacy=0x7fb2040d12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.196+0000 7fb202a00640 1 -- 172.21.15.8:0/724035665 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204160c00 con 0x7fb20415d0b0 2024-05-26T15:40:40.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.197+0000 7fb202a00640 1 --2- 172.21.15.8:0/724035665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 0x7fb2040b1570 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009e50 tx=0x7fb1f402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955f80528c47b41c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.197+0000 7fb202000640 1 -- 172.21.15.8:0/724035665 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4031600 con 0x7fb20415d0b0 2024-05-26T15:40:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.198+0000 7fb202000640 1 -- 172.21.15.8:0/724035665 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f402d050 con 0x7fb20415d0b0 2024-05-26T15:40:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.198+0000 7fb202000640 1 -- 172.21.15.8:0/724035665 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4031980 con 0x7fb20415d0b0 2024-05-26T15:40:40.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.198+0000 7fb203e00640 1 -- 172.21.15.8:0/724035665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 msgr2=0x7fb2040b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.198+0000 7fb203e00640 1 --2- 172.21.15.8:0/724035665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 0x7fb2040b1570 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009e50 tx=0x7fb1f402a6d0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.198+0000 7fb203e00640 1 -- 172.21.15.8:0/724035665 shutdown_connections 2024-05-26T15:40:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.198+0000 7fb203e00640 1 --2- 172.21.15.8:0/724035665 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 0x7fb2040b1570 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.198+0000 7fb203e00640 1 -- 172.21.15.8:0/724035665 >> 172.21.15.8:0/724035665 conn(0x7fb20406b160 msgr2=0x7fb20406b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.198+0000 7fb203e00640 1 -- 172.21.15.8:0/724035665 shutdown_connections 2024-05-26T15:40:40.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.198+0000 7fb203e00640 1 -- 172.21.15.8:0/724035665 wait complete. 2024-05-26T15:40:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.200+0000 7fb203e00640 1 Processor -- start 2024-05-26T15:40:40.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.200+0000 7fb203e00640 1 -- start start 2024-05-26T15:40:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.201+0000 7fb203e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2040ce0c0 0x7fb20414c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.201+0000 7fb203e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2040cfb10 0x7fb2040a9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.201+0000 7fb203e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 0x7fb2040cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.201+0000 7fb203e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20414d6b0 con 0x7fb20415d0b0 2024-05-26T15:40:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.201+0000 7fb203e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20414caa0 con 0x7fb2040cfb10 2024-05-26T15:40:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.201+0000 7fb203e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20414cd80 con 0x7fb2040ce0c0 2024-05-26T15:40:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb203400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 0x7fb2040cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb203400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 0x7fb2040cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33072/0 (socket says 172.21.15.8:33072) 2024-05-26T15:40:40.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb203400640 1 -- 172.21.15.8:0/3053312657 learned_addr learned my addr 172.21.15.8:0/3053312657 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:40.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb202a00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2040ce0c0 0x7fb20414c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb1fbe00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2040cfb10 0x7fb2040a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb203400640 1 -- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2040ce0c0 msgr2=0x7fb20414c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb203400640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2040ce0c0 0x7fb20414c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb203400640 1 -- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2040cfb10 msgr2=0x7fb2040a9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb203400640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2040cfb10 0x7fb2040a9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb203400640 1 -- 172.21.15.8:0/3053312657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f4009b30 con 0x7fb20415d0b0 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb1fbe00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2040cfb10 0x7fb2040a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb202a00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2040ce0c0 0x7fb20414c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.202+0000 7fb203400640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 0x7fb2040cc640 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00c400 tx=0x7fb1fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.203+0000 7fb1faa00640 1 -- 172.21.15.8:0/3053312657 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0074e0 con 0x7fb20415d0b0 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.203+0000 7fb1faa00640 1 -- 172.21.15.8:0/3053312657 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1fc007640 con 0x7fb20415d0b0 2024-05-26T15:40:40.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.203+0000 7fb1faa00640 1 -- 172.21.15.8:0/3053312657 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0049e0 con 0x7fb20415d0b0 2024-05-26T15:40:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.203+0000 7fb203e00640 1 -- 172.21.15.8:0/3053312657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20414d060 con 0x7fb20415d0b0 2024-05-26T15:40:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.203+0000 7fb203e00640 1 -- 172.21.15.8:0/3053312657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2040a9780 con 0x7fb20415d0b0 2024-05-26T15:40:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.204+0000 7fb203e00640 1 -- 172.21.15.8:0/3053312657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2040c5e70 con 0x7fb20415d0b0 2024-05-26T15:40:40.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.205+0000 7fb1faa00640 1 -- 172.21.15.8:0/3053312657 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb1fc004b40 con 0x7fb20415d0b0 2024-05-26T15:40:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.206+0000 7fb1faa00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb1e006ac00 0x7fb1e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.206+0000 7fb1faa00640 1 -- 172.21.15.8:0/3053312657 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb1fc089210 con 0x7fb20415d0b0 2024-05-26T15:40:40.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.207+0000 7fb202a00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb1e006ac00 0x7fb1e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.208+0000 7fb202a00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb1e006ac00 0x7fb1e006d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4033000 tx=0x7fb1f4009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:40.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.211+0000 7fb1faa00640 1 -- 172.21.15.8:0/3053312657 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb1fc053f70 con 0x7fb20415d0b0 2024-05-26T15:40:40.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.413+0000 7fb203e00640 1 -- 172.21.15.8:0/3053312657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb20404e210 con 0x7fb20415d0b0 2024-05-26T15:40:40.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.414+0000 7fb1faa00640 1 -- 172.21.15.8:0/3053312657 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1fc057590 con 0x7fb20415d0b0 2024-05-26T15:40:40.412 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.416+0000 7fb203e00640 1 -- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb1e006ac00 msgr2=0x7fb1e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb1e006ac00 0x7fb1e006d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4033000 tx=0x7fb1f4009000 comp rx=0 tx=0).stop 2024-05-26T15:40:40.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 -- 172.21.15.8:0/3053312657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 msgr2=0x7fb2040cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 0x7fb2040cc640 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00c400 tx=0x7fb1fc00c8c0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 -- 172.21.15.8:0/3053312657 shutdown_connections 2024-05-26T15:40:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb20415d0b0 0x7fb2040cc640 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb1e006ac00 0x7fb1e006d0c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2040cfb10 0x7fb2040a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 --2- 172.21.15.8:0/3053312657 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2040ce0c0 0x7fb20414c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 -- 172.21.15.8:0/3053312657 >> 172.21.15.8:0/3053312657 conn(0x7fb20406b160 msgr2=0x7fb2040d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 -- 172.21.15.8:0/3053312657 shutdown_connections 2024-05-26T15:40:40.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.417+0000 7fb203e00640 1 -- 172.21.15.8:0/3053312657 wait complete. 2024-05-26T15:40:40.434 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.639+0000 7f1301000640 1 Processor -- start 2024-05-26T15:40:40.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.639+0000 7f1301000640 1 -- start start 2024-05-26T15:40:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.641+0000 7f1301000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f12fc0ce090 0x7f12fc06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.641+0000 7f1301000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f12fc0ad830 0x7f12fc06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.641+0000 7f1301000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12fc06cab0 con 0x7f12fc070360 2024-05-26T15:40:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.641+0000 7f1301000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc0ae080 con 0x7f12fc0ad830 2024-05-26T15:40:40.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.641+0000 7f1301000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0b18d0 con 0x7f12fc0ce090 2024-05-26T15:40:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.641+0000 7f12fbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f12fc0ad830 0x7f12fc06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.641+0000 7f12fbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f12fc0ad830 0x7f12fc06d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33078/0 (socket says 172.21.15.8:33078) 2024-05-26T15:40:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.641+0000 7f12fbe00640 1 -- 172.21.15.8:0/2706541369 learned_addr learned my addr 172.21.15.8:0/2706541369 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.641+0000 7f12fb400640 1 --1- 172.21.15.8:0/2706541369 >> v1:172.21.15.8:6789/0 conn(0x7f12fc070360 0x7f12fc070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:48772/0 (socket says 172.21.15.8:48772) 2024-05-26T15:40:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.642+0000 7f12f3e00640 1 --2- 172.21.15.8:0/2706541369 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f12fc0ce090 0x7f12fc06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.642+0000 7f12fbe00640 1 -- 172.21.15.8:0/2706541369 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f12fc0ce090 msgr2=0x7f12fc06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.642+0000 7f12fbe00640 1 --2- 172.21.15.8:0/2706541369 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f12fc0ce090 0x7f12fc06cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.642+0000 7f12fbe00640 1 -- 172.21.15.8:0/2706541369 >> v1:172.21.15.8:6789/0 conn(0x7f12fc070360 legacy=0x7f12fc070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.642+0000 7f12fbe00640 1 -- 172.21.15.8:0/2706541369 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc06c460 con 0x7f12fc0ad830 2024-05-26T15:40:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.643+0000 7f12fbe00640 1 --2- 172.21.15.8:0/2706541369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 0x7f12fc06d480 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009e80 tx=0x7f12f402a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8640f6e10d1ed54b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:40.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.643+0000 7f12faa00640 1 -- 172.21.15.8:0/2706541369 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4031600 con 0x7f12fc0ad830 2024-05-26T15:40:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.643+0000 7f12faa00640 1 -- 172.21.15.8:0/2706541369 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f402d050 con 0x7f12fc0ad830 2024-05-26T15:40:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.643+0000 7f12faa00640 1 -- 172.21.15.8:0/2706541369 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4031980 con 0x7f12fc0ad830 2024-05-26T15:40:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.644+0000 7f1301000640 1 -- 172.21.15.8:0/2706541369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 msgr2=0x7f12fc06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.644+0000 7f1301000640 1 --2- 172.21.15.8:0/2706541369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 0x7f12fc06d480 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f12f4009e80 tx=0x7f12f402a6b0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.644+0000 7f1301000640 1 -- 172.21.15.8:0/2706541369 shutdown_connections 2024-05-26T15:40:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.644+0000 7f1301000640 1 --2- 172.21.15.8:0/2706541369 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 0x7f12fc06d480 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.644+0000 7f1301000640 1 --2- 172.21.15.8:0/2706541369 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f12fc0ce090 0x7f12fc06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.644+0000 7f1301000640 1 -- 172.21.15.8:0/2706541369 >> 172.21.15.8:0/2706541369 conn(0x7f12fc0ce4f0 msgr2=0x7f12fc0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.644+0000 7f1301000640 1 -- 172.21.15.8:0/2706541369 shutdown_connections 2024-05-26T15:40:40.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.644+0000 7f1301000640 1 -- 172.21.15.8:0/2706541369 wait complete. 2024-05-26T15:40:40.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.646+0000 7f1301000640 1 Processor -- start 2024-05-26T15:40:40.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.646+0000 7f1301000640 1 -- start start 2024-05-26T15:40:40.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.647+0000 7f1301000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12fc070360 0x7f12fc1f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.647+0000 7f1301000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 0x7f12fc158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.647+0000 7f1301000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f12fc0ce090 0x7f12fc1f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.647+0000 7f1301000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc155fc0 con 0x7f12fc0ad830 2024-05-26T15:40:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.647+0000 7f1301000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc1f7460 con 0x7f12fc070360 2024-05-26T15:40:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.647+0000 7f1301000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc1f7740 con 0x7f12fc0ce090 2024-05-26T15:40:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.647+0000 7f12f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 0x7f12fc158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.647+0000 7f12f3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 0x7f12fc158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33088/0 (socket says 172.21.15.8:33088) 2024-05-26T15:40:40.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.647+0000 7f12f3e00640 1 -- 172.21.15.8:0/1387748337 learned_addr learned my addr 172.21.15.8:0/1387748337 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:40.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.648+0000 7f12fbe00640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f12fc0ce090 0x7f12fc1f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.648+0000 7f12fb400640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12fc070360 0x7f12fc1f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.648+0000 7f12f3e00640 1 -- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f12fc0ce090 msgr2=0x7f12fc1f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.648+0000 7f12f3e00640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f12fc0ce090 0x7f12fc1f7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.648+0000 7f12f3e00640 1 -- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12fc070360 msgr2=0x7f12fc1f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.648+0000 7f12f3e00640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12fc070360 0x7f12fc1f6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.648+0000 7f12f3e00640 1 -- 172.21.15.8:0/1387748337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4009b30 con 0x7f12fc0ad830 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.648+0000 7f12f3e00640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 0x7f12fc158290 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f12e400d800 tx=0x7f12e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.649+0000 7f12f3400640 1 -- 172.21.15.8:0/1387748337 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e400b6c0 con 0x7f12fc0ad830 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.649+0000 7f12f3400640 1 -- 172.21.15.8:0/1387748337 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e400b820 con 0x7f12fc0ad830 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.649+0000 7f1301000640 1 -- 172.21.15.8:0/1387748337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc1f7a20 con 0x7f12fc0ad830 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.649+0000 7f12f3400640 1 -- 172.21.15.8:0/1387748337 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e400bbb0 con 0x7f12fc0ad830 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.649+0000 7f1301000640 1 -- 172.21.15.8:0/1387748337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12fc1f7150 con 0x7f12fc0ad830 2024-05-26T15:40:40.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.650+0000 7f1301000640 1 -- 172.21.15.8:0/1387748337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12fc04e210 con 0x7f12fc0ad830 2024-05-26T15:40:40.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.651+0000 7f12f3400640 1 -- 172.21.15.8:0/1387748337 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f12e400bd10 con 0x7f12fc0ad830 2024-05-26T15:40:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.652+0000 7f12f3400640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f12d806ac00 0x7f12d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.652+0000 7f12f3400640 1 -- 172.21.15.8:0/1387748337 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f12e4089d80 con 0x7f12fc0ad830 2024-05-26T15:40:40.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.652+0000 7f12fb400640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f12d806ac00 0x7f12d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:40.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.653+0000 7f12fb400640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f12d806ac00 0x7f12d806d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12ec000f60 tx=0x7f12ec007c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:40.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.656+0000 7f12f3400640 1 -- 172.21.15.8:0/1387748337 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f12e4054ae0 con 0x7f12fc0ad830 2024-05-26T15:40:40.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.865+0000 7f1301000640 1 -- 172.21.15.8:0/1387748337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f12fc0cf120 con 0x7f12fc0ad830 2024-05-26T15:40:40.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.866+0000 7f12f3400640 1 -- 172.21.15.8:0/1387748337 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f12e4058100 con 0x7f12fc0ad830 2024-05-26T15:40:40.864 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.868+0000 7f1301000640 1 -- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f12d806ac00 msgr2=0x7f12d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.868+0000 7f1301000640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f12d806ac00 0x7f12d806d0c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12ec000f60 tx=0x7f12ec007c80 comp rx=0 tx=0).stop 2024-05-26T15:40:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.869+0000 7f1301000640 1 -- 172.21.15.8:0/1387748337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 msgr2=0x7f12fc158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.869+0000 7f1301000640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 0x7f12fc158290 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f12e400d800 tx=0x7f12e400dcc0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.869+0000 7f1301000640 1 -- 172.21.15.8:0/1387748337 shutdown_connections 2024-05-26T15:40:40.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.869+0000 7f1301000640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f12fc0ce090 0x7f12fc1f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.869+0000 7f1301000640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f12fc0ad830 0x7f12fc158290 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.869+0000 7f1301000640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f12d806ac00 0x7f12d806d0c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.869+0000 7f1301000640 1 --2- 172.21.15.8:0/1387748337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12fc070360 0x7f12fc1f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.869+0000 7f1301000640 1 -- 172.21.15.8:0/1387748337 >> 172.21.15.8:0/1387748337 conn(0x7f12fc0ce4f0 msgr2=0x7f12fc0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.869+0000 7f1301000640 1 -- 172.21.15.8:0/1387748337 shutdown_connections 2024-05-26T15:40:40.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:40.869+0000 7f1301000640 1 -- 172.21.15.8:0/1387748337 wait complete. 2024-05-26T15:40:40.889 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj' 2024-05-26T15:40:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.099+0000 7f77da000640 1 Processor -- start 2024-05-26T15:40:41.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.100+0000 7f77da000640 1 -- start start 2024-05-26T15:40:41.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.101+0000 7f77da000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f77d4157ff0 0x7f77d40afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:41.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.101+0000 7f77da000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d40b0660 con 0x7f77d40cc750 2024-05-26T15:40:41.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.101+0000 7f77da000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d40ccb70 con 0x7f77d40b0200 2024-05-26T15:40:41.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.101+0000 7f77da000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d41621c0 con 0x7f77d4157ff0 2024-05-26T15:40:41.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.102+0000 7f77d9600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f77d40cc750 0x7f77d41625f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41922/0 (socket says 172.21.15.8:41922) 2024-05-26T15:40:41.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.102+0000 7f77d9600640 1 -- 172.21.15.8:0/929736384 learned_addr learned my addr 172.21.15.8:0/929736384 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:41.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.102+0000 7f77d8c00640 1 --2- 172.21.15.8:0/929736384 >> v2:172.21.15.47:3300/0 conn(0x7f77d4157ff0 0x7f77d40afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:41.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.102+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483079419 0 0) 0x7f77d40b0660 con 0x7f77d40cc750 2024-05-26T15:40:41.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.102+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b8003520 con 0x7f77d40cc750 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3835195042 0 0) 0x7f77b8003520 con 0x7f77d40cc750 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 >> v2:172.21.15.47:3300/0 conn(0x7f77d4157ff0 msgr2=0x7f77d40afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 --2- 172.21.15.8:0/929736384 >> v2:172.21.15.47:3300/0 conn(0x7f77d4157ff0 0x7f77d40afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 >> v1:172.21.15.47:6789/0 conn(0x7f77d40b0200 legacy=0x7f77d40cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4161540 con 0x7f77d40cc750 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f77cc0019f0 con 0x7f77d40cc750 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 >> v1:172.21.15.8:6789/0 conn(0x7f77d40cc750 legacy=0x7f77d41625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77b8003970 0x7f77b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f77b80047c0 0x7f77b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b8005180 0x7f77b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:41.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d41621c0 con 0x7f77b8003970 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b800c020 con 0x7f77b8005180 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b800c1e0 con 0x7f77b80047c0 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.103+0000 7f77d8c00640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77b8003970 0x7f77b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.104+0000 7f77d3e00640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f77b80047c0 0x7f77b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.104+0000 7f77d8c00640 1 -- 172.21.15.8:0/929736384 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f77b80047c0 msgr2=0x7f77b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.104+0000 7f77d9600640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b8005180 0x7f77b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.104+0000 7f77d8c00640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f77b80047c0 0x7f77b8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.104+0000 7f77d8c00640 1 -- 172.21.15.8:0/929736384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b8005180 msgr2=0x7f77b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.104+0000 7f77d8c00640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b8005180 0x7f77b800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.104+0000 7f77d8c00640 1 -- 172.21.15.8:0/929736384 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b8003520 con 0x7f77b8003970 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.104+0000 7f77d3e00640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f77b80047c0 0x7f77b8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.104+0000 7f77d9600640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77b8005180 0x7f77b800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:41.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.104+0000 7f77d9600640 1 -- 172.21.15.8:0/929736384 reap_dead start 2024-05-26T15:40:41.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.105+0000 7f77d8c00640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77b8003970 0x7f77b8003d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009ac0 tx=0x7f77b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d06ceb81fdad34 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.105+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc031400 con 0x7f77b8003970 2024-05-26T15:40:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.105+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc02d050 con 0x7f77b8003970 2024-05-26T15:40:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.105+0000 7f77d3400640 1 -- 172.21.15.8:0/929736384 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc031780 con 0x7f77b8003970 2024-05-26T15:40:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.106+0000 7f77da000640 1 -- 172.21.15.8:0/929736384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77b8003970 msgr2=0x7f77b8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.106+0000 7f77da000640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77b8003970 0x7f77b8003d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009ac0 tx=0x7f77b80057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.106+0000 7f77da000640 1 -- 172.21.15.8:0/929736384 shutdown_connections 2024-05-26T15:40:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.106+0000 7f77da000640 1 --2- 172.21.15.8:0/929736384 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77b8003970 0x7f77b8003d90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.106+0000 7f77da000640 1 -- 172.21.15.8:0/929736384 >> 172.21.15.8:0/929736384 conn(0x7f77d4070480 msgr2=0x7f77d4070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.106+0000 7f77da000640 1 -- 172.21.15.8:0/929736384 shutdown_connections 2024-05-26T15:40:41.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.106+0000 7f77da000640 1 -- 172.21.15.8:0/929736384 wait complete. 2024-05-26T15:40:41.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.109+0000 7f77da000640 1 Processor -- start 2024-05-26T15:40:41.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.109+0000 7f77da000640 1 -- start start 2024-05-26T15:40:41.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.110+0000 7f77da000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f77b8003970 0x7f77d41524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:41.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.110+0000 7f77da000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d415af10 0x7f77d414b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:41.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.110+0000 7f77da000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4158ed0 0x7f77d4159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:41.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.110+0000 7f77da000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415d3d0 con 0x7f77d4158ed0 2024-05-26T15:40:41.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.110+0000 7f77da000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d41598c0 con 0x7f77d415af10 2024-05-26T15:40:41.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.110+0000 7f77da000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d415aa10 con 0x7f77b8003970 2024-05-26T15:40:41.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.111+0000 7f77d9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4158ed0 0x7f77d4159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:41.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.111+0000 7f77d9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4158ed0 0x7f77d4159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50178/0 (socket says 172.21.15.8:50178) 2024-05-26T15:40:41.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.111+0000 7f77d9600640 1 -- 172.21.15.8:0/500706891 learned_addr learned my addr 172.21.15.8:0/500706891 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:41.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.111+0000 7f77d3e00640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d415af10 0x7f77d414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:41.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.111+0000 7f77d8c00640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f77b8003970 0x7f77d41524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:41.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.111+0000 7f77d9600640 1 -- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f77b8003970 msgr2=0x7f77d41524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:41.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.111+0000 7f77d9600640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f77b8003970 0x7f77d41524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.111+0000 7f77d9600640 1 -- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d415af10 msgr2=0x7f77d414b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:41.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.111+0000 7f77d9600640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d415af10 0x7f77d414b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.111+0000 7f77d9600640 1 -- 172.21.15.8:0/500706891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d414f4d0 con 0x7f77d4158ed0 2024-05-26T15:40:41.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.112+0000 7f77d9600640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4158ed0 0x7f77d4159380 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f77d40ce670 tx=0x7f77cc00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:41.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.112+0000 7f77d0c00640 1 -- 172.21.15.8:0/500706891 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc004d60 con 0x7f77d4158ed0 2024-05-26T15:40:41.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.112+0000 7f77d0c00640 1 -- 172.21.15.8:0/500706891 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc00bb00 con 0x7f77d4158ed0 2024-05-26T15:40:41.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.112+0000 7f77d0c00640 1 -- 172.21.15.8:0/500706891 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc00beb0 con 0x7f77d4158ed0 2024-05-26T15:40:41.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.112+0000 7f77da000640 1 -- 172.21.15.8:0/500706891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d415b510 con 0x7f77d4158ed0 2024-05-26T15:40:41.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.112+0000 7f77da000640 1 -- 172.21.15.8:0/500706891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d415cff0 con 0x7f77d4158ed0 2024-05-26T15:40:41.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.114+0000 7f77da000640 1 -- 172.21.15.8:0/500706891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d415cb70 con 0x7f77d4158ed0 2024-05-26T15:40:41.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.115+0000 7f77d0c00640 1 -- 172.21.15.8:0/500706891 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f77cc007110 con 0x7f77d4158ed0 2024-05-26T15:40:41.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.116+0000 7f77d0c00640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77b006ac30 0x7f77b006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:41.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.116+0000 7f77d0c00640 1 -- 172.21.15.8:0/500706891 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f77cc089460 con 0x7f77d4158ed0 2024-05-26T15:40:41.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.117+0000 7f77d8c00640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77b006ac30 0x7f77b006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:41.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.118+0000 7f77d8c00640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77b006ac30 0x7f77b006d0f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f77bc033000 tx=0x7f77bc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:41.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.120+0000 7f77d0c00640 1 -- 172.21.15.8:0/500706891 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f77d415cb70 con 0x7f77d4158ed0 2024-05-26T15:40:41.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.395+0000 7f77da000640 1 -- 172.21.15.8:0/500706891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]} v 0) v1 -- 0x7f77d415d510 con 0x7f77d4158ed0 2024-05-26T15:40:41.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.760+0000 7f77d0c00640 1 -- 172.21.15.8:0/500706891 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]}]=0 v84) v1 ==== 150+0+0 (secure 0 0 0) 0x7f77d415d510 con 0x7f77d4158ed0 2024-05-26T15:40:41.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.763+0000 7f77da000640 1 -- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77b006ac30 msgr2=0x7f77b006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:41.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.763+0000 7f77da000640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77b006ac30 0x7f77b006d0f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f77bc033000 tx=0x7f77bc008030 comp rx=0 tx=0).stop 2024-05-26T15:40:41.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.763+0000 7f77da000640 1 -- 172.21.15.8:0/500706891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4158ed0 msgr2=0x7f77d4159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:41.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.763+0000 7f77da000640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4158ed0 0x7f77d4159380 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f77d40ce670 tx=0x7f77cc00b4a0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.764+0000 7f77da000640 1 -- 172.21.15.8:0/500706891 shutdown_connections 2024-05-26T15:40:41.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.764+0000 7f77da000640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f77d4158ed0 0x7f77d4159380 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.764+0000 7f77da000640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77b006ac30 0x7f77b006d0f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.764+0000 7f77da000640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77d415af10 0x7f77d414b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.764+0000 7f77da000640 1 --2- 172.21.15.8:0/500706891 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f77b8003970 0x7f77d41524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:41.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.764+0000 7f77da000640 1 -- 172.21.15.8:0/500706891 >> 172.21.15.8:0/500706891 conn(0x7f77d4070480 msgr2=0x7f77d4152a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:41.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.764+0000 7f77da000640 1 -- 172.21.15.8:0/500706891 shutdown_connections 2024-05-26T15:40:41.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:41.764+0000 7f77da000640 1 -- 172.21.15.8:0/500706891 wait complete. 2024-05-26T15:40:41.787 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-26T15:40:42.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.010+0000 7f252cc00640 1 Processor -- start 2024-05-26T15:40:42.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.010+0000 7f252cc00640 1 -- start start 2024-05-26T15:40:42.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.011+0000 7f252cc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f252815cdb0 0x7f25280b8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.011+0000 7f252cc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25280d26a0 0x7f25280d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.011+0000 7f252cc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25280b4540 0x7f25280b4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.011+0000 7f252cc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25280b4ea0 con 0x7f252815cdb0 2024-05-26T15:40:42.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.011+0000 7f252cc00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25280d1360 con 0x7f25280b4540 2024-05-26T15:40:42.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.011+0000 7f252cc00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25280d1600 con 0x7f25280d26a0 2024-05-26T15:40:42.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2525e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f252815cdb0 0x7f25280b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2525e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f252815cdb0 0x7f25280b8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50180/0 (socket says 172.21.15.8:50180) 2024-05-26T15:40:42.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2525e00640 1 -- 172.21.15.8:0/743834052 learned_addr learned my addr 172.21.15.8:0/743834052 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:42.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2525400640 1 --2- 172.21.15.8:0/743834052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25280d26a0 0x7f25280d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2526800640 1 --2- 172.21.15.8:0/743834052 >> v2:172.21.15.47:3300/0 conn(0x7f25280b4540 0x7f25280b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2525e00640 1 -- 172.21.15.8:0/743834052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25280d26a0 msgr2=0x7f25280d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:42.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2525e00640 1 --2- 172.21.15.8:0/743834052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25280d26a0 0x7f25280d0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2525e00640 1 -- 172.21.15.8:0/743834052 >> v2:172.21.15.47:3300/0 conn(0x7f25280b4540 msgr2=0x7f25280b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:42.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2525e00640 1 --2- 172.21.15.8:0/743834052 >> v2:172.21.15.47:3300/0 conn(0x7f25280b4540 0x7f25280b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2525e00640 1 -- 172.21.15.8:0/743834052 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25280d18e0 con 0x7f252815cdb0 2024-05-26T15:40:42.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.012+0000 7f2525400640 1 --2- 172.21.15.8:0/743834052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25280d26a0 0x7f25280d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:42.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.014+0000 7f2525e00640 1 --2- 172.21.15.8:0/743834052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f252815cdb0 0x7f25280b8670 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f25280b5040 tx=0x7f251002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88add48e7631c96 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:42.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.014+0000 7f2524a00640 1 -- 172.21.15.8:0/743834052 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251002ae80 con 0x7f252815cdb0 2024-05-26T15:40:42.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.014+0000 7f2524a00640 1 -- 172.21.15.8:0/743834052 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2510032440 con 0x7f252815cdb0 2024-05-26T15:40:42.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.014+0000 7f2524a00640 1 -- 172.21.15.8:0/743834052 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25100327b0 con 0x7f252815cdb0 2024-05-26T15:40:42.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.015+0000 7f252cc00640 1 -- 172.21.15.8:0/743834052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f252815cdb0 msgr2=0x7f25280b8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:42.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.015+0000 7f252cc00640 1 --2- 172.21.15.8:0/743834052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f252815cdb0 0x7f25280b8670 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f25280b5040 tx=0x7f251002a130 comp rx=0 tx=0).stop 2024-05-26T15:40:42.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.015+0000 7f252cc00640 1 -- 172.21.15.8:0/743834052 shutdown_connections 2024-05-26T15:40:42.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.015+0000 7f252cc00640 1 --2- 172.21.15.8:0/743834052 >> v2:172.21.15.47:3300/0 conn(0x7f25280b4540 0x7f25280b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.015+0000 7f252cc00640 1 --2- 172.21.15.8:0/743834052 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25280d26a0 0x7f25280d0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.015+0000 7f252cc00640 1 --2- 172.21.15.8:0/743834052 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f252815cdb0 0x7f25280b8670 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.015+0000 7f252cc00640 1 -- 172.21.15.8:0/743834052 >> 172.21.15.8:0/743834052 conn(0x7f2528071bd0 msgr2=0x7f25280cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:42.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.015+0000 7f252cc00640 1 -- 172.21.15.8:0/743834052 shutdown_connections 2024-05-26T15:40:42.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.015+0000 7f252cc00640 1 -- 172.21.15.8:0/743834052 wait complete. 2024-05-26T15:40:42.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.017+0000 7f252cc00640 1 Processor -- start 2024-05-26T15:40:42.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.017+0000 7f252cc00640 1 -- start start 2024-05-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.018+0000 7f252cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25280b4540 0x7f25281594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.018+0000 7f252cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25280d26a0 0x7f25280cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.018+0000 7f252cc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f252815cdb0 0x7f2528157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.018+0000 7f252cc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25280cc590 con 0x7f25280b4540 2024-05-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.018+0000 7f252cc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25280cbcf0 con 0x7f25280d26a0 2024-05-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.018+0000 7f252cc00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25280cbfd0 con 0x7f252815cdb0 2024-05-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.018+0000 7f2525e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25280b4540 0x7f25281594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.018+0000 7f2525e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25280b4540 0x7f25281594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50192/0 (socket says 172.21.15.8:50192) 2024-05-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.018+0000 7f2525e00640 1 -- 172.21.15.8:0/1394720741 learned_addr learned my addr 172.21.15.8:0/1394720741 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:42.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.019+0000 7f2525400640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25280d26a0 0x7f25280cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.019+0000 7f2525e00640 1 -- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f252815cdb0 msgr2=0x7f2528157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:42.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.019+0000 7f2525e00640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f252815cdb0 0x7f2528157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.019+0000 7f2525e00640 1 -- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25280d26a0 msgr2=0x7f25280cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.019+0000 7f2525e00640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25280d26a0 0x7f25280cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.019+0000 7f2525e00640 1 -- 172.21.15.8:0/1394720741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25100094d0 con 0x7f25280b4540 2024-05-26T15:40:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.019+0000 7f2525e00640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25280b4540 0x7f25281594c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f251002a170 tx=0x7f25100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.020+0000 7f251e000640 1 -- 172.21.15.8:0/1394720741 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510030850 con 0x7f25280b4540 2024-05-26T15:40:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.020+0000 7f251e000640 1 -- 172.21.15.8:0/1394720741 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25100309b0 con 0x7f25280b4540 2024-05-26T15:40:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.020+0000 7f251e000640 1 -- 172.21.15.8:0/1394720741 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510030d60 con 0x7f25280b4540 2024-05-26T15:40:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.020+0000 7f252cc00640 1 -- 172.21.15.8:0/1394720741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25280cc2b0 con 0x7f25280b4540 2024-05-26T15:40:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.020+0000 7f252cc00640 1 -- 172.21.15.8:0/1394720741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2528157b70 con 0x7f25280b4540 2024-05-26T15:40:42.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.021+0000 7f252cc00640 1 -- 172.21.15.8:0/1394720741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2528154a40 con 0x7f25280b4540 2024-05-26T15:40:42.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.022+0000 7f251e000640 1 -- 172.21.15.8:0/1394720741 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2510039040 con 0x7f25280b4540 2024-05-26T15:40:42.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.023+0000 7f251e000640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f250406ac00 0x7f250406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.023+0000 7f251e000640 1 -- 172.21.15.8:0/1394720741 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f25100aa2f0 con 0x7f25280b4540 2024-05-26T15:40:42.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.024+0000 7f2525400640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f250406ac00 0x7f250406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.025+0000 7f2525400640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f250406ac00 0x7f250406d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f25280cc6f0 tx=0x7f2518008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:42.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.027+0000 7f251e000640 1 -- 172.21.15.8:0/1394720741 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2528154a40 con 0x7f25280b4540 2024-05-26T15:40:42.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.228+0000 7f252cc00640 1 -- 172.21.15.8:0/1394720741 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2528154a40 con 0x7f25280b4540 2024-05-26T15:40:42.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.234+0000 7f251e000640 1 -- 172.21.15.8:0/1394720741 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2528154a40 con 0x7f25280b4540 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 -- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f250406ac00 msgr2=0x7f250406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f250406ac00 0x7f250406d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f25280cc6f0 tx=0x7f2518008040 comp rx=0 tx=0).stop 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 -- 172.21.15.8:0/1394720741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25280b4540 msgr2=0x7f25281594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25280b4540 0x7f25281594c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f251002a170 tx=0x7f25100046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 -- 172.21.15.8:0/1394720741 shutdown_connections 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f252815cdb0 0x7f2528157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f250406ac00 0x7f250406d0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25280d26a0 0x7f25280cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 --2- 172.21.15.8:0/1394720741 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25280b4540 0x7f25281594c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 -- 172.21.15.8:0/1394720741 >> 172.21.15.8:0/1394720741 conn(0x7f2528071bd0 msgr2=0x7f252815ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:42.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 -- 172.21.15.8:0/1394720741 shutdown_connections 2024-05-26T15:40:42.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.237+0000 7f252cc00640 1 -- 172.21.15.8:0/1394720741 wait complete. 2024-05-26T15:40:42.255 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-26T15:40:42.256 DEBUG:teuthology.orchestra.run.smithi008:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-26T15:40:42.371 DEBUG:teuthology.orchestra.run.smithi047:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-26T15:40:42.497 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-26T15:40:42.497 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:40:42.497 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:42.558 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:40:42.559 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:42.615 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:40:42.615 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:42.671 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:42.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.889+0000 7ff5a2200640 1 Processor -- start 2024-05-26T15:40:42.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.889+0000 7ff5a2200640 1 -- start start 2024-05-26T15:40:42.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.891+0000 7ff5a2200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff59c0b03d0 0x7ff59c0cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.891+0000 7ff5a2200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 0x7ff59c1625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.891+0000 7ff5a2200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c161540 con 0x7ff59c157ff0 2024-05-26T15:40:42.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.891+0000 7ff5a2200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c1621c0 con 0x7ff59c0b03d0 2024-05-26T15:40:42.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.891+0000 7ff5a2200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c1583d0 con 0x7ff59c0cc580 2024-05-26T15:40:42.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.891+0000 7ff5a1800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 0x7ff59c1625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.892+0000 7ff5a1800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 0x7ff59c1625f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:58168/0 (socket says 172.21.15.8:58168) 2024-05-26T15:40:42.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.892+0000 7ff5a1800640 1 -- 172.21.15.8:0/2226397160 learned_addr learned my addr 172.21.15.8:0/2226397160 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:42.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.892+0000 7ff59be00640 1 --2- 172.21.15.8:0/2226397160 >> v2:172.21.15.47:3300/0 conn(0x7ff59c0b03d0 0x7ff59c0cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.892+0000 7ff5a1800640 1 -- 172.21.15.8:0/2226397160 >> v2:172.21.15.47:3300/0 conn(0x7ff59c0b03d0 msgr2=0x7ff59c0cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:42.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.892+0000 7ff5a1800640 1 --2- 172.21.15.8:0/2226397160 >> v2:172.21.15.47:3300/0 conn(0x7ff59c0b03d0 0x7ff59c0cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.892+0000 7ff5a1800640 1 -- 172.21.15.8:0/2226397160 >> v1:172.21.15.47:6789/0 conn(0x7ff59c157ff0 legacy=0x7ff59c0afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:42.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.892+0000 7ff5a1800640 1 -- 172.21.15.8:0/2226397160 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c161820 con 0x7ff59c0cc580 2024-05-26T15:40:42.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.894+0000 7ff5a1800640 1 --2- 172.21.15.8:0/2226397160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 0x7ff59c1625f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff594009e50 tx=0x7ff59402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff975d2e56977a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:42.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.894+0000 7ff59b400640 1 -- 172.21.15.8:0/2226397160 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594031600 con 0x7ff59c0cc580 2024-05-26T15:40:42.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.894+0000 7ff59b400640 1 -- 172.21.15.8:0/2226397160 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59402d050 con 0x7ff59c0cc580 2024-05-26T15:40:42.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.894+0000 7ff59b400640 1 -- 172.21.15.8:0/2226397160 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594031980 con 0x7ff59c0cc580 2024-05-26T15:40:42.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.895+0000 7ff5a2200640 1 -- 172.21.15.8:0/2226397160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 msgr2=0x7ff59c1625f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:42.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.895+0000 7ff5a2200640 1 --2- 172.21.15.8:0/2226397160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 0x7ff59c1625f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff594009e50 tx=0x7ff59402a710 comp rx=0 tx=0).stop 2024-05-26T15:40:42.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.895+0000 7ff5a2200640 1 -- 172.21.15.8:0/2226397160 shutdown_connections 2024-05-26T15:40:42.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.895+0000 7ff5a2200640 1 --2- 172.21.15.8:0/2226397160 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 0x7ff59c1625f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.895+0000 7ff5a2200640 1 --2- 172.21.15.8:0/2226397160 >> v2:172.21.15.47:3300/0 conn(0x7ff59c0b03d0 0x7ff59c0cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.895+0000 7ff5a2200640 1 -- 172.21.15.8:0/2226397160 >> 172.21.15.8:0/2226397160 conn(0x7ff59c070480 msgr2=0x7ff59c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:42.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.896+0000 7ff5a2200640 1 -- 172.21.15.8:0/2226397160 shutdown_connections 2024-05-26T15:40:42.894 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.896+0000 7ff5a2200640 1 -- 172.21.15.8:0/2226397160 wait complete. 2024-05-26T15:40:42.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.897+0000 7ff5a2200640 1 Processor -- start 2024-05-26T15:40:42.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.897+0000 7ff5a2200640 1 -- start start 2024-05-26T15:40:42.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.898+0000 7ff5a2200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff59c0b03d0 0x7ff59c15d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.898+0000 7ff5a2200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 0x7ff59c148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.898+0000 7ff5a2200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff59c157ff0 0x7ff59c15cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.898+0000 7ff5a2200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c158510 con 0x7ff59c157ff0 2024-05-26T15:40:42.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.898+0000 7ff5a2200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c15dec0 con 0x7ff59c0b03d0 2024-05-26T15:40:42.897 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.898+0000 7ff5a2200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c158760 con 0x7ff59c0cc580 2024-05-26T15:40:42.898 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff5a1800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff59c157ff0 0x7ff59c15cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff5a1800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff59c157ff0 0x7ff59c15cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50196/0 (socket says 172.21.15.8:50196) 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff5a1800640 1 -- 172.21.15.8:0/1846521816 learned_addr learned my addr 172.21.15.8:0/1846521816 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff59be00640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 0x7ff59c148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff5a0e00640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff59c0b03d0 0x7ff59c15d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff5a1800640 1 -- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 msgr2=0x7ff59c148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff5a1800640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 0x7ff59c148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff5a1800640 1 -- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff59c0b03d0 msgr2=0x7ff59c15d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff5a1800640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff59c0b03d0 0x7ff59c15d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff5a1800640 1 -- 172.21.15.8:0/1846521816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594009b30 con 0x7ff59c157ff0 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.899+0000 7ff5a0e00640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff59c0b03d0 0x7ff59c15d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.900+0000 7ff5a1800640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff59c157ff0 0x7ff59c15cb40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff594009f40 tx=0x7ff594004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.900+0000 7ff598c00640 1 -- 172.21.15.8:0/1846521816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59403b820 con 0x7ff59c157ff0 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.900+0000 7ff598c00640 1 -- 172.21.15.8:0/1846521816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59403b980 con 0x7ff59c157ff0 2024-05-26T15:40:42.899 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.900+0000 7ff598c00640 1 -- 172.21.15.8:0/1846521816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59403bd30 con 0x7ff59c157ff0 2024-05-26T15:40:42.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.900+0000 7ff5a2200640 1 -- 172.21.15.8:0/1846521816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c158a40 con 0x7ff59c157ff0 2024-05-26T15:40:42.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.900+0000 7ff5a2200640 1 -- 172.21.15.8:0/1846521816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c159000 con 0x7ff59c157ff0 2024-05-26T15:40:42.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.901+0000 7ff5a2200640 1 -- 172.21.15.8:0/1846521816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c04e280 con 0x7ff59c157ff0 2024-05-26T15:40:42.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.902+0000 7ff598c00640 1 -- 172.21.15.8:0/1846521816 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff594038050 con 0x7ff59c157ff0 2024-05-26T15:40:42.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.903+0000 7ff598c00640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff57c06ac00 0x7ff57c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:42.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.904+0000 7ff598c00640 1 -- 172.21.15.8:0/1846521816 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff5940a9a40 con 0x7ff59c157ff0 2024-05-26T15:40:42.902 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.904+0000 7ff5a0e00640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff57c06ac00 0x7ff57c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:42.903 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.905+0000 7ff5a0e00640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff57c06ac00 0x7ff57c06d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff58c000f60 tx=0x7ff58c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:42.906 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:42.908+0000 7ff598c00640 1 -- 172.21.15.8:0/1846521816 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff594074950 con 0x7ff59c157ff0 2024-05-26T15:40:43.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.108+0000 7ff5a2200640 1 -- 172.21.15.8:0/1846521816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff59c154650 con 0x7ff59c157ff0 2024-05-26T15:40:43.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.111+0000 7ff598c00640 1 -- 172.21.15.8:0/1846521816 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7ff594077f70 con 0x7ff59c157ff0 2024-05-26T15:40:43.110 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:43.110 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.113+0000 7ff5a2200640 1 -- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff57c06ac00 msgr2=0x7ff57c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.113+0000 7ff5a2200640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff57c06ac00 0x7ff57c06d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff58c000f60 tx=0x7ff58c009040 comp rx=0 tx=0).stop 2024-05-26T15:40:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.113+0000 7ff5a2200640 1 -- 172.21.15.8:0/1846521816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff59c157ff0 msgr2=0x7ff59c15cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.113+0000 7ff5a2200640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff59c157ff0 0x7ff59c15cb40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff594009f40 tx=0x7ff594004a40 comp rx=0 tx=0).stop 2024-05-26T15:40:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.113+0000 7ff5a2200640 1 -- 172.21.15.8:0/1846521816 shutdown_connections 2024-05-26T15:40:43.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.113+0000 7ff5a2200640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff59c157ff0 0x7ff59c15cb40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.113+0000 7ff5a2200640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff59c0cc580 0x7ff59c148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.114+0000 7ff5a2200640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff57c06ac00 0x7ff57c06d0c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.114+0000 7ff5a2200640 1 --2- 172.21.15.8:0/1846521816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff59c0b03d0 0x7ff59c15d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.114+0000 7ff5a2200640 1 -- 172.21.15.8:0/1846521816 >> 172.21.15.8:0/1846521816 conn(0x7ff59c070480 msgr2=0x7ff59c0afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:43.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.114+0000 7ff5a2200640 1 -- 172.21.15.8:0/1846521816 shutdown_connections 2024-05-26T15:40:43.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.114+0000 7ff5a2200640 1 -- 172.21.15.8:0/1846521816 wait complete. 2024-05-26T15:40:43.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:43.132 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:43.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.352+0000 7fb53d800640 1 Processor -- start 2024-05-26T15:40:43.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.353+0000 7fb53d800640 1 -- start start 2024-05-26T15:40:43.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.354+0000 7fb53d800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb5381464e0 0x7fb5380b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.354+0000 7fb53d800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb538160c20 0x7fb5380ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.354+0000 7fb53d800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53806c830 con 0x7fb5380addb0 2024-05-26T15:40:43.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.354+0000 7fb53d800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5380b1f50 con 0x7fb538160c20 2024-05-26T15:40:43.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.354+0000 7fb53d800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5380ae350 con 0x7fb5381464e0 2024-05-26T15:40:43.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.355+0000 7fb53ce00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb538160c20 0x7fb5380ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:43.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.355+0000 7fb53ce00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb538160c20 0x7fb5380ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50206/0 (socket says 172.21.15.8:50206) 2024-05-26T15:40:43.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.355+0000 7fb537400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb5380addb0 0x7fb538160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41932/0 (socket says 172.21.15.8:41932) 2024-05-26T15:40:43.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.355+0000 7fb53ce00640 1 -- 172.21.15.8:0/2045436172 learned_addr learned my addr 172.21.15.8:0/2045436172 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:43.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.355+0000 7fb537e00640 1 --2- 172.21.15.8:0/2045436172 >> v2:172.21.15.47:3300/0 conn(0x7fb5381464e0 0x7fb5380b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:43.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.355+0000 7fb53ce00640 1 -- 172.21.15.8:0/2045436172 >> v2:172.21.15.47:3300/0 conn(0x7fb5381464e0 msgr2=0x7fb5380b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:43.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.355+0000 7fb53ce00640 1 --2- 172.21.15.8:0/2045436172 >> v2:172.21.15.47:3300/0 conn(0x7fb5381464e0 0x7fb5380b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.355+0000 7fb53ce00640 1 -- 172.21.15.8:0/2045436172 >> v1:172.21.15.8:6789/0 conn(0x7fb5380addb0 legacy=0x7fb538160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.355+0000 7fb53ce00640 1 -- 172.21.15.8:0/2045436172 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380b3f60 con 0x7fb538160c20 2024-05-26T15:40:43.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.357+0000 7fb53ce00640 1 --2- 172.21.15.8:0/2045436172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb538160c20 0x7fb5380ac070 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb5380ce8c0 tx=0x7fb53002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f15ee0b752775d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:43.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.357+0000 7fb536a00640 1 -- 172.21.15.8:0/2045436172 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530032440 con 0x7fb538160c20 2024-05-26T15:40:43.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.357+0000 7fb536a00640 1 -- 172.21.15.8:0/2045436172 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5300325a0 con 0x7fb538160c20 2024-05-26T15:40:43.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.357+0000 7fb536a00640 1 -- 172.21.15.8:0/2045436172 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530032930 con 0x7fb538160c20 2024-05-26T15:40:43.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.358+0000 7fb53d800640 1 -- 172.21.15.8:0/2045436172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb538160c20 msgr2=0x7fb5380ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.358+0000 7fb53d800640 1 --2- 172.21.15.8:0/2045436172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb538160c20 0x7fb5380ac070 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb5380ce8c0 tx=0x7fb53002a160 comp rx=0 tx=0).stop 2024-05-26T15:40:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.358+0000 7fb53d800640 1 -- 172.21.15.8:0/2045436172 shutdown_connections 2024-05-26T15:40:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.358+0000 7fb53d800640 1 --2- 172.21.15.8:0/2045436172 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb538160c20 0x7fb5380ac070 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.358+0000 7fb53d800640 1 --2- 172.21.15.8:0/2045436172 >> v2:172.21.15.47:3300/0 conn(0x7fb5381464e0 0x7fb5380b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.358+0000 7fb53d800640 1 -- 172.21.15.8:0/2045436172 >> 172.21.15.8:0/2045436172 conn(0x7fb5380b0710 msgr2=0x7fb5380b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.358+0000 7fb53d800640 1 -- 172.21.15.8:0/2045436172 shutdown_connections 2024-05-26T15:40:43.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.358+0000 7fb53d800640 1 -- 172.21.15.8:0/2045436172 wait complete. 2024-05-26T15:40:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.360+0000 7fb53d800640 1 Processor -- start 2024-05-26T15:40:43.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.360+0000 7fb53d800640 1 -- start start 2024-05-26T15:40:43.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.361+0000 7fb53d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5380addb0 0x7fb53815bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.361+0000 7fb53d800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb5381464e0 0x7fb5381444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.361+0000 7fb53d800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb538160c20 0x7fb5381449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.361+0000 7fb53d800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53815c200 con 0x7fb5380addb0 2024-05-26T15:40:43.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.361+0000 7fb53d800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380cccf0 con 0x7fb538160c20 2024-05-26T15:40:43.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.361+0000 7fb53d800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380cc0e0 con 0x7fb5381464e0 2024-05-26T15:40:43.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.361+0000 7fb537e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5380addb0 0x7fb53815bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:43.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.361+0000 7fb537e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5380addb0 0x7fb53815bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50214/0 (socket says 172.21.15.8:50214) 2024-05-26T15:40:43.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.361+0000 7fb537e00640 1 -- 172.21.15.8:0/3090992550 learned_addr learned my addr 172.21.15.8:0/3090992550 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:43.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.362+0000 7fb537e00640 1 -- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb5381464e0 msgr2=0x7fb5381444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.362+0000 7fb537e00640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb5381464e0 0x7fb5381444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.362+0000 7fb537e00640 1 -- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb538160c20 msgr2=0x7fb5381449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.362+0000 7fb537e00640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb538160c20 0x7fb5381449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.362+0000 7fb537e00640 1 -- 172.21.15.8:0/3090992550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5300094d0 con 0x7fb5380addb0 2024-05-26T15:40:43.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.362+0000 7fb537e00640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5380addb0 0x7fb53815bcc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb52800d830 tx=0x7fb52800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.362+0000 7fb52fe00640 1 -- 172.21.15.8:0/3090992550 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800b6c0 con 0x7fb5380addb0 2024-05-26T15:40:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.362+0000 7fb52fe00640 1 -- 172.21.15.8:0/3090992550 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52800b820 con 0x7fb5380addb0 2024-05-26T15:40:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.362+0000 7fb53d800640 1 -- 172.21.15.8:0/3090992550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5380cc3c0 con 0x7fb5380addb0 2024-05-26T15:40:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.362+0000 7fb52fe00640 1 -- 172.21.15.8:0/3090992550 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800bbb0 con 0x7fb5380addb0 2024-05-26T15:40:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.363+0000 7fb53d800640 1 -- 172.21.15.8:0/3090992550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5380cc980 con 0x7fb5380addb0 2024-05-26T15:40:43.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.364+0000 7fb53d800640 1 -- 172.21.15.8:0/3090992550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53804e210 con 0x7fb5380addb0 2024-05-26T15:40:43.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.365+0000 7fb52fe00640 1 -- 172.21.15.8:0/3090992550 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb52801e460 con 0x7fb5380addb0 2024-05-26T15:40:43.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.366+0000 7fb52fe00640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb51806ac00 0x7fb51806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.366+0000 7fb52fe00640 1 -- 172.21.15.8:0/3090992550 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb528089f20 con 0x7fb5380addb0 2024-05-26T15:40:43.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.366+0000 7fb537400640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb51806ac00 0x7fb51806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:43.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.368+0000 7fb537400640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb51806ac00 0x7fb51806d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb524007fd0 tx=0x7fb524007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:43.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.370+0000 7fb52fe00640 1 -- 172.21.15.8:0/3090992550 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb528054d10 con 0x7fb5380addb0 2024-05-26T15:40:43.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.571+0000 7fb53d800640 1 -- 172.21.15.8:0/3090992550 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb538160070 con 0x7fb5380addb0 2024-05-26T15:40:43.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.573+0000 7fb52fe00640 1 -- 172.21.15.8:0/3090992550 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb528058330 con 0x7fb5380addb0 2024-05-26T15:40:43.571 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:43.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 -- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb51806ac00 msgr2=0x7fb51806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb51806ac00 0x7fb51806d0c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb524007fd0 tx=0x7fb524007d40 comp rx=0 tx=0).stop 2024-05-26T15:40:43.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 -- 172.21.15.8:0/3090992550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5380addb0 msgr2=0x7fb53815bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5380addb0 0x7fb53815bcc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb52800d830 tx=0x7fb52800dcf0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 -- 172.21.15.8:0/3090992550 shutdown_connections 2024-05-26T15:40:43.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb51806ac00 0x7fb51806d0c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb538160c20 0x7fb5381449e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb5381464e0 0x7fb5381444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 --2- 172.21.15.8:0/3090992550 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5380addb0 0x7fb53815bcc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 -- 172.21.15.8:0/3090992550 >> 172.21.15.8:0/3090992550 conn(0x7fb5380b0710 msgr2=0x7fb53806cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:43.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 -- 172.21.15.8:0/3090992550 shutdown_connections 2024-05-26T15:40:43.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.576+0000 7fb53d800640 1 -- 172.21.15.8:0/3090992550 wait complete. 2024-05-26T15:40:43.595 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:43.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.810+0000 7f3e81800640 1 Processor -- start 2024-05-26T15:40:43.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.811+0000 7f3e81800640 1 -- start start 2024-05-26T15:40:43.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.812+0000 7f3e81800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e7c15cce0 0x7f3e7c0ce790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.812+0000 7f3e81800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3e7c0af5d0 0x7f3e7c0afa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.812+0000 7f3e81800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7c069e70 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.812+0000 7f3e81800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c06a0c0 con 0x7f3e7c0af5d0 2024-05-26T15:40:43.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.812+0000 7f3e81800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c06a3a0 con 0x7f3e7c15cce0 2024-05-26T15:40:43.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.812+0000 7f3e80e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3e7c0af5d0 0x7f3e7c0afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:43.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.812+0000 7f3e80e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3e7c0af5d0 0x7f3e7c0afa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50226/0 (socket says 172.21.15.8:50226) 2024-05-26T15:40:43.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.812+0000 7f3e80e00640 1 -- 172.21.15.8:0/1148219481 learned_addr learned my addr 172.21.15.8:0/1148219481 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:43.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.813+0000 7f3e80e00640 1 -- 172.21.15.8:0/1148219481 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e7c15cce0 msgr2=0x7f3e7c0ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:43.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.813+0000 7f3e80e00640 1 --2- 172.21.15.8:0/1148219481 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e7c15cce0 0x7f3e7c0ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.813+0000 7f3e80e00640 1 -- 172.21.15.8:0/1148219481 >> v1:172.21.15.47:6789/0 conn(0x7f3e7c0cecd0 legacy=0x7f3e7c0ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:43.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.813+0000 7f3e80e00640 1 -- 172.21.15.8:0/1148219481 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c06a680 con 0x7f3e7c0af5d0 2024-05-26T15:40:43.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.814+0000 7f3e80e00640 1 --2- 172.21.15.8:0/1148219481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0af5d0 0x7f3e7c0afa60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009e50 tx=0x7f3e7402a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5610fe0012e4cae1 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:43.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.814+0000 7f3e7aa00640 1 -- 172.21.15.8:0/1148219481 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74031600 con 0x7f3e7c0af5d0 2024-05-26T15:40:43.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.814+0000 7f3e7aa00640 1 -- 172.21.15.8:0/1148219481 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7402d050 con 0x7f3e7c0af5d0 2024-05-26T15:40:43.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.814+0000 7f3e7aa00640 1 -- 172.21.15.8:0/1148219481 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74031980 con 0x7f3e7c0af5d0 2024-05-26T15:40:43.813 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.815+0000 7f3e81800640 1 -- 172.21.15.8:0/1148219481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0af5d0 msgr2=0x7f3e7c0afa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.815+0000 7f3e81800640 1 --2- 172.21.15.8:0/1148219481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0af5d0 0x7f3e7c0afa60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009e50 tx=0x7f3e7402a640 comp rx=0 tx=0).stop 2024-05-26T15:40:43.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.815+0000 7f3e81800640 1 -- 172.21.15.8:0/1148219481 shutdown_connections 2024-05-26T15:40:43.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.815+0000 7f3e81800640 1 --2- 172.21.15.8:0/1148219481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0af5d0 0x7f3e7c0afa60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.815+0000 7f3e81800640 1 --2- 172.21.15.8:0/1148219481 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e7c15cce0 0x7f3e7c0ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.815+0000 7f3e81800640 1 -- 172.21.15.8:0/1148219481 >> 172.21.15.8:0/1148219481 conn(0x7f3e7c098a50 msgr2=0x7f3e7c0cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:43.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.815+0000 7f3e81800640 1 -- 172.21.15.8:0/1148219481 shutdown_connections 2024-05-26T15:40:43.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.815+0000 7f3e81800640 1 -- 172.21.15.8:0/1148219481 wait complete. 2024-05-26T15:40:43.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.817+0000 7f3e81800640 1 Processor -- start 2024-05-26T15:40:43.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.817+0000 7f3e81800640 1 -- start start 2024-05-26T15:40:43.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.818+0000 7f3e81800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e7c0af5d0 0x7f3e7c1591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.816 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.818+0000 7f3e81800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0cecd0 0x7f3e7c0b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.818+0000 7f3e81800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e7c0b2710 0x7f3e7c0b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.818+0000 7f3e81800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c159730 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.818+0000 7f3e81800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c0b2bb0 con 0x7f3e7c0b2710 2024-05-26T15:40:43.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.818+0000 7f3e81800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c0b2e90 con 0x7f3e7c0af5d0 2024-05-26T15:40:43.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.818+0000 7f3e7b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0cecd0 0x7f3e7c0b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:43.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.818+0000 7f3e7b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0cecd0 0x7f3e7c0b21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50242/0 (socket says 172.21.15.8:50242) 2024-05-26T15:40:43.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.818+0000 7f3e7b400640 1 -- 172.21.15.8:0/2964404017 learned_addr learned my addr 172.21.15.8:0/2964404017 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:43.818 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.819+0000 7f3e7b400640 1 -- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e7c0af5d0 msgr2=0x7f3e7c1591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.819+0000 7f3e80e00640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e7c0b2710 0x7f3e7c0b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.819+0000 7f3e7be00640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e7c0af5d0 0x7f3e7c1591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.819+0000 7f3e7b400640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e7c0af5d0 0x7f3e7c1591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.819+0000 7f3e7b400640 1 -- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e7c0b2710 msgr2=0x7f3e7c0b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.819+0000 7f3e7b400640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e7c0b2710 0x7f3e7c0b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.819+0000 7f3e7b400640 1 -- 172.21.15.8:0/2964404017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e74009b30 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.819+0000 7f3e80e00640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e7c0b2710 0x7f3e7c0b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.819+0000 7f3e7be00640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e7c0af5d0 0x7f3e7c1591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.819+0000 7f3e7b400640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0cecd0 0x7f3e7c0b21d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c410 tx=0x7f3e6800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.820+0000 7f3e73e00640 1 -- 172.21.15.8:0/2964404017 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e680035f0 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.820+0000 7f3e73e00640 1 -- 172.21.15.8:0/2964404017 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68003750 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.820+0000 7f3e73e00640 1 -- 172.21.15.8:0/2964404017 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68003b40 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.820+0000 7f3e81800640 1 -- 172.21.15.8:0/2964404017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c0b3170 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.820+0000 7f3e81800640 1 -- 172.21.15.8:0/2964404017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7c0b3730 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.821+0000 7f3e81800640 1 -- 172.21.15.8:0/2964404017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7c066a90 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.820 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.822+0000 7f3e73e00640 1 -- 172.21.15.8:0/2964404017 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3e68003ca0 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.823+0000 7f3e73e00640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3e5c06ac00 0x7f3e5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:43.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.823+0000 7f3e73e00640 1 -- 172.21.15.8:0/2964404017 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3e68088960 con 0x7f3e7c0cecd0 2024-05-26T15:40:43.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.824+0000 7f3e7be00640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3e5c06ac00 0x7f3e5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:43.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.825+0000 7f3e7be00640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3e5c06ac00 0x7f3e5c06d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0995c0 tx=0x7f3e6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:43.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:43.828+0000 7f3e73e00640 1 -- 172.21.15.8:0/2964404017 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3e68053750 con 0x7f3e7c0cecd0 2024-05-26T15:40:44.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.026+0000 7f3e81800640 1 -- 172.21.15.8:0/2964404017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e7c0674b0 con 0x7f3e7c0cecd0 2024-05-26T15:40:44.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.027+0000 7f3e73e00640 1 -- 172.21.15.8:0/2964404017 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e68056d70 con 0x7f3e7c0cecd0 2024-05-26T15:40:44.026 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:44.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 -- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3e5c06ac00 msgr2=0x7f3e5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3e5c06ac00 0x7f3e5c06d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0995c0 tx=0x7f3e6c008040 comp rx=0 tx=0).stop 2024-05-26T15:40:44.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 -- 172.21.15.8:0/2964404017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0cecd0 msgr2=0x7f3e7c0b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0cecd0 0x7f3e7c0b21d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c410 tx=0x7f3e6800c8d0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 -- 172.21.15.8:0/2964404017 shutdown_connections 2024-05-26T15:40:44.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3e5c06ac00 0x7f3e5c06d0c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e7c0b2710 0x7f3e7c0b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3e7c0cecd0 0x7f3e7c0b21d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 --2- 172.21.15.8:0/2964404017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3e7c0af5d0 0x7f3e7c1591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 -- 172.21.15.8:0/2964404017 >> 172.21.15.8:0/2964404017 conn(0x7f3e7c098a50 msgr2=0x7f3e7c0adf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:44.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 -- 172.21.15.8:0/2964404017 shutdown_connections 2024-05-26T15:40:44.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.030+0000 7f3e81800640 1 -- 172.21.15.8:0/2964404017 wait complete. 2024-05-26T15:40:44.049 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:44.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.267+0000 7f18e7e00640 1 Processor -- start 2024-05-26T15:40:44.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.268+0000 7f18e7e00640 1 -- start start 2024-05-26T15:40:44.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.269+0000 7f18e7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f18e80cb910 0x7f18e815e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.269+0000 7f18e7e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e815e990 con 0x7f18e8069e70 2024-05-26T15:40:44.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.269+0000 7f18e7e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e815ec70 con 0x7f18e815de70 2024-05-26T15:40:44.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.269+0000 7f18e7e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e80af050 con 0x7f18e80cb910 2024-05-26T15:40:44.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.269+0000 7f18e7400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f18e80cb910 0x7f18e815e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.269+0000 7f18e6000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f18e8069e70 0x7f18e80af4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41936/0 (socket says 172.21.15.8:41936) 2024-05-26T15:40:44.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.269+0000 7f18e6000640 1 -- 172.21.15.8:0/3538877257 learned_addr learned my addr 172.21.15.8:0/3538877257 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:44.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.270+0000 7f18e7400640 1 -- 172.21.15.8:0/3538877257 >> v1:172.21.15.47:6789/0 conn(0x7f18e815de70 legacy=0x7f18e80cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:44.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.270+0000 7f18e7400640 1 -- 172.21.15.8:0/3538877257 >> v1:172.21.15.8:6789/0 conn(0x7f18e8069e70 legacy=0x7f18e80af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.270+0000 7f18e7400640 1 -- 172.21.15.8:0/3538877257 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e815ef50 con 0x7f18e80cb910 2024-05-26T15:40:44.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.270+0000 7f18e5600640 1 -- 172.21.15.8:0/3538877257 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472290763 0 0) 0x7f18e815e990 con 0x7f18e8069e70 2024-05-26T15:40:44.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.271+0000 7f18e7400640 1 --2- 172.21.15.8:0/3538877257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e80cb910 0x7f18e815e360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f18e00097a0 tx=0x7f18e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850954de3b22762d server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:44.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.271+0000 7f18e5600640 1 -- 172.21.15.8:0/3538877257 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0032440 con 0x7f18e80cb910 2024-05-26T15:40:44.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.271+0000 7f18e5600640 1 -- 172.21.15.8:0/3538877257 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e00325a0 con 0x7f18e80cb910 2024-05-26T15:40:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.271+0000 7f18e5600640 1 -- 172.21.15.8:0/3538877257 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0032930 con 0x7f18e80cb910 2024-05-26T15:40:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.272+0000 7f18e7e00640 1 -- 172.21.15.8:0/3538877257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e80cb910 msgr2=0x7f18e815e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.272+0000 7f18e7e00640 1 --2- 172.21.15.8:0/3538877257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e80cb910 0x7f18e815e360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f18e00097a0 tx=0x7f18e002a1e0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.272+0000 7f18e7e00640 1 -- 172.21.15.8:0/3538877257 shutdown_connections 2024-05-26T15:40:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.272+0000 7f18e7e00640 1 --2- 172.21.15.8:0/3538877257 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e80cb910 0x7f18e815e360 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.272+0000 7f18e7e00640 1 -- 172.21.15.8:0/3538877257 >> 172.21.15.8:0/3538877257 conn(0x7f18e8098a50 msgr2=0x7f18e80b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.272+0000 7f18e7e00640 1 -- 172.21.15.8:0/3538877257 shutdown_connections 2024-05-26T15:40:44.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.272+0000 7f18e7e00640 1 -- 172.21.15.8:0/3538877257 wait complete. 2024-05-26T15:40:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.274+0000 7f18e7e00640 1 Processor -- start 2024-05-26T15:40:44.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.274+0000 7f18e7e00640 1 -- start start 2024-05-26T15:40:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18e8069e70 0x7f18e8158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18e80cb910 0x7f18e80c3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e815de70 0x7f18e80b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e815a010 con 0x7f18e815de70 2024-05-26T15:40:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8158c90 con 0x7f18e80cb910 2024-05-26T15:40:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8158f70 con 0x7f18e8069e70 2024-05-26T15:40:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e815de70 0x7f18e80b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e815de70 0x7f18e80b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50248/0 (socket says 172.21.15.8:50248) 2024-05-26T15:40:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7400640 1 -- 172.21.15.8:0/3341574253 learned_addr learned my addr 172.21.15.8:0/3341574253 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:44.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e6000640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18e80cb910 0x7f18e80c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e6a00640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18e8069e70 0x7f18e8158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7400640 1 -- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18e8069e70 msgr2=0x7f18e8158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.275+0000 7f18e7400640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18e8069e70 0x7f18e8158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.276+0000 7f18e7400640 1 -- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18e80cb910 msgr2=0x7f18e80c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.276+0000 7f18e7400640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18e80cb910 0x7f18e80c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.276+0000 7f18e7400640 1 -- 172.21.15.8:0/3341574253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0009400 con 0x7f18e815de70 2024-05-26T15:40:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.276+0000 7f18e7400640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e815de70 0x7f18e80b3790 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f18e00097a0 tx=0x7f18e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.276+0000 7f18df400640 1 -- 172.21.15.8:0/3341574253 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0030b00 con 0x7f18e815de70 2024-05-26T15:40:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.276+0000 7f18df400640 1 -- 172.21.15.8:0/3341574253 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e0030c60 con 0x7f18e815de70 2024-05-26T15:40:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.276+0000 7f18df400640 1 -- 172.21.15.8:0/3341574253 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e0006e10 con 0x7f18e815de70 2024-05-26T15:40:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.276+0000 7f18e7e00640 1 -- 172.21.15.8:0/3341574253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e8159250 con 0x7f18e815de70 2024-05-26T15:40:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.276+0000 7f18e7e00640 1 -- 172.21.15.8:0/3341574253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e8159810 con 0x7f18e815de70 2024-05-26T15:40:44.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.278+0000 7f18e7e00640 1 -- 172.21.15.8:0/3341574253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e804e210 con 0x7f18e815de70 2024-05-26T15:40:44.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.279+0000 7f18df400640 1 -- 172.21.15.8:0/3341574253 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18e0039040 con 0x7f18e815de70 2024-05-26T15:40:44.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.279+0000 7f18df400640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f18c806ac00 0x7f18c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.280+0000 7f18df400640 1 -- 172.21.15.8:0/3341574253 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f18e00aa130 con 0x7f18e815de70 2024-05-26T15:40:44.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.280+0000 7f18e6a00640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f18c806ac00 0x7f18c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.281+0000 7f18e6a00640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f18c806ac00 0x7f18c806d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f18d8007bf0 tx=0x7f18d8007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:44.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.284+0000 7f18df400640 1 -- 172.21.15.8:0/3341574253 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f18e0074e90 con 0x7f18e815de70 2024-05-26T15:40:44.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.488+0000 7f18e7e00640 1 -- 172.21.15.8:0/3341574253 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18e80b54e0 con 0x7f18e815de70 2024-05-26T15:40:44.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.489+0000 7f18df400640 1 -- 172.21.15.8:0/3341574253 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18e004c0a0 con 0x7f18e815de70 2024-05-26T15:40:44.488 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:44.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.492+0000 7f18e7e00640 1 -- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f18c806ac00 msgr2=0x7f18c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.492+0000 7f18e7e00640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f18c806ac00 0x7f18c806d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f18d8007bf0 tx=0x7f18d8007240 comp rx=0 tx=0).stop 2024-05-26T15:40:44.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.492+0000 7f18e7e00640 1 -- 172.21.15.8:0/3341574253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e815de70 msgr2=0x7f18e80b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.492+0000 7f18e7e00640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e815de70 0x7f18e80b3790 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f18e00097a0 tx=0x7f18e00046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.492+0000 7f18e7e00640 1 -- 172.21.15.8:0/3341574253 shutdown_connections 2024-05-26T15:40:44.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.493+0000 7f18e7e00640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18e815de70 0x7f18e80b3790 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.493+0000 7f18e7e00640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f18c806ac00 0x7f18c806d0c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.493+0000 7f18e7e00640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18e80cb910 0x7f18e80c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.493+0000 7f18e7e00640 1 --2- 172.21.15.8:0/3341574253 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18e8069e70 0x7f18e8158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.493+0000 7f18e7e00640 1 -- 172.21.15.8:0/3341574253 >> 172.21.15.8:0/3341574253 conn(0x7f18e8098a50 msgr2=0x7f18e806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:44.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.493+0000 7f18e7e00640 1 -- 172.21.15.8:0/3341574253 shutdown_connections 2024-05-26T15:40:44.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.493+0000 7f18e7e00640 1 -- 172.21.15.8:0/3341574253 wait complete. 2024-05-26T15:40:44.511 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:44.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.724+0000 7fc7d3e00640 1 Processor -- start 2024-05-26T15:40:44.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.724+0000 7fc7d3e00640 1 -- start start 2024-05-26T15:40:44.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.725+0000 7fc7d3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7d415e460 0x7fc7d40cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.725+0000 7fc7d3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc7d40cf460 0x7fc7d4098a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.725+0000 7fc7d3e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d40998c0 con 0x7fc7d415e080 2024-05-26T15:40:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.725+0000 7fc7d3e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d4099ba0 con 0x7fc7d40cf460 2024-05-26T15:40:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.725+0000 7fc7d3e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4099e80 con 0x7fc7d415e460 2024-05-26T15:40:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.725+0000 7fc7d2a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc7d415e080 0x7fc7d40c42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41950/0 (socket says 172.21.15.8:41950) 2024-05-26T15:40:44.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.725+0000 7fc7d2a00640 1 -- 172.21.15.8:0/4008129017 learned_addr learned my addr 172.21.15.8:0/4008129017 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937459172 0 0) 0x7fc7d40998c0 con 0x7fc7d415e080 2024-05-26T15:40:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d2000640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7d415e460 0x7fc7d40cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b8003520 con 0x7fc7d415e080 2024-05-26T15:40:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d3400640 1 --2- 172.21.15.8:0/4008129017 >> v2:172.21.15.47:3300/0 conn(0x7fc7d40cf460 0x7fc7d4098a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 392756413 0 0) 0x7fc7b8003520 con 0x7fc7d415e080 2024-05-26T15:40:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7d415e460 msgr2=0x7fc7d40cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7d415e460 0x7fc7d40cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 >> v2:172.21.15.47:3300/0 conn(0x7fc7d40cf460 msgr2=0x7fc7d4098a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 --2- 172.21.15.8:0/4008129017 >> v2:172.21.15.47:3300/0 conn(0x7fc7d40cf460 0x7fc7d4098a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d40cb6e0 con 0x7fc7d415e080 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fc7bc001670 con 0x7fc7d415e080 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 >> v1:172.21.15.8:6789/0 conn(0x7fc7d415e080 legacy=0x7fc7d40c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7b8003970 0x7fc7b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b80047c0 0x7fc7b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7d415e460 0x7fc7b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4099ba0 con 0x7fc7b80047c0 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4099e80 con 0x7fc7b8003970 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.726+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b800ba80 con 0x7fc7d415e460 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.727+0000 7fc7d2000640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b80047c0 0x7fc7b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.727+0000 7fc7d2a00640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7b8003970 0x7fc7b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.727+0000 7fc7d2000640 1 -- 172.21.15.8:0/4008129017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7d415e460 msgr2=0x7fc7b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:44.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.727+0000 7fc7d2000640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7d415e460 0x7fc7b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.727+0000 7fc7d2000640 1 -- 172.21.15.8:0/4008129017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7b8003970 msgr2=0x7fc7b8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:44.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.727+0000 7fc7d2000640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7b8003970 0x7fc7b8003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.727+0000 7fc7d2000640 1 -- 172.21.15.8:0/4008129017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b8003520 con 0x7fc7b80047c0 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.728+0000 7fc7d2000640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b80047c0 0x7fc7b8004c40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009fc0 tx=0x7fc7b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f53a6321c3cf54 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.728+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c40305f0 con 0x7fc7b80047c0 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.728+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c400f040 con 0x7fc7b80047c0 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.728+0000 7fc7d1600640 1 -- 172.21.15.8:0/4008129017 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4030990 con 0x7fc7b80047c0 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.729+0000 7fc7d3e00640 1 -- 172.21.15.8:0/4008129017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b80047c0 msgr2=0x7fc7b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.729+0000 7fc7d3e00640 1 --2- 172.21.15.8:0/4008129017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7b80047c0 0x7fc7b8004c40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009fc0 tx=0x7fc7b80057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.729+0000 7fc7d3400640 1 -- 172.21.15.8:0/4008129017 reap_dead start 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.729+0000 7fc7d3e00640 1 -- 172.21.15.8:0/4008129017 shutdown_connections 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.729+0000 7fc7d3e00640 1 -- 172.21.15.8:0/4008129017 >> 172.21.15.8:0/4008129017 conn(0x7fc7d40b2270 msgr2=0x7fc7d40b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.729+0000 7fc7d3e00640 1 -- 172.21.15.8:0/4008129017 shutdown_connections 2024-05-26T15:40:44.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.729+0000 7fc7d3e00640 1 -- 172.21.15.8:0/4008129017 wait complete. 2024-05-26T15:40:44.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.731+0000 7fc7d3e00640 1 Processor -- start 2024-05-26T15:40:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.731+0000 7fc7d3e00640 1 -- start start 2024-05-26T15:40:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.732+0000 7fc7d3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7b80047c0 0x7fc7d406bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.732+0000 7fc7d3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7d4154df0 0x7fc7d40b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.732+0000 7fc7d3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7d406c120 0x7fc7d40c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.732+0000 7fc7d3e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d406b630 con 0x7fc7d406c120 2024-05-26T15:40:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.732+0000 7fc7d3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d406b020 con 0x7fc7d4154df0 2024-05-26T15:40:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.732+0000 7fc7d3e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d406ca90 con 0x7fc7b80047c0 2024-05-26T15:40:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.732+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7d406c120 0x7fc7d40c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.732+0000 7fc7d3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7d406c120 0x7fc7d40c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50260/0 (socket says 172.21.15.8:50260) 2024-05-26T15:40:44.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.732+0000 7fc7d3400640 1 -- 172.21.15.8:0/2148148428 learned_addr learned my addr 172.21.15.8:0/2148148428 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:44.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7d2000640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7d4154df0 0x7fc7d40b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7d2a00640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7b80047c0 0x7fc7d406bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7d3400640 1 -- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7b80047c0 msgr2=0x7fc7d406bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7d3400640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7b80047c0 0x7fc7d406bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7d3400640 1 -- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7d4154df0 msgr2=0x7fc7d40b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7d3400640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7d4154df0 0x7fc7d40b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7d3400640 1 -- 172.21.15.8:0/2148148428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d406b2c0 con 0x7fc7d406c120 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7d2000640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7d4154df0 0x7fc7d40b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7d3400640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7d406c120 0x7fc7d40c59c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc7d406de90 tx=0x7fc7cc00d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7caa00640 1 -- 172.21.15.8:0/2148148428 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc017070 con 0x7fc7d406c120 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7caa00640 1 -- 172.21.15.8:0/2148148428 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc004020 con 0x7fc7d406c120 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7caa00640 1 -- 172.21.15.8:0/2148148428 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0041f0 con 0x7fc7d406c120 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.733+0000 7fc7d3e00640 1 -- 172.21.15.8:0/2148148428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d40b5af0 con 0x7fc7d406c120 2024-05-26T15:40:44.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.734+0000 7fc7d3e00640 1 -- 172.21.15.8:0/2148148428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d406c5a0 con 0x7fc7d406c120 2024-05-26T15:40:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.735+0000 7fc7d3e00640 1 -- 172.21.15.8:0/2148148428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d40caf00 con 0x7fc7d406c120 2024-05-26T15:40:44.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.736+0000 7fc7caa00640 1 -- 172.21.15.8:0/2148148428 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc7cc004350 con 0x7fc7d406c120 2024-05-26T15:40:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.737+0000 7fc7caa00640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7b006ac00 0x7fc7b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:44.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.737+0000 7fc7caa00640 1 -- 172.21.15.8:0/2148148428 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc7cc0890d0 con 0x7fc7d406c120 2024-05-26T15:40:44.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.738+0000 7fc7d2a00640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7b006ac00 0x7fc7b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:44.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.739+0000 7fc7d2a00640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7b006ac00 0x7fc7b006d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000c00 tx=0x7fc7bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:44.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.741+0000 7fc7caa00640 1 -- 172.21.15.8:0/2148148428 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc7cc053e30 con 0x7fc7d406c120 2024-05-26T15:40:44.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.943+0000 7fc7d3e00640 1 -- 172.21.15.8:0/2148148428 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc7d404e210 con 0x7fc7d406c120 2024-05-26T15:40:44.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.943+0000 7fc7caa00640 1 -- 172.21.15.8:0/2148148428 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc7cc057450 con 0x7fc7d406c120 2024-05-26T15:40:44.942 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:44.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.946+0000 7fc7d3e00640 1 -- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7b006ac00 msgr2=0x7fc7b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.946+0000 7fc7d3e00640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7b006ac00 0x7fc7b006d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc000c00 tx=0x7fc7bc009040 comp rx=0 tx=0).stop 2024-05-26T15:40:44.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.946+0000 7fc7d3e00640 1 -- 172.21.15.8:0/2148148428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7d406c120 msgr2=0x7fc7d40c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:44.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.946+0000 7fc7d3e00640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7d406c120 0x7fc7d40c59c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc7d406de90 tx=0x7fc7cc00d820 comp rx=0 tx=0).stop 2024-05-26T15:40:44.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.947+0000 7fc7d3e00640 1 -- 172.21.15.8:0/2148148428 shutdown_connections 2024-05-26T15:40:44.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.947+0000 7fc7d3e00640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7d406c120 0x7fc7d40c59c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.947+0000 7fc7d3e00640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc7b006ac00 0x7fc7b006d0c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.947+0000 7fc7d3e00640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7d4154df0 0x7fc7d40b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.947+0000 7fc7d3e00640 1 --2- 172.21.15.8:0/2148148428 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc7b80047c0 0x7fc7d406bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:44.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.947+0000 7fc7d3e00640 1 -- 172.21.15.8:0/2148148428 >> 172.21.15.8:0/2148148428 conn(0x7fc7d40b2270 msgr2=0x7fc7d40cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:44.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.947+0000 7fc7d3e00640 1 -- 172.21.15.8:0/2148148428 shutdown_connections 2024-05-26T15:40:44.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:44.947+0000 7fc7d3e00640 1 -- 172.21.15.8:0/2148148428 wait complete. 2024-05-26T15:40:44.964 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-26T15:40:45.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.173+0000 7feadd200640 1 Processor -- start 2024-05-26T15:40:45.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.173+0000 7feadd200640 1 -- start start 2024-05-26T15:40:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.175+0000 7feadd200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fead806dc80 0x7fead81644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.175+0000 7feadd200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead8142960 con 0x7fead80ce100 2024-05-26T15:40:45.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.175+0000 7feadd200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead80cd060 con 0x7fead8142580 2024-05-26T15:40:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.175+0000 7feadd200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead80cd340 con 0x7fead806dc80 2024-05-26T15:40:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.175+0000 7fead6a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fead80ce100 0x7fead806d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41966/0 (socket says 172.21.15.8:41966) 2024-05-26T15:40:45.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.175+0000 7fead6a00640 1 -- 172.21.15.8:0/4096727786 learned_addr learned my addr 172.21.15.8:0/4096727786 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602195967 0 0) 0x7fead8142960 con 0x7fead80ce100 2024-05-26T15:40:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feabc003520 con 0x7fead80ce100 2024-05-26T15:40:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead7e00640 1 --2- 172.21.15.8:0/4096727786 >> v2:172.21.15.47:3300/0 conn(0x7fead806dc80 0x7fead81644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 41254231 0 0) 0x7feabc003520 con 0x7fead80ce100 2024-05-26T15:40:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 >> v2:172.21.15.47:3300/0 conn(0x7fead806dc80 msgr2=0x7fead81644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 --2- 172.21.15.8:0/4096727786 >> v2:172.21.15.47:3300/0 conn(0x7fead806dc80 0x7fead81644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 >> v1:172.21.15.47:6789/0 conn(0x7fead8142580 legacy=0x7fead80cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80cd620 con 0x7fead80ce100 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7feac4001670 con 0x7fead80ce100 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 >> v1:172.21.15.8:6789/0 conn(0x7fead80ce100 legacy=0x7fead806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0039c0 0x7feabc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feabc0047c0 0x7feabc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feabc0051d0 0x7feabc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead80cd340 con 0x7feabc0051d0 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.176+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc00c120 con 0x7feabc0047c0 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.177+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc00c2e0 con 0x7feabc0039c0 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.177+0000 7fead7e00640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feabc0051d0 0x7feabc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.177+0000 7fead6a00640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feabc0047c0 0x7feabc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.177+0000 7fead7400640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0039c0 0x7feabc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.177+0000 7fead7e00640 1 -- 172.21.15.8:0/4096727786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0039c0 msgr2=0x7feabc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:45.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.177+0000 7fead7e00640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0039c0 0x7feabc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.177+0000 7fead7e00640 1 -- 172.21.15.8:0/4096727786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feabc0047c0 msgr2=0x7feabc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:45.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.177+0000 7fead7e00640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feabc0047c0 0x7feabc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.177+0000 7fead7e00640 1 -- 172.21.15.8:0/4096727786 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc003520 con 0x7feabc0051d0 2024-05-26T15:40:45.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.177+0000 7fead7400640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0039c0 0x7feabc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:45.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.178+0000 7fead7e00640 1 -- 172.21.15.8:0/4096727786 reap_dead start 2024-05-26T15:40:45.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.178+0000 7fead7e00640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feabc0051d0 0x7feabc00b980 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fead8070240 tx=0x7feabc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4e783ba2378d1c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:45.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.178+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0003b90 con 0x7feabc0051d0 2024-05-26T15:40:45.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.179+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0003cf0 con 0x7feabc0051d0 2024-05-26T15:40:45.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.179+0000 7fead6000640 1 -- 172.21.15.8:0/4096727786 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0004260 con 0x7feabc0051d0 2024-05-26T15:40:45.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.179+0000 7feadd200640 1 -- 172.21.15.8:0/4096727786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feabc0051d0 msgr2=0x7feabc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.179+0000 7feadd200640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feabc0051d0 0x7feabc00b980 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fead8070240 tx=0x7feabc0057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.179+0000 7feadd200640 1 -- 172.21.15.8:0/4096727786 shutdown_connections 2024-05-26T15:40:45.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.179+0000 7feadd200640 1 --2- 172.21.15.8:0/4096727786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feabc0051d0 0x7feabc00b980 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.179+0000 7feadd200640 1 -- 172.21.15.8:0/4096727786 >> 172.21.15.8:0/4096727786 conn(0x7fead80662e0 msgr2=0x7fead8069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:45.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.179+0000 7feadd200640 1 -- 172.21.15.8:0/4096727786 shutdown_connections 2024-05-26T15:40:45.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.180+0000 7feadd200640 1 -- 172.21.15.8:0/4096727786 wait complete. 2024-05-26T15:40:45.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.181+0000 7feadd200640 1 Processor -- start 2024-05-26T15:40:45.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.182+0000 7feadd200640 1 -- start start 2024-05-26T15:40:45.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.182+0000 7feadd200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0051d0 0x7fead80c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7feadd200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead8148e90 0x7fead80cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7feadd200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead8149310 0x7fead80cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7feadd200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead80cbdb0 con 0x7fead8148e90 2024-05-26T15:40:45.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7feadd200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead815ae80 con 0x7fead8149310 2024-05-26T15:40:45.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7feadd200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead815b160 con 0x7feabc0051d0 2024-05-26T15:40:45.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead8148e90 0x7fead80cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead8148e90 0x7fead80cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50276/0 (socket says 172.21.15.8:50276) 2024-05-26T15:40:45.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead6a00640 1 -- 172.21.15.8:0/1816391989 learned_addr learned my addr 172.21.15.8:0/1816391989 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:45.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead7e00640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead8149310 0x7fead80cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead7400640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0051d0 0x7fead80c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead6a00640 1 -- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0051d0 msgr2=0x7fead80c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead6a00640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0051d0 0x7fead80c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead6a00640 1 -- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead8149310 msgr2=0x7fead80cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead6a00640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead8149310 0x7fead80cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead6a00640 1 -- 172.21.15.8:0/1816391989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead815b440 con 0x7fead8148e90 2024-05-26T15:40:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.183+0000 7fead7400640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0051d0 0x7fead80c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.184+0000 7fead6a00640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead8148e90 0x7fead80cb1f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feac400e730 tx=0x7feac400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.184+0000 7feacf400640 1 -- 172.21.15.8:0/1816391989 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac400c6c0 con 0x7fead8148e90 2024-05-26T15:40:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.184+0000 7feacf400640 1 -- 172.21.15.8:0/1816391989 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac400c840 con 0x7fead8148e90 2024-05-26T15:40:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.184+0000 7feacf400640 1 -- 172.21.15.8:0/1816391989 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac400cbf0 con 0x7fead8148e90 2024-05-26T15:40:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.184+0000 7feadd200640 1 -- 172.21.15.8:0/1816391989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead815b720 con 0x7fead8148e90 2024-05-26T15:40:45.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.184+0000 7feadd200640 1 -- 172.21.15.8:0/1816391989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead80c8d10 con 0x7fead8148e90 2024-05-26T15:40:45.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.185+0000 7feadd200640 1 -- 172.21.15.8:0/1816391989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead815b910 con 0x7fead8148e90 2024-05-26T15:40:45.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.186+0000 7feacf400640 1 -- 172.21.15.8:0/1816391989 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feac400cd50 con 0x7fead8148e90 2024-05-26T15:40:45.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.187+0000 7feacf400640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feab806ac00 0x7feab806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.187+0000 7feacf400640 1 -- 172.21.15.8:0/1816391989 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7feac4089640 con 0x7fead8148e90 2024-05-26T15:40:45.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.188+0000 7fead7400640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feab806ac00 0x7feab806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.189+0000 7fead7400640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feab806ac00 0x7feab806d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fead815d230 tx=0x7feac8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:45.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.192+0000 7feacf400640 1 -- 172.21.15.8:0/1816391989 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7feac40543a0 con 0x7fead8148e90 2024-05-26T15:40:45.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.395+0000 7feadd200640 1 -- 172.21.15.8:0/1816391989 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fead804e280 con 0x7fead8148e90 2024-05-26T15:40:45.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.395+0000 7feacf400640 1 -- 172.21.15.8:0/1816391989 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7feac40579c0 con 0x7fead8148e90 2024-05-26T15:40:45.394 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2024-05-26T15:40:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 -- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feab806ac00 msgr2=0x7feab806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feab806ac00 0x7feab806d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fead815d230 tx=0x7feac8009040 comp rx=0 tx=0).stop 2024-05-26T15:40:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 -- 172.21.15.8:0/1816391989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead8148e90 msgr2=0x7fead80cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead8148e90 0x7fead80cb1f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feac400e730 tx=0x7feac400ebf0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 -- 172.21.15.8:0/1816391989 shutdown_connections 2024-05-26T15:40:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feab806ac00 0x7feab806d0c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead8149310 0x7fead80cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fead8148e90 0x7fead80cb1f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 --2- 172.21.15.8:0/1816391989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feabc0051d0 0x7fead80c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 -- 172.21.15.8:0/1816391989 >> 172.21.15.8:0/1816391989 conn(0x7fead80662e0 msgr2=0x7fead813e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 -- 172.21.15.8:0/1816391989 shutdown_connections 2024-05-26T15:40:45.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.398+0000 7feadd200640 1 -- 172.21.15.8:0/1816391989 wait complete. 2024-05-26T15:40:45.414 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-26T15:40:45.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:45.414 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-26T15:40:45.509 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:40:45.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:45.509 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-26T15:40:45.563 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:40:45.564 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:45.625 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:40:45.625 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:45.683 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:40:45.683 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:45.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:45.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.952+0000 7f4087200640 1 Processor -- start 2024-05-26T15:40:45.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.952+0000 7f4087200640 1 -- start start 2024-05-26T15:40:45.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.953+0000 7f4087200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4080154f50 0x7f40800b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.953+0000 7f4087200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408015b640 con 0x7f408015ae70 2024-05-26T15:40:45.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.953+0000 7f4087200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408015b920 con 0x7f40800c36c0 2024-05-26T15:40:45.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.953+0000 7f4087200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408015bee0 con 0x7f4080154f50 2024-05-26T15:40:45.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.954+0000 7f4085400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f408015ae70 0x7f408015eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41968/0 (socket says 172.21.15.8:41968) 2024-05-26T15:40:45.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.954+0000 7f4085400640 1 -- 172.21.15.8:0/1188929859 learned_addr learned my addr 172.21.15.8:0/1188929859 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:45.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.954+0000 7f4085e00640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4080154f50 0x7f40800b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.954+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932440080 0 0) 0x7f408015b640 con 0x7f408015ae70 2024-05-26T15:40:45.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.954+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4068003520 con 0x7f408015ae70 2024-05-26T15:40:45.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.954+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1939123566 0 0) 0x7f4068003520 con 0x7f408015ae70 2024-05-26T15:40:45.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.954+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4080154f50 msgr2=0x7f40800b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:45.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.954+0000 7f4084a00640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4080154f50 0x7f40800b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.954+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 >> v1:172.21.15.47:6789/0 conn(0x7f40800c36c0 legacy=0x7f40800cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.954 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.954+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408015bc00 con 0x7f408015ae70 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f4070001670 con 0x7f408015ae70 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 >> v1:172.21.15.8:6789/0 conn(0x7f408015ae70 legacy=0x7f408015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4084a00640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40680039a0 0x7f4068003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4084a00640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680047c0 0x7f4068004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4084a00640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4080154f50 0x7f4068005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408015bee0 con 0x7f40680047c0 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406800bb10 con 0x7f40680039a0 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406800bcd0 con 0x7f4080154f50 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4085400640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680047c0 0x7f4068004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4085e00640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40680039a0 0x7f4068003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4085400640 1 -- 172.21.15.8:0/1188929859 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4080154f50 msgr2=0x7f4068005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4085400640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4080154f50 0x7f4068005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4085400640 1 -- 172.21.15.8:0/1188929859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40680039a0 msgr2=0x7f4068003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:45.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.955+0000 7f4085400640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40680039a0 0x7f4068003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.956+0000 7f4085400640 1 -- 172.21.15.8:0/1188929859 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068003520 con 0x7f40680047c0 2024-05-26T15:40:45.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.957+0000 7f4085400640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680047c0 0x7f4068004c40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f407000c0e0 tx=0x7f40680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d84f736332dd1f server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:45.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.957+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070005ad0 con 0x7f40680047c0 2024-05-26T15:40:45.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.957+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407002d070 con 0x7f40680047c0 2024-05-26T15:40:45.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.957+0000 7f4084a00640 1 -- 172.21.15.8:0/1188929859 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070007070 con 0x7f40680047c0 2024-05-26T15:40:45.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.957+0000 7f4087200640 1 -- 172.21.15.8:0/1188929859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680047c0 msgr2=0x7f4068004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.957+0000 7f4087200640 1 --2- 172.21.15.8:0/1188929859 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f40680047c0 0x7f4068004c40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f407000c0e0 tx=0x7f40680057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.957+0000 7f4086800640 1 -- 172.21.15.8:0/1188929859 reap_dead start 2024-05-26T15:40:45.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.957+0000 7f4087200640 1 -- 172.21.15.8:0/1188929859 shutdown_connections 2024-05-26T15:40:45.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.957+0000 7f4087200640 1 -- 172.21.15.8:0/1188929859 >> 172.21.15.8:0/1188929859 conn(0x7f4080070480 msgr2=0x7f4080070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:45.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.957+0000 7f4087200640 1 -- 172.21.15.8:0/1188929859 shutdown_connections 2024-05-26T15:40:45.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.958+0000 7f4087200640 1 -- 172.21.15.8:0/1188929859 wait complete. 2024-05-26T15:40:45.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.959+0000 7f4087200640 1 Processor -- start 2024-05-26T15:40:45.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.959+0000 7f4087200640 1 -- start start 2024-05-26T15:40:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.960+0000 7f4087200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f40680047c0 0x7f408013fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.960+0000 7f4087200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f408014eb20 0x7f408014c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.960+0000 7f4087200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f408014ef80 0x7f408014c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.960+0000 7f4087200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4080152850 con 0x7f408014ef80 2024-05-26T15:40:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.960+0000 7f4087200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40801517b0 con 0x7f408014eb20 2024-05-26T15:40:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.960+0000 7f4087200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4080151a90 con 0x7f40680047c0 2024-05-26T15:40:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4086800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f408014ef80 0x7f408014c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4086800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f408014ef80 0x7f408014c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50288/0 (socket says 172.21.15.8:50288) 2024-05-26T15:40:45.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4086800640 1 -- 172.21.15.8:0/4005769722 learned_addr learned my addr 172.21.15.8:0/4005769722 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:45.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4085400640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f408014eb20 0x7f408014c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4085e00640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f40680047c0 0x7f408013fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4086800640 1 -- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f40680047c0 msgr2=0x7f408013fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4086800640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f40680047c0 0x7f408013fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4086800640 1 -- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f408014eb20 msgr2=0x7f408014c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4086800640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f408014eb20 0x7f408014c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4086800640 1 -- 172.21.15.8:0/4005769722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4080151d70 con 0x7f408014ef80 2024-05-26T15:40:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.961+0000 7f4085400640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f408014eb20 0x7f408014c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.962+0000 7f4086800640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f408014ef80 0x7f408014c620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4080067880 tx=0x7f407c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:45.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.962+0000 7f407a000640 1 -- 172.21.15.8:0/4005769722 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c005d40 con 0x7f408014ef80 2024-05-26T15:40:45.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.962+0000 7f407a000640 1 -- 172.21.15.8:0/4005769722 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c00ced0 con 0x7f408014ef80 2024-05-26T15:40:45.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.962+0000 7f407a000640 1 -- 172.21.15.8:0/4005769722 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c00a850 con 0x7f408014ef80 2024-05-26T15:40:45.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.962+0000 7f4087200640 1 -- 172.21.15.8:0/4005769722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4080152050 con 0x7f408014ef80 2024-05-26T15:40:45.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.962+0000 7f4087200640 1 -- 172.21.15.8:0/4005769722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408014b740 con 0x7f408014ef80 2024-05-26T15:40:45.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.963+0000 7f4087200640 1 -- 172.21.15.8:0/4005769722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4080152570 con 0x7f408014ef80 2024-05-26T15:40:45.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.964+0000 7f407a000640 1 -- 172.21.15.8:0/4005769722 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f407c00a9b0 con 0x7f408014ef80 2024-05-26T15:40:45.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.965+0000 7f407a000640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f406406ac00 0x7f406406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:45.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.965+0000 7f407a000640 1 -- 172.21.15.8:0/4005769722 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f407c0889c0 con 0x7f408014ef80 2024-05-26T15:40:45.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.966+0000 7f4085e00640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f406406ac00 0x7f406406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:45.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.967+0000 7f4085e00640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f406406ac00 0x7f406406d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4074006fd0 tx=0x7f4074008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:45.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:45.970+0000 7f407a000640 1 -- 172.21.15.8:0/4005769722 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4080152570 con 0x7f408014ef80 2024-05-26T15:40:46.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.167+0000 7f4087200640 1 -- 172.21.15.8:0/4005769722 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4080152570 con 0x7f408014ef80 2024-05-26T15:40:46.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.170+0000 7f407a000640 1 -- 172.21.15.8:0/4005769722 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7f4080152570 con 0x7f408014ef80 2024-05-26T15:40:46.168 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:46.169 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.172+0000 7f4087200640 1 -- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f406406ac00 msgr2=0x7f406406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.172+0000 7f4087200640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f406406ac00 0x7f406406d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4074006fd0 tx=0x7f4074008040 comp rx=0 tx=0).stop 2024-05-26T15:40:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.172+0000 7f4087200640 1 -- 172.21.15.8:0/4005769722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f408014ef80 msgr2=0x7f408014c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.172+0000 7f4087200640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f408014ef80 0x7f408014c620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4080067880 tx=0x7f407c00cb90 comp rx=0 tx=0).stop 2024-05-26T15:40:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.172+0000 7f4087200640 1 -- 172.21.15.8:0/4005769722 shutdown_connections 2024-05-26T15:40:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.172+0000 7f4087200640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f408014ef80 0x7f408014c620 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.172+0000 7f4087200640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f406406ac00 0x7f406406d0c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.172+0000 7f4087200640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f408014eb20 0x7f408014c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.172+0000 7f4087200640 1 --2- 172.21.15.8:0/4005769722 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f40680047c0 0x7f408013fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.172+0000 7f4087200640 1 -- 172.21.15.8:0/4005769722 >> 172.21.15.8:0/4005769722 conn(0x7f4080070480 msgr2=0x7f40800cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:46.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.173+0000 7f4087200640 1 -- 172.21.15.8:0/4005769722 shutdown_connections 2024-05-26T15:40:46.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.173+0000 7f4087200640 1 -- 172.21.15.8:0/4005769722 wait complete. 2024-05-26T15:40:46.190 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:46.191 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:46.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.408+0000 7f18bb000640 1 Processor -- start 2024-05-26T15:40:46.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.408+0000 7f18bb000640 1 -- start start 2024-05-26T15:40:46.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.410+0000 7f18bb000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40b0170 0x7f18b40ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.410+0000 7f18bb000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b40c3130 con 0x7f18b415cf70 2024-05-26T15:40:46.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.410+0000 7f18bb000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b40b08e0 con 0x7f18b40d01b0 2024-05-26T15:40:46.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.410+0000 7f18bb000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40af780 con 0x7f18b40b0170 2024-05-26T15:40:46.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.410+0000 7f18b9c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f18b415cf70 0x7f18b40ac390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41982/0 (socket says 172.21.15.8:41982) 2024-05-26T15:40:46.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.410+0000 7f18b9c00640 1 -- 172.21.15.8:0/2487813583 learned_addr learned my addr 172.21.15.8:0/2487813583 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18ba600640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40b0170 0x7f18b40ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369816707 0 0) 0x7f18b40c3130 con 0x7f18b415cf70 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f189c003520 con 0x7f18b415cf70 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772747525 0 0) 0x7f189c003520 con 0x7f18b415cf70 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40b0170 msgr2=0x7f18b40ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40b0170 0x7f18b40ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 >> v1:172.21.15.47:6789/0 conn(0x7f18b40d01b0 legacy=0x7f18b40acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b40afa60 con 0x7f18b415cf70 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f18a8001670 con 0x7f18b415cf70 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 >> v1:172.21.15.8:6789/0 conn(0x7f18b415cf70 legacy=0x7f18b40ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40b0170 0x7f189c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f189c003f70 0x7f189c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f189c004d00 0x7f189c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40af780 con 0x7f189c004d00 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c00bb70 con 0x7f189c003f70 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.411+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189c00df40 con 0x7f18b40b0170 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.412+0000 7f18ba600640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f189c004d00 0x7f189c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.412+0000 7f18b9200640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f189c003f70 0x7f189c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.412+0000 7f18ba600640 1 -- 172.21.15.8:0/2487813583 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40b0170 msgr2=0x7f189c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.412+0000 7f18ba600640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40b0170 0x7f189c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.412+0000 7f18ba600640 1 -- 172.21.15.8:0/2487813583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f189c003f70 msgr2=0x7f189c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.412+0000 7f18ba600640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f189c003f70 0x7f189c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.412+0000 7f18ba600640 1 -- 172.21.15.8:0/2487813583 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c003520 con 0x7f189c004d00 2024-05-26T15:40:46.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.413+0000 7f18ba600640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f189c004d00 0x7f189c005180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009fc0 tx=0x7f189c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bedef0094155a10 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:46.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.413+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac031670 con 0x7f189c004d00 2024-05-26T15:40:46.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.413+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac00f040 con 0x7f189c004d00 2024-05-26T15:40:46.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.413+0000 7f18b3e00640 1 -- 172.21.15.8:0/2487813583 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac031a10 con 0x7f189c004d00 2024-05-26T15:40:46.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.414+0000 7f18bb000640 1 -- 172.21.15.8:0/2487813583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f189c004d00 msgr2=0x7f189c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.414+0000 7f18bb000640 1 --2- 172.21.15.8:0/2487813583 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f189c004d00 0x7f189c005180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009fc0 tx=0x7f189c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.414+0000 7f18ba600640 1 -- 172.21.15.8:0/2487813583 reap_dead start 2024-05-26T15:40:46.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.414+0000 7f18bb000640 1 -- 172.21.15.8:0/2487813583 shutdown_connections 2024-05-26T15:40:46.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.414+0000 7f18bb000640 1 -- 172.21.15.8:0/2487813583 >> 172.21.15.8:0/2487813583 conn(0x7f18b4098a50 msgr2=0x7f18b40cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:46.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.414+0000 7f18bb000640 1 -- 172.21.15.8:0/2487813583 shutdown_connections 2024-05-26T15:40:46.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.414+0000 7f18bb000640 1 -- 172.21.15.8:0/2487813583 wait complete. 2024-05-26T15:40:46.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.416+0000 7f18bb000640 1 Processor -- start 2024-05-26T15:40:46.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.416+0000 7f18bb000640 1 -- start start 2024-05-26T15:40:46.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.417+0000 7f18bb000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f189c004d00 0x7f18b40cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.417+0000 7f18bb000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18b40c8920 0x7f18b40c3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.417+0000 7f18bb000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40c8d80 0x7f18b40c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.417+0000 7f18bb000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40c5650 con 0x7f18b40c8920 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.417+0000 7f18bb000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40c73f0 con 0x7f189c004d00 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.417+0000 7f18bb000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40c76d0 con 0x7f18b40c8d80 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.417+0000 7f18b9200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18b40c8920 0x7f18b40c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.418+0000 7f18b9200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18b40c8920 0x7f18b40c3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50316/0 (socket says 172.21.15.8:50316) 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.418+0000 7f18b9200640 1 -- 172.21.15.8:0/3505201189 learned_addr learned my addr 172.21.15.8:0/3505201189 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.418+0000 7f18b9200640 1 -- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40c8d80 msgr2=0x7f18b40c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.418+0000 7f18b9200640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40c8d80 0x7f18b40c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.418+0000 7f18b9200640 1 -- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f189c004d00 msgr2=0x7f18b40cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.418+0000 7f18b9200640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f189c004d00 0x7f18b40cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.418+0000 7f18b9200640 1 -- 172.21.15.8:0/3505201189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b40c79b0 con 0x7f18b40c8920 2024-05-26T15:40:46.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.418+0000 7f18b9200640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18b40c8920 0x7f18b40c3110 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f18a0001eb0 tx=0x7f18a000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:46.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.419+0000 7f18b1600640 1 -- 172.21.15.8:0/3505201189 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0005480 con 0x7f18b40c8920 2024-05-26T15:40:46.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.419+0000 7f18b1600640 1 -- 172.21.15.8:0/3505201189 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a0003610 con 0x7f18b40c8920 2024-05-26T15:40:46.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.419+0000 7f18bb000640 1 -- 172.21.15.8:0/3505201189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b40c7c90 con 0x7f18b40c8920 2024-05-26T15:40:46.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.419+0000 7f18b1600640 1 -- 172.21.15.8:0/3505201189 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0003980 con 0x7f18b40c8920 2024-05-26T15:40:46.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.419+0000 7f18bb000640 1 -- 172.21.15.8:0/3505201189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b40c70c0 con 0x7f18b40c8920 2024-05-26T15:40:46.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.420+0000 7f18bb000640 1 -- 172.21.15.8:0/3505201189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b40caa00 con 0x7f18b40c8920 2024-05-26T15:40:46.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.421+0000 7f18b1600640 1 -- 172.21.15.8:0/3505201189 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18a0003ae0 con 0x7f18b40c8920 2024-05-26T15:40:46.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.422+0000 7f18b1600640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f189406ac00 0x7f189406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.422+0000 7f18b1600640 1 -- 172.21.15.8:0/3505201189 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f18a00896d0 con 0x7f18b40c8920 2024-05-26T15:40:46.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.423+0000 7f18b9c00640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f189406ac00 0x7f189406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:46.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.424+0000 7f18b9c00640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f189406ac00 0x7f189406d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f18a8001eb0 tx=0x7f18a80015d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:46.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.426+0000 7f18b1600640 1 -- 172.21.15.8:0/3505201189 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f18a00543a0 con 0x7f18b40c8920 2024-05-26T15:40:46.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.624+0000 7f18bb000640 1 -- 172.21.15.8:0/3505201189 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18b4066a90 con 0x7f18b40c8920 2024-05-26T15:40:46.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.625+0000 7f18b1600640 1 -- 172.21.15.8:0/3505201189 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18a00579c0 con 0x7f18b40c8920 2024-05-26T15:40:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.627+0000 7f18bb000640 1 -- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f189406ac00 msgr2=0x7f189406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.627+0000 7f18bb000640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f189406ac00 0x7f189406d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f18a8001eb0 tx=0x7f18a80015d0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.627+0000 7f18bb000640 1 -- 172.21.15.8:0/3505201189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18b40c8920 msgr2=0x7f18b40c3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.627+0000 7f18bb000640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18b40c8920 0x7f18b40c3110 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f18a0001eb0 tx=0x7f18a000d9d0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.627+0000 7f18bb000640 1 -- 172.21.15.8:0/3505201189 shutdown_connections 2024-05-26T15:40:46.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.627+0000 7f18bb000640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18b40c8d80 0x7f18b40c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.627+0000 7f18bb000640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18b40c8920 0x7f18b40c3110 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.627+0000 7f18bb000640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f189406ac00 0x7f189406d0c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.627+0000 7f18bb000640 1 --2- 172.21.15.8:0/3505201189 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f189c004d00 0x7f18b40cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.627+0000 7f18bb000640 1 -- 172.21.15.8:0/3505201189 >> 172.21.15.8:0/3505201189 conn(0x7f18b4098a50 msgr2=0x7f18b41e7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.628+0000 7f18bb000640 1 -- 172.21.15.8:0/3505201189 shutdown_connections 2024-05-26T15:40:46.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.628+0000 7f18bb000640 1 -- 172.21.15.8:0/3505201189 wait complete. 2024-05-26T15:40:46.646 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:46.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.852+0000 7faa75800640 1 Processor -- start 2024-05-26T15:40:46.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.853+0000 7faa75800640 1 -- start start 2024-05-26T15:40:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.855+0000 7faa75800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faa700d0020 0x7faa700d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.855+0000 7faa75800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa700d20d0 con 0x7faa700b82c0 2024-05-26T15:40:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.856+0000 7faa75800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa700d14c0 con 0x7faa7015ca00 2024-05-26T15:40:46.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.856+0000 7faa75800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa700d06b0 con 0x7faa700d0020 2024-05-26T15:40:46.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.856+0000 7faa6f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faa700d0020 0x7faa700d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:46.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.856+0000 7faa6f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faa700d0020 0x7faa700d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50324/0 (socket says 172.21.15.8:50324) 2024-05-26T15:40:46.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.856+0000 7faa74e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7faa700b82c0 0x7faa700b5ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41994/0 (socket says 172.21.15.8:41994) 2024-05-26T15:40:46.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.856+0000 7faa6f400640 1 -- 172.21.15.8:0/455715745 learned_addr learned my addr 172.21.15.8:0/455715745 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:46.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.856+0000 7faa6f400640 1 -- 172.21.15.8:0/455715745 >> v1:172.21.15.47:6789/0 conn(0x7faa7015ca00 legacy=0x7faa700cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.857+0000 7faa6f400640 1 -- 172.21.15.8:0/455715745 >> v1:172.21.15.8:6789/0 conn(0x7faa700b82c0 legacy=0x7faa700b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.857+0000 7faa6f400640 1 -- 172.21.15.8:0/455715745 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa700d17a0 con 0x7faa700d0020 2024-05-26T15:40:46.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.858+0000 7faa6f400640 1 --2- 172.21.15.8:0/455715745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa700d0020 0x7faa700d0d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faa58009870 tx=0x7faa5802a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bd162694fed613 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:46.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.858+0000 7faa6ea00640 1 -- 172.21.15.8:0/455715745 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58032640 con 0x7faa700d0020 2024-05-26T15:40:46.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.858+0000 7faa6ea00640 1 -- 172.21.15.8:0/455715745 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580327a0 con 0x7faa700d0020 2024-05-26T15:40:46.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.858+0000 7faa6ea00640 1 -- 172.21.15.8:0/455715745 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58032b30 con 0x7faa700d0020 2024-05-26T15:40:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.859+0000 7faa75800640 1 -- 172.21.15.8:0/455715745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa700d0020 msgr2=0x7faa700d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.859+0000 7faa75800640 1 --2- 172.21.15.8:0/455715745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa700d0020 0x7faa700d0d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faa58009870 tx=0x7faa5802a2f0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.859+0000 7faa75800640 1 -- 172.21.15.8:0/455715745 shutdown_connections 2024-05-26T15:40:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.859+0000 7faa75800640 1 --2- 172.21.15.8:0/455715745 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa700d0020 0x7faa700d0d70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.859+0000 7faa75800640 1 -- 172.21.15.8:0/455715745 >> 172.21.15.8:0/455715745 conn(0x7faa7006b640 msgr2=0x7faa7006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.859+0000 7faa75800640 1 -- 172.21.15.8:0/455715745 shutdown_connections 2024-05-26T15:40:46.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.859+0000 7faa75800640 1 -- 172.21.15.8:0/455715745 wait complete. 2024-05-26T15:40:46.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.861+0000 7faa75800640 1 Processor -- start 2024-05-26T15:40:46.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.861+0000 7faa75800640 1 -- start start 2024-05-26T15:40:46.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.862+0000 7faa75800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faa700b82c0 0x7faa700cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.862+0000 7faa75800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa700d0020 0x7faa701f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.862+0000 7faa75800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7015ca00 0x7faa701f2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.862+0000 7faa75800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa701f2e50 con 0x7faa7015ca00 2024-05-26T15:40:46.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.862+0000 7faa75800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7015ef60 con 0x7faa700d0020 2024-05-26T15:40:46.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.862+0000 7faa75800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7015e350 con 0x7faa700b82c0 2024-05-26T15:40:46.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.862+0000 7faa74e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7015ca00 0x7faa701f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:46.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.862+0000 7faa74e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7015ca00 0x7faa701f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50340/0 (socket says 172.21.15.8:50340) 2024-05-26T15:40:46.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.862+0000 7faa74e00640 1 -- 172.21.15.8:0/1614048908 learned_addr learned my addr 172.21.15.8:0/1614048908 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.863+0000 7faa6fe00640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faa700b82c0 0x7faa700cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.863+0000 7faa6f400640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa700d0020 0x7faa701f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.863+0000 7faa74e00640 1 -- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faa700b82c0 msgr2=0x7faa700cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.863+0000 7faa74e00640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faa700b82c0 0x7faa700cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.863+0000 7faa74e00640 1 -- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa700d0020 msgr2=0x7faa701f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.863+0000 7faa74e00640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa700d0020 0x7faa701f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.863+0000 7faa74e00640 1 -- 172.21.15.8:0/1614048908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa580094d0 con 0x7faa7015ca00 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.863+0000 7faa6f400640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa700d0020 0x7faa701f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.863+0000 7faa74e00640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7015ca00 0x7faa701f2910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c780 tx=0x7faa6800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.864+0000 7faa67e00640 1 -- 172.21.15.8:0/1614048908 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800ce90 con 0x7faa7015ca00 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.864+0000 7faa67e00640 1 -- 172.21.15.8:0/1614048908 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6800a640 con 0x7faa7015ca00 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.864+0000 7faa67e00640 1 -- 172.21.15.8:0/1614048908 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800a9b0 con 0x7faa7015ca00 2024-05-26T15:40:46.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.864+0000 7faa75800640 1 -- 172.21.15.8:0/1614048908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7015e630 con 0x7faa7015ca00 2024-05-26T15:40:46.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.864+0000 7faa75800640 1 -- 172.21.15.8:0/1614048908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7015ebf0 con 0x7faa7015ca00 2024-05-26T15:40:46.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.865+0000 7faa75800640 1 -- 172.21.15.8:0/1614048908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7004e210 con 0x7faa7015ca00 2024-05-26T15:40:46.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.867+0000 7faa67e00640 1 -- 172.21.15.8:0/1614048908 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faa6800ab10 con 0x7faa7015ca00 2024-05-26T15:40:46.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.868+0000 7faa67e00640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faa4c06ac00 0x7faa4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:46.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.868+0000 7faa67e00640 1 -- 172.21.15.8:0/1614048908 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7faa68088e70 con 0x7faa7015ca00 2024-05-26T15:40:46.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.869+0000 7faa6fe00640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faa4c06ac00 0x7faa4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:46.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.870+0000 7faa6fe00640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faa4c06ac00 0x7faa4c06d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faa700c9d20 tx=0x7faa60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:46.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:46.873+0000 7faa67e00640 1 -- 172.21.15.8:0/1614048908 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faa68053d10 con 0x7faa7015ca00 2024-05-26T15:40:47.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.073+0000 7faa75800640 1 -- 172.21.15.8:0/1614048908 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa700cebb0 con 0x7faa7015ca00 2024-05-26T15:40:47.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.074+0000 7faa67e00640 1 -- 172.21.15.8:0/1614048908 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa680170a0 con 0x7faa7015ca00 2024-05-26T15:40:47.072 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 -- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faa4c06ac00 msgr2=0x7faa4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faa4c06ac00 0x7faa4c06d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faa700c9d20 tx=0x7faa60009040 comp rx=0 tx=0).stop 2024-05-26T15:40:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 -- 172.21.15.8:0/1614048908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7015ca00 msgr2=0x7faa701f2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7015ca00 0x7faa701f2910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c780 tx=0x7faa6800cc40 comp rx=0 tx=0).stop 2024-05-26T15:40:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 -- 172.21.15.8:0/1614048908 shutdown_connections 2024-05-26T15:40:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faa7015ca00 0x7faa701f2910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faa4c06ac00 0x7faa4c06d0c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa700d0020 0x7faa701f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 --2- 172.21.15.8:0/1614048908 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faa700b82c0 0x7faa700cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 -- 172.21.15.8:0/1614048908 >> 172.21.15.8:0/1614048908 conn(0x7faa7006b640 msgr2=0x7faa7015b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.077+0000 7faa75800640 1 -- 172.21.15.8:0/1614048908 shutdown_connections 2024-05-26T15:40:47.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.078+0000 7faa75800640 1 -- 172.21.15.8:0/1614048908 wait complete. 2024-05-26T15:40:47.096 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.305+0000 7f8d6f200640 1 Processor -- start 2024-05-26T15:40:47.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.306+0000 7f8d6f200640 1 -- start start 2024-05-26T15:40:47.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.307+0000 7f8d6f200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d7013d860 0x7f8d700ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.307+0000 7f8d6f200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8d700cd070 0x7f8d700703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.307+0000 7f8d6f200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7015f140 con 0x7f8d7006c3d0 2024-05-26T15:40:47.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.307+0000 7f8d6f200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7015e550 con 0x7f8d700cd070 2024-05-26T15:40:47.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.307+0000 7f8d6f200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7015e810 con 0x7f8d7013d860 2024-05-26T15:40:47.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.307+0000 7f8d6d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8d700cd070 0x7f8d700703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.308+0000 7f8d6d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8d700cd070 0x7f8d700703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50344/0 (socket says 172.21.15.8:50344) 2024-05-26T15:40:47.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.308+0000 7f8d6d400640 1 -- 172.21.15.8:0/2934246645 learned_addr learned my addr 172.21.15.8:0/2934246645 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:47.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.308+0000 7f8d6de00640 1 --2- 172.21.15.8:0/2934246645 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d7013d860 0x7f8d700ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.308+0000 7f8d6d400640 1 -- 172.21.15.8:0/2934246645 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d7013d860 msgr2=0x7f8d700ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:47.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.308+0000 7f8d6d400640 1 --2- 172.21.15.8:0/2934246645 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d7013d860 0x7f8d700ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.308+0000 7f8d6d400640 1 -- 172.21.15.8:0/2934246645 >> v1:172.21.15.47:6789/0 conn(0x7f8d7006c3d0 legacy=0x7f8d7006d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:47.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.308+0000 7f8d6d400640 1 -- 172.21.15.8:0/2934246645 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7015eaf0 con 0x7f8d700cd070 2024-05-26T15:40:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.310+0000 7f8d6d400640 1 --2- 172.21.15.8:0/2934246645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d700cd070 0x7f8d700703b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009870 tx=0x7f8d5802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5609f7b2f8a39198 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.310+0000 7f8d6ca00640 1 -- 172.21.15.8:0/2934246645 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5802ae90 con 0x7f8d700cd070 2024-05-26T15:40:47.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.310+0000 7f8d6ca00640 1 -- 172.21.15.8:0/2934246645 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58032440 con 0x7f8d700cd070 2024-05-26T15:40:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.310+0000 7f8d6ca00640 1 -- 172.21.15.8:0/2934246645 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d580327d0 con 0x7f8d700cd070 2024-05-26T15:40:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.311+0000 7f8d6f200640 1 -- 172.21.15.8:0/2934246645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d700cd070 msgr2=0x7f8d700703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.311+0000 7f8d6f200640 1 --2- 172.21.15.8:0/2934246645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d700cd070 0x7f8d700703b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009870 tx=0x7f8d5802a180 comp rx=0 tx=0).stop 2024-05-26T15:40:47.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.311+0000 7f8d6f200640 1 -- 172.21.15.8:0/2934246645 shutdown_connections 2024-05-26T15:40:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.311+0000 7f8d6f200640 1 --2- 172.21.15.8:0/2934246645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d700cd070 0x7f8d700703b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.311+0000 7f8d6f200640 1 --2- 172.21.15.8:0/2934246645 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d7013d860 0x7f8d700ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.311+0000 7f8d6f200640 1 -- 172.21.15.8:0/2934246645 >> 172.21.15.8:0/2934246645 conn(0x7f8d70069e70 msgr2=0x7f8d7006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.311+0000 7f8d6f200640 1 -- 172.21.15.8:0/2934246645 shutdown_connections 2024-05-26T15:40:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.311+0000 7f8d6f200640 1 -- 172.21.15.8:0/2934246645 wait complete. 2024-05-26T15:40:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.313+0000 7f8d6f200640 1 Processor -- start 2024-05-26T15:40:47.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.313+0000 7f8d6f200640 1 -- start start 2024-05-26T15:40:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.314+0000 7f8d6f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d7006c3d0 0x7f8d701546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.314+0000 7f8d6f200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d7013d860 0x7f8d70155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.314+0000 7f8d6f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d701350f0 0x7f8d70156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.314+0000 7f8d6f200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70156900 con 0x7f8d701350f0 2024-05-26T15:40:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.314+0000 7f8d6f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70155cf0 con 0x7f8d7006c3d0 2024-05-26T15:40:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.314+0000 7f8d6f200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70155fd0 con 0x7f8d7013d860 2024-05-26T15:40:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.314+0000 7f8d6e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d701350f0 0x7f8d70156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.314+0000 7f8d6e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d701350f0 0x7f8d70156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50360/0 (socket says 172.21.15.8:50360) 2024-05-26T15:40:47.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.314+0000 7f8d6e800640 1 -- 172.21.15.8:0/1181282879 learned_addr learned my addr 172.21.15.8:0/1181282879 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d6de00640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d7006c3d0 0x7f8d701546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d6e800640 1 -- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d7013d860 msgr2=0x7f8d70155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d6d400640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d7013d860 0x7f8d70155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d6e800640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d7013d860 0x7f8d70155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d6e800640 1 -- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d7006c3d0 msgr2=0x7f8d701546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d6e800640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d7006c3d0 0x7f8d701546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d6e800640 1 -- 172.21.15.8:0/1181282879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d580094d0 con 0x7f8d701350f0 2024-05-26T15:40:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d6e800640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d701350f0 0x7f8d70156d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800c410 tx=0x7f8d6800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d66000640 1 -- 172.21.15.8:0/1181282879 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68011790 con 0x7f8d701350f0 2024-05-26T15:40:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d66000640 1 -- 172.21.15.8:0/1181282879 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d680118f0 con 0x7f8d701350f0 2024-05-26T15:40:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d66000640 1 -- 172.21.15.8:0/1181282879 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68011ce0 con 0x7f8d701350f0 2024-05-26T15:40:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.315+0000 7f8d6f200640 1 -- 172.21.15.8:0/1181282879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d701562b0 con 0x7f8d701350f0 2024-05-26T15:40:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.316+0000 7f8d6f200640 1 -- 172.21.15.8:0/1181282879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d70155950 con 0x7f8d701350f0 2024-05-26T15:40:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.317+0000 7f8d6f200640 1 -- 172.21.15.8:0/1181282879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d70156a70 con 0x7f8d701350f0 2024-05-26T15:40:47.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.318+0000 7f8d66000640 1 -- 172.21.15.8:0/1181282879 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d6801c460 con 0x7f8d701350f0 2024-05-26T15:40:47.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.319+0000 7f8d66000640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8d4c06ac00 0x7f8d4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.319+0000 7f8d66000640 1 -- 172.21.15.8:0/1181282879 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8d680893f0 con 0x7f8d701350f0 2024-05-26T15:40:47.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.320+0000 7f8d6de00640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8d4c06ac00 0x7f8d4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.321+0000 7f8d6de00640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8d4c06ac00 0x7f8d4c06d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009e90 tx=0x7f8d6000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:47.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.324+0000 7f8d66000640 1 -- 172.21.15.8:0/1181282879 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8d680541e0 con 0x7f8d701350f0 2024-05-26T15:40:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.521+0000 7f8d6f200640 1 -- 172.21.15.8:0/1181282879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d7004e210 con 0x7f8d701350f0 2024-05-26T15:40:47.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.522+0000 7f8d66000640 1 -- 172.21.15.8:0/1181282879 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d68057800 con 0x7f8d701350f0 2024-05-26T15:40:47.521 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 -- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8d4c06ac00 msgr2=0x7f8d4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8d4c06ac00 0x7f8d4c06d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009e90 tx=0x7f8d6000b040 comp rx=0 tx=0).stop 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 -- 172.21.15.8:0/1181282879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d701350f0 msgr2=0x7f8d70156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d701350f0 0x7f8d70156d90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800c410 tx=0x7f8d6800c8d0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 -- 172.21.15.8:0/1181282879 shutdown_connections 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8d701350f0 0x7f8d70156d90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8d7013d860 0x7f8d70155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8d4c06ac00 0x7f8d4c06d0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 --2- 172.21.15.8:0/1181282879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d7006c3d0 0x7f8d701546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 -- 172.21.15.8:0/1181282879 >> 172.21.15.8:0/1181282879 conn(0x7f8d70069e70 msgr2=0x7f8d700aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 -- 172.21.15.8:0/1181282879 shutdown_connections 2024-05-26T15:40:47.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.525+0000 7f8d6f200640 1 -- 172.21.15.8:0/1181282879 wait complete. 2024-05-26T15:40:47.543 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.759+0000 7f22da800640 1 Processor -- start 2024-05-26T15:40:47.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.759+0000 7f22da800640 1 -- start start 2024-05-26T15:40:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.761+0000 7f22da800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f22d41599a0 0x7f22d406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.761+0000 7f22da800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22d415d300 0x7f22d406da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.761+0000 7f22da800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d40cd570 con 0x7f22d40cc3d0 2024-05-26T15:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.761+0000 7f22da800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d40cc960 con 0x7f22d415d300 2024-05-26T15:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.761+0000 7f22da800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40ccc40 con 0x7f22d41599a0 2024-05-26T15:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.761+0000 7f22d8a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22d415d300 0x7f22d406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.761+0000 7f22d8a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22d415d300 0x7f22d406da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50366/0 (socket says 172.21.15.8:50366) 2024-05-26T15:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.761+0000 7f22d8a00640 1 -- 172.21.15.8:0/2834592736 learned_addr learned my addr 172.21.15.8:0/2834592736 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.762+0000 7f22d8a00640 1 -- 172.21.15.8:0/2834592736 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f22d41599a0 msgr2=0x7f22d406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:47.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.762+0000 7f22d8a00640 1 --2- 172.21.15.8:0/2834592736 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f22d41599a0 0x7f22d406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.762+0000 7f22d8a00640 1 -- 172.21.15.8:0/2834592736 >> v1:172.21.15.47:6789/0 conn(0x7f22d40cc3d0 legacy=0x7f22d4070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.762+0000 7f22d8a00640 1 -- 172.21.15.8:0/2834592736 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d40ccf20 con 0x7f22d415d300 2024-05-26T15:40:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.763+0000 7f22d8a00640 1 --2- 172.21.15.8:0/2834592736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 0x7f22d406da10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009870 tx=0x7f22c002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45eb87723c65cb45 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.763+0000 7f22d3e00640 1 -- 172.21.15.8:0/2834592736 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c002ae90 con 0x7f22d415d300 2024-05-26T15:40:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.763+0000 7f22d3e00640 1 -- 172.21.15.8:0/2834592736 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c0032440 con 0x7f22d415d300 2024-05-26T15:40:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.763+0000 7f22d3e00640 1 -- 172.21.15.8:0/2834592736 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c00327d0 con 0x7f22d415d300 2024-05-26T15:40:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.764+0000 7f22da800640 1 -- 172.21.15.8:0/2834592736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 msgr2=0x7f22d406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.764+0000 7f22da800640 1 --2- 172.21.15.8:0/2834592736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 0x7f22d406da10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009870 tx=0x7f22c002a180 comp rx=0 tx=0).stop 2024-05-26T15:40:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.764+0000 7f22da800640 1 -- 172.21.15.8:0/2834592736 shutdown_connections 2024-05-26T15:40:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.764+0000 7f22da800640 1 --2- 172.21.15.8:0/2834592736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 0x7f22d406da10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.764+0000 7f22da800640 1 --2- 172.21.15.8:0/2834592736 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f22d41599a0 0x7f22d406d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.764+0000 7f22da800640 1 -- 172.21.15.8:0/2834592736 >> 172.21.15.8:0/2834592736 conn(0x7f22d40ce4f0 msgr2=0x7f22d40ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.764+0000 7f22da800640 1 -- 172.21.15.8:0/2834592736 shutdown_connections 2024-05-26T15:40:47.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.764+0000 7f22da800640 1 -- 172.21.15.8:0/2834592736 wait complete. 2024-05-26T15:40:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.766+0000 7f22da800640 1 Processor -- start 2024-05-26T15:40:47.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.766+0000 7f22da800640 1 -- start start 2024-05-26T15:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.767+0000 7f22da800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f22d40cc3d0 0x7f22d41f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.767+0000 7f22da800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 0x7f22d4155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.767+0000 7f22da800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22d41f4160 0x7f22d41561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.767+0000 7f22da800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d41f6380 con 0x7f22d415d300 2024-05-26T15:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.767+0000 7f22da800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4158e00 con 0x7f22d41f4160 2024-05-26T15:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.767+0000 7f22da800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d41590e0 con 0x7f22d40cc3d0 2024-05-26T15:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.767+0000 7f22d8a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 0x7f22d4155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.767+0000 7f22d8a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 0x7f22d4155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50372/0 (socket says 172.21.15.8:50372) 2024-05-26T15:40:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.767+0000 7f22d8a00640 1 -- 172.21.15.8:0/2144275854 learned_addr learned my addr 172.21.15.8:0/2144275854 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:47.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.768+0000 7f22d8a00640 1 -- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f22d40cc3d0 msgr2=0x7f22d41f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.768+0000 7f22d9e00640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22d41f4160 0x7f22d41561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.768+0000 7f22d9400640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f22d40cc3d0 0x7f22d41f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.768+0000 7f22d8a00640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f22d40cc3d0 0x7f22d41f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.768+0000 7f22d8a00640 1 -- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22d41f4160 msgr2=0x7f22d41561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.768+0000 7f22d8a00640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22d41f4160 0x7f22d41561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.768+0000 7f22d8a00640 1 -- 172.21.15.8:0/2144275854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c00094d0 con 0x7f22d415d300 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.768+0000 7f22d9e00640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22d41f4160 0x7f22d41561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.768+0000 7f22d9400640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f22d40cc3d0 0x7f22d41f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.768+0000 7f22d8a00640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 0x7f22d4155cb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009870 tx=0x7f22c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.769+0000 7f22d1600640 1 -- 172.21.15.8:0/2144275854 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0030950 con 0x7f22d415d300 2024-05-26T15:40:47.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.769+0000 7f22d1600640 1 -- 172.21.15.8:0/2144275854 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c0030ab0 con 0x7f22d415d300 2024-05-26T15:40:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.769+0000 7f22da800640 1 -- 172.21.15.8:0/2144275854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d4152ad0 con 0x7f22d415d300 2024-05-26T15:40:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.769+0000 7f22d1600640 1 -- 172.21.15.8:0/2144275854 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0030e60 con 0x7f22d415d300 2024-05-26T15:40:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.769+0000 7f22da800640 1 -- 172.21.15.8:0/2144275854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d4153090 con 0x7f22d415d300 2024-05-26T15:40:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.770+0000 7f22da800640 1 -- 172.21.15.8:0/2144275854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d4159220 con 0x7f22d415d300 2024-05-26T15:40:47.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.771+0000 7f22d1600640 1 -- 172.21.15.8:0/2144275854 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f22c0039040 con 0x7f22d415d300 2024-05-26T15:40:47.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.772+0000 7f22d1600640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f22b406ac00 0x7f22b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:47.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.772+0000 7f22d1600640 1 -- 172.21.15.8:0/2144275854 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f22c00aa0c0 con 0x7f22d415d300 2024-05-26T15:40:47.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.773+0000 7f22d9400640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f22b406ac00 0x7f22b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:47.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.774+0000 7f22d9400640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f22b406ac00 0x7f22b406d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f22c8006fd0 tx=0x7f22c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:47.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.776+0000 7f22d1600640 1 -- 172.21.15.8:0/2144275854 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f22c00dd900 con 0x7f22d415d300 2024-05-26T15:40:47.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.975+0000 7f22da800640 1 -- 172.21.15.8:0/2144275854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f22d404e210 con 0x7f22d415d300 2024-05-26T15:40:47.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.976+0000 7f22d1600640 1 -- 172.21.15.8:0/2144275854 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f22c00370a0 con 0x7f22d415d300 2024-05-26T15:40:47.974 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:47.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.978+0000 7f22da800640 1 -- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f22b406ac00 msgr2=0x7f22b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.978+0000 7f22da800640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f22b406ac00 0x7f22b406d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f22c8006fd0 tx=0x7f22c8008040 comp rx=0 tx=0).stop 2024-05-26T15:40:47.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.979+0000 7f22da800640 1 -- 172.21.15.8:0/2144275854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 msgr2=0x7f22d4155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:47.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.979+0000 7f22da800640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 0x7f22d4155cb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009870 tx=0x7f22c00046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.979+0000 7f22da800640 1 -- 172.21.15.8:0/2144275854 shutdown_connections 2024-05-26T15:40:47.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.979+0000 7f22da800640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f22b406ac00 0x7f22b406d0c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.979+0000 7f22da800640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22d41f4160 0x7f22d41561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.979+0000 7f22da800640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22d415d300 0x7f22d4155cb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.979+0000 7f22da800640 1 --2- 172.21.15.8:0/2144275854 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f22d40cc3d0 0x7f22d41f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:47.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.979+0000 7f22da800640 1 -- 172.21.15.8:0/2144275854 >> 172.21.15.8:0/2144275854 conn(0x7f22d40ce4f0 msgr2=0x7f22d4070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:47.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.979+0000 7f22da800640 1 -- 172.21.15.8:0/2144275854 shutdown_connections 2024-05-26T15:40:47.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:47.979+0000 7f22da800640 1 -- 172.21.15.8:0/2144275854 wait complete. 2024-05-26T15:40:47.996 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-26T15:40:48.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.194+0000 7f7c3de00640 1 Processor -- start 2024-05-26T15:40:48.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.194+0000 7f7c3de00640 1 -- start start 2024-05-26T15:40:48.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.195+0000 7f7c3de00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7c3815cde0 0x7f7c380d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.195+0000 7f7c3de00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c380ce040 0x7f7c380b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.195+0000 7f7c3de00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3815d1c0 con 0x7f7c380d1120 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.195+0000 7f7c3de00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c380d1610 con 0x7f7c3815cde0 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.195+0000 7f7c3de00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380d18f0 con 0x7f7c380ce040 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.195+0000 7f7c36000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7c380d1120 0x7f7c380cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42004/0 (socket says 172.21.15.8:42004) 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.195+0000 7f7c36000640 1 -- 172.21.15.8:0/3235757302 learned_addr learned my addr 172.21.15.8:0/3235757302 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548421818 0 0) 0x7f7c3815d1c0 con 0x7f7c380d1120 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c1c003520 con 0x7f7c380d1120 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c36a00640 1 --2- 172.21.15.8:0/3235757302 >> v2:172.21.15.47:3300/0 conn(0x7f7c3815cde0 0x7f7c380d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c37400640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c380ce040 0x7f7c380b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1927784750 0 0) 0x7f7c1c003520 con 0x7f7c380d1120 2024-05-26T15:40:48.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c380ce040 msgr2=0x7f7c380b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c380ce040 0x7f7c380b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 >> v2:172.21.15.47:3300/0 conn(0x7f7c3815cde0 msgr2=0x7f7c380d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 --2- 172.21.15.8:0/3235757302 >> v2:172.21.15.47:3300/0 conn(0x7f7c3815cde0 0x7f7c380d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c380d1bd0 con 0x7f7c380d1120 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f7c20001670 con 0x7f7c380d1120 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 >> v1:172.21.15.8:6789/0 conn(0x7f7c380d1120 legacy=0x7f7c380cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c1c003970 0x7f7c1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c380ce040 0x7f7c1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c1c004d00 0x7f7c1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380d1610 con 0x7f7c1c004d00 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.196+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380d18f0 con 0x7f7c1c003970 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.197+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c00bae0 con 0x7f7c380ce040 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.197+0000 7f7c37400640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c1c004d00 0x7f7c1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:48.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.197+0000 7f7c37400640 1 -- 172.21.15.8:0/3235757302 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c380ce040 msgr2=0x7f7c1c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:48.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.197+0000 7f7c37400640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c380ce040 0x7f7c1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:48.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.197+0000 7f7c37400640 1 -- 172.21.15.8:0/3235757302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c1c003970 msgr2=0x7f7c1c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:48.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.197+0000 7f7c36a00640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c1c003970 0x7f7c1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:48.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.197+0000 7f7c37400640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c1c003970 0x7f7c1c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:48.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.197+0000 7f7c37400640 1 -- 172.21.15.8:0/3235757302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c003520 con 0x7f7c1c004d00 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.198+0000 7f7c37400640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c1c004d00 0x7f7c1c005180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000ba30 tx=0x7f7c1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a30670156cf163 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.199+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3002ae10 con 0x7f7c1c004d00 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.199+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3002e070 con 0x7f7c1c004d00 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.199+0000 7f7c35600640 1 -- 172.21.15.8:0/3235757302 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30034620 con 0x7f7c1c004d00 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.199+0000 7f7c3de00640 1 -- 172.21.15.8:0/3235757302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c1c004d00 msgr2=0x7f7c1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.199+0000 7f7c3de00640 1 --2- 172.21.15.8:0/3235757302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c1c004d00 0x7f7c1c005180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000ba30 tx=0x7f7c1c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.199+0000 7f7c37400640 1 -- 172.21.15.8:0/3235757302 reap_dead start 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.199+0000 7f7c3de00640 1 -- 172.21.15.8:0/3235757302 shutdown_connections 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.199+0000 7f7c3de00640 1 -- 172.21.15.8:0/3235757302 >> 172.21.15.8:0/3235757302 conn(0x7f7c380719c0 msgr2=0x7f7c38071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.199+0000 7f7c3de00640 1 -- 172.21.15.8:0/3235757302 shutdown_connections 2024-05-26T15:40:48.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.199+0000 7f7c3de00640 1 -- 172.21.15.8:0/3235757302 wait complete. 2024-05-26T15:40:48.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.201+0000 7f7c3de00640 1 Processor -- start 2024-05-26T15:40:48.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.201+0000 7f7c3de00640 1 -- start start 2024-05-26T15:40:48.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.202+0000 7f7c3de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c1c004d00 0x7f7c381f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:48.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.202+0000 7f7c3de00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c381efca0 0x7f7c380cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:48.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c3de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380c8850 0x7f7c380cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c3de00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380caee0 con 0x7f7c380c8850 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c3de00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380c9c30 con 0x7f7c1c004d00 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c3de00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380caa50 con 0x7f7c381efca0 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c37400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380c8850 0x7f7c380cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c37400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380c8850 0x7f7c380cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50380/0 (socket says 172.21.15.8:50380) 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c37400640 1 -- 172.21.15.8:0/1455561968 learned_addr learned my addr 172.21.15.8:0/1455561968 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c36a00640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c1c004d00 0x7f7c381f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c36000640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c381efca0 0x7f7c380cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c37400640 1 -- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c381efca0 msgr2=0x7f7c380cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c37400640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c381efca0 0x7f7c380cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c37400640 1 -- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c1c004d00 msgr2=0x7f7c381f2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:48.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c37400640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c1c004d00 0x7f7c381f2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c37400640 1 -- 172.21.15.8:0/1455561968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c380d2830 con 0x7f7c380c8850 2024-05-26T15:40:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.203+0000 7f7c36a00640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c1c004d00 0x7f7c381f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.204+0000 7f7c37400640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380c8850 0x7f7c380cb900 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000bb50 tx=0x7f7c30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.204+0000 7f7c2f400640 1 -- 172.21.15.8:0/1455561968 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30044070 con 0x7f7c380c8850 2024-05-26T15:40:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.204+0000 7f7c2f400640 1 -- 172.21.15.8:0/1455561968 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c30004020 con 0x7f7c380c8850 2024-05-26T15:40:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.204+0000 7f7c2f400640 1 -- 172.21.15.8:0/1455561968 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300043b0 con 0x7f7c380c8850 2024-05-26T15:40:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.204+0000 7f7c3de00640 1 -- 172.21.15.8:0/1455561968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c381f3430 con 0x7f7c380c8850 2024-05-26T15:40:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.204+0000 7f7c3de00640 1 -- 172.21.15.8:0/1455561968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c380ca120 con 0x7f7c380c8850 2024-05-26T15:40:48.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.205+0000 7f7c3de00640 1 -- 172.21.15.8:0/1455561968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c380681d0 con 0x7f7c380c8850 2024-05-26T15:40:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.206+0000 7f7c2f400640 1 -- 172.21.15.8:0/1455561968 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c30003610 con 0x7f7c380c8850 2024-05-26T15:40:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.207+0000 7f7c2f400640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c1406ac00 0x7f7c1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:48.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.207+0000 7f7c2f400640 1 -- 172.21.15.8:0/1455561968 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7c30000e40 con 0x7f7c380c8850 2024-05-26T15:40:48.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.208+0000 7f7c36a00640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c1406ac00 0x7f7c1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:48.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.209+0000 7f7c36a00640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c1406ac00 0x7f7c1406d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009f30 tx=0x7f7c2800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:48.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.212+0000 7f7c2f400640 1 -- 172.21.15.8:0/1455561968 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7c30074b90 con 0x7f7c380c8850 2024-05-26T15:40:48.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.429+0000 7f7c3de00640 1 -- 172.21.15.8:0/1455561968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7c380cab90 con 0x7f7c380c8850 2024-05-26T15:40:49.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.429+0000 7f7c2f400640 1 -- 172.21.15.8:0/1455561968 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7c3003c3a0 con 0x7f7c380c8850 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 -- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c1406ac00 msgr2=0x7f7c1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c1406ac00 0x7f7c1406d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009f30 tx=0x7f7c2800b040 comp rx=0 tx=0).stop 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 -- 172.21.15.8:0/1455561968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380c8850 msgr2=0x7f7c380cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380c8850 0x7f7c380cb900 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000bb50 tx=0x7f7c30004730 comp rx=0 tx=0).stop 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 -- 172.21.15.8:0/1455561968 shutdown_connections 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c380c8850 0x7f7c380cb900 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c381efca0 0x7f7c380cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c1406ac00 0x7f7c1406d0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 --2- 172.21.15.8:0/1455561968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c1c004d00 0x7f7c381f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 -- 172.21.15.8:0/1455561968 >> 172.21.15.8:0/1455561968 conn(0x7f7c380719c0 msgr2=0x7f7c380c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 -- 172.21.15.8:0/1455561968 shutdown_connections 2024-05-26T15:40:49.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:48.432+0000 7f7c3de00640 1 -- 172.21.15.8:0/1455561968 wait complete. 2024-05-26T15:40:49.152 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-26T15:40:49.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:49.152 DEBUG:teuthology.orchestra.run.smithi047:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-26T15:40:49.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:40:49.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:49.257 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-26T15:40:49.319 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:40:49.319 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:49.379 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:40:49.379 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:49.437 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:40:49.437 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:49.489 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.698+0000 7f8862c00640 1 Processor -- start 2024-05-26T15:40:49.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.698+0000 7f8862c00640 1 -- start start 2024-05-26T15:40:49.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.700+0000 7f8862c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c13c640 0x7f885c13f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:49.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.700+0000 7f8862c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f885c06d590 0x7f885c06da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:49.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.700+0000 7f8862c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885c13fe00 con 0x7f885c15d2e0 2024-05-26T15:40:49.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.700+0000 7f8862c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c06df60 con 0x7f885c06d590 2024-05-26T15:40:49.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.700+0000 7f8862c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c13d570 con 0x7f885c13c640 2024-05-26T15:40:49.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.700+0000 7f8860e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f885c15d2e0 0x7f885c13ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42008/0 (socket says 172.21.15.8:42008) 2024-05-26T15:40:49.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.700+0000 7f8860e00640 1 -- 172.21.15.8:0/1552801150 learned_addr learned my addr 172.21.15.8:0/1552801150 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:49.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f8861800640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c13c640 0x7f885c13f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255927041 0 0) 0x7f885c13fe00 con 0x7f885c15d2e0 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f8862200640 1 --2- 172.21.15.8:0/1552801150 >> v2:172.21.15.47:3300/0 conn(0x7f885c06d590 0x7f885c06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8844003520 con 0x7f885c15d2e0 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249700635 0 0) 0x7f8844003520 con 0x7f885c15d2e0 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c13c640 msgr2=0x7f885c13f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c13c640 0x7f885c13f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 >> v2:172.21.15.47:3300/0 conn(0x7f885c06d590 msgr2=0x7f885c06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 --2- 172.21.15.8:0/1552801150 >> v2:172.21.15.47:3300/0 conn(0x7f885c06d590 0x7f885c06da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c15d850 con 0x7f885c15d2e0 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f8848001670 con 0x7f885c15d2e0 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 >> v1:172.21.15.8:6789/0 conn(0x7f885c15d2e0 legacy=0x7f885c13ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:49.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 0x7f8844003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88440047c0 0x7f8844004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c13c640 0x7f8844005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c06df60 con 0x7f88440039a0 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c13d570 con 0x7f88440047c0 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.701+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884400ba60 con 0x7f885c13c640 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.702+0000 7f8861800640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 0x7f8844003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.702+0000 7f8860e00640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88440047c0 0x7f8844004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.702+0000 7f8861800640 1 -- 172.21.15.8:0/1552801150 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c13c640 msgr2=0x7f8844005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.702+0000 7f8861800640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c13c640 0x7f8844005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.702+0000 7f8861800640 1 -- 172.21.15.8:0/1552801150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88440047c0 msgr2=0x7f8844004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.702+0000 7f8861800640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88440047c0 0x7f8844004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.702+0000 7f8861800640 1 -- 172.21.15.8:0/1552801150 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844003520 con 0x7f88440039a0 2024-05-26T15:40:49.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.703+0000 7f8861800640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 0x7f8844003dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f885000ba00 tx=0x7f88440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6951f0b1632228 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.703+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885002adb0 con 0x7f88440039a0 2024-05-26T15:40:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.704+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885002e070 con 0x7f88440039a0 2024-05-26T15:40:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.704+0000 7f885be00640 1 -- 172.21.15.8:0/1552801150 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850034620 con 0x7f88440039a0 2024-05-26T15:40:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.704+0000 7f8862c00640 1 -- 172.21.15.8:0/1552801150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 msgr2=0x7f8844003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.704+0000 7f8862c00640 1 --2- 172.21.15.8:0/1552801150 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 0x7f8844003dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f885000ba00 tx=0x7f88440057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.704+0000 7f8862200640 1 -- 172.21.15.8:0/1552801150 reap_dead start 2024-05-26T15:40:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.704+0000 7f8862c00640 1 -- 172.21.15.8:0/1552801150 shutdown_connections 2024-05-26T15:40:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.704+0000 7f8862c00640 1 -- 172.21.15.8:0/1552801150 >> 172.21.15.8:0/1552801150 conn(0x7f885c070480 msgr2=0x7f885c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.704+0000 7f8862c00640 1 -- 172.21.15.8:0/1552801150 shutdown_connections 2024-05-26T15:40:49.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.704+0000 7f8862c00640 1 -- 172.21.15.8:0/1552801150 wait complete. 2024-05-26T15:40:49.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.706+0000 7f8862c00640 1 Processor -- start 2024-05-26T15:40:49.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.706+0000 7f8862c00640 1 -- start start 2024-05-26T15:40:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.707+0000 7f8862c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 0x7f885c14e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.707+0000 7f8862c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c151020 0x7f885c151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.707+0000 7f8862c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c1514a0 0x7f885c1354f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.707+0000 7f8862c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c150b90 con 0x7f88440039a0 2024-05-26T15:40:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.707+0000 7f8862c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c1523b0 con 0x7f885c151020 2024-05-26T15:40:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.707+0000 7f8862c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c150260 con 0x7f885c1514a0 2024-05-26T15:40:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.707+0000 7f8861800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 0x7f885c14e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.707+0000 7f8861800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 0x7f885c14e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50402/0 (socket says 172.21.15.8:50402) 2024-05-26T15:40:49.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.707+0000 7f8861800640 1 -- 172.21.15.8:0/1443310048 learned_addr learned my addr 172.21.15.8:0/1443310048 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:49.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.708+0000 7f8861800640 1 -- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c1514a0 msgr2=0x7f885c1354f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.708+0000 7f8861800640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c1514a0 0x7f885c1354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.708+0000 7f8861800640 1 -- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c151020 msgr2=0x7f885c151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.708+0000 7f8860e00640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c151020 0x7f885c151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.708+0000 7f8861800640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c151020 0x7f885c151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.708+0000 7f8861800640 1 -- 172.21.15.8:0/1443310048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c150540 con 0x7f88440039a0 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.708+0000 7f8861800640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 0x7f885c14e7d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f885000bb20 tx=0x7f8850004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.708+0000 7f8859600640 1 -- 172.21.15.8:0/1443310048 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885003f470 con 0x7f88440039a0 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.709+0000 7f8859600640 1 -- 172.21.15.8:0/1443310048 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885003f5f0 con 0x7f88440039a0 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.709+0000 7f8859600640 1 -- 172.21.15.8:0/1443310048 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885003f9a0 con 0x7f88440039a0 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.709+0000 7f8862c00640 1 -- 172.21.15.8:0/1443310048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c150820 con 0x7f88440039a0 2024-05-26T15:40:49.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.709+0000 7f8862c00640 1 -- 172.21.15.8:0/1443310048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c14ed10 con 0x7f88440039a0 2024-05-26T15:40:49.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.710+0000 7f8862c00640 1 -- 172.21.15.8:0/1443310048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c04e280 con 0x7f88440039a0 2024-05-26T15:40:49.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.711+0000 7f8859600640 1 -- 172.21.15.8:0/1443310048 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f885003fb00 con 0x7f88440039a0 2024-05-26T15:40:49.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.712+0000 7f8859600640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883c06ac00 0x7f883c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:49.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.712+0000 7f8859600640 1 -- 172.21.15.8:0/1443310048 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f88500aa640 con 0x7f88440039a0 2024-05-26T15:40:49.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.713+0000 7f8860e00640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883c06ac00 0x7f883c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:49.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.715+0000 7f8860e00640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883c06ac00 0x7f883c06d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8848000ff0 tx=0x7f8848009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:49.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.717+0000 7f8859600640 1 -- 172.21.15.8:0/1443310048 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8850078e30 con 0x7f88440039a0 2024-05-26T15:40:49.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.921+0000 7f8862c00640 1 -- 172.21.15.8:0/1443310048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f885c14c270 con 0x7f88440039a0 2024-05-26T15:40:49.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.924+0000 7f8859600640 1 -- 172.21.15.8:0/1443310048 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7f88500789c0 con 0x7f88440039a0 2024-05-26T15:40:49.923 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:49.924 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:49.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.927+0000 7f8862c00640 1 -- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883c06ac00 msgr2=0x7f883c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:49.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.927+0000 7f8862c00640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883c06ac00 0x7f883c06d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8848000ff0 tx=0x7f8848009040 comp rx=0 tx=0).stop 2024-05-26T15:40:49.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.927+0000 7f8862c00640 1 -- 172.21.15.8:0/1443310048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 msgr2=0x7f885c14e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:49.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.927+0000 7f8862c00640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 0x7f885c14e7d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f885000bb20 tx=0x7f8850004730 comp rx=0 tx=0).stop 2024-05-26T15:40:49.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.927+0000 7f8862c00640 1 -- 172.21.15.8:0/1443310048 shutdown_connections 2024-05-26T15:40:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.927+0000 7f8862c00640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f885c1514a0 0x7f885c1354f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.927+0000 7f8862c00640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f883c06ac00 0x7f883c06d0c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.927+0000 7f8862c00640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f885c151020 0x7f885c151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.927+0000 7f8862c00640 1 --2- 172.21.15.8:0/1443310048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f88440039a0 0x7f885c14e7d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.928+0000 7f8862c00640 1 -- 172.21.15.8:0/1443310048 >> 172.21.15.8:0/1443310048 conn(0x7f885c070480 msgr2=0x7f885c13d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.928+0000 7f8862c00640 1 -- 172.21.15.8:0/1443310048 shutdown_connections 2024-05-26T15:40:49.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:49.928+0000 7f8862c00640 1 -- 172.21.15.8:0/1443310048 wait complete. 2024-05-26T15:40:49.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:49.948 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:50.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.159+0000 7f4240a00640 1 Processor -- start 2024-05-26T15:40:50.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.159+0000 7f4240a00640 1 -- start start 2024-05-26T15:40:50.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.160+0000 7f4240a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f423c15ca00 0x7f423c0d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.160+0000 7f4240a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f423c0d0020 0x7f423c0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f4240a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c0d20d0 con 0x7f423c0b82c0 2024-05-26T15:40:50.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f4240a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c0d06b0 con 0x7f423c15ca00 2024-05-26T15:40:50.159 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f4240a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0d12b0 con 0x7f423c0d0020 2024-05-26T15:40:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f423a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f423c15ca00 0x7f423c0d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f4239e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f423c0b82c0 0x7f423c0cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:42018/0 (socket says 172.21.15.8:42018) 2024-05-26T15:40:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f4239e00640 1 -- 172.21.15.8:0/4021478331 learned_addr learned my addr 172.21.15.8:0/4021478331 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f423b200640 1 --2- 172.21.15.8:0/4021478331 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f423c0d0020 0x7f423c0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:50.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f423a800640 1 -- 172.21.15.8:0/4021478331 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f423c0d0020 msgr2=0x7f423c0b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f423a800640 1 --2- 172.21.15.8:0/4021478331 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f423c0d0020 0x7f423c0b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f423a800640 1 -- 172.21.15.8:0/4021478331 >> v1:172.21.15.8:6789/0 conn(0x7f423c0b82c0 legacy=0x7f423c0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.162+0000 7f423a800640 1 -- 172.21.15.8:0/4021478331 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c0d14c0 con 0x7f423c15ca00 2024-05-26T15:40:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.161+0000 7f4239400640 1 -- 172.21.15.8:0/4021478331 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797201474 0 0) 0x7f423c0d20d0 con 0x7f423c0b82c0 2024-05-26T15:40:50.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.162+0000 7f423b200640 1 --2- 172.21.15.8:0/4021478331 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f423c0d0020 0x7f423c0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.163+0000 7f423a800640 1 --2- 172.21.15.8:0/4021478331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 0x7f423c0d0d70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f422c0097a0 tx=0x7f422c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf38d286da2ac15c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.163+0000 7f4239400640 1 -- 172.21.15.8:0/4021478331 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c032440 con 0x7f423c15ca00 2024-05-26T15:40:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.163+0000 7f4239400640 1 -- 172.21.15.8:0/4021478331 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c0325a0 con 0x7f423c15ca00 2024-05-26T15:40:50.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.163+0000 7f4239400640 1 -- 172.21.15.8:0/4021478331 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c032930 con 0x7f423c15ca00 2024-05-26T15:40:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.164+0000 7f4240a00640 1 -- 172.21.15.8:0/4021478331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 msgr2=0x7f423c0d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.164+0000 7f4240a00640 1 --2- 172.21.15.8:0/4021478331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 0x7f423c0d0d70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f422c0097a0 tx=0x7f422c02a180 comp rx=0 tx=0).stop 2024-05-26T15:40:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.164+0000 7f4240a00640 1 -- 172.21.15.8:0/4021478331 shutdown_connections 2024-05-26T15:40:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.164+0000 7f4240a00640 1 --2- 172.21.15.8:0/4021478331 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f423c0d0020 0x7f423c0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.164+0000 7f4240a00640 1 --2- 172.21.15.8:0/4021478331 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 0x7f423c0d0d70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.164+0000 7f4240a00640 1 -- 172.21.15.8:0/4021478331 >> 172.21.15.8:0/4021478331 conn(0x7f423c06b640 msgr2=0x7f423c06ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.164+0000 7f4240a00640 1 -- 172.21.15.8:0/4021478331 shutdown_connections 2024-05-26T15:40:50.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.164+0000 7f4240a00640 1 -- 172.21.15.8:0/4021478331 wait complete. 2024-05-26T15:40:50.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.166+0000 7f4240a00640 1 Processor -- start 2024-05-26T15:40:50.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.166+0000 7f4240a00640 1 -- start start 2024-05-26T15:40:50.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.167+0000 7f4240a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f423c0b82c0 0x7f423c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.167+0000 7f4240a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0d0020 0x7f423c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.167+0000 7f4240a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 0x7f423c0c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.167+0000 7f4240a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c13f6e0 con 0x7f423c15ca00 2024-05-26T15:40:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.167+0000 7f4240a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0cc5a0 con 0x7f423c0d0020 2024-05-26T15:40:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.167+0000 7f4240a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0cc880 con 0x7f423c0b82c0 2024-05-26T15:40:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.167+0000 7f423b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 0x7f423c0c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.167+0000 7f423b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 0x7f423c0c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50408/0 (socket says 172.21.15.8:50408) 2024-05-26T15:40:50.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.167+0000 7f423b200640 1 -- 172.21.15.8:0/3616235626 learned_addr learned my addr 172.21.15.8:0/3616235626 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f423b200640 1 -- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f423c0b82c0 msgr2=0x7f423c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f423b200640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f423c0b82c0 0x7f423c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f423b200640 1 -- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0d0020 msgr2=0x7f423c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f423b200640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0d0020 0x7f423c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f423b200640 1 -- 172.21.15.8:0/3616235626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009400 con 0x7f423c15ca00 2024-05-26T15:40:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f423b200640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 0x7f423c0c9f40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f423400c7f0 tx=0x7f423400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f4232a00640 1 -- 172.21.15.8:0/3616235626 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234004220 con 0x7f423c15ca00 2024-05-26T15:40:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f4232a00640 1 -- 172.21.15.8:0/3616235626 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42340043a0 con 0x7f423c15ca00 2024-05-26T15:40:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f4232a00640 1 -- 172.21.15.8:0/3616235626 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234007860 con 0x7f423c15ca00 2024-05-26T15:40:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f4240a00640 1 -- 172.21.15.8:0/3616235626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c0ccb60 con 0x7f423c15ca00 2024-05-26T15:40:50.168 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.168+0000 7f4240a00640 1 -- 172.21.15.8:0/3616235626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c0cb870 con 0x7f423c15ca00 2024-05-26T15:40:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.170+0000 7f4240a00640 1 -- 172.21.15.8:0/3616235626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c13fb70 con 0x7f423c15ca00 2024-05-26T15:40:50.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.171+0000 7f4232a00640 1 -- 172.21.15.8:0/3616235626 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4234007bd0 con 0x7f423c15ca00 2024-05-26T15:40:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.171+0000 7f4232a00640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f421806ac00 0x7f421806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.172+0000 7f4232a00640 1 -- 172.21.15.8:0/3616235626 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4234089730 con 0x7f423c15ca00 2024-05-26T15:40:50.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.172+0000 7f423a800640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f421806ac00 0x7f421806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:50.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.173+0000 7f423a800640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f421806ac00 0x7f421806d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f422c034000 tx=0x7f422c02c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:50.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.176+0000 7f4232a00640 1 -- 172.21.15.8:0/3616235626 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f423c13fb70 con 0x7f423c15ca00 2024-05-26T15:40:50.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.374+0000 7f4240a00640 1 -- 172.21.15.8:0/3616235626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f423c13fb70 con 0x7f423c15ca00 2024-05-26T15:40:50.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.375+0000 7f4232a00640 1 -- 172.21.15.8:0/3616235626 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f423c13fb70 con 0x7f423c15ca00 2024-05-26T15:40:50.374 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 -- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f421806ac00 msgr2=0x7f421806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f421806ac00 0x7f421806d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f422c034000 tx=0x7f422c02c000 comp rx=0 tx=0).stop 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 -- 172.21.15.8:0/3616235626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 msgr2=0x7f423c0c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 0x7f423c0c9f40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f423400c7f0 tx=0x7f423400ccb0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 -- 172.21.15.8:0/3616235626 shutdown_connections 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c15ca00 0x7f423c0c9f40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f421806ac00 0x7f421806d0c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0d0020 0x7f423c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 --2- 172.21.15.8:0/3616235626 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f423c0b82c0 0x7f423c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 -- 172.21.15.8:0/3616235626 >> 172.21.15.8:0/3616235626 conn(0x7f423c06b640 msgr2=0x7f423c0d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 -- 172.21.15.8:0/3616235626 shutdown_connections 2024-05-26T15:40:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.378+0000 7f4240a00640 1 -- 172.21.15.8:0/3616235626 wait complete. 2024-05-26T15:40:50.396 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:50.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.617+0000 7f6f4ea00640 1 Processor -- start 2024-05-26T15:40:50.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.618+0000 7f6f4ea00640 1 -- start start 2024-05-26T15:40:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.619+0000 7f6f4ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6f48165820 0x7f6f4806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.619+0000 7f6f4ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f4806d410 0x7f6f48161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.619+0000 7f6f4ea00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4806cbd0 con 0x7f6f48164770 2024-05-26T15:40:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.619+0000 7f6f4ea00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4806d830 con 0x7f6f4806d410 2024-05-26T15:40:50.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.619+0000 7f6f4ea00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f48161500 con 0x7f6f48165820 2024-05-26T15:40:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.620+0000 7f6f4ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f4806d410 0x7f6f48161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.620+0000 7f6f4ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6f4806d410 0x7f6f48161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50420/0 (socket says 172.21.15.8:50420) 2024-05-26T15:40:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.620+0000 7f6f4ca00640 1 -- 172.21.15.8:0/4094985968 learned_addr learned my addr 172.21.15.8:0/4094985968 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.620+0000 7f6f3fe00640 1 --2- 172.21.15.8:0/4094985968 >> v2:172.21.15.47:3300/0 conn(0x7f6f48165820 0x7f6f4806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:50.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.620+0000 7f6f4ca00640 1 -- 172.21.15.8:0/4094985968 >> v2:172.21.15.47:3300/0 conn(0x7f6f48165820 msgr2=0x7f6f4806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.620+0000 7f6f4ca00640 1 --2- 172.21.15.8:0/4094985968 >> v2:172.21.15.47:3300/0 conn(0x7f6f48165820 0x7f6f4806ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.620+0000 7f6f4ca00640 1 -- 172.21.15.8:0/4094985968 >> v1:172.21.15.47:6789/0 conn(0x7f6f48164770 legacy=0x7f6f4806c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:50.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.620+0000 7f6f4ca00640 1 -- 172.21.15.8:0/4094985968 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f480b2410 con 0x7f6f4806d410 2024-05-26T15:40:50.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.621+0000 7f6f4ca00640 1 --2- 172.21.15.8:0/4094985968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 0x7f6f48161780 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6f4806d9d0 tx=0x7f6f4002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46190fc216502294 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:50.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.622+0000 7f6f47400640 1 -- 172.21.15.8:0/4094985968 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40031600 con 0x7f6f4806d410 2024-05-26T15:40:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.622+0000 7f6f47400640 1 -- 172.21.15.8:0/4094985968 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4002d050 con 0x7f6f4806d410 2024-05-26T15:40:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.622+0000 7f6f47400640 1 -- 172.21.15.8:0/4094985968 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40031980 con 0x7f6f4806d410 2024-05-26T15:40:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.622+0000 7f6f4ea00640 1 -- 172.21.15.8:0/4094985968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 msgr2=0x7f6f48161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.622+0000 7f6f4ea00640 1 --2- 172.21.15.8:0/4094985968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 0x7f6f48161780 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6f4806d9d0 tx=0x7f6f4002a640 comp rx=0 tx=0).stop 2024-05-26T15:40:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.623+0000 7f6f4ea00640 1 -- 172.21.15.8:0/4094985968 shutdown_connections 2024-05-26T15:40:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.623+0000 7f6f4ea00640 1 --2- 172.21.15.8:0/4094985968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 0x7f6f48161780 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.623+0000 7f6f4ea00640 1 --2- 172.21.15.8:0/4094985968 >> v2:172.21.15.47:3300/0 conn(0x7f6f48165820 0x7f6f4806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.623+0000 7f6f4ea00640 1 -- 172.21.15.8:0/4094985968 >> 172.21.15.8:0/4094985968 conn(0x7f6f48069e70 msgr2=0x7f6f4806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.623+0000 7f6f4ea00640 1 -- 172.21.15.8:0/4094985968 shutdown_connections 2024-05-26T15:40:50.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.623+0000 7f6f4ea00640 1 -- 172.21.15.8:0/4094985968 wait complete. 2024-05-26T15:40:50.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.625+0000 7f6f4ea00640 1 Processor -- start 2024-05-26T15:40:50.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.626+0000 7f6f4ea00640 1 -- start start 2024-05-26T15:40:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.627+0000 7f6f4ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 0x7f6f48162a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.627+0000 7f6f4ea00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6f48164770 0x7f6f481f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.627+0000 7f6f4ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f48165820 0x7f6f481f9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.627+0000 7f6f4ea00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f481f9cd0 con 0x7f6f4806d410 2024-05-26T15:40:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.627+0000 7f6f4ea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480cb6f0 con 0x7f6f48165820 2024-05-26T15:40:50.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.627+0000 7f6f4ea00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480cb990 con 0x7f6f48164770 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.627+0000 7f6f47e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 0x7f6f48162a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.627+0000 7f6f47e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 0x7f6f48162a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50426/0 (socket says 172.21.15.8:50426) 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.627+0000 7f6f47e00640 1 -- 172.21.15.8:0/3532814341 learned_addr learned my addr 172.21.15.8:0/3532814341 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.628+0000 7f6f3fe00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6f48164770 0x7f6f481f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.628+0000 7f6f4ca00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f48165820 0x7f6f481f9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.628+0000 7f6f47e00640 1 -- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6f48164770 msgr2=0x7f6f481f9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.628+0000 7f6f47e00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6f48164770 0x7f6f481f9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.628+0000 7f6f47e00640 1 -- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f48165820 msgr2=0x7f6f481f9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.628+0000 7f6f47e00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f48165820 0x7f6f481f9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.628+0000 7f6f47e00640 1 -- 172.21.15.8:0/3532814341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f40009b30 con 0x7f6f4806d410 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.628+0000 7f6f4ca00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f48165820 0x7f6f481f9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:50.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.628+0000 7f6f47e00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 0x7f6f48162a40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800c410 tx=0x7f6f3800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:50.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.629+0000 7f6f44c00640 1 -- 172.21.15.8:0/3532814341 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f380035f0 con 0x7f6f4806d410 2024-05-26T15:40:50.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.629+0000 7f6f44c00640 1 -- 172.21.15.8:0/3532814341 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f38003750 con 0x7f6f4806d410 2024-05-26T15:40:50.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.629+0000 7f6f44c00640 1 -- 172.21.15.8:0/3532814341 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38003b40 con 0x7f6f4806d410 2024-05-26T15:40:50.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.629+0000 7f6f4ea00640 1 -- 172.21.15.8:0/3532814341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f480cbc70 con 0x7f6f4806d410 2024-05-26T15:40:50.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.629+0000 7f6f4ea00640 1 -- 172.21.15.8:0/3532814341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f480cc230 con 0x7f6f4806d410 2024-05-26T15:40:50.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.630+0000 7f6f4ea00640 1 -- 172.21.15.8:0/3532814341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4806c4c0 con 0x7f6f4806d410 2024-05-26T15:40:50.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.631+0000 7f6f44c00640 1 -- 172.21.15.8:0/3532814341 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f38003ca0 con 0x7f6f4806d410 2024-05-26T15:40:50.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.632+0000 7f6f44c00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6f2406ac00 0x7f6f2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:50.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.632+0000 7f6f44c00640 1 -- 172.21.15.8:0/3532814341 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6f38088a00 con 0x7f6f4806d410 2024-05-26T15:40:50.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.633+0000 7f6f3fe00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6f2406ac00 0x7f6f2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:50.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.634+0000 7f6f3fe00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6f2406ac00 0x7f6f2406d0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f30006fd0 tx=0x7f6f30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:50.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.638+0000 7f6f44c00640 1 -- 172.21.15.8:0/3532814341 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6f38053760 con 0x7f6f4806d410 2024-05-26T15:40:50.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.836+0000 7f6f4ea00640 1 -- 172.21.15.8:0/3532814341 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f4804e210 con 0x7f6f4806d410 2024-05-26T15:40:50.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.837+0000 7f6f44c00640 1 -- 172.21.15.8:0/3532814341 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f3805d070 con 0x7f6f4806d410 2024-05-26T15:40:50.836 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 -- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6f2406ac00 msgr2=0x7f6f2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6f2406ac00 0x7f6f2406d0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f30006fd0 tx=0x7f6f30008040 comp rx=0 tx=0).stop 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 -- 172.21.15.8:0/3532814341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 msgr2=0x7f6f48162a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 0x7f6f48162a40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800c410 tx=0x7f6f3800c8d0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 -- 172.21.15.8:0/3532814341 shutdown_connections 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6f2406ac00 0x7f6f2406d0c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f48165820 0x7f6f481f9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6f48164770 0x7f6f481f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 --2- 172.21.15.8:0/3532814341 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f4806d410 0x7f6f48162a40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 -- 172.21.15.8:0/3532814341 >> 172.21.15.8:0/3532814341 conn(0x7f6f48069e70 msgr2=0x7f6f48163670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 -- 172.21.15.8:0/3532814341 shutdown_connections 2024-05-26T15:40:50.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:50.840+0000 7f6f4ea00640 1 -- 172.21.15.8:0/3532814341 wait complete. 2024-05-26T15:40:50.859 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:51.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.079+0000 7fe8cb200640 1 Processor -- start 2024-05-26T15:40:51.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.079+0000 7fe8cb200640 1 -- start start 2024-05-26T15:40:51.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.080+0000 7fe8cb200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe8cc0d2fc0 0x7fe8cc0d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.080+0000 7fe8cb200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8cc0d13e0 0x7fe8cc0b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.081+0000 7fe8cb200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8cc0b6340 con 0x7fe8cc160490 2024-05-26T15:40:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.081+0000 7fe8cb200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8cc0b59b0 con 0x7fe8cc0d2fc0 2024-05-26T15:40:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.081+0000 7fe8cb200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc0b6010 con 0x7fe8cc0d13e0 2024-05-26T15:40:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.081+0000 7fe8c9e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe8cc160490 0x7fe8cc0d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:49186/0 (socket says 172.21.15.8:49186) 2024-05-26T15:40:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.081+0000 7fe8c9e00640 1 -- 172.21.15.8:0/4033238211 learned_addr learned my addr 172.21.15.8:0/4033238211 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.081+0000 7fe8c9400640 1 --2- 172.21.15.8:0/4033238211 >> v2:172.21.15.47:3300/0 conn(0x7fe8cc0d2fc0 0x7fe8cc0d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.081+0000 7fe8ca800640 1 --2- 172.21.15.8:0/4033238211 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8cc0d13e0 0x7fe8cc0b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.082+0000 7fe8c9400640 1 -- 172.21.15.8:0/4033238211 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8cc0d13e0 msgr2=0x7fe8cc0b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.082+0000 7fe8c9400640 1 --2- 172.21.15.8:0/4033238211 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8cc0d13e0 0x7fe8cc0b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.082+0000 7fe8c9400640 1 -- 172.21.15.8:0/4033238211 >> v1:172.21.15.47:6789/0 conn(0x7fe8cc160490 legacy=0x7fe8cc0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.082+0000 7fe8c9400640 1 -- 172.21.15.8:0/4033238211 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc0d1890 con 0x7fe8cc0d2fc0 2024-05-26T15:40:51.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.083+0000 7fe8c9400640 1 --2- 172.21.15.8:0/4033238211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc0d2fc0 0x7fe8cc0d0ea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80097a0 tx=0x7fe8b802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a31b69a62d23175 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:51.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.083+0000 7fe8c8a00640 1 -- 172.21.15.8:0/4033238211 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8032440 con 0x7fe8cc0d2fc0 2024-05-26T15:40:51.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.083+0000 7fe8c8a00640 1 -- 172.21.15.8:0/4033238211 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b80325a0 con 0x7fe8cc0d2fc0 2024-05-26T15:40:51.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.083+0000 7fe8c8a00640 1 -- 172.21.15.8:0/4033238211 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8032930 con 0x7fe8cc0d2fc0 2024-05-26T15:40:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.084+0000 7fe8cb200640 1 -- 172.21.15.8:0/4033238211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc0d2fc0 msgr2=0x7fe8cc0d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.084+0000 7fe8cb200640 1 --2- 172.21.15.8:0/4033238211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc0d2fc0 0x7fe8cc0d0ea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80097a0 tx=0x7fe8b802a180 comp rx=0 tx=0).stop 2024-05-26T15:40:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.084+0000 7fe8cb200640 1 -- 172.21.15.8:0/4033238211 shutdown_connections 2024-05-26T15:40:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.084+0000 7fe8cb200640 1 --2- 172.21.15.8:0/4033238211 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8cc0d13e0 0x7fe8cc0b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.084+0000 7fe8cb200640 1 --2- 172.21.15.8:0/4033238211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc0d2fc0 0x7fe8cc0d0ea0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.084+0000 7fe8cb200640 1 -- 172.21.15.8:0/4033238211 >> 172.21.15.8:0/4033238211 conn(0x7fe8cc0715a0 msgr2=0x7fe8cc0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:51.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.084+0000 7fe8cb200640 1 -- 172.21.15.8:0/4033238211 shutdown_connections 2024-05-26T15:40:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.084+0000 7fe8cb200640 1 -- 172.21.15.8:0/4033238211 wait complete. 2024-05-26T15:40:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.086+0000 7fe8cb200640 1 Processor -- start 2024-05-26T15:40:51.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.086+0000 7fe8cb200640 1 -- start start 2024-05-26T15:40:51.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.087+0000 7fe8cb200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8cc0d13e0 0x7fe8cc14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.087+0000 7fe8cb200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc0d2fc0 0x7fe8cc0c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.087+0000 7fe8cb200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8cc160490 0x7fe8cc15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.087+0000 7fe8cb200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc0b35d0 con 0x7fe8cc160490 2024-05-26T15:40:51.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.087+0000 7fe8cb200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc0c6b10 con 0x7fe8cc0d2fc0 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.087+0000 7fe8cb200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc0c6df0 con 0x7fe8cc0d13e0 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8ca800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8cc160490 0x7fe8cc15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8ca800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8cc160490 0x7fe8cc15d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42056/0 (socket says 172.21.15.8:42056) 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8ca800640 1 -- 172.21.15.8:0/1337317863 learned_addr learned my addr 172.21.15.8:0/1337317863 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8c9400640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc0d2fc0 0x7fe8cc0c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8c9e00640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8cc0d13e0 0x7fe8cc14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8ca800640 1 -- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8cc0d13e0 msgr2=0x7fe8cc14f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8ca800640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8cc0d13e0 0x7fe8cc14f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8ca800640 1 -- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc0d2fc0 msgr2=0x7fe8cc0c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8ca800640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc0d2fc0 0x7fe8cc0c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8ca800640 1 -- 172.21.15.8:0/1337317863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b8009400 con 0x7fe8cc160490 2024-05-26T15:40:51.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.088+0000 7fe8ca800640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8cc160490 0x7fe8cc15d370 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4007e40 tx=0x7fe8c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:51.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.089+0000 7fe8c2000640 1 -- 172.21.15.8:0/1337317863 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4014620 con 0x7fe8cc160490 2024-05-26T15:40:51.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.089+0000 7fe8c2000640 1 -- 172.21.15.8:0/1337317863 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c400ee90 con 0x7fe8cc160490 2024-05-26T15:40:51.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.089+0000 7fe8c2000640 1 -- 172.21.15.8:0/1337317863 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c40149e0 con 0x7fe8cc160490 2024-05-26T15:40:51.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.089+0000 7fe8cb200640 1 -- 172.21.15.8:0/1337317863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8cc0c70d0 con 0x7fe8cc160490 2024-05-26T15:40:51.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.089+0000 7fe8cb200640 1 -- 172.21.15.8:0/1337317863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8cc0c67c0 con 0x7fe8cc160490 2024-05-26T15:40:51.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.090+0000 7fe8cb200640 1 -- 172.21.15.8:0/1337317863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8cc0b3710 con 0x7fe8cc160490 2024-05-26T15:40:51.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.091+0000 7fe8c2000640 1 -- 172.21.15.8:0/1337317863 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8c4014b40 con 0x7fe8cc160490 2024-05-26T15:40:51.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.092+0000 7fe8c2000640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8ac06ac00 0x7fe8ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.092+0000 7fe8c2000640 1 -- 172.21.15.8:0/1337317863 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe8c408a0b0 con 0x7fe8cc160490 2024-05-26T15:40:51.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.093+0000 7fe8c9e00640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8ac06ac00 0x7fe8ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.094+0000 7fe8c9e00640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8ac06ac00 0x7fe8ac06d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc005880 tx=0x7fe8bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.096+0000 7fe8c2000640 1 -- 172.21.15.8:0/1337317863 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe8cc0b3710 con 0x7fe8cc160490 2024-05-26T15:40:51.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.295+0000 7fe8cb200640 1 -- 172.21.15.8:0/1337317863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8cc0b3710 con 0x7fe8cc160490 2024-05-26T15:40:51.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.296+0000 7fe8c2000640 1 -- 172.21.15.8:0/1337317863 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8cc0b3710 con 0x7fe8cc160490 2024-05-26T15:40:51.295 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:51.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 -- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8ac06ac00 msgr2=0x7fe8ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8ac06ac00 0x7fe8ac06d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc005880 tx=0x7fe8bc009040 comp rx=0 tx=0).stop 2024-05-26T15:40:51.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 -- 172.21.15.8:0/1337317863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8cc160490 msgr2=0x7fe8cc15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8cc160490 0x7fe8cc15d370 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4007e40 tx=0x7fe8c400e4b0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 -- 172.21.15.8:0/1337317863 shutdown_connections 2024-05-26T15:40:51.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8cc160490 0x7fe8cc15d370 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8ac06ac00 0x7fe8ac06d0c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8cc0d2fc0 0x7fe8cc0c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 --2- 172.21.15.8:0/1337317863 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8cc0d13e0 0x7fe8cc14f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 -- 172.21.15.8:0/1337317863 >> 172.21.15.8:0/1337317863 conn(0x7fe8cc0715a0 msgr2=0x7fe8cc15e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:51.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 -- 172.21.15.8:0/1337317863 shutdown_connections 2024-05-26T15:40:51.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.299+0000 7fe8cb200640 1 -- 172.21.15.8:0/1337317863 wait complete. 2024-05-26T15:40:51.318 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.542+0000 7f71e1600640 1 Processor -- start 2024-05-26T15:40:51.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.542+0000 7f71e1600640 1 -- start start 2024-05-26T15:40:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.544+0000 7f71e1600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f71dc15a9d0 0x7f71dc06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.544+0000 7f71e1600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0cdd10 0x7f71dc1643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.544+0000 7f71e1600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc0cba60 con 0x7f71dc06d970 2024-05-26T15:40:51.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.544+0000 7f71e1600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc071610 con 0x7f71dc15a9d0 2024-05-26T15:40:51.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.544+0000 7f71e1600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0cbd00 con 0x7f71dc0cdd10 2024-05-26T15:40:51.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.544+0000 7f71db400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f71dc06d970 0x7f71dc0cd600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36588/0 (socket says 172.21.15.8:36588) 2024-05-26T15:40:51.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.544+0000 7f71db400640 1 -- 172.21.15.8:0/4083484927 learned_addr learned my addr 172.21.15.8:0/4083484927 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71e0c00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0cdd10 0x7f71dc1643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71dbe00640 1 --2- 172.21.15.8:0/4083484927 >> v2:172.21.15.47:3300/0 conn(0x7f71dc15a9d0 0x7f71dc06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819748023 0 0) 0x7f71dc0cba60 con 0x7f71dc06d970 2024-05-26T15:40:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c0003520 con 0x7f71dc06d970 2024-05-26T15:40:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2712858033 0 0) 0x7f71c0003520 con 0x7f71dc06d970 2024-05-26T15:40:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0cdd10 msgr2=0x7f71dc1643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0cdd10 0x7f71dc1643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.545 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 >> v2:172.21.15.47:3300/0 conn(0x7f71dc15a9d0 msgr2=0x7f71dc06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 --2- 172.21.15.8:0/4083484927 >> v2:172.21.15.47:3300/0 conn(0x7f71dc15a9d0 0x7f71dc06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc070e10 con 0x7f71dc06d970 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f71c8001670 con 0x7f71dc06d970 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 >> v1:172.21.15.8:6789/0 conn(0x7f71dc06d970 legacy=0x7f71dc0cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.545+0000 7f71daa00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c0003970 0x7f71c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71daa00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0cdd10 0x7f71c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71daa00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 0x7f71c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc071610 con 0x7f71c0004d00 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0cbd00 con 0x7f71c0003970 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c000b980 con 0x7f71dc0cdd10 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71e0c00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 0x7f71c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.546 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71dbe00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c0003970 0x7f71c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71db400640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0cdd10 0x7f71c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71e0c00640 1 -- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0cdd10 msgr2=0x7f71c00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:51.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71e0c00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0cdd10 0x7f71c00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71e0c00640 1 -- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c0003970 msgr2=0x7f71c0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:51.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71e0c00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c0003970 0x7f71c0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71e0c00640 1 -- 172.21.15.8:0/4083484927 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0003520 con 0x7f71c0004d00 2024-05-26T15:40:51.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.546+0000 7f71dbe00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71c0003970 0x7f71c0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.547+0000 7f71e0c00640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 0x7f71c0005180 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0ce120 tx=0x7f71c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f28005599c3bb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.548+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4032600 con 0x7f71c0004d00 2024-05-26T15:40:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.548+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d402e050 con 0x7f71c0004d00 2024-05-26T15:40:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.548+0000 7f71daa00640 1 -- 172.21.15.8:0/4083484927 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4032980 con 0x7f71c0004d00 2024-05-26T15:40:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.548+0000 7f71e1600640 1 -- 172.21.15.8:0/4083484927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 msgr2=0x7f71c0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.548+0000 7f71e1600640 1 --2- 172.21.15.8:0/4083484927 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 0x7f71c0005180 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0ce120 tx=0x7f71c00057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.548+0000 7f71e0c00640 1 -- 172.21.15.8:0/4083484927 reap_dead start 2024-05-26T15:40:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.548+0000 7f71e1600640 1 -- 172.21.15.8:0/4083484927 shutdown_connections 2024-05-26T15:40:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.548+0000 7f71e1600640 1 -- 172.21.15.8:0/4083484927 >> 172.21.15.8:0/4083484927 conn(0x7f71dc0ce4f0 msgr2=0x7f71dc0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.549+0000 7f71e1600640 1 -- 172.21.15.8:0/4083484927 shutdown_connections 2024-05-26T15:40:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.549+0000 7f71e1600640 1 -- 172.21.15.8:0/4083484927 wait complete. 2024-05-26T15:40:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.550+0000 7f71e1600640 1 Processor -- start 2024-05-26T15:40:51.549 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.551+0000 7f71e1600640 1 -- start start 2024-05-26T15:40:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71e1600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 0x7f71dc0c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71e1600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71dc1418b0 0x7f71dc0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71e1600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0af0a0 0x7f71dc0af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71e1600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0afa60 con 0x7f71c0004d00 2024-05-26T15:40:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71e1600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0c4c80 con 0x7f71dc1418b0 2024-05-26T15:40:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71e1600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc141d30 con 0x7f71dc0af0a0 2024-05-26T15:40:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71dbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 0x7f71dc0c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71dbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 0x7f71dc0c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42076/0 (socket says 172.21.15.8:42076) 2024-05-26T15:40:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71dbe00640 1 -- 172.21.15.8:0/1883628512 learned_addr learned my addr 172.21.15.8:0/1883628512 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:51.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71db400640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71dc1418b0 0x7f71dc0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71dbe00640 1 -- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0af0a0 msgr2=0x7f71dc0af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71e0c00640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0af0a0 0x7f71dc0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71dbe00640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0af0a0 0x7f71dc0af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71dbe00640 1 -- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71dc1418b0 msgr2=0x7f71dc0c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71dbe00640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71dc1418b0 0x7f71dc0c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.552+0000 7f71dbe00640 1 -- 172.21.15.8:0/1883628512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0c3b20 con 0x7f71c0004d00 2024-05-26T15:40:51.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.553+0000 7f71dbe00640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 0x7f71dc0c34d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f71cc011600 tx=0x7f71cc011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:51.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.553+0000 7f71d3e00640 1 -- 172.21.15.8:0/1883628512 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00f920 con 0x7f71c0004d00 2024-05-26T15:40:51.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.553+0000 7f71d3e00640 1 -- 172.21.15.8:0/1883628512 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc00fa80 con 0x7f71c0004d00 2024-05-26T15:40:51.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.553+0000 7f71d3e00640 1 -- 172.21.15.8:0/1883628512 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00fe10 con 0x7f71c0004d00 2024-05-26T15:40:51.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.553+0000 7f71e1600640 1 -- 172.21.15.8:0/1883628512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc0c3e00 con 0x7f71c0004d00 2024-05-26T15:40:51.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.553+0000 7f71e1600640 1 -- 172.21.15.8:0/1883628512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc0c43c0 con 0x7f71c0004d00 2024-05-26T15:40:51.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.555+0000 7f71e1600640 1 -- 172.21.15.8:0/1883628512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc04e210 con 0x7f71c0004d00 2024-05-26T15:40:51.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.555+0000 7f71d3e00640 1 -- 172.21.15.8:0/1883628512 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f71cc015460 con 0x7f71c0004d00 2024-05-26T15:40:51.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.556+0000 7f71d3e00640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f71bc06ac50 0x7f71bc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:51.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.557+0000 7f71d3e00640 1 -- 172.21.15.8:0/1883628512 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f71cc089f80 con 0x7f71c0004d00 2024-05-26T15:40:51.555 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.557+0000 7f71db400640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f71bc06ac50 0x7f71bc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:51.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.558+0000 7f71db400640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f71bc06ac50 0x7f71bc06d110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0c70c0 tx=0x7f71c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:51.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.561+0000 7f71d3e00640 1 -- 172.21.15.8:0/1883628512 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f71cc054e60 con 0x7f71c0004d00 2024-05-26T15:40:51.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.766+0000 7f71e1600640 1 -- 172.21.15.8:0/1883628512 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f71dc0c4e40 con 0x7f71c0004d00 2024-05-26T15:40:51.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.766+0000 7f71d3e00640 1 -- 172.21.15.8:0/1883628512 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f71cc058480 con 0x7f71c0004d00 2024-05-26T15:40:51.765 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 -- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f71bc06ac50 msgr2=0x7f71bc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f71bc06ac50 0x7f71bc06d110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0c70c0 tx=0x7f71c8009040 comp rx=0 tx=0).stop 2024-05-26T15:40:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 -- 172.21.15.8:0/1883628512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 msgr2=0x7f71dc0c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 0x7f71dc0c34d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f71cc011600 tx=0x7f71cc011ac0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 -- 172.21.15.8:0/1883628512 shutdown_connections 2024-05-26T15:40:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f71dc0af0a0 0x7f71dc0af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f71bc06ac50 0x7f71bc06d110 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71dc1418b0 0x7f71dc0c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 --2- 172.21.15.8:0/1883628512 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f71c0004d00 0x7f71dc0c34d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:51.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 -- 172.21.15.8:0/1883628512 >> 172.21.15.8:0/1883628512 conn(0x7f71dc0ce4f0 msgr2=0x7f71dc0abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:51.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.769+0000 7f71e1600640 1 -- 172.21.15.8:0/1883628512 shutdown_connections 2024-05-26T15:40:51.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:51.770+0000 7f71e1600640 1 -- 172.21.15.8:0/1883628512 wait complete. 2024-05-26T15:40:51.788 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-26T15:40:52.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.002+0000 7f82e3200640 1 Processor -- start 2024-05-26T15:40:52.001 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.002+0000 7f82e3200640 1 -- start start 2024-05-26T15:40:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.004+0000 7f82e3200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f82e40cdac0 0x7f82e40c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.004+0000 7f82e3200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e40c5840 con 0x7f82e41550f0 2024-05-26T15:40:52.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.004+0000 7f82e3200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e406aa20 con 0x7f82e406d940 2024-05-26T15:40:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.004+0000 7f82e3200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e415ae80 con 0x7f82e40cdac0 2024-05-26T15:40:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.004+0000 7f82e1e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f82e41550f0 0x7f82e415b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36596/0 (socket says 172.21.15.8:36596) 2024-05-26T15:40:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.004+0000 7f82e1e00640 1 -- 172.21.15.8:0/1986687530 learned_addr learned my addr 172.21.15.8:0/1986687530 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:52.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.005+0000 7f82e2800640 1 --2- 172.21.15.8:0/1986687530 >> v2:172.21.15.47:3300/0 conn(0x7f82e40cdac0 0x7f82e40c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.005+0000 7f82e1400640 1 -- 172.21.15.8:0/1986687530 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996234009 0 0) 0x7f82d4001490 con 0x7f82e41550f0 2024-05-26T15:40:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.005+0000 7f82e1400640 1 -- 172.21.15.8:0/1986687530 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c8003520 con 0x7f82e41550f0 2024-05-26T15:40:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.006+0000 7f82e2800640 1 -- 172.21.15.8:0/1986687530 >> v1:172.21.15.47:6789/0 conn(0x7f82e406d940 legacy=0x7f82e40cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.006+0000 7f82e1400640 1 -- 172.21.15.8:0/1986687530 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2217408138 0 0) 0x7f82c8003520 con 0x7f82e41550f0 2024-05-26T15:40:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.006+0000 7f82e2800640 1 -- 172.21.15.8:0/1986687530 >> v1:172.21.15.8:6789/0 conn(0x7f82e41550f0 legacy=0x7f82e415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.006+0000 7f82e2800640 1 -- 172.21.15.8:0/1986687530 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e40c5280 con 0x7f82e40cdac0 2024-05-26T15:40:52.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.007+0000 7f82e2800640 1 --2- 172.21.15.8:0/1986687530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40cdac0 0x7f82e40c4b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0097a0 tx=0x7f82dc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65429ebe5c7ecd08 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.008+0000 7f82e1400640 1 -- 172.21.15.8:0/1986687530 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc032440 con 0x7f82e40cdac0 2024-05-26T15:40:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.008+0000 7f82e1400640 1 -- 172.21.15.8:0/1986687530 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc0325a0 con 0x7f82e40cdac0 2024-05-26T15:40:52.006 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.008+0000 7f82e1400640 1 -- 172.21.15.8:0/1986687530 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc032930 con 0x7f82e40cdac0 2024-05-26T15:40:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.008+0000 7f82e3200640 1 -- 172.21.15.8:0/1986687530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40cdac0 msgr2=0x7f82e40c4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.008+0000 7f82e3200640 1 --2- 172.21.15.8:0/1986687530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40cdac0 0x7f82e40c4b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0097a0 tx=0x7f82dc02a230 comp rx=0 tx=0).stop 2024-05-26T15:40:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.009+0000 7f82e3200640 1 -- 172.21.15.8:0/1986687530 shutdown_connections 2024-05-26T15:40:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.009+0000 7f82e3200640 1 --2- 172.21.15.8:0/1986687530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e40cdac0 0x7f82e40c4b30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.009+0000 7f82e3200640 1 -- 172.21.15.8:0/1986687530 >> 172.21.15.8:0/1986687530 conn(0x7f82e40662e0 msgr2=0x7f82e4069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.009+0000 7f82e3200640 1 -- 172.21.15.8:0/1986687530 shutdown_connections 2024-05-26T15:40:52.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.009+0000 7f82e3200640 1 -- 172.21.15.8:0/1986687530 wait complete. 2024-05-26T15:40:52.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.011+0000 7f82e3200640 1 Processor -- start 2024-05-26T15:40:52.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.011+0000 7f82e3200640 1 -- start start 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82e3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e406d940 0x7f82e41436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82e3200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e40cdac0 0x7f82e40c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82e3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e41550f0 0x7f82e40c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82e3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4144000 con 0x7f82e41550f0 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82e3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e415eaa0 con 0x7f82e406d940 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82e3200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e41442a0 con 0x7f82e40cdac0 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82e2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e41550f0 0x7f82e40c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82e2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e41550f0 0x7f82e40c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42092/0 (socket says 172.21.15.8:42092) 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82e2800640 1 -- 172.21.15.8:0/3640616364 learned_addr learned my addr 172.21.15.8:0/3640616364 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82e1e00640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e406d940 0x7f82e41436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.012+0000 7f82d9400640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e40cdac0 0x7f82e40c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.013+0000 7f82e2800640 1 -- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e40cdac0 msgr2=0x7f82e40c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.013+0000 7f82e2800640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e40cdac0 0x7f82e40c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.013+0000 7f82e2800640 1 -- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e406d940 msgr2=0x7f82e41436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.013+0000 7f82e2800640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e406d940 0x7f82e41436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.013+0000 7f82e2800640 1 -- 172.21.15.8:0/3640616364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc009400 con 0x7f82e41550f0 2024-05-26T15:40:52.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.013+0000 7f82e2800640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e41550f0 0x7f82e40c9c20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82dc035040 tx=0x7f82dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:52.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.013+0000 7f82daa00640 1 -- 172.21.15.8:0/3640616364 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc004230 con 0x7f82e41550f0 2024-05-26T15:40:52.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.013+0000 7f82daa00640 1 -- 172.21.15.8:0/3640616364 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc032e90 con 0x7f82e41550f0 2024-05-26T15:40:52.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.013+0000 7f82daa00640 1 -- 172.21.15.8:0/3640616364 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc006e10 con 0x7f82e41550f0 2024-05-26T15:40:52.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.013+0000 7f82e3200640 1 -- 172.21.15.8:0/3640616364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e4144580 con 0x7f82e41550f0 2024-05-26T15:40:52.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.014+0000 7f82e3200640 1 -- 172.21.15.8:0/3640616364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e40c6d40 con 0x7f82e41550f0 2024-05-26T15:40:52.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.015+0000 7f82e3200640 1 -- 172.21.15.8:0/3640616364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e4144aa0 con 0x7f82e41550f0 2024-05-26T15:40:52.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.016+0000 7f82daa00640 1 -- 172.21.15.8:0/3640616364 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f82dc039040 con 0x7f82e41550f0 2024-05-26T15:40:52.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.016+0000 7f82daa00640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac00 0x7f82c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.017+0000 7f82daa00640 1 -- 172.21.15.8:0/3640616364 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f82dc0aa1a0 con 0x7f82e41550f0 2024-05-26T15:40:52.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.017+0000 7f82e1e00640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac00 0x7f82c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.018+0000 7f82e1e00640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac00 0x7f82c006d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f82d40016f0 tx=0x7f82d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:52.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.024+0000 7f82daa00640 1 -- 172.21.15.8:0/3640616364 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f82e4144aa0 con 0x7f82e41550f0 2024-05-26T15:40:52.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.249+0000 7f82e3200640 1 -- 172.21.15.8:0/3640616364 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82e4144aa0 con 0x7f82e41550f0 2024-05-26T15:40:52.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.250+0000 7f82daa00640 1 -- 172.21.15.8:0/3640616364 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f82e4144aa0 con 0x7f82e41550f0 2024-05-26T15:40:52.248 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2024-05-26T15:40:52.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 -- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac00 msgr2=0x7f82c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac00 0x7f82c006d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f82d40016f0 tx=0x7f82d4009040 comp rx=0 tx=0).stop 2024-05-26T15:40:52.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 -- 172.21.15.8:0/3640616364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e41550f0 msgr2=0x7f82e40c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e41550f0 0x7f82e40c9c20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82dc035040 tx=0x7f82dc0046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 -- 172.21.15.8:0/3640616364 shutdown_connections 2024-05-26T15:40:52.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e41550f0 0x7f82e40c9c20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e40cdac0 0x7f82e40c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac00 0x7f82c006d0c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 --2- 172.21.15.8:0/3640616364 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e406d940 0x7f82e41436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 -- 172.21.15.8:0/3640616364 >> 172.21.15.8:0/3640616364 conn(0x7f82e40662e0 msgr2=0x7f82e40b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:52.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 -- 172.21.15.8:0/3640616364 shutdown_connections 2024-05-26T15:40:52.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.253+0000 7f82e3200640 1 -- 172.21.15.8:0/3640616364 wait complete. 2024-05-26T15:40:52.271 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-26T15:40:52.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:52.271 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-26T15:40:52.354 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:40:52.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:52.354 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-26T15:40:52.398 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:40:52.398 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:52.461 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:40:52.461 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:52.516 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:40:52.516 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:40:52.573 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:52.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.798+0000 7f2072e00640 1 Processor -- start 2024-05-26T15:40:52.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.798+0000 7f2072e00640 1 -- start start 2024-05-26T15:40:52.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.800+0000 7f2072e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f206c0b0f60 0x7f206c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.800+0000 7f2072e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f206c15f0c0 0x7f206c0c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.800+0000 7f2072e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c15b640 con 0x7f206c154f50 2024-05-26T15:40:52.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.800+0000 7f2072e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c15bee0 con 0x7f206c0b0f60 2024-05-26T15:40:52.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.800+0000 7f2072e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0b0ba0 con 0x7f206c15f0c0 2024-05-26T15:40:52.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.800+0000 7f2071a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f206c154f50 0x7f206c15ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36612/0 (socket says 172.21.15.8:36612) 2024-05-26T15:40:52.799 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.800+0000 7f2071a00640 1 -- 172.21.15.8:0/1095274194 learned_addr learned my addr 172.21.15.8:0/1095274194 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:52.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912521665 0 0) 0x7f206c15b640 con 0x7f206c154f50 2024-05-26T15:40:52.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2054003520 con 0x7f206c154f50 2024-05-26T15:40:52.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f2072400640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f206c15f0c0 0x7f206c0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f2071000640 1 --2- 172.21.15.8:0/1095274194 >> v2:172.21.15.47:3300/0 conn(0x7f206c0b0f60 0x7f206c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3471959268 0 0) 0x7f2054003520 con 0x7f206c154f50 2024-05-26T15:40:52.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f206c15f0c0 msgr2=0x7f206c0c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:52.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f206c15f0c0 0x7f206c0c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 >> v2:172.21.15.47:3300/0 conn(0x7f206c0b0f60 msgr2=0x7f206c15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:52.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 --2- 172.21.15.8:0/1095274194 >> v2:172.21.15.47:3300/0 conn(0x7f206c0b0f60 0x7f206c15eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c15b920 con 0x7f206c154f50 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f2060001670 con 0x7f206c154f50 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 >> v1:172.21.15.8:6789/0 conn(0x7f206c154f50 legacy=0x7f206c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20540039a0 0x7f2054003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20540047c0 0x7f2054004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2054005180 0x7f205400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15bee0 con 0x7f20540047c0 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205400c0b0 con 0x7f20540039a0 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205400c270 con 0x7f2054005180 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f2072400640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f206c15f0c0 0x7f206c0c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.801+0000 7f2071000640 1 --2- 172.21.15.8:0/1095274194 >> v2:172.21.15.47:3300/0 conn(0x7f206c0b0f60 0x7f206c15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.802+0000 7f2071000640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20540047c0 0x7f2054004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.802 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.802+0000 7f2071a00640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20540039a0 0x7f2054003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.802+0000 7f2071000640 1 -- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2054005180 msgr2=0x7f205400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.802+0000 7f2071000640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2054005180 0x7f205400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.802+0000 7f2071000640 1 -- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20540039a0 msgr2=0x7f2054003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.802+0000 7f2071000640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20540039a0 0x7f2054003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.802+0000 7f2071000640 1 -- 172.21.15.8:0/1095274194 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054003520 con 0x7f20540047c0 2024-05-26T15:40:52.803 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.802+0000 7f2071a00640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20540039a0 0x7f2054003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.803+0000 7f2071000640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20540047c0 0x7f2054004c40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f20580098a0 tx=0x7f20540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e93132a595413dd server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.804+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205802ad20 con 0x7f20540047c0 2024-05-26T15:40:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.804+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205802ae80 con 0x7f20540047c0 2024-05-26T15:40:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.804+0000 7f206be00640 1 -- 172.21.15.8:0/1095274194 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058032640 con 0x7f20540047c0 2024-05-26T15:40:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.804+0000 7f2072e00640 1 -- 172.21.15.8:0/1095274194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20540047c0 msgr2=0x7f2054004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.804+0000 7f2072e00640 1 --2- 172.21.15.8:0/1095274194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f20540047c0 0x7f2054004c40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f20580098a0 tx=0x7f20540057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.804+0000 7f2072400640 1 -- 172.21.15.8:0/1095274194 reap_dead start 2024-05-26T15:40:52.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.804+0000 7f2072e00640 1 -- 172.21.15.8:0/1095274194 shutdown_connections 2024-05-26T15:40:52.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.804+0000 7f2072e00640 1 -- 172.21.15.8:0/1095274194 >> 172.21.15.8:0/1095274194 conn(0x7f206c070480 msgr2=0x7f206c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:52.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.804+0000 7f2072e00640 1 -- 172.21.15.8:0/1095274194 shutdown_connections 2024-05-26T15:40:52.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.804+0000 7f2072e00640 1 -- 172.21.15.8:0/1095274194 wait complete. 2024-05-26T15:40:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.806+0000 7f2072e00640 1 Processor -- start 2024-05-26T15:40:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.806+0000 7f2072e00640 1 -- start start 2024-05-26T15:40:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.807+0000 7f2072e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20540047c0 0x7f206c0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.807+0000 7f2072e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f206c0c9870 0x7f206c1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.807+0000 7f2072e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159e00 0x7f206c13ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.807+0000 7f2072e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c15a280 con 0x7f206c159e00 2024-05-26T15:40:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.807+0000 7f2072e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0cdcc0 con 0x7f20540047c0 2024-05-26T15:40:52.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.807+0000 7f2072e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c13dbc0 con 0x7f206c0c9870 2024-05-26T15:40:52.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.808+0000 7f2072400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159e00 0x7f206c13ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.808+0000 7f2072400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159e00 0x7f206c13ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42108/0 (socket says 172.21.15.8:42108) 2024-05-26T15:40:52.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.808+0000 7f2072400640 1 -- 172.21.15.8:0/1060148276 learned_addr learned my addr 172.21.15.8:0/1060148276 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:52.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.808+0000 7f2071000640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f206c0c9870 0x7f206c1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.808+0000 7f2071a00640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20540047c0 0x7f206c0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.808+0000 7f2072400640 1 -- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f206c0c9870 msgr2=0x7f206c1598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.808+0000 7f2072400640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f206c0c9870 0x7f206c1598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.808+0000 7f2072400640 1 -- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20540047c0 msgr2=0x7f206c0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:52.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.808+0000 7f2072400640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20540047c0 0x7f206c0cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:52.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.808+0000 7f2072400640 1 -- 172.21.15.8:0/1060148276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c0c8ab0 con 0x7f206c159e00 2024-05-26T15:40:52.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.809+0000 7f2072400640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159e00 0x7f206c13ce90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f206c0b1800 tx=0x7f206400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:52.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.809+0000 7f2069600640 1 -- 172.21.15.8:0/1060148276 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206400dc90 con 0x7f206c159e00 2024-05-26T15:40:52.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.809+0000 7f2069600640 1 -- 172.21.15.8:0/1060148276 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206400f040 con 0x7f206c159e00 2024-05-26T15:40:52.808 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.809+0000 7f2069600640 1 -- 172.21.15.8:0/1060148276 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064003990 con 0x7f206c159e00 2024-05-26T15:40:52.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.809+0000 7f2072e00640 1 -- 172.21.15.8:0/1060148276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c0c8d90 con 0x7f206c159e00 2024-05-26T15:40:52.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.809+0000 7f2072e00640 1 -- 172.21.15.8:0/1060148276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c0c9350 con 0x7f206c159e00 2024-05-26T15:40:52.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.810+0000 7f2072e00640 1 -- 172.21.15.8:0/1060148276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c04e280 con 0x7f206c159e00 2024-05-26T15:40:52.809 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.811+0000 7f2069600640 1 -- 172.21.15.8:0/1060148276 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2064003af0 con 0x7f206c159e00 2024-05-26T15:40:52.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.812+0000 7f2069600640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f204c06ac30 0x7f204c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:52.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.812+0000 7f2069600640 1 -- 172.21.15.8:0/1060148276 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2064089570 con 0x7f206c159e00 2024-05-26T15:40:52.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.813+0000 7f2071a00640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f204c06ac30 0x7f204c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:52.812 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.814+0000 7f2071a00640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f204c06ac30 0x7f204c06d0f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20600078d0 tx=0x7f2060009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:52.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:52.816+0000 7f2069600640 1 -- 172.21.15.8:0/1060148276 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2064054370 con 0x7f206c159e00 2024-05-26T15:40:53.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.022+0000 7f2072e00640 1 -- 172.21.15.8:0/1060148276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f206c0714a0 con 0x7f206c159e00 2024-05-26T15:40:53.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.024+0000 7f2069600640 1 -- 172.21.15.8:0/1060148276 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7f2064057990 con 0x7f206c159e00 2024-05-26T15:40:53.023 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:53.023 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:53.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 -- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f204c06ac30 msgr2=0x7f204c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f204c06ac30 0x7f204c06d0f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20600078d0 tx=0x7f2060009040 comp rx=0 tx=0).stop 2024-05-26T15:40:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 -- 172.21.15.8:0/1060148276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159e00 msgr2=0x7f206c13ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159e00 0x7f206c13ce90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f206c0b1800 tx=0x7f206400d4a0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 -- 172.21.15.8:0/1060148276 shutdown_connections 2024-05-26T15:40:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f206c159e00 0x7f206c13ce90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f206c0c9870 0x7f206c1598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f204c06ac30 0x7f204c06d0f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 --2- 172.21.15.8:0/1060148276 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f20540047c0 0x7f206c0cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 -- 172.21.15.8:0/1060148276 >> 172.21.15.8:0/1060148276 conn(0x7f206c070480 msgr2=0x7f206c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 -- 172.21.15.8:0/1060148276 shutdown_connections 2024-05-26T15:40:53.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.027+0000 7f2072e00640 1 -- 172.21.15.8:0/1060148276 wait complete. 2024-05-26T15:40:53.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:53.048 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:53.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.268+0000 7f3dcec00640 1 Processor -- start 2024-05-26T15:40:53.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.268+0000 7f3dcec00640 1 -- start start 2024-05-26T15:40:53.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.270+0000 7f3dcec00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3dc80b4cd0 0x7f3dc806b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.270+0000 7f3dcec00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3dc80b5d70 0x7f3dc806b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.270+0000 7f3dcec00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc806bde0 con 0x7f3dc815cba0 2024-05-26T15:40:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.270+0000 7f3dcec00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc806c330 con 0x7f3dc80b5d70 2024-05-26T15:40:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.270+0000 7f3dcec00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc80d1570 con 0x7f3dc80b4cd0 2024-05-26T15:40:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.270+0000 7f3dccc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3dc80b5d70 0x7f3dc806b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.270+0000 7f3dc7e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3dc815cba0 0x7f3dc80b45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36624/0 (socket says 172.21.15.8:36624) 2024-05-26T15:40:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.270+0000 7f3dc7e00640 1 -- 172.21.15.8:0/3374410881 learned_addr learned my addr 172.21.15.8:0/3374410881 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:53.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.271+0000 7f3dc7400640 1 --2- 172.21.15.8:0/3374410881 >> v2:172.21.15.47:3300/0 conn(0x7f3dc80b4cd0 0x7f3dc806b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.271+0000 7f3dccc00640 1 -- 172.21.15.8:0/3374410881 >> v2:172.21.15.47:3300/0 conn(0x7f3dc80b4cd0 msgr2=0x7f3dc806b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.271+0000 7f3dccc00640 1 --2- 172.21.15.8:0/3374410881 >> v2:172.21.15.47:3300/0 conn(0x7f3dc80b4cd0 0x7f3dc806b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.271+0000 7f3dccc00640 1 -- 172.21.15.8:0/3374410881 >> v1:172.21.15.8:6789/0 conn(0x7f3dc815cba0 legacy=0x7f3dc80b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.271+0000 7f3dccc00640 1 -- 172.21.15.8:0/3374410881 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc806c050 con 0x7f3dc80b5d70 2024-05-26T15:40:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.272+0000 7f3dccc00640 1 --2- 172.21.15.8:0/3374410881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80b5d70 0x7f3dc806b8a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3dc806a7f0 tx=0x7f3dc002a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d5fb03b94e04a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.272+0000 7f3dc6a00640 1 -- 172.21.15.8:0/3374410881 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0007740 con 0x7f3dc80b5d70 2024-05-26T15:40:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.272+0000 7f3dc6a00640 1 -- 172.21.15.8:0/3374410881 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc002d050 con 0x7f3dc80b5d70 2024-05-26T15:40:53.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.272+0000 7f3dc6a00640 1 -- 172.21.15.8:0/3374410881 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0007ac0 con 0x7f3dc80b5d70 2024-05-26T15:40:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.273+0000 7f3dcec00640 1 -- 172.21.15.8:0/3374410881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80b5d70 msgr2=0x7f3dc806b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.273+0000 7f3dcec00640 1 --2- 172.21.15.8:0/3374410881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80b5d70 0x7f3dc806b8a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3dc806a7f0 tx=0x7f3dc002a4e0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.273+0000 7f3dcec00640 1 -- 172.21.15.8:0/3374410881 shutdown_connections 2024-05-26T15:40:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.273+0000 7f3dcec00640 1 --2- 172.21.15.8:0/3374410881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc80b5d70 0x7f3dc806b8a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.273+0000 7f3dcec00640 1 --2- 172.21.15.8:0/3374410881 >> v2:172.21.15.47:3300/0 conn(0x7f3dc80b4cd0 0x7f3dc806b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.273+0000 7f3dcec00640 1 -- 172.21.15.8:0/3374410881 >> 172.21.15.8:0/3374410881 conn(0x7f3dc80cf5c0 msgr2=0x7f3dc80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.273+0000 7f3dcec00640 1 -- 172.21.15.8:0/3374410881 shutdown_connections 2024-05-26T15:40:53.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.273+0000 7f3dcec00640 1 -- 172.21.15.8:0/3374410881 wait complete. 2024-05-26T15:40:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.275+0000 7f3dcec00640 1 Processor -- start 2024-05-26T15:40:53.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.275+0000 7f3dcec00640 1 -- start start 2024-05-26T15:40:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.276+0000 7f3dcec00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3dc80b4cd0 0x7f3dc80cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.276+0000 7f3dcec00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc80b5d70 0x7f3dc81f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.276+0000 7f3dcec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc815cba0 0x7f3dc80c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.276+0000 7f3dcec00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc815dd60 con 0x7f3dc815cba0 2024-05-26T15:40:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.276+0000 7f3dcec00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc815d7a0 con 0x7f3dc80b5d70 2024-05-26T15:40:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.276+0000 7f3dcec00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc815da80 con 0x7f3dc80b4cd0 2024-05-26T15:40:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.276+0000 7f3dccc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc815cba0 0x7f3dc80c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.276+0000 7f3dccc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc815cba0 0x7f3dc80c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42130/0 (socket says 172.21.15.8:42130) 2024-05-26T15:40:53.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.276+0000 7f3dccc00640 1 -- 172.21.15.8:0/3532121804 learned_addr learned my addr 172.21.15.8:0/3532121804 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.277+0000 7f3dc7400640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc80b5d70 0x7f3dc81f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.277+0000 7f3dc7e00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3dc80b4cd0 0x7f3dc80cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.277+0000 7f3dccc00640 1 -- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3dc80b4cd0 msgr2=0x7f3dc80cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.277+0000 7f3dccc00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3dc80b4cd0 0x7f3dc80cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.277+0000 7f3dccc00640 1 -- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc80b5d70 msgr2=0x7f3dc81f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.277+0000 7f3dccc00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc80b5d70 0x7f3dc81f1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.277+0000 7f3dccc00640 1 -- 172.21.15.8:0/3532121804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc0009a70 con 0x7f3dc815cba0 2024-05-26T15:40:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.277+0000 7f3dc7400640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc80b5d70 0x7f3dc81f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:53.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.277+0000 7f3dc7e00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3dc80b4cd0 0x7f3dc80cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.277+0000 7f3dccc00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc815cba0 0x7f3dc80c7670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3dc002aad0 tx=0x7f3dc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.278+0000 7f3dbfe00640 1 -- 172.21.15.8:0/3532121804 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0003b90 con 0x7f3dc815cba0 2024-05-26T15:40:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.278+0000 7f3dbfe00640 1 -- 172.21.15.8:0/3532121804 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc0003cf0 con 0x7f3dc815cba0 2024-05-26T15:40:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.278+0000 7f3dcec00640 1 -- 172.21.15.8:0/3532121804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc80cc290 con 0x7f3dc815cba0 2024-05-26T15:40:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.278+0000 7f3dbfe00640 1 -- 172.21.15.8:0/3532121804 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc003c8f0 con 0x7f3dc815cba0 2024-05-26T15:40:53.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.278+0000 7f3dcec00640 1 -- 172.21.15.8:0/3532121804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc8160300 con 0x7f3dc815cba0 2024-05-26T15:40:53.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.279+0000 7f3dcec00640 1 -- 172.21.15.8:0/3532121804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc80cc4d0 con 0x7f3dc815cba0 2024-05-26T15:40:53.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.280+0000 7f3dbfe00640 1 -- 172.21.15.8:0/3532121804 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3dc003ca50 con 0x7f3dc815cba0 2024-05-26T15:40:53.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.281+0000 7f3dbfe00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3da406ac00 0x7f3da406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.281+0000 7f3dbfe00640 1 -- 172.21.15.8:0/3532121804 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3dc00ab080 con 0x7f3dc815cba0 2024-05-26T15:40:53.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.282+0000 7f3dc7e00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3da406ac00 0x7f3da406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.283+0000 7f3dc7e00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3da406ac00 0x7f3da406d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3db8000f60 tx=0x7f3db8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:53.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.285+0000 7f3dbfe00640 1 -- 172.21.15.8:0/3532121804 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3dc00de900 con 0x7f3dc815cba0 2024-05-26T15:40:53.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.483+0000 7f3dcec00640 1 -- 172.21.15.8:0/3532121804 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3dc804e210 con 0x7f3dc815cba0 2024-05-26T15:40:53.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.484+0000 7f3dbfe00640 1 -- 172.21.15.8:0/3532121804 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3dc00400a0 con 0x7f3dc815cba0 2024-05-26T15:40:53.483 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:53.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 -- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3da406ac00 msgr2=0x7f3da406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3da406ac00 0x7f3da406d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3db8000f60 tx=0x7f3db8009040 comp rx=0 tx=0).stop 2024-05-26T15:40:53.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 -- 172.21.15.8:0/3532121804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc815cba0 msgr2=0x7f3dc80c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc815cba0 0x7f3dc80c7670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3dc002aad0 tx=0x7f3dc0004a40 comp rx=0 tx=0).stop 2024-05-26T15:40:53.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 -- 172.21.15.8:0/3532121804 shutdown_connections 2024-05-26T15:40:53.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3dc815cba0 0x7f3dc80c7670 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3da406ac00 0x7f3da406d0c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dc80b5d70 0x7f3dc81f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 --2- 172.21.15.8:0/3532121804 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3dc80b4cd0 0x7f3dc80cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 -- 172.21.15.8:0/3532121804 >> 172.21.15.8:0/3532121804 conn(0x7f3dc80cf5c0 msgr2=0x7f3dc80d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:53.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 -- 172.21.15.8:0/3532121804 shutdown_connections 2024-05-26T15:40:53.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.487+0000 7f3dcec00640 1 -- 172.21.15.8:0/3532121804 wait complete. 2024-05-26T15:40:53.505 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:53.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.709+0000 7f15cf200640 1 Processor -- start 2024-05-26T15:40:53.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.710+0000 7f15cf200640 1 -- start start 2024-05-26T15:40:53.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.711+0000 7f15cf200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f15d015ca00 0x7f15d00d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.711+0000 7f15cf200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f15d00b82c0 0x7f15d00cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.711+0000 7f15cf200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15d00cfe50 0x7f15d00d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.711+0000 7f15cf200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d00d02e0 con 0x7f15d00b82c0 2024-05-26T15:40:53.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.711+0000 7f15cf200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d00d06b0 con 0x7f15d015ca00 2024-05-26T15:40:53.710 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.711+0000 7f15cf200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00d12b0 con 0x7f15d00cfe50 2024-05-26T15:40:53.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.712+0000 7f15cd400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f15d00b82c0 0x7f15d00cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.712+0000 7f15cd400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f15d00b82c0 0x7f15d00cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42138/0 (socket says 172.21.15.8:42138) 2024-05-26T15:40:53.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.712+0000 7f15cd400640 1 -- 172.21.15.8:0/1573770114 learned_addr learned my addr 172.21.15.8:0/1573770114 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.712+0000 7f15cde00640 1 --2- 172.21.15.8:0/1573770114 >> v2:172.21.15.47:3300/0 conn(0x7f15d015ca00 0x7f15d00d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.712+0000 7f15ce800640 1 --2- 172.21.15.8:0/1573770114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15d00cfe50 0x7f15d00d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.712+0000 7f15cd400640 1 -- 172.21.15.8:0/1573770114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15d00cfe50 msgr2=0x7f15d00d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.712+0000 7f15cd400640 1 --2- 172.21.15.8:0/1573770114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15d00cfe50 0x7f15d00d28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.712+0000 7f15cd400640 1 -- 172.21.15.8:0/1573770114 >> v2:172.21.15.47:3300/0 conn(0x7f15d015ca00 msgr2=0x7f15d00d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.712+0000 7f15cd400640 1 --2- 172.21.15.8:0/1573770114 >> v2:172.21.15.47:3300/0 conn(0x7f15d015ca00 0x7f15d00d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.712+0000 7f15cd400640 1 -- 172.21.15.8:0/1573770114 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d00d20d0 con 0x7f15d00b82c0 2024-05-26T15:40:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.714+0000 7f15cd400640 1 --2- 172.21.15.8:0/1573770114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d00b82c0 0x7f15d00cf910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f15d00b4710 tx=0x7f15b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3166a8cbd39d48 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:53.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.714+0000 7f15cca00640 1 -- 172.21.15.8:0/1573770114 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8032440 con 0x7f15d00b82c0 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.714+0000 7f15cca00640 1 -- 172.21.15.8:0/1573770114 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b80325a0 con 0x7f15d00b82c0 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.714+0000 7f15cca00640 1 -- 172.21.15.8:0/1573770114 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8032930 con 0x7f15d00b82c0 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.715+0000 7f15cf200640 1 -- 172.21.15.8:0/1573770114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d00b82c0 msgr2=0x7f15d00cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.715+0000 7f15cf200640 1 --2- 172.21.15.8:0/1573770114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d00b82c0 0x7f15d00cf910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f15d00b4710 tx=0x7f15b802a1e0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.715+0000 7f15cf200640 1 -- 172.21.15.8:0/1573770114 shutdown_connections 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.715+0000 7f15cf200640 1 --2- 172.21.15.8:0/1573770114 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15d00cfe50 0x7f15d00d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.715+0000 7f15cf200640 1 --2- 172.21.15.8:0/1573770114 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d00b82c0 0x7f15d00cf910 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.715+0000 7f15cf200640 1 --2- 172.21.15.8:0/1573770114 >> v2:172.21.15.47:3300/0 conn(0x7f15d015ca00 0x7f15d00d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.715+0000 7f15cf200640 1 -- 172.21.15.8:0/1573770114 >> 172.21.15.8:0/1573770114 conn(0x7f15d006b640 msgr2=0x7f15d006ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.715+0000 7f15cf200640 1 -- 172.21.15.8:0/1573770114 shutdown_connections 2024-05-26T15:40:53.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.715+0000 7f15cf200640 1 -- 172.21.15.8:0/1573770114 wait complete. 2024-05-26T15:40:53.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.717+0000 7f15cf200640 1 Processor -- start 2024-05-26T15:40:53.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.717+0000 7f15cf200640 1 -- start start 2024-05-26T15:40:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.718+0000 7f15cf200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d00b82c0 0x7f15d00ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.718+0000 7f15cf200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15d00cfe50 0x7f15d00b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.718+0000 7f15cf200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d015ca00 0x7f15d015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.718+0000 7f15cf200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00b3bc0 con 0x7f15d015ca00 2024-05-26T15:40:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.718+0000 7f15cf200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00a9210 con 0x7f15d00b82c0 2024-05-26T15:40:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.718+0000 7f15cf200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00a9460 con 0x7f15d00cfe50 2024-05-26T15:40:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.718+0000 7f15ce800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d015ca00 0x7f15d015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.718+0000 7f15ce800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d015ca00 0x7f15d015eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42150/0 (socket says 172.21.15.8:42150) 2024-05-26T15:40:53.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.718+0000 7f15ce800640 1 -- 172.21.15.8:0/3684661763 learned_addr learned my addr 172.21.15.8:0/3684661763 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15cde00640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d00b82c0 0x7f15d00ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15cd400640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15d00cfe50 0x7f15d00b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15ce800640 1 -- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15d00cfe50 msgr2=0x7f15d00b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15ce800640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15d00cfe50 0x7f15d00b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15ce800640 1 -- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d00b82c0 msgr2=0x7f15d00ab660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15ce800640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d00b82c0 0x7f15d00ab660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15ce800640 1 -- 172.21.15.8:0/3684661763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80094d0 con 0x7f15d015ca00 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15cde00640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d00b82c0 0x7f15d00ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15ce800640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d015ca00 0x7f15d015eb10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f15c8007e60 tx=0x7f15c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15c6000640 1 -- 172.21.15.8:0/3684661763 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c8014620 con 0x7f15d015ca00 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15c6000640 1 -- 172.21.15.8:0/3684661763 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c800ee90 con 0x7f15d015ca00 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15c6000640 1 -- 172.21.15.8:0/3684661763 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c80149e0 con 0x7f15d015ca00 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.719+0000 7f15cf200640 1 -- 172.21.15.8:0/3684661763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d00a9740 con 0x7f15d015ca00 2024-05-26T15:40:53.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.720+0000 7f15cf200640 1 -- 172.21.15.8:0/3684661763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d00a9d00 con 0x7f15d015ca00 2024-05-26T15:40:53.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.721+0000 7f15cf200640 1 -- 172.21.15.8:0/3684661763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d004e210 con 0x7f15d015ca00 2024-05-26T15:40:53.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.722+0000 7f15c6000640 1 -- 172.21.15.8:0/3684661763 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15c8014b40 con 0x7f15d015ca00 2024-05-26T15:40:53.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.722+0000 7f15c6000640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f15ac06ac00 0x7f15ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:53.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.723+0000 7f15c6000640 1 -- 172.21.15.8:0/3684661763 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f15c808a0a0 con 0x7f15d015ca00 2024-05-26T15:40:53.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.723+0000 7f15cde00640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f15ac06ac00 0x7f15ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:53.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.724+0000 7f15cde00640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f15ac06ac00 0x7f15ac06d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f15c0006fd0 tx=0x7f15c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:53.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.727+0000 7f15c6000640 1 -- 172.21.15.8:0/3684661763 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f15c8054e90 con 0x7f15d015ca00 2024-05-26T15:40:53.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.930+0000 7f15cf200640 1 -- 172.21.15.8:0/3684661763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15d006a190 con 0x7f15d015ca00 2024-05-26T15:40:53.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.931+0000 7f15c6000640 1 -- 172.21.15.8:0/3684661763 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15c80584b0 con 0x7f15d015ca00 2024-05-26T15:40:53.929 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.933+0000 7f15cf200640 1 -- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f15ac06ac00 msgr2=0x7f15ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.933+0000 7f15cf200640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f15ac06ac00 0x7f15ac06d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f15c0006fd0 tx=0x7f15c0008040 comp rx=0 tx=0).stop 2024-05-26T15:40:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.933+0000 7f15cf200640 1 -- 172.21.15.8:0/3684661763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d015ca00 msgr2=0x7f15d015eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.933+0000 7f15cf200640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d015ca00 0x7f15d015eb10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f15c8007e60 tx=0x7f15c800e4b0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.934+0000 7f15cf200640 1 -- 172.21.15.8:0/3684661763 shutdown_connections 2024-05-26T15:40:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.934+0000 7f15cf200640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f15d015ca00 0x7f15d015eb10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.934+0000 7f15cf200640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f15d00cfe50 0x7f15d00b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.934+0000 7f15cf200640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f15ac06ac00 0x7f15ac06d0c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.934+0000 7f15cf200640 1 --2- 172.21.15.8:0/3684661763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d00b82c0 0x7f15d00ab660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:53.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.934+0000 7f15cf200640 1 -- 172.21.15.8:0/3684661763 >> 172.21.15.8:0/3684661763 conn(0x7f15d006b640 msgr2=0x7f15d00d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:53.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.934+0000 7f15cf200640 1 -- 172.21.15.8:0/3684661763 shutdown_connections 2024-05-26T15:40:53.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:53.934+0000 7f15cf200640 1 -- 172.21.15.8:0/3684661763 wait complete. 2024-05-26T15:40:53.951 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:54.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.162+0000 7fa02a000640 1 Processor -- start 2024-05-26T15:40:54.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.162+0000 7fa02a000640 1 -- start start 2024-05-26T15:40:54.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.164+0000 7fa02a000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa0240b0550 0x7fa0240b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.162 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.164+0000 7fa02a000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0240aeec0 con 0x7fa02406a8f0 2024-05-26T15:40:54.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.164+0000 7fa02a000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0240cf200 con 0x7fa0240cb030 2024-05-26T15:40:54.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.164+0000 7fa02a000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0240b0f00 con 0x7fa0240b0550 2024-05-26T15:40:54.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.164+0000 7fa01be00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa02406a8f0 0x7fa0240ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36632/0 (socket says 172.21.15.8:36632) 2024-05-26T15:40:54.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.164+0000 7fa01be00640 1 -- 172.21.15.8:0/563076480 learned_addr learned my addr 172.21.15.8:0/563076480 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:54.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.164+0000 7fa029600640 1 --2- 172.21.15.8:0/563076480 >> v2:172.21.15.8:3300/0 conn(0x7fa0240b0550 0x7fa0240b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:54.163 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.165+0000 7fa023e00640 1 -- 172.21.15.8:0/563076480 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710187095 0 0) 0x7fa0240aeec0 con 0x7fa02406a8f0 2024-05-26T15:40:54.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.165+0000 7fa023e00640 1 -- 172.21.15.8:0/563076480 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa008003520 con 0x7fa02406a8f0 2024-05-26T15:40:54.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.165+0000 7fa029600640 1 -- 172.21.15.8:0/563076480 >> v1:172.21.15.47:6789/0 conn(0x7fa0240cb030 legacy=0x7fa0240afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.165+0000 7fa029600640 1 -- 172.21.15.8:0/563076480 >> v1:172.21.15.8:6789/0 conn(0x7fa02406a8f0 legacy=0x7fa0240ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.165+0000 7fa029600640 1 -- 172.21.15.8:0/563076480 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240af130 con 0x7fa0240b0550 2024-05-26T15:40:54.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.166+0000 7fa029600640 1 --2- 172.21.15.8:0/563076480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 0x7fa0240b09c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009d90 tx=0x7fa01c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82bb8a7fc241241 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:54.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.166+0000 7fa023e00640 1 -- 172.21.15.8:0/563076480 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c007740 con 0x7fa0240b0550 2024-05-26T15:40:54.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.166+0000 7fa023e00640 1 -- 172.21.15.8:0/563076480 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01c02d050 con 0x7fa0240b0550 2024-05-26T15:40:54.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.166+0000 7fa023e00640 1 -- 172.21.15.8:0/563076480 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c007aa0 con 0x7fa0240b0550 2024-05-26T15:40:54.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.167+0000 7fa02a000640 1 -- 172.21.15.8:0/563076480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 msgr2=0x7fa0240b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.167+0000 7fa02a000640 1 --2- 172.21.15.8:0/563076480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 0x7fa0240b09c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009d90 tx=0x7fa01c02a660 comp rx=0 tx=0).stop 2024-05-26T15:40:54.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.167+0000 7fa02a000640 1 -- 172.21.15.8:0/563076480 shutdown_connections 2024-05-26T15:40:54.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.167+0000 7fa02a000640 1 --2- 172.21.15.8:0/563076480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 0x7fa0240b09c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.167+0000 7fa02a000640 1 -- 172.21.15.8:0/563076480 >> 172.21.15.8:0/563076480 conn(0x7fa024098a50 msgr2=0x7fa0240b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:54.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.167+0000 7fa02a000640 1 -- 172.21.15.8:0/563076480 shutdown_connections 2024-05-26T15:40:54.166 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.167+0000 7fa02a000640 1 -- 172.21.15.8:0/563076480 wait complete. 2024-05-26T15:40:54.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.169+0000 7fa02a000640 1 Processor -- start 2024-05-26T15:40:54.167 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.169+0000 7fa02a000640 1 -- start start 2024-05-26T15:40:54.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.170+0000 7fa02a000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa02406a8f0 0x7fa024159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.170+0000 7fa02a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 0x7fa02414b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.170+0000 7fa02a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0240cb030 0x7fa0240cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.170+0000 7fa02a000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02415a760 con 0x7fa0240b0550 2024-05-26T15:40:54.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.170+0000 7fa02a000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02415aa40 con 0x7fa0240cb030 2024-05-26T15:40:54.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.170+0000 7fa02a000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02415ad20 con 0x7fa02406a8f0 2024-05-26T15:40:54.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.170+0000 7fa01be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 0x7fa02414b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:54.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.170+0000 7fa01be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 0x7fa02414b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42180/0 (socket says 172.21.15.8:42180) 2024-05-26T15:40:54.169 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.170+0000 7fa01be00640 1 -- 172.21.15.8:0/719922129 learned_addr learned my addr 172.21.15.8:0/719922129 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:54.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.171+0000 7fa01be00640 1 -- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa02406a8f0 msgr2=0x7fa024159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.171+0000 7fa01be00640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa02406a8f0 0x7fa024159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.171+0000 7fa01be00640 1 -- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0240cb030 msgr2=0x7fa0240cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.170 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.171+0000 7fa01be00640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0240cb030 0x7fa0240cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.171+0000 7fa01be00640 1 -- 172.21.15.8:0/719922129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c009a70 con 0x7fa0240b0550 2024-05-26T15:40:54.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.171+0000 7fa01be00640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 0x7fa02414b910 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c4d0 tx=0x7fa00c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:54.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.171+0000 7fa021600640 1 -- 172.21.15.8:0/719922129 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c005ce0 con 0x7fa0240b0550 2024-05-26T15:40:54.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.172+0000 7fa021600640 1 -- 172.21.15.8:0/719922129 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c005e40 con 0x7fa0240b0550 2024-05-26T15:40:54.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.172+0000 7fa021600640 1 -- 172.21.15.8:0/719922129 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c007270 con 0x7fa0240b0550 2024-05-26T15:40:54.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.172+0000 7fa02a000640 1 -- 172.21.15.8:0/719922129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02415b000 con 0x7fa0240b0550 2024-05-26T15:40:54.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.172+0000 7fa02a000640 1 -- 172.21.15.8:0/719922129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02414be50 con 0x7fa0240b0550 2024-05-26T15:40:54.171 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.173+0000 7fa02a000640 1 -- 172.21.15.8:0/719922129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02415b520 con 0x7fa0240b0550 2024-05-26T15:40:54.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.174+0000 7fa021600640 1 -- 172.21.15.8:0/719922129 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa00c007490 con 0x7fa0240b0550 2024-05-26T15:40:54.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.175+0000 7fa021600640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa00006ac00 0x7fa00006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.173 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.175+0000 7fa021600640 1 -- 172.21.15.8:0/719922129 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa00c088d00 con 0x7fa0240b0550 2024-05-26T15:40:54.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.175+0000 7fa028c00640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa00006ac00 0x7fa00006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:54.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.177+0000 7fa028c00640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa00006ac00 0x7fa00006d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa014000f60 tx=0x7fa0140079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:54.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.180+0000 7fa021600640 1 -- 172.21.15.8:0/719922129 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa02415b520 con 0x7fa0240b0550 2024-05-26T15:40:54.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.383+0000 7fa02a000640 1 -- 172.21.15.8:0/719922129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa02415b520 con 0x7fa0240b0550 2024-05-26T15:40:54.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.384+0000 7fa021600640 1 -- 172.21.15.8:0/719922129 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa02415b520 con 0x7fa0240b0550 2024-05-26T15:40:54.382 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:54.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.386+0000 7fa02a000640 1 -- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa00006ac00 msgr2=0x7fa00006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.386+0000 7fa02a000640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa00006ac00 0x7fa00006d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa014000f60 tx=0x7fa0140079b0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.386+0000 7fa02a000640 1 -- 172.21.15.8:0/719922129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 msgr2=0x7fa02414b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.386+0000 7fa02a000640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 0x7fa02414b910 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c4d0 tx=0x7fa00c00c990 comp rx=0 tx=0).stop 2024-05-26T15:40:54.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.386+0000 7fa02a000640 1 -- 172.21.15.8:0/719922129 shutdown_connections 2024-05-26T15:40:54.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.386+0000 7fa02a000640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa00006ac00 0x7fa00006d0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.386+0000 7fa02a000640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa0240cb030 0x7fa0240cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.386+0000 7fa02a000640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0240b0550 0x7fa02414b910 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.386+0000 7fa02a000640 1 --2- 172.21.15.8:0/719922129 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa02406a8f0 0x7fa024159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.386+0000 7fa02a000640 1 -- 172.21.15.8:0/719922129 >> 172.21.15.8:0/719922129 conn(0x7fa024098a50 msgr2=0x7fa02415f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:54.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.387+0000 7fa02a000640 1 -- 172.21.15.8:0/719922129 shutdown_connections 2024-05-26T15:40:54.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.387+0000 7fa02a000640 1 -- 172.21.15.8:0/719922129 wait complete. 2024-05-26T15:40:54.405 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:54.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.627+0000 7fb097e00640 1 Processor -- start 2024-05-26T15:40:54.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.627+0000 7fb097e00640 1 -- start start 2024-05-26T15:40:54.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.629+0000 7fb097e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb0981599a0 0x7fb09806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.629+0000 7fb097e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0980cd570 con 0x7fb0980b2570 2024-05-26T15:40:54.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.629+0000 7fb097e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb098071180 con 0x7fb09815d300 2024-05-26T15:40:54.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.629+0000 7fb097e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0980cc960 con 0x7fb0981599a0 2024-05-26T15:40:54.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.630+0000 7fb097400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb0980b2570 0x7fb098070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36636/0 (socket says 172.21.15.8:36636) 2024-05-26T15:40:54.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.630+0000 7fb097400640 1 -- 172.21.15.8:0/3097448855 learned_addr learned my addr 172.21.15.8:0/3097448855 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:54.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.630+0000 7fb096a00640 1 --2- 172.21.15.8:0/3097448855 >> v2:172.21.15.47:3300/0 conn(0x7fb0981599a0 0x7fb09806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:54.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.630+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702822500 0 0) 0x7fb0980cd570 con 0x7fb0980b2570 2024-05-26T15:40:54.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.630+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c003520 con 0x7fb0980b2570 2024-05-26T15:40:54.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2432222143 0 0) 0x7fb07c003520 con 0x7fb0980b2570 2024-05-26T15:40:54.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 >> v2:172.21.15.47:3300/0 conn(0x7fb0981599a0 msgr2=0x7fb09806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 --2- 172.21.15.8:0/3097448855 >> v2:172.21.15.47:3300/0 conn(0x7fb0981599a0 0x7fb09806d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 >> v1:172.21.15.47:6789/0 conn(0x7fb09815d300 legacy=0x7fb098070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0980ccc40 con 0x7fb0980b2570 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fb0900019f0 con 0x7fb0980b2570 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 >> v1:172.21.15.8:6789/0 conn(0x7fb0980b2570 legacy=0x7fb098070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 --2- 172.21.15.8:0/3097448855 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb07c003970 0x7fb07c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 --2- 172.21.15.8:0/3097448855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb07c0047c0 0x7fb07c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 --2- 172.21.15.8:0/3097448855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb07c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980cc960 con 0x7fb07c005180 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c00c120 con 0x7fb07c0047c0 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c00c2e0 con 0x7fb07c003970 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.631+0000 7fb097400640 1 --2- 172.21.15.8:0/3097448855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb07c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:54.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.632+0000 7fb096a00640 1 --2- 172.21.15.8:0/3097448855 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb07c003970 0x7fb07c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:54.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.632+0000 7fb097400640 1 -- 172.21.15.8:0/3097448855 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb07c003970 msgr2=0x7fb07c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:54.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.632+0000 7fb097400640 1 --2- 172.21.15.8:0/3097448855 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb07c003970 0x7fb07c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.632+0000 7fb097400640 1 -- 172.21.15.8:0/3097448855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb07c0047c0 msgr2=0x7fb07c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:54.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.632+0000 7fb097400640 1 --2- 172.21.15.8:0/3097448855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb07c0047c0 0x7fb07c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.632+0000 7fb097400640 1 -- 172.21.15.8:0/3097448855 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c003520 con 0x7fb07c005180 2024-05-26T15:40:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.633+0000 7fb097400640 1 -- 172.21.15.8:0/3097448855 reap_dead start 2024-05-26T15:40:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.633+0000 7fb097400640 1 --2- 172.21.15.8:0/3097448855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb07c00b980 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb09000a410 tx=0x7fb07c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ba5382b49b9ab server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.633+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09002dc20 con 0x7fb07c005180 2024-05-26T15:40:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.633+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09002dda0 con 0x7fb07c005180 2024-05-26T15:40:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.633+0000 7fb096000640 1 -- 172.21.15.8:0/3097448855 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0900366b0 con 0x7fb07c005180 2024-05-26T15:40:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.634+0000 7fb097e00640 1 -- 172.21.15.8:0/3097448855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 msgr2=0x7fb07c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.634+0000 7fb097e00640 1 --2- 172.21.15.8:0/3097448855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb07c00b980 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb09000a410 tx=0x7fb07c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.634+0000 7fb097e00640 1 -- 172.21.15.8:0/3097448855 shutdown_connections 2024-05-26T15:40:54.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.634+0000 7fb097e00640 1 --2- 172.21.15.8:0/3097448855 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb07c00b980 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.634+0000 7fb097e00640 1 -- 172.21.15.8:0/3097448855 >> 172.21.15.8:0/3097448855 conn(0x7fb0980ce4f0 msgr2=0x7fb0980ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:54.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.634+0000 7fb097e00640 1 -- 172.21.15.8:0/3097448855 shutdown_connections 2024-05-26T15:40:54.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.634+0000 7fb097e00640 1 -- 172.21.15.8:0/3097448855 wait complete. 2024-05-26T15:40:54.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.636+0000 7fb097e00640 1 Processor -- start 2024-05-26T15:40:54.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.636+0000 7fb097e00640 1 -- start start 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb097e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb098146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb097e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb098147200 0x7fb09815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb097e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb098148910 0x7fb098158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb097e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb098147660 con 0x7fb07c005180 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb097e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09815c910 con 0x7fb098148910 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb097e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb098147870 con 0x7fb098147200 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb096a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb098146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb096a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb098146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42208/0 (socket says 172.21.15.8:42208) 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb096a00640 1 -- 172.21.15.8:0/1092765392 learned_addr learned my addr 172.21.15.8:0/1092765392 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb08e000640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb098147200 0x7fb09815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:54.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb096a00640 1 -- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb098147200 msgr2=0x7fb09815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb096a00640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb098147200 0x7fb09815c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb096a00640 1 -- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb098148910 msgr2=0x7fb098158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.637+0000 7fb096a00640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb098148910 0x7fb098158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.638+0000 7fb096a00640 1 -- 172.21.15.8:0/1092765392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098147b50 con 0x7fb07c005180 2024-05-26T15:40:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.638+0000 7fb096a00640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb098146b50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb088010860 tx=0x7fb088010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.638+0000 7fb08f400640 1 -- 172.21.15.8:0/1092765392 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088009610 con 0x7fb07c005180 2024-05-26T15:40:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.638+0000 7fb08f400640 1 -- 172.21.15.8:0/1092765392 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08800eb60 con 0x7fb07c005180 2024-05-26T15:40:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.638+0000 7fb08f400640 1 -- 172.21.15.8:0/1092765392 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08801c400 con 0x7fb07c005180 2024-05-26T15:40:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.638+0000 7fb097e00640 1 -- 172.21.15.8:0/1092765392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb098147e30 con 0x7fb07c005180 2024-05-26T15:40:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.638+0000 7fb097e00640 1 -- 172.21.15.8:0/1092765392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0981483f0 con 0x7fb07c005180 2024-05-26T15:40:54.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.640+0000 7fb097e00640 1 -- 172.21.15.8:0/1092765392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0980af3e0 con 0x7fb07c005180 2024-05-26T15:40:54.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.641+0000 7fb08f400640 1 -- 172.21.15.8:0/1092765392 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb08801c560 con 0x7fb07c005180 2024-05-26T15:40:54.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.642+0000 7fb08f400640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07406ac30 0x7fb07406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:54.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.642+0000 7fb08f400640 1 -- 172.21.15.8:0/1092765392 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb088089cf0 con 0x7fb07c005180 2024-05-26T15:40:54.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.642+0000 7fb08e000640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07406ac30 0x7fb07406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:54.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.643+0000 7fb08e000640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07406ac30 0x7fb07406d0f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb0981547a0 tx=0x7fb080009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:54.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.646+0000 7fb08f400640 1 -- 172.21.15.8:0/1092765392 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb088054b00 con 0x7fb07c005180 2024-05-26T15:40:54.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.849+0000 7fb097e00640 1 -- 172.21.15.8:0/1092765392 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb09804e210 con 0x7fb07c005180 2024-05-26T15:40:54.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.850+0000 7fb08f400640 1 -- 172.21.15.8:0/1092765392 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb088058120 con 0x7fb07c005180 2024-05-26T15:40:54.848 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.852+0000 7fb097e00640 1 -- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07406ac30 msgr2=0x7fb07406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.852+0000 7fb097e00640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07406ac30 0x7fb07406d0f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb0981547a0 tx=0x7fb080009040 comp rx=0 tx=0).stop 2024-05-26T15:40:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.852+0000 7fb097e00640 1 -- 172.21.15.8:0/1092765392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 msgr2=0x7fb098146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.852+0000 7fb097e00640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb098146b50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb088010860 tx=0x7fb088010d20 comp rx=0 tx=0).stop 2024-05-26T15:40:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.852+0000 7fb097e00640 1 -- 172.21.15.8:0/1092765392 shutdown_connections 2024-05-26T15:40:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.852+0000 7fb097e00640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07406ac30 0x7fb07406d0f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.852+0000 7fb097e00640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb098148910 0x7fb098158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.852+0000 7fb097e00640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb098147200 0x7fb09815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.852+0000 7fb097e00640 1 --2- 172.21.15.8:0/1092765392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb07c005180 0x7fb098146b50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:54.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.852+0000 7fb097e00640 1 -- 172.21.15.8:0/1092765392 >> 172.21.15.8:0/1092765392 conn(0x7fb0980ce4f0 msgr2=0x7fb09815d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:54.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.853+0000 7fb097e00640 1 -- 172.21.15.8:0/1092765392 shutdown_connections 2024-05-26T15:40:54.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:54.853+0000 7fb097e00640 1 -- 172.21.15.8:0/1092765392 wait complete. 2024-05-26T15:40:54.869 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-26T15:40:55.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.078+0000 7f225ae00640 1 Processor -- start 2024-05-26T15:40:55.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.078+0000 7f225ae00640 1 -- start start 2024-05-26T15:40:55.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.080+0000 7f225ae00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f22540cac70 0x7f225406cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.080+0000 7f225ae00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22540c9310 con 0x7f22540b0a50 2024-05-26T15:40:55.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.080+0000 7f225ae00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22540c95f0 con 0x7f225415c960 2024-05-26T15:40:55.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.080+0000 7f225ae00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22540c98d0 con 0x7f22540cac70 2024-05-26T15:40:55.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.081+0000 7f2259000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f22540b0a50 0x7f225406c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36646/0 (socket says 172.21.15.8:36646) 2024-05-26T15:40:55.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.081+0000 7f2259000640 1 -- 172.21.15.8:0/3373422184 learned_addr learned my addr 172.21.15.8:0/3373422184 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:55.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.081+0000 7f225a400640 1 --2- 172.21.15.8:0/3373422184 >> v2:172.21.15.8:3300/0 conn(0x7f22540cac70 0x7f225406cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.081+0000 7f2253e00640 1 -- 172.21.15.8:0/3373422184 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523125783 0 0) 0x7f22540c9310 con 0x7f22540b0a50 2024-05-26T15:40:55.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.081+0000 7f2253e00640 1 -- 172.21.15.8:0/3373422184 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f223c003520 con 0x7f22540b0a50 2024-05-26T15:40:55.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.081+0000 7f225a400640 1 -- 172.21.15.8:0/3373422184 >> v1:172.21.15.47:6789/0 conn(0x7f225415c960 legacy=0x7f22540ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.081+0000 7f225a400640 1 -- 172.21.15.8:0/3373422184 >> v1:172.21.15.8:6789/0 conn(0x7f22540b0a50 legacy=0x7f225406c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.081+0000 7f225a400640 1 -- 172.21.15.8:0/3373422184 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22540c9bb0 con 0x7f22540cac70 2024-05-26T15:40:55.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.083+0000 7f225a400640 1 --2- 172.21.15.8:0/3373422184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 0x7f225406cc00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f224c009d90 tx=0x7f224c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b01c496b631bee server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:55.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.083+0000 7f2253e00640 1 -- 172.21.15.8:0/3373422184 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c007740 con 0x7f22540cac70 2024-05-26T15:40:55.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.083+0000 7f2253e00640 1 -- 172.21.15.8:0/3373422184 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c02d050 con 0x7f22540cac70 2024-05-26T15:40:55.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.083+0000 7f2253e00640 1 -- 172.21.15.8:0/3373422184 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224c007ac0 con 0x7f22540cac70 2024-05-26T15:40:55.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.084+0000 7f225ae00640 1 -- 172.21.15.8:0/3373422184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 msgr2=0x7f225406cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.084+0000 7f225ae00640 1 --2- 172.21.15.8:0/3373422184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 0x7f225406cc00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f224c009d90 tx=0x7f224c02a6f0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.084+0000 7f225ae00640 1 -- 172.21.15.8:0/3373422184 shutdown_connections 2024-05-26T15:40:55.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.084+0000 7f225ae00640 1 --2- 172.21.15.8:0/3373422184 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 0x7f225406cc00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.084+0000 7f225ae00640 1 -- 172.21.15.8:0/3373422184 >> 172.21.15.8:0/3373422184 conn(0x7f22540662e0 msgr2=0x7f2254069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:55.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.084+0000 7f225ae00640 1 -- 172.21.15.8:0/3373422184 shutdown_connections 2024-05-26T15:40:55.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.084+0000 7f225ae00640 1 -- 172.21.15.8:0/3373422184 wait complete. 2024-05-26T15:40:55.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.085+0000 7f225ae00640 1 Processor -- start 2024-05-26T15:40:55.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.086+0000 7f225ae00640 1 -- start start 2024-05-26T15:40:55.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f225ae00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22540b0a50 0x7f2254153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f225ae00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 0x7f22541f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f225ae00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f225415c960 0x7f2254158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f225ae00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225415d240 con 0x7f22540cac70 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f225ae00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225415d520 con 0x7f22540b0a50 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f225ae00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225415d800 con 0x7f225415c960 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f2259000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 0x7f22541f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f2259000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 0x7f22541f3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42228/0 (socket says 172.21.15.8:42228) 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f2259000640 1 -- 172.21.15.8:0/1948009972 learned_addr learned my addr 172.21.15.8:0/1948009972 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f225a400640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f225415c960 0x7f2254158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f2259a00640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22540b0a50 0x7f2254153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f2259000640 1 -- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f225415c960 msgr2=0x7f2254158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f2259000640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f225415c960 0x7f2254158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f2259000640 1 -- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22540b0a50 msgr2=0x7f2254153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f2259000640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22540b0a50 0x7f2254153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f2259000640 1 -- 172.21.15.8:0/1948009972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c009a70 con 0x7f22540cac70 2024-05-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.087+0000 7f2259a00640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22540b0a50 0x7f2254153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.088+0000 7f2259000640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 0x7f22541f3280 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f224000c500 tx=0x7f224000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.088+0000 7f2251600640 1 -- 172.21.15.8:0/1948009972 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240005ce0 con 0x7f22540cac70 2024-05-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.088+0000 7f2251600640 1 -- 172.21.15.8:0/1948009972 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240005e40 con 0x7f22540cac70 2024-05-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.088+0000 7f2251600640 1 -- 172.21.15.8:0/1948009972 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240007330 con 0x7f22540cac70 2024-05-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.088+0000 7f225ae00640 1 -- 172.21.15.8:0/1948009972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225415dae0 con 0x7f22540cac70 2024-05-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.088+0000 7f225ae00640 1 -- 172.21.15.8:0/1948009972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22541f37c0 con 0x7f22540cac70 2024-05-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.089+0000 7f225ae00640 1 -- 172.21.15.8:0/1948009972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225415e000 con 0x7f22540cac70 2024-05-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.090+0000 7f2251600640 1 -- 172.21.15.8:0/1948009972 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2240007550 con 0x7f22540cac70 2024-05-26T15:40:55.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.091+0000 7f2251600640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f223406ac00 0x7f223406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.091+0000 7f2251600640 1 -- 172.21.15.8:0/1948009972 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2240088da0 con 0x7f22540cac70 2024-05-26T15:40:55.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.092+0000 7f2259a00640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f223406ac00 0x7f223406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.093+0000 7f2259a00640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f223406ac00 0x7f223406d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2248000f60 tx=0x7f2248009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:55.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.095+0000 7f2251600640 1 -- 172.21.15.8:0/1948009972 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f225415e000 con 0x7f22540cac70 2024-05-26T15:40:55.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.310+0000 7f225ae00640 1 -- 172.21.15.8:0/1948009972 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f225415e000 con 0x7f22540cac70 2024-05-26T15:40:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.311+0000 7f2251600640 1 -- 172.21.15.8:0/1948009972 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f225415e000 con 0x7f22540cac70 2024-05-26T15:40:55.309 INFO:teuthology.orchestra.run.smithi008.stderr:listed 0 entries 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 -- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f223406ac00 msgr2=0x7f223406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f223406ac00 0x7f223406d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2248000f60 tx=0x7f2248009040 comp rx=0 tx=0).stop 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 -- 172.21.15.8:0/1948009972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 msgr2=0x7f22541f3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 0x7f22541f3280 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f224000c500 tx=0x7f224000c9c0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 -- 172.21.15.8:0/1948009972 shutdown_connections 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f225415c960 0x7f2254158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22540cac70 0x7f22541f3280 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f223406ac00 0x7f223406d0c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 --2- 172.21.15.8:0/1948009972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22540b0a50 0x7f2254153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 -- 172.21.15.8:0/1948009972 >> 172.21.15.8:0/1948009972 conn(0x7f22540662e0 msgr2=0x7f2254156140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 -- 172.21.15.8:0/1948009972 shutdown_connections 2024-05-26T15:40:55.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.314+0000 7f225ae00640 1 -- 172.21.15.8:0/1948009972 wait complete. 2024-05-26T15:40:55.332 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-26T15:40:55.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:55.333 DEBUG:teuthology.orchestra.run.smithi047:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-26T15:40:55.437 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:40:55.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:40:55.437 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-26T15:40:55.487 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-26T15:40:55.487 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:40:55.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.707+0000 7fbf74800640 1 Processor -- start 2024-05-26T15:40:55.706 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.708+0000 7fbf74800640 1 -- start start 2024-05-26T15:40:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.710+0000 7fbf74800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c144530 0x7fbf6c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.710+0000 7fbf74800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6c0b1db0 con 0x7fbf6c070d70 2024-05-26T15:40:55.708 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.710+0000 7fbf74800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6c0cc8f0 con 0x7fbf6c144150 2024-05-26T15:40:55.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.710+0000 7fbf74800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0cbac0 con 0x7fbf6c144530 2024-05-26T15:40:55.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.710+0000 7fbf72800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbf6c070d70 0x7fbf6c0cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36652/0 (socket says 172.21.15.8:36652) 2024-05-26T15:40:55.709 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.710+0000 7fbf72800640 1 -- 172.21.15.8:0/2987950474 learned_addr learned my addr 172.21.15.8:0/2987950474 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:55.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.710+0000 7fbf71400640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c144530 0x7fbf6c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035279628 0 0) 0x7fbf6c0b1db0 con 0x7fbf6c070d70 2024-05-26T15:40:55.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf54003520 con 0x7fbf6c070d70 2024-05-26T15:40:55.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 994641295 0 0) 0x7fbf54003520 con 0x7fbf6c070d70 2024-05-26T15:40:55.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c144530 msgr2=0x7fbf6c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:55.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c144530 0x7fbf6c0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 >> v1:172.21.15.47:6789/0 conn(0x7fbf6c144150 legacy=0x7fbf6c070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c0ccb90 con 0x7fbf6c070d70 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fbf680019f0 con 0x7fbf6c070d70 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf71400640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c144530 0x7fbf6c0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 >> v1:172.21.15.8:6789/0 conn(0x7fbf6c070d70 legacy=0x7fbf6c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf540039a0 0x7fbf54003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf540047c0 0x7fbf54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c144530 0x7fbf54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c0cbac0 con 0x7fbf540047c0 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5400ba80 con 0x7fbf540039a0 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.711+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5400bc40 con 0x7fbf6c144530 2024-05-26T15:40:55.712 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.712+0000 7fbf71400640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf540047c0 0x7fbf54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.712+0000 7fbf71e00640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf540039a0 0x7fbf54003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.712+0000 7fbf72800640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c144530 0x7fbf54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.712+0000 7fbf71400640 1 -- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c144530 msgr2=0x7fbf54005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:55.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.712+0000 7fbf71400640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c144530 0x7fbf54005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.712+0000 7fbf71400640 1 -- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf540039a0 msgr2=0x7fbf54003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:55.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.712+0000 7fbf71400640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf540039a0 0x7fbf54003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.712+0000 7fbf71400640 1 -- 172.21.15.8:0/2987950474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf54003520 con 0x7fbf540047c0 2024-05-26T15:40:55.714 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.713+0000 7fbf71400640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf540047c0 0x7fbf54004c40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0098a0 tx=0x7fbf540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7990b54e309d5922 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.713+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c02ace0 con 0x7fbf540047c0 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.714+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c02ae40 con 0x7fbf540047c0 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.714+0000 7fbf70a00640 1 -- 172.21.15.8:0/2987950474 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c004250 con 0x7fbf540047c0 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.714+0000 7fbf74800640 1 -- 172.21.15.8:0/2987950474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf540047c0 msgr2=0x7fbf54004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.714+0000 7fbf74800640 1 --2- 172.21.15.8:0/2987950474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf540047c0 0x7fbf54004c40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0098a0 tx=0x7fbf540057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.714+0000 7fbf72800640 1 -- 172.21.15.8:0/2987950474 reap_dead start 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.714+0000 7fbf74800640 1 -- 172.21.15.8:0/2987950474 shutdown_connections 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.714+0000 7fbf74800640 1 -- 172.21.15.8:0/2987950474 >> 172.21.15.8:0/2987950474 conn(0x7fbf6c0b0570 msgr2=0x7fbf6c0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.714+0000 7fbf74800640 1 -- 172.21.15.8:0/2987950474 shutdown_connections 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.714+0000 7fbf74800640 1 -- 172.21.15.8:0/2987950474 wait complete. 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.716+0000 7fbf74800640 1 Processor -- start 2024-05-26T15:40:55.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.716+0000 7fbf74800640 1 -- start start 2024-05-26T15:40:55.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.717+0000 7fbf74800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf540047c0 0x7fbf6c1f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.717+0000 7fbf74800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c139c00 0x7fbf6c139450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.717+0000 7fbf74800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf6c13f760 0x7fbf6c13fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.717+0000 7fbf74800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c140120 con 0x7fbf6c13f760 2024-05-26T15:40:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.717+0000 7fbf74800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c13a4a0 con 0x7fbf540047c0 2024-05-26T15:40:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.717+0000 7fbf74800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6c06d580 con 0x7fbf6c139c00 2024-05-26T15:40:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.717+0000 7fbf72800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf6c13f760 0x7fbf6c13fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.717+0000 7fbf72800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf6c13f760 0x7fbf6c13fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42240/0 (socket says 172.21.15.8:42240) 2024-05-26T15:40:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.717+0000 7fbf72800640 1 -- 172.21.15.8:0/591615474 learned_addr learned my addr 172.21.15.8:0/591615474 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf71400640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c139c00 0x7fbf6c139450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf71e00640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf540047c0 0x7fbf6c1f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf72800640 1 -- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c139c00 msgr2=0x7fbf6c139450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf72800640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c139c00 0x7fbf6c139450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf72800640 1 -- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf540047c0 msgr2=0x7fbf6c1f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf72800640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf540047c0 0x7fbf6c1f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf72800640 1 -- 172.21.15.8:0/591615474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6c06cfe0 con 0x7fbf6c13f760 2024-05-26T15:40:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf71e00640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf540047c0 0x7fbf6c1f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf72800640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf6c13f760 0x7fbf6c13fbe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbf68007960 tx=0x7fbf6800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf66000640 1 -- 172.21.15.8:0/591615474 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6800ec40 con 0x7fbf6c13f760 2024-05-26T15:40:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf66000640 1 -- 172.21.15.8:0/591615474 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6800eda0 con 0x7fbf6c13f760 2024-05-26T15:40:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf66000640 1 -- 172.21.15.8:0/591615474 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68014670 con 0x7fbf6c13f760 2024-05-26T15:40:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.718+0000 7fbf74800640 1 -- 172.21.15.8:0/591615474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6c06d2a0 con 0x7fbf6c13f760 2024-05-26T15:40:55.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.719+0000 7fbf74800640 1 -- 172.21.15.8:0/591615474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6c0ae480 con 0x7fbf6c13f760 2024-05-26T15:40:55.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.720+0000 7fbf74800640 1 -- 172.21.15.8:0/591615474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6c0681d0 con 0x7fbf6c13f760 2024-05-26T15:40:55.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.721+0000 7fbf66000640 1 -- 172.21.15.8:0/591615474 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbf680149e0 con 0x7fbf6c13f760 2024-05-26T15:40:55.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.722+0000 7fbf66000640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf5006ac00 0x7fbf5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:55.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.722+0000 7fbf66000640 1 -- 172.21.15.8:0/591615474 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbf68089670 con 0x7fbf6c13f760 2024-05-26T15:40:55.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.722+0000 7fbf71e00640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf5006ac00 0x7fbf5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:55.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.724+0000 7fbf71e00640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf5006ac00 0x7fbf5006d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf600035f0 tx=0x7fbf60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:55.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.726+0000 7fbf66000640 1 -- 172.21.15.8:0/591615474 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbf68054530 con 0x7fbf6c13f760 2024-05-26T15:40:55.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.968+0000 7fbf74800640 1 -- 172.21.15.8:0/591615474 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf6c06d750 con 0x7fbf6c13f760 2024-05-26T15:40:55.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.969+0000 7fbf66000640 1 -- 172.21.15.8:0/591615474 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4718 (secure 0 0 0) 0x7fbf68057b50 con 0x7fbf6c13f760 2024-05-26T15:40:55.968 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:55.968 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:39:32.881224+0000","modified":"2024-05-26T15:40:01.486240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-26T15:40:55.968 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2024-05-26T15:40:55.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 -- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf5006ac00 msgr2=0x7fbf5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf5006ac00 0x7fbf5006d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf600035f0 tx=0x7fbf60009040 comp rx=0 tx=0).stop 2024-05-26T15:40:55.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 -- 172.21.15.8:0/591615474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf6c13f760 msgr2=0x7fbf6c13fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:55.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf6c13f760 0x7fbf6c13fbe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbf68007960 tx=0x7fbf6800e530 comp rx=0 tx=0).stop 2024-05-26T15:40:55.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 -- 172.21.15.8:0/591615474 shutdown_connections 2024-05-26T15:40:55.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf6c13f760 0x7fbf6c13fbe0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf6c139c00 0x7fbf6c139450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf5006ac00 0x7fbf5006d0c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 --2- 172.21.15.8:0/591615474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf540047c0 0x7fbf6c1f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:55.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 -- 172.21.15.8:0/591615474 >> 172.21.15.8:0/591615474 conn(0x7fbf6c0b0570 msgr2=0x7fbf6c140840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:55.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 -- 172.21.15.8:0/591615474 shutdown_connections 2024-05-26T15:40:55.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:55.972+0000 7fbf74800640 1 -- 172.21.15.8:0/591615474 wait complete. 2024-05-26T15:40:55.992 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.185+0000 7f239e000640 1 Processor -- start 2024-05-26T15:40:56.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.185+0000 7f239e000640 1 -- start start 2024-05-26T15:40:56.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.186+0000 7f239e000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2398154f50 0x7f23980b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.186+0000 7f239e000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f23980c36c0 0x7f23980c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.186+0000 7f239e000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239815b640 con 0x7f239815ae70 2024-05-26T15:40:56.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.186+0000 7f239e000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239815bee0 con 0x7f2398154f50 2024-05-26T15:40:56.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.186+0000 7f239e000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23980b0ba0 con 0x7f23980c36c0 2024-05-26T15:40:56.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.187+0000 7f239cc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f2398154f50 0x7f23980b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.187+0000 7f2397e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f239815ae70 0x7f239815eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36654/0 (socket says 172.21.15.8:36654) 2024-05-26T15:40:56.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.187+0000 7f2397e00640 1 -- 172.21.15.8:0/2954153437 learned_addr learned my addr 172.21.15.8:0/2954153437 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.187+0000 7f239d600640 1 --2- 172.21.15.8:0/2954153437 >> v2:172.21.15.47:3300/0 conn(0x7f23980c36c0 0x7f23980c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.187+0000 7f239cc00640 1 -- 172.21.15.8:0/2954153437 >> v2:172.21.15.47:3300/0 conn(0x7f23980c36c0 msgr2=0x7f23980c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.187+0000 7f239cc00640 1 --2- 172.21.15.8:0/2954153437 >> v2:172.21.15.47:3300/0 conn(0x7f23980c36c0 0x7f23980c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.187+0000 7f239cc00640 1 -- 172.21.15.8:0/2954153437 >> v1:172.21.15.8:6789/0 conn(0x7f239815ae70 legacy=0x7f239815eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.187+0000 7f239cc00640 1 -- 172.21.15.8:0/2954153437 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239815b920 con 0x7f2398154f50 2024-05-26T15:40:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.188+0000 7f239cc00640 1 --2- 172.21.15.8:0/2954153437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 0x7f23980b0f60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f23980c6990 tx=0x7f238c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce763420aadb1729 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f2397400640 1 -- 172.21.15.8:0/2954153437 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c032440 con 0x7f2398154f50 2024-05-26T15:40:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f2397400640 1 -- 172.21.15.8:0/2954153437 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c0325a0 con 0x7f2398154f50 2024-05-26T15:40:56.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f2397400640 1 -- 172.21.15.8:0/2954153437 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c032930 con 0x7f2398154f50 2024-05-26T15:40:56.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f239e000640 1 -- 172.21.15.8:0/2954153437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 msgr2=0x7f23980b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f239e000640 1 --2- 172.21.15.8:0/2954153437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 0x7f23980b0f60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f23980c6990 tx=0x7f238c02a1a0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f239e000640 1 -- 172.21.15.8:0/2954153437 shutdown_connections 2024-05-26T15:40:56.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f239e000640 1 --2- 172.21.15.8:0/2954153437 >> v2:172.21.15.47:3300/0 conn(0x7f23980c36c0 0x7f23980c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f239e000640 1 --2- 172.21.15.8:0/2954153437 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 0x7f23980b0f60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f239e000640 1 -- 172.21.15.8:0/2954153437 >> 172.21.15.8:0/2954153437 conn(0x7f2398070480 msgr2=0x7f2398070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:56.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f239e000640 1 -- 172.21.15.8:0/2954153437 shutdown_connections 2024-05-26T15:40:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.189+0000 7f239e000640 1 -- 172.21.15.8:0/2954153437 wait complete. 2024-05-26T15:40:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.191+0000 7f239e000640 1 Processor -- start 2024-05-26T15:40:56.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.191+0000 7f239e000640 1 -- start start 2024-05-26T15:40:56.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.192+0000 7f239e000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23980c36c0 0x7f239814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.192+0000 7f239e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 0x7f23980c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.192+0000 7f239e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f239815ae70 0x7f23980cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.192+0000 7f239e000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23980cb920 con 0x7f2398154f50 2024-05-26T15:40:56.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.192+0000 7f239e000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23980cbc00 con 0x7f239815ae70 2024-05-26T15:40:56.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.192+0000 7f239e000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23980cbee0 con 0x7f23980c36c0 2024-05-26T15:40:56.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f2397e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 0x7f23980c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f2397e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 0x7f23980c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42256/0 (socket says 172.21.15.8:42256) 2024-05-26T15:40:56.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f2397e00640 1 -- 172.21.15.8:0/1192988387 learned_addr learned my addr 172.21.15.8:0/1192988387 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:56.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f239cc00640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23980c36c0 0x7f239814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f239d600640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f239815ae70 0x7f23980cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f2397e00640 1 -- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23980c36c0 msgr2=0x7f239814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f2397e00640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23980c36c0 0x7f239814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f2397e00640 1 -- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f239815ae70 msgr2=0x7f23980cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f2397e00640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f239815ae70 0x7f23980cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f2397e00640 1 -- 172.21.15.8:0/1192988387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c009400 con 0x7f2398154f50 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f239cc00640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23980c36c0 0x7f239814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f239d600640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f239815ae70 0x7f23980cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.193+0000 7f2397e00640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 0x7f23980c7500 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f238400c480 tx=0x7f238400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.194+0000 7f2394c00640 1 -- 172.21.15.8:0/1192988387 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384005ce0 con 0x7f2398154f50 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.194+0000 7f2394c00640 1 -- 172.21.15.8:0/1192988387 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384005e40 con 0x7f2398154f50 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.194+0000 7f2394c00640 1 -- 172.21.15.8:0/1192988387 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23840072f0 con 0x7f2398154f50 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.194+0000 7f239e000640 1 -- 172.21.15.8:0/1192988387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23980cc1c0 con 0x7f2398154f50 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.194+0000 7f239e000640 1 -- 172.21.15.8:0/1192988387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239814a560 con 0x7f2398154f50 2024-05-26T15:40:56.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.195+0000 7f239e000640 1 -- 172.21.15.8:0/1192988387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239804e280 con 0x7f2398154f50 2024-05-26T15:40:56.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.196+0000 7f2394c00640 1 -- 172.21.15.8:0/1192988387 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2384007510 con 0x7f2398154f50 2024-05-26T15:40:56.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.197+0000 7f2394c00640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f237806ac00 0x7f237806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.197+0000 7f2394c00640 1 -- 172.21.15.8:0/1192988387 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2384088bf0 con 0x7f2398154f50 2024-05-26T15:40:56.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.198+0000 7f239cc00640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f237806ac00 0x7f237806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.199+0000 7f239cc00640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f237806ac00 0x7f237806d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f238c034000 tx=0x7f238c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:56.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.201+0000 7f2394c00640 1 -- 172.21.15.8:0/1192988387 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2384053a90 con 0x7f2398154f50 2024-05-26T15:40:56.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.402+0000 7f239e000640 1 -- 172.21.15.8:0/1192988387 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23980714a0 con 0x7f2398154f50 2024-05-26T15:40:56.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.404+0000 7f2394c00640 1 -- 172.21.15.8:0/1192988387 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7f2384017020 con 0x7f2398154f50 2024-05-26T15:40:56.403 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:56.403 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 -- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f237806ac00 msgr2=0x7f237806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f237806ac00 0x7f237806d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f238c034000 tx=0x7f238c02e000 comp rx=0 tx=0).stop 2024-05-26T15:40:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 -- 172.21.15.8:0/1192988387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 msgr2=0x7f23980c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 0x7f23980c7500 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f238400c480 tx=0x7f238400c940 comp rx=0 tx=0).stop 2024-05-26T15:40:56.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 -- 172.21.15.8:0/1192988387 shutdown_connections 2024-05-26T15:40:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f237806ac00 0x7f237806d0c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f239815ae70 0x7f23980cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2398154f50 0x7f23980c7500 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 --2- 172.21.15.8:0/1192988387 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f23980c36c0 0x7f239814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 -- 172.21.15.8:0/1192988387 >> 172.21.15.8:0/1192988387 conn(0x7f2398070480 msgr2=0x7f239815d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 -- 172.21.15.8:0/1192988387 shutdown_connections 2024-05-26T15:40:56.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.407+0000 7f239e000640 1 -- 172.21.15.8:0/1192988387 wait complete. 2024-05-26T15:40:56.426 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:39:31.319843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:39:31.879470+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-26T15:39:35.408580+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-26T15:40:56.427 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:40:56.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.640+0000 7fa214400640 1 Processor -- start 2024-05-26T15:40:56.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.640+0000 7fa214400640 1 -- start start 2024-05-26T15:40:56.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.641+0000 7fa214400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa20c1596c0 0x7fa20c06de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.642+0000 7fa214400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa20c0b3350 0x7fa20c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.642+0000 7fa214400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20c0b1620 con 0x7fa20c159aa0 2024-05-26T15:40:56.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.642+0000 7fa214400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20c0b1900 con 0x7fa20c1596c0 2024-05-26T15:40:56.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.642+0000 7fa214400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20c0b1be0 con 0x7fa20c0b3350 2024-05-26T15:40:56.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.642+0000 7fa211000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa20c159aa0 0x7fa20c0b2c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36666/0 (socket says 172.21.15.8:36666) 2024-05-26T15:40:56.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.642+0000 7fa211000640 1 -- 172.21.15.8:0/3510469558 learned_addr learned my addr 172.21.15.8:0/3510469558 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:56.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.642+0000 7fa211a00640 1 --2- 172.21.15.8:0/3510469558 >> v2:172.21.15.8:3300/0 conn(0x7fa20c1596c0 0x7fa20c06de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.642+0000 7fa212400640 1 --2- 172.21.15.8:0/3510469558 >> v2:172.21.15.47:3300/0 conn(0x7fa20c0b3350 0x7fa20c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.642+0000 7fa20be00640 1 -- 172.21.15.8:0/3510469558 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431093693 0 0) 0x7fa20c0b1620 con 0x7fa20c159aa0 2024-05-26T15:40:56.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.643+0000 7fa20be00640 1 -- 172.21.15.8:0/3510469558 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1f4003520 con 0x7fa20c159aa0 2024-05-26T15:40:56.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.643+0000 7fa211a00640 1 -- 172.21.15.8:0/3510469558 >> v2:172.21.15.47:3300/0 conn(0x7fa20c0b3350 msgr2=0x7fa20c06e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:56.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.643+0000 7fa211a00640 1 --2- 172.21.15.8:0/3510469558 >> v2:172.21.15.47:3300/0 conn(0x7fa20c0b3350 0x7fa20c06e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.643+0000 7fa211a00640 1 -- 172.21.15.8:0/3510469558 >> v1:172.21.15.8:6789/0 conn(0x7fa20c159aa0 legacy=0x7fa20c0b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.643+0000 7fa211a00640 1 -- 172.21.15.8:0/3510469558 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c0b1ec0 con 0x7fa20c1596c0 2024-05-26T15:40:56.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.644+0000 7fa211a00640 1 --2- 172.21.15.8:0/3510469558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c1596c0 0x7fa20c06de30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0b2660 tx=0x7fa20002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e0f146367f4bad server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:56.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.644+0000 7fa20be00640 1 -- 172.21.15.8:0/3510469558 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200032440 con 0x7fa20c1596c0 2024-05-26T15:40:56.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.644+0000 7fa20be00640 1 -- 172.21.15.8:0/3510469558 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2000325a0 con 0x7fa20c1596c0 2024-05-26T15:40:56.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.644+0000 7fa20be00640 1 -- 172.21.15.8:0/3510469558 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200032930 con 0x7fa20c1596c0 2024-05-26T15:40:56.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.645+0000 7fa214400640 1 -- 172.21.15.8:0/3510469558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c1596c0 msgr2=0x7fa20c06de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.645+0000 7fa214400640 1 --2- 172.21.15.8:0/3510469558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c1596c0 0x7fa20c06de30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0b2660 tx=0x7fa20002a1a0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.645+0000 7fa214400640 1 -- 172.21.15.8:0/3510469558 shutdown_connections 2024-05-26T15:40:56.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.645+0000 7fa214400640 1 --2- 172.21.15.8:0/3510469558 >> v2:172.21.15.47:3300/0 conn(0x7fa20c0b3350 0x7fa20c06e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.645+0000 7fa214400640 1 --2- 172.21.15.8:0/3510469558 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c1596c0 0x7fa20c06de30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.645+0000 7fa214400640 1 -- 172.21.15.8:0/3510469558 >> 172.21.15.8:0/3510469558 conn(0x7fa20c069e70 msgr2=0x7fa20c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:56.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.645+0000 7fa214400640 1 -- 172.21.15.8:0/3510469558 shutdown_connections 2024-05-26T15:40:56.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.645+0000 7fa214400640 1 -- 172.21.15.8:0/3510469558 wait complete. 2024-05-26T15:40:56.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.647+0000 7fa214400640 1 Processor -- start 2024-05-26T15:40:56.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.647+0000 7fa214400640 1 -- start start 2024-05-26T15:40:56.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.648+0000 7fa214400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b3350 0x7fa20c14f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.648+0000 7fa214400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa20c1596c0 0x7fa20c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.648+0000 7fa214400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c159aa0 0x7fa20c06d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.648+0000 7fa214400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c0a7a00 con 0x7fa20c159aa0 2024-05-26T15:40:56.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.648+0000 7fa214400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c0a7ce0 con 0x7fa20c0b3350 2024-05-26T15:40:56.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.648+0000 7fa214400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c0a7fc0 con 0x7fa20c1596c0 2024-05-26T15:40:56.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa212400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c159aa0 0x7fa20c06d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa212400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c159aa0 0x7fa20c06d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42272/0 (socket says 172.21.15.8:42272) 2024-05-26T15:40:56.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa212400640 1 -- 172.21.15.8:0/871931181 learned_addr learned my addr 172.21.15.8:0/871931181 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa211000640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa20c1596c0 0x7fa20c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa211a00640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b3350 0x7fa20c14f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa212400640 1 -- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa20c1596c0 msgr2=0x7fa20c157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa212400640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa20c1596c0 0x7fa20c157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa212400640 1 -- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b3350 msgr2=0x7fa20c14f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa212400640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b3350 0x7fa20c14f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa212400640 1 -- 172.21.15.8:0/871931181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200009400 con 0x7fa20c159aa0 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa211000640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa20c1596c0 0x7fa20c157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa211a00640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b3350 0x7fa20c14f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.649+0000 7fa212400640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c159aa0 0x7fa20c06d750 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa204007e40 tx=0x7fa20400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.650+0000 7fa209600640 1 -- 172.21.15.8:0/871931181 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204014620 con 0x7fa20c159aa0 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.650+0000 7fa209600640 1 -- 172.21.15.8:0/871931181 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20400ee90 con 0x7fa20c159aa0 2024-05-26T15:40:56.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.650+0000 7fa209600640 1 -- 172.21.15.8:0/871931181 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2040149e0 con 0x7fa20c159aa0 2024-05-26T15:40:56.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.650+0000 7fa214400640 1 -- 172.21.15.8:0/871931181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20c0a82a0 con 0x7fa20c159aa0 2024-05-26T15:40:56.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.650+0000 7fa214400640 1 -- 172.21.15.8:0/871931181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20c14f730 con 0x7fa20c159aa0 2024-05-26T15:40:56.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.651+0000 7fa214400640 1 -- 172.21.15.8:0/871931181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20c04e210 con 0x7fa20c159aa0 2024-05-26T15:40:56.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.652+0000 7fa209600640 1 -- 172.21.15.8:0/871931181 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa204014b40 con 0x7fa20c159aa0 2024-05-26T15:40:56.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.653+0000 7fa209600640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa1ec06ac00 0x7fa1ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:56.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.653+0000 7fa209600640 1 -- 172.21.15.8:0/871931181 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa20408a1b0 con 0x7fa20c159aa0 2024-05-26T15:40:56.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.654+0000 7fa211a00640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa1ec06ac00 0x7fa1ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:56.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.655+0000 7fa211a00640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa1ec06ac00 0x7fa1ec06d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa200034000 tx=0x7fa20002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:56.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.657+0000 7fa209600640 1 -- 172.21.15.8:0/871931181 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa204054f10 con 0x7fa20c159aa0 2024-05-26T15:40:56.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.854+0000 7fa214400640 1 -- 172.21.15.8:0/871931181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa20c0cf140 con 0x7fa20c159aa0 2024-05-26T15:40:56.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.855+0000 7fa209600640 1 -- 172.21.15.8:0/871931181 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa204058530 con 0x7fa20c159aa0 2024-05-26T15:40:56.853 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:40:56.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.857+0000 7fa214400640 1 -- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa1ec06ac00 msgr2=0x7fa1ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.857+0000 7fa214400640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa1ec06ac00 0x7fa1ec06d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa200034000 tx=0x7fa20002e000 comp rx=0 tx=0).stop 2024-05-26T15:40:56.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.857+0000 7fa214400640 1 -- 172.21.15.8:0/871931181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c159aa0 msgr2=0x7fa20c06d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:56.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.857+0000 7fa214400640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c159aa0 0x7fa20c06d750 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa204007e40 tx=0x7fa20400e4b0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.858+0000 7fa214400640 1 -- 172.21.15.8:0/871931181 shutdown_connections 2024-05-26T15:40:56.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.858+0000 7fa214400640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa20c159aa0 0x7fa20c06d750 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.858+0000 7fa214400640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa20c1596c0 0x7fa20c157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.858+0000 7fa214400640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa1ec06ac00 0x7fa1ec06d0c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.858+0000 7fa214400640 1 --2- 172.21.15.8:0/871931181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa20c0b3350 0x7fa20c14f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:56.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.858+0000 7fa214400640 1 -- 172.21.15.8:0/871931181 >> 172.21.15.8:0/871931181 conn(0x7fa20c069e70 msgr2=0x7fa20c070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:56.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.858+0000 7fa214400640 1 -- 172.21.15.8:0/871931181 shutdown_connections 2024-05-26T15:40:56.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:56.858+0000 7fa214400640 1 -- 172.21.15.8:0/871931181 wait complete. 2024-05-26T15:40:56.875 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:40:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.083+0000 7fa327400640 1 Processor -- start 2024-05-26T15:40:57.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.083+0000 7fa327400640 1 -- start start 2024-05-26T15:40:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.084+0000 7fa327400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa320144140 0x7fa3200cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.084+0000 7fa327400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa320070ba0 0x7fa32006cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.084+0000 7fa327400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa320144520 con 0x7fa3200cd7c0 2024-05-26T15:40:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.084+0000 7fa327400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3200cdd80 con 0x7fa320070ba0 2024-05-26T15:40:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.084+0000 7fa327400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3200ce060 con 0x7fa320144140 2024-05-26T15:40:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.085+0000 7fa325400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa320070ba0 0x7fa32006cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.085+0000 7fa325400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa320070ba0 0x7fa32006cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42280/0 (socket says 172.21.15.8:42280) 2024-05-26T15:40:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.085+0000 7fa325400640 1 -- 172.21.15.8:0/1081487798 learned_addr learned my addr 172.21.15.8:0/1081487798 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.085+0000 7fa325400640 1 -- 172.21.15.8:0/1081487798 >> v2:172.21.15.47:3300/0 conn(0x7fa320144140 msgr2=0x7fa3200cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.085+0000 7fa324a00640 1 --2- 172.21.15.8:0/1081487798 >> v2:172.21.15.47:3300/0 conn(0x7fa320144140 0x7fa3200cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.085+0000 7fa325400640 1 --2- 172.21.15.8:0/1081487798 >> v2:172.21.15.47:3300/0 conn(0x7fa320144140 0x7fa3200cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.085+0000 7fa325400640 1 -- 172.21.15.8:0/1081487798 >> v1:172.21.15.47:6789/0 conn(0x7fa3200cd7c0 legacy=0x7fa320070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.085+0000 7fa325400640 1 -- 172.21.15.8:0/1081487798 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3200ce340 con 0x7fa320070ba0 2024-05-26T15:40:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.086+0000 7fa325400640 1 --2- 172.21.15.8:0/1081487798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa320070ba0 0x7fa32006cc90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa320071700 tx=0x7fa31802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cca896c5711d76 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.087+0000 7fa31f400640 1 -- 172.21.15.8:0/1081487798 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318031600 con 0x7fa320070ba0 2024-05-26T15:40:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.087+0000 7fa31f400640 1 -- 172.21.15.8:0/1081487798 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31802d050 con 0x7fa320070ba0 2024-05-26T15:40:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.087+0000 7fa31f400640 1 -- 172.21.15.8:0/1081487798 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318031980 con 0x7fa320070ba0 2024-05-26T15:40:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.087+0000 7fa327400640 1 -- 172.21.15.8:0/1081487798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa320070ba0 msgr2=0x7fa32006cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.087+0000 7fa327400640 1 --2- 172.21.15.8:0/1081487798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa320070ba0 0x7fa32006cc90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa320071700 tx=0x7fa31802a660 comp rx=0 tx=0).stop 2024-05-26T15:40:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.088+0000 7fa327400640 1 -- 172.21.15.8:0/1081487798 shutdown_connections 2024-05-26T15:40:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.088+0000 7fa327400640 1 --2- 172.21.15.8:0/1081487798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa320070ba0 0x7fa32006cc90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.088+0000 7fa327400640 1 --2- 172.21.15.8:0/1081487798 >> v2:172.21.15.47:3300/0 conn(0x7fa320144140 0x7fa3200cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.088+0000 7fa327400640 1 -- 172.21.15.8:0/1081487798 >> 172.21.15.8:0/1081487798 conn(0x7fa320069e70 msgr2=0x7fa32006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.088+0000 7fa327400640 1 -- 172.21.15.8:0/1081487798 shutdown_connections 2024-05-26T15:40:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.088+0000 7fa327400640 1 -- 172.21.15.8:0/1081487798 wait complete. 2024-05-26T15:40:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.089+0000 7fa327400640 1 Processor -- start 2024-05-26T15:40:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.090+0000 7fa327400640 1 -- start start 2024-05-26T15:40:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.090+0000 7fa327400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa320070ba0 0x7fa32013a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.090+0000 7fa327400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3200cd7c0 0x7fa320155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.090+0000 7fa327400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa320144140 0x7fa32013f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.090+0000 7fa327400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa320142f50 con 0x7fa3200cd7c0 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.090+0000 7fa327400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa320142340 con 0x7fa320144140 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.090+0000 7fa327400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa320142620 con 0x7fa320070ba0 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3200cd7c0 0x7fa320155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3200cd7c0 0x7fa320155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42288/0 (socket says 172.21.15.8:42288) 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa31fe00640 1 -- 172.21.15.8:0/2748264539 learned_addr learned my addr 172.21.15.8:0/2748264539 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa324a00640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa320070ba0 0x7fa32013a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa325400640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa320144140 0x7fa32013f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa31fe00640 1 -- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa320070ba0 msgr2=0x7fa32013a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa31fe00640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa320070ba0 0x7fa32013a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa31fe00640 1 -- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa320144140 msgr2=0x7fa32013f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa31fe00640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa320144140 0x7fa32013f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa31fe00640 1 -- 172.21.15.8:0/2748264539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318009b30 con 0x7fa3200cd7c0 2024-05-26T15:40:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.091+0000 7fa325400640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa320144140 0x7fa32013f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.092+0000 7fa31fe00640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3200cd7c0 0x7fa320155020 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00c430 tx=0x7fa30c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.092+0000 7fa31cc00640 1 -- 172.21.15.8:0/2748264539 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c011790 con 0x7fa3200cd7c0 2024-05-26T15:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.092+0000 7fa31cc00640 1 -- 172.21.15.8:0/2748264539 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c0118f0 con 0x7fa3200cd7c0 2024-05-26T15:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.092+0000 7fa31cc00640 1 -- 172.21.15.8:0/2748264539 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c011ce0 con 0x7fa3200cd7c0 2024-05-26T15:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.092+0000 7fa327400640 1 -- 172.21.15.8:0/2748264539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3200cefa0 con 0x7fa3200cd7c0 2024-05-26T15:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.092+0000 7fa327400640 1 -- 172.21.15.8:0/2748264539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa320142be0 con 0x7fa3200cd7c0 2024-05-26T15:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.093+0000 7fa327400640 1 -- 172.21.15.8:0/2748264539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32004e210 con 0x7fa3200cd7c0 2024-05-26T15:40:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.094+0000 7fa31cc00640 1 -- 172.21.15.8:0/2748264539 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa30c01c460 con 0x7fa3200cd7c0 2024-05-26T15:40:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.095+0000 7fa31cc00640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa30006ac00 0x7fa30006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.095+0000 7fa31cc00640 1 -- 172.21.15.8:0/2748264539 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa30c089730 con 0x7fa3200cd7c0 2024-05-26T15:40:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.096+0000 7fa324a00640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa30006ac00 0x7fa30006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.097+0000 7fa324a00640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa30006ac00 0x7fa30006d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa314006fd0 tx=0x7fa314008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:57.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.099+0000 7fa31cc00640 1 -- 172.21.15.8:0/2748264539 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa30c054490 con 0x7fa3200cd7c0 2024-05-26T15:40:57.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.291+0000 7fa327400640 1 -- 172.21.15.8:0/2748264539 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa32013aea0 con 0x7fa3200cd7c0 2024-05-26T15:40:57.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.292+0000 7fa31cc00640 1 -- 172.21.15.8:0/2748264539 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa30c057ab0 con 0x7fa3200cd7c0 2024-05-26T15:40:57.290 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 -- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa30006ac00 msgr2=0x7fa30006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa30006ac00 0x7fa30006d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa314006fd0 tx=0x7fa314008040 comp rx=0 tx=0).stop 2024-05-26T15:40:57.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 -- 172.21.15.8:0/2748264539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3200cd7c0 msgr2=0x7fa320155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3200cd7c0 0x7fa320155020 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00c430 tx=0x7fa30c00c8f0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 -- 172.21.15.8:0/2748264539 shutdown_connections 2024-05-26T15:40:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa30006ac00 0x7fa30006d0c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa320144140 0x7fa32013f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa3200cd7c0 0x7fa320155020 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 --2- 172.21.15.8:0/2748264539 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa320070ba0 0x7fa32013a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 -- 172.21.15.8:0/2748264539 >> 172.21.15.8:0/2748264539 conn(0x7fa320069e70 msgr2=0x7fa320070490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 -- 172.21.15.8:0/2748264539 shutdown_connections 2024-05-26T15:40:57.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.294+0000 7fa327400640 1 -- 172.21.15.8:0/2748264539 wait complete. 2024-05-26T15:40:57.310 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:40:57.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.519+0000 7f33d4a00640 1 Processor -- start 2024-05-26T15:40:57.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.519+0000 7f33d4a00640 1 -- start start 2024-05-26T15:40:57.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.520+0000 7f33d4a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f33d00b05e0 0x7f33d00b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.521+0000 7f33d4a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d00b0f00 con 0x7f33d00cc950 2024-05-26T15:40:57.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.521+0000 7f33d4a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d006a010 con 0x7f33d00ca200 2024-05-26T15:40:57.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.521+0000 7f33d4a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d00c9db0 con 0x7f33d00b05e0 2024-05-26T15:40:57.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.521+0000 7f33ce800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f33d00cc950 0x7f33d00cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36670/0 (socket says 172.21.15.8:36670) 2024-05-26T15:40:57.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.521+0000 7f33ce800640 1 -- 172.21.15.8:0/975134756 learned_addr learned my addr 172.21.15.8:0/975134756 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:57.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.521+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297565522 0 0) 0x7f33d00b0f00 con 0x7f33d00cc950 2024-05-26T15:40:57.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.521+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b4003520 con 0x7f33d00cc950 2024-05-26T15:40:57.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.521+0000 7f33cde00640 1 --2- 172.21.15.8:0/975134756 >> v2:172.21.15.47:3300/0 conn(0x7f33d00b05e0 0x7f33d00b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 6521895 0 0) 0x7f33b4003520 con 0x7f33d00cc950 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 >> v2:172.21.15.47:3300/0 conn(0x7f33d00b05e0 msgr2=0x7f33d00b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 --2- 172.21.15.8:0/975134756 >> v2:172.21.15.47:3300/0 conn(0x7f33d00b05e0 0x7f33d00b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 >> v1:172.21.15.47:6789/0 conn(0x7f33d00ca200 legacy=0x7f33d00ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d006a2f0 con 0x7f33d00cc950 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f33c80019f0 con 0x7f33d00cc950 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 >> v1:172.21.15.8:6789/0 conn(0x7f33d00cc950 legacy=0x7f33d00cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 --2- 172.21.15.8:0/975134756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33b40039e0 0x7f33b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 --2- 172.21.15.8:0/975134756 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33b40047c0 0x7f33b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 --2- 172.21.15.8:0/975134756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33b4005180 0x7f33b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00c9db0 con 0x7f33b40039e0 2024-05-26T15:40:57.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b400c0b0 con 0x7f33b4005180 2024-05-26T15:40:57.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b400c270 con 0x7f33b40047c0 2024-05-26T15:40:57.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.522+0000 7f33cde00640 1 --2- 172.21.15.8:0/975134756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33b40039e0 0x7f33b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.523+0000 7f33cde00640 1 -- 172.21.15.8:0/975134756 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33b40047c0 msgr2=0x7f33b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:57.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.523+0000 7f33cde00640 1 --2- 172.21.15.8:0/975134756 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33b40047c0 0x7f33b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.523+0000 7f33cde00640 1 -- 172.21.15.8:0/975134756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33b4005180 msgr2=0x7f33b400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:57.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.523+0000 7f33cde00640 1 --2- 172.21.15.8:0/975134756 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33b4005180 0x7f33b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.523+0000 7f33cde00640 1 -- 172.21.15.8:0/975134756 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b4003520 con 0x7f33b40039e0 2024-05-26T15:40:57.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.523+0000 7f33ce800640 1 -- 172.21.15.8:0/975134756 reap_dead start 2024-05-26T15:40:57.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.524+0000 7f33cde00640 1 --2- 172.21.15.8:0/975134756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33b40039e0 0x7f33b4003e00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009ac0 tx=0x7f33b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ab605aa3dbe240 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.524+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0031400 con 0x7f33b40039e0 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.524+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c002d050 con 0x7f33b40039e0 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.524+0000 7f33cd400640 1 -- 172.21.15.8:0/975134756 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0031780 con 0x7f33b40039e0 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.524+0000 7f33d4a00640 1 -- 172.21.15.8:0/975134756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33b40039e0 msgr2=0x7f33b4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.524+0000 7f33d4a00640 1 --2- 172.21.15.8:0/975134756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33b40039e0 0x7f33b4003e00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009ac0 tx=0x7f33b40057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.524+0000 7f33d4a00640 1 -- 172.21.15.8:0/975134756 shutdown_connections 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.524+0000 7f33d4a00640 1 --2- 172.21.15.8:0/975134756 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33b40039e0 0x7f33b4003e00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.524+0000 7f33d4a00640 1 -- 172.21.15.8:0/975134756 >> 172.21.15.8:0/975134756 conn(0x7f33d00b1330 msgr2=0x7f33d00b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.525+0000 7f33d4a00640 1 -- 172.21.15.8:0/975134756 shutdown_connections 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.525+0000 7f33d4a00640 1 -- 172.21.15.8:0/975134756 wait complete. 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.526+0000 7f33d4a00640 1 Processor -- start 2024-05-26T15:40:57.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.526+0000 7f33d4a00640 1 -- start start 2024-05-26T15:40:57.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.527+0000 7f33d4a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33b40039e0 0x7f33d00afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.527+0000 7f33d4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33d00b4240 0x7f33d00b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.527+0000 7f33d4a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d01466d0 0x7f33d0146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.527+0000 7f33d4a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0146430 con 0x7f33d00b4240 2024-05-26T15:40:57.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.527+0000 7f33d4a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00b31a0 con 0x7f33d01466d0 2024-05-26T15:40:57.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.527+0000 7f33d4a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00b3480 con 0x7f33b40039e0 2024-05-26T15:40:57.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33c7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33d00b4240 0x7f33d00b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33c7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33d00b4240 0x7f33d00b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42298/0 (socket says 172.21.15.8:42298) 2024-05-26T15:40:57.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33c7e00640 1 -- 172.21.15.8:0/566516010 learned_addr learned my addr 172.21.15.8:0/566516010 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:57.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33cde00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33b40039e0 0x7f33d00afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33ce800640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d01466d0 0x7f33d0146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33c7e00640 1 -- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33b40039e0 msgr2=0x7f33d00afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33c7e00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33b40039e0 0x7f33d00afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33c7e00640 1 -- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d01466d0 msgr2=0x7f33d0146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33c7e00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d01466d0 0x7f33d0146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33c7e00640 1 -- 172.21.15.8:0/566516010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00b3760 con 0x7f33d00b4240 2024-05-26T15:40:57.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33cde00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33b40039e0 0x7f33d00afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:57.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.528+0000 7f33ce800640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d01466d0 0x7f33d0146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:40:57.529 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.529+0000 7f33c7e00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33d00b4240 0x7f33d00b2b00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f33b800c3c0 tx=0x7f33b800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:57.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.529+0000 7f33c6000640 1 -- 172.21.15.8:0/566516010 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80052d0 con 0x7f33d00b4240 2024-05-26T15:40:57.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.529+0000 7f33c6000640 1 -- 172.21.15.8:0/566516010 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8005450 con 0x7f33d00b4240 2024-05-26T15:40:57.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.529+0000 7f33d4a00640 1 -- 172.21.15.8:0/566516010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d00b3a40 con 0x7f33d00b4240 2024-05-26T15:40:57.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.529+0000 7f33c6000640 1 -- 172.21.15.8:0/566516010 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8007260 con 0x7f33d00b4240 2024-05-26T15:40:57.530 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.529+0000 7f33d4a00640 1 -- 172.21.15.8:0/566516010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d0147090 con 0x7f33d00b4240 2024-05-26T15:40:57.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.530+0000 7f33d4a00640 1 -- 172.21.15.8:0/566516010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d006bf50 con 0x7f33d00b4240 2024-05-26T15:40:57.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.531+0000 7f33c6000640 1 -- 172.21.15.8:0/566516010 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f33b80073c0 con 0x7f33d00b4240 2024-05-26T15:40:57.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.532+0000 7f33c6000640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33ac06ac00 0x7f33ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.532+0000 7f33c6000640 1 -- 172.21.15.8:0/566516010 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f33b8088c00 con 0x7f33d00b4240 2024-05-26T15:40:57.531 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.533+0000 7f33cde00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33ac06ac00 0x7f33ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.532 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.534+0000 7f33cde00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33ac06ac00 0x7f33ac06d0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33c0033000 tx=0x7f33c0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:57.534 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.536+0000 7f33c6000640 1 -- 172.21.15.8:0/566516010 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f33b8053990 con 0x7f33d00b4240 2024-05-26T15:40:57.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.732+0000 7f33d4a00640 1 -- 172.21.15.8:0/566516010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33d004e210 con 0x7f33d00b4240 2024-05-26T15:40:57.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.732+0000 7f33c6000640 1 -- 172.21.15.8:0/566516010 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f33b8056fb0 con 0x7f33d00b4240 2024-05-26T15:40:57.731 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:40:57.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 -- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33ac06ac00 msgr2=0x7f33ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33ac06ac00 0x7f33ac06d0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33c0033000 tx=0x7f33c0008030 comp rx=0 tx=0).stop 2024-05-26T15:40:57.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 -- 172.21.15.8:0/566516010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33d00b4240 msgr2=0x7f33d00b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33d00b4240 0x7f33d00b2b00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f33b800c3c0 tx=0x7f33b800c880 comp rx=0 tx=0).stop 2024-05-26T15:40:57.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 -- 172.21.15.8:0/566516010 shutdown_connections 2024-05-26T15:40:57.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33ac06ac00 0x7f33ac06d0c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33d01466d0 0x7f33d0146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33d00b4240 0x7f33d00b2b00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 --2- 172.21.15.8:0/566516010 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33b40039e0 0x7f33d00afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 -- 172.21.15.8:0/566516010 >> 172.21.15.8:0/566516010 conn(0x7f33d00b1330 msgr2=0x7f33d006d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:57.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.735+0000 7f33d4a00640 1 -- 172.21.15.8:0/566516010 shutdown_connections 2024-05-26T15:40:57.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.736+0000 7f33d4a00640 1 -- 172.21.15.8:0/566516010 wait complete. 2024-05-26T15:40:57.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-26T15:40:57.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.970+0000 7f0438e00640 1 Processor -- start 2024-05-26T15:40:57.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.970+0000 7f0438e00640 1 -- start start 2024-05-26T15:40:57.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.971+0000 7f0438e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f043415ca00 0x7f04340d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.971+0000 7f0438e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 0x7f04340cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.971+0000 7f0438e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04340d20d0 con 0x7f04340cfe50 2024-05-26T15:40:57.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.971+0000 7f0438e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04340d02e0 con 0x7f043415ca00 2024-05-26T15:40:57.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.971+0000 7f0438e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04340d06b0 con 0x7f04340b82c0 2024-05-26T15:40:57.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.972+0000 7f0433400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f043415ca00 0x7f04340d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.972+0000 7f0433e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f04340cfe50 0x7f04340d28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36684/0 (socket says 172.21.15.8:36684) 2024-05-26T15:40:57.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.972+0000 7f0433e00640 1 -- 172.21.15.8:0/2192795096 learned_addr learned my addr 172.21.15.8:0/2192795096 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:57.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.972+0000 7f0432a00640 1 --2- 172.21.15.8:0/2192795096 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 0x7f04340cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.972+0000 7f0433400640 1 -- 172.21.15.8:0/2192795096 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 msgr2=0x7f04340cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:57.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.972+0000 7f0433400640 1 --2- 172.21.15.8:0/2192795096 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 0x7f04340cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.972+0000 7f0433400640 1 -- 172.21.15.8:0/2192795096 >> v1:172.21.15.8:6789/0 conn(0x7f04340cfe50 legacy=0x7f04340d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.973+0000 7f0433400640 1 -- 172.21.15.8:0/2192795096 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340d14c0 con 0x7f043415ca00 2024-05-26T15:40:57.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.973+0000 7f0432a00640 1 --2- 172.21.15.8:0/2192795096 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 0x7f04340cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:57.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.972+0000 7f0432000640 1 -- 172.21.15.8:0/2192795096 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225759382 0 0) 0x7f04340d20d0 con 0x7f04340cfe50 2024-05-26T15:40:57.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.974+0000 7f0433400640 1 --2- 172.21.15.8:0/2192795096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 0x7f04340d0d70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0424009d90 tx=0x7f042402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869fadd9a020e301 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:57.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.974+0000 7f0432000640 1 -- 172.21.15.8:0/2192795096 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424007740 con 0x7f043415ca00 2024-05-26T15:40:57.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.974+0000 7f0432000640 1 -- 172.21.15.8:0/2192795096 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042402d050 con 0x7f043415ca00 2024-05-26T15:40:57.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.974+0000 7f0432000640 1 -- 172.21.15.8:0/2192795096 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424007ac0 con 0x7f043415ca00 2024-05-26T15:40:57.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.975+0000 7f0438e00640 1 -- 172.21.15.8:0/2192795096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 msgr2=0x7f04340d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.975+0000 7f0438e00640 1 --2- 172.21.15.8:0/2192795096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 0x7f04340d0d70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0424009d90 tx=0x7f042402a660 comp rx=0 tx=0).stop 2024-05-26T15:40:57.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.975+0000 7f0438e00640 1 -- 172.21.15.8:0/2192795096 shutdown_connections 2024-05-26T15:40:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.975+0000 7f0438e00640 1 --2- 172.21.15.8:0/2192795096 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 0x7f04340cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.975+0000 7f0438e00640 1 --2- 172.21.15.8:0/2192795096 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 0x7f04340d0d70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.975+0000 7f0438e00640 1 -- 172.21.15.8:0/2192795096 >> 172.21.15.8:0/2192795096 conn(0x7f043406b640 msgr2=0x7f043406ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.975+0000 7f0438e00640 1 -- 172.21.15.8:0/2192795096 shutdown_connections 2024-05-26T15:40:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.975+0000 7f0438e00640 1 -- 172.21.15.8:0/2192795096 wait complete. 2024-05-26T15:40:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.977+0000 7f0438e00640 1 Processor -- start 2024-05-26T15:40:57.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.977+0000 7f0438e00640 1 -- start start 2024-05-26T15:40:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.978+0000 7f0438e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 0x7f04340c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.978+0000 7f0438e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04340cfe50 0x7f043414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.978+0000 7f0438e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 0x7f04341f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.978+0000 7f0438e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04341507b0 con 0x7f043415ca00 2024-05-26T15:40:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0438e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043415f9b0 con 0x7f04340cfe50 2024-05-26T15:40:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0438e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043415ebf0 con 0x7f04340b82c0 2024-05-26T15:40:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0433e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 0x7f04341f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0433e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 0x7f04341f5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42312/0 (socket says 172.21.15.8:42312) 2024-05-26T15:40:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0433e00640 1 -- 172.21.15.8:0/1570952075 learned_addr learned my addr 172.21.15.8:0/1570952075 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0433400640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 0x7f04340c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0432a00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04340cfe50 0x7f043414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0433e00640 1 -- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 msgr2=0x7f04340c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0433e00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 0x7f04340c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0433e00640 1 -- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04340cfe50 msgr2=0x7f043414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0433e00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04340cfe50 0x7f043414ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0433e00640 1 -- 172.21.15.8:0/1570952075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0424009a70 con 0x7f043415ca00 2024-05-26T15:40:57.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.979+0000 7f0432a00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04340cfe50 0x7f043414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.980+0000 7f0433e00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 0x7f04341f5640 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c480 tx=0x7f042c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.980+0000 7f042b400640 1 -- 172.21.15.8:0/1570952075 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c0074e0 con 0x7f043415ca00 2024-05-26T15:40:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.980+0000 7f042b400640 1 -- 172.21.15.8:0/1570952075 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c007660 con 0x7f043415ca00 2024-05-26T15:40:57.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.980+0000 7f0438e00640 1 -- 172.21.15.8:0/1570952075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043415eed0 con 0x7f043415ca00 2024-05-26T15:40:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.980+0000 7f042b400640 1 -- 172.21.15.8:0/1570952075 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c004a20 con 0x7f043415ca00 2024-05-26T15:40:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.980+0000 7f0438e00640 1 -- 172.21.15.8:0/1570952075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043415f490 con 0x7f043415ca00 2024-05-26T15:40:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.981+0000 7f0438e00640 1 -- 172.21.15.8:0/1570952075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043404e210 con 0x7f043415ca00 2024-05-26T15:40:57.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.982+0000 7f042b400640 1 -- 172.21.15.8:0/1570952075 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f042c004b80 con 0x7f043415ca00 2024-05-26T15:40:57.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.983+0000 7f042b400640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041406ac00 0x7f041406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:57.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.983+0000 7f042b400640 1 -- 172.21.15.8:0/1570952075 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f042c088c30 con 0x7f043415ca00 2024-05-26T15:40:57.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.984+0000 7f0433400640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041406ac00 0x7f041406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:57.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.985+0000 7f0433400640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041406ac00 0x7f041406d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0424034000 tx=0x7f042402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:57.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:57.988+0000 7f042b400640 1 -- 172.21.15.8:0/1570952075 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f042c053b80 con 0x7f043415ca00 2024-05-26T15:40:58.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.186+0000 7f0438e00640 1 -- 172.21.15.8:0/1570952075 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f043415f650 con 0x7f043415ca00 2024-05-26T15:40:58.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.186+0000 7f042b400640 1 -- 172.21.15.8:0/1570952075 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f042c018020 con 0x7f043415ca00 2024-05-26T15:40:58.185 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:40:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 -- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041406ac00 msgr2=0x7f041406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041406ac00 0x7f041406d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0424034000 tx=0x7f042402f000 comp rx=0 tx=0).stop 2024-05-26T15:40:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 -- 172.21.15.8:0/1570952075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 msgr2=0x7f04341f5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 0x7f04341f5640 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c480 tx=0x7f042c00c940 comp rx=0 tx=0).stop 2024-05-26T15:40:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 -- 172.21.15.8:0/1570952075 shutdown_connections 2024-05-26T15:40:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f043415ca00 0x7f04341f5640 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f041406ac00 0x7f041406d0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04340cfe50 0x7f043414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 --2- 172.21.15.8:0/1570952075 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04340b82c0 0x7f04340c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 -- 172.21.15.8:0/1570952075 >> 172.21.15.8:0/1570952075 conn(0x7f043406b640 msgr2=0x7f04340b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.189+0000 7f0438e00640 1 -- 172.21.15.8:0/1570952075 shutdown_connections 2024-05-26T15:40:58.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.190+0000 7f0438e00640 1 -- 172.21.15.8:0/1570952075 wait complete. 2024-05-26T15:40:58.208 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:40:58.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:40:58.320 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:40:58.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.417+0000 7fb72a000640 1 Processor -- start 2024-05-26T15:40:58.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.417+0000 7fb72a000640 1 -- start start 2024-05-26T15:40:58.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.419+0000 7fb72a000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb72415cf10 0x7fb7240b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.419+0000 7fb72a000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7241615f0 0x7fb7241609e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.419+0000 7fb72a000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb724160f20 0x7fb7240cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.419+0000 7fb72a000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7241613b0 con 0x7fb7241615f0 2024-05-26T15:40:58.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.419+0000 7fb72a000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7240b5c30 con 0x7fb724160f20 2024-05-26T15:40:58.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.419+0000 7fb72a000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7240b6a50 con 0x7fb72415cf10 2024-05-26T15:40:58.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.419+0000 7fb71be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7241615f0 0x7fb7241609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.419+0000 7fb71be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb7241615f0 0x7fb7241609e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42318/0 (socket says 172.21.15.8:42318) 2024-05-26T15:40:58.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.419+0000 7fb71be00640 1 -- 172.21.15.8:0/3903028145 learned_addr learned my addr 172.21.15.8:0/3903028145 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:58.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.420+0000 7fb723400640 1 --2- 172.21.15.8:0/3903028145 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb72415cf10 0x7fb7240b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.420+0000 7fb723e00640 1 --2- 172.21.15.8:0/3903028145 >> v2:172.21.15.47:3300/0 conn(0x7fb724160f20 0x7fb7240cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.420+0000 7fb71be00640 1 -- 172.21.15.8:0/3903028145 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb72415cf10 msgr2=0x7fb7240b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:58.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.420+0000 7fb71be00640 1 --2- 172.21.15.8:0/3903028145 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb72415cf10 0x7fb7240b84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.420+0000 7fb71be00640 1 -- 172.21.15.8:0/3903028145 >> v2:172.21.15.47:3300/0 conn(0x7fb724160f20 msgr2=0x7fb7240cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:58.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.420+0000 7fb71be00640 1 --2- 172.21.15.8:0/3903028145 >> v2:172.21.15.47:3300/0 conn(0x7fb724160f20 0x7fb7240cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.420+0000 7fb71be00640 1 -- 172.21.15.8:0/3903028145 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72415d2f0 con 0x7fb7241615f0 2024-05-26T15:40:58.419 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.421+0000 7fb71be00640 1 --2- 172.21.15.8:0/3903028145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 0x7fb7241609e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb7240c66f0 tx=0x7fb70c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e5be3282bd8fc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:58.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.421+0000 7fb722a00640 1 -- 172.21.15.8:0/3903028145 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c032440 con 0x7fb7241615f0 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.421+0000 7fb722a00640 1 -- 172.21.15.8:0/3903028145 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c0325a0 con 0x7fb7241615f0 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.421+0000 7fb722a00640 1 -- 172.21.15.8:0/3903028145 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c032930 con 0x7fb7241615f0 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.422+0000 7fb72a000640 1 -- 172.21.15.8:0/3903028145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 msgr2=0x7fb7241609e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.422+0000 7fb72a000640 1 --2- 172.21.15.8:0/3903028145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 0x7fb7241609e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb7240c66f0 tx=0x7fb70c02a270 comp rx=0 tx=0).stop 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.422+0000 7fb72a000640 1 -- 172.21.15.8:0/3903028145 shutdown_connections 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.422+0000 7fb72a000640 1 --2- 172.21.15.8:0/3903028145 >> v2:172.21.15.47:3300/0 conn(0x7fb724160f20 0x7fb7240cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.422+0000 7fb72a000640 1 --2- 172.21.15.8:0/3903028145 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 0x7fb7241609e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.422+0000 7fb72a000640 1 --2- 172.21.15.8:0/3903028145 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb72415cf10 0x7fb7240b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.422+0000 7fb72a000640 1 -- 172.21.15.8:0/3903028145 >> 172.21.15.8:0/3903028145 conn(0x7fb724071990 msgr2=0x7fb724071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.422+0000 7fb72a000640 1 -- 172.21.15.8:0/3903028145 shutdown_connections 2024-05-26T15:40:58.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.422+0000 7fb72a000640 1 -- 172.21.15.8:0/3903028145 wait complete. 2024-05-26T15:40:58.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.424+0000 7fb72a000640 1 Processor -- start 2024-05-26T15:40:58.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.425+0000 7fb72a000640 1 -- start start 2024-05-26T15:40:58.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.426+0000 7fb72a000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb72415cf10 0x7fb724150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.426+0000 7fb72a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb724160f20 0x7fb724152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.426+0000 7fb72a000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 0x7fb7241551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.426+0000 7fb72a000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72415eb80 con 0x7fb7241615f0 2024-05-26T15:40:58.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.426+0000 7fb72a000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7241536f0 con 0x7fb724160f20 2024-05-26T15:40:58.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.426+0000 7fb72a000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7241539d0 con 0x7fb72415cf10 2024-05-26T15:40:58.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.426+0000 7fb723e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 0x7fb7241551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.426+0000 7fb723e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 0x7fb7241551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42322/0 (socket says 172.21.15.8:42322) 2024-05-26T15:40:58.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.426+0000 7fb723e00640 1 -- 172.21.15.8:0/4209898140 learned_addr learned my addr 172.21.15.8:0/4209898140 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:58.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb723400640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb72415cf10 0x7fb724150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb71be00640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb724160f20 0x7fb724152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb723e00640 1 -- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb72415cf10 msgr2=0x7fb724150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb723e00640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb72415cf10 0x7fb724150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb723e00640 1 -- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb724160f20 msgr2=0x7fb724152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb723e00640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb724160f20 0x7fb724152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb723e00640 1 -- 172.21.15.8:0/4209898140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c0094d0 con 0x7fb7241615f0 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb723e00640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 0x7fb7241551d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00cd70 tx=0x7fb71c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb71b400640 1 -- 172.21.15.8:0/4209898140 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c003b90 con 0x7fb7241615f0 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb71b400640 1 -- 172.21.15.8:0/4209898140 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c003cf0 con 0x7fb7241615f0 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.427+0000 7fb71b400640 1 -- 172.21.15.8:0/4209898140 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c004240 con 0x7fb7241615f0 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.428+0000 7fb72a000640 1 -- 172.21.15.8:0/4209898140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72415e530 con 0x7fb7241615f0 2024-05-26T15:40:58.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.428+0000 7fb72a000640 1 -- 172.21.15.8:0/4209898140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb724151500 con 0x7fb7241615f0 2024-05-26T15:40:58.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.429+0000 7fb72a000640 1 -- 172.21.15.8:0/4209898140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72415ecf0 con 0x7fb7241615f0 2024-05-26T15:40:58.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.430+0000 7fb71b400640 1 -- 172.21.15.8:0/4209898140 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb71c0043a0 con 0x7fb7241615f0 2024-05-26T15:40:58.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.431+0000 7fb71b400640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb70006ac30 0x7fb70006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.431+0000 7fb71b400640 1 -- 172.21.15.8:0/4209898140 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb71c012070 con 0x7fb7241615f0 2024-05-26T15:40:58.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.432+0000 7fb723400640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb70006ac30 0x7fb70006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.433+0000 7fb723400640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb70006ac30 0x7fb70006d0f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb724153cd0 tx=0x7fb714008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:58.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.436+0000 7fb71b400640 1 -- 172.21.15.8:0/4209898140 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb71c054f00 con 0x7fb7241615f0 2024-05-26T15:40:58.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.673+0000 7fb72a000640 1 -- 172.21.15.8:0/4209898140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7240681d0 con 0x7fb7241615f0 2024-05-26T15:40:58.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.674+0000 7fb71b400640 1 -- 172.21.15.8:0/4209898140 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4718 (secure 0 0 0) 0x7fb71c058520 con 0x7fb7241615f0 2024-05-26T15:40:58.673 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:58.673 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:39:32.881224+0000","modified":"2024-05-26T15:40:01.486240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-26T15:40:58.673 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2024-05-26T15:40:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.677+0000 7fb72a000640 1 -- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb70006ac30 msgr2=0x7fb70006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.677+0000 7fb72a000640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb70006ac30 0x7fb70006d0f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb724153cd0 tx=0x7fb714008040 comp rx=0 tx=0).stop 2024-05-26T15:40:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.677+0000 7fb72a000640 1 -- 172.21.15.8:0/4209898140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 msgr2=0x7fb7241551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.677+0000 7fb72a000640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 0x7fb7241551d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00cd70 tx=0x7fb71c00a660 comp rx=0 tx=0).stop 2024-05-26T15:40:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.677+0000 7fb72a000640 1 -- 172.21.15.8:0/4209898140 shutdown_connections 2024-05-26T15:40:58.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.677+0000 7fb72a000640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb7241615f0 0x7fb7241551d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.677+0000 7fb72a000640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb70006ac30 0x7fb70006d0f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.677+0000 7fb72a000640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb724160f20 0x7fb724152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.677+0000 7fb72a000640 1 --2- 172.21.15.8:0/4209898140 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb72415cf10 0x7fb724150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.677+0000 7fb72a000640 1 -- 172.21.15.8:0/4209898140 >> 172.21.15.8:0/4209898140 conn(0x7fb724071990 msgr2=0x7fb7240d1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.678+0000 7fb72a000640 1 -- 172.21.15.8:0/4209898140 shutdown_connections 2024-05-26T15:40:58.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.678+0000 7fb72a000640 1 -- 172.21.15.8:0/4209898140 wait complete. 2024-05-26T15:40:58.696 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:40:58.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.961+0000 7fe386200640 1 Processor -- start 2024-05-26T15:40:58.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.961+0000 7fe386200640 1 -- start start 2024-05-26T15:40:58.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.963+0000 7fe386200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe3800b0f60 0x7fe38015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.963+0000 7fe386200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38015b640 con 0x7fe380154f50 2024-05-26T15:40:58.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.963+0000 7fe386200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38015b920 con 0x7fe38015f0c0 2024-05-26T15:40:58.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.963+0000 7fe386200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38015bee0 con 0x7fe3800b0f60 2024-05-26T15:40:58.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.963+0000 7fe384e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe380154f50 0x7fe38015ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36698/0 (socket says 172.21.15.8:36698) 2024-05-26T15:40:58.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.963+0000 7fe384e00640 1 -- 172.21.15.8:0/2394122123 learned_addr learned my addr 172.21.15.8:0/2394122123 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:58.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240481063 0 0) 0x7fe38015b640 con 0x7fe380154f50 2024-05-26T15:40:58.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe368003520 con 0x7fe380154f50 2024-05-26T15:40:58.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37fe00640 1 --2- 172.21.15.8:0/2394122123 >> v2:172.21.15.47:3300/0 conn(0x7fe3800b0f60 0x7fe38015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1920449961 0 0) 0x7fe368003520 con 0x7fe380154f50 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 >> v2:172.21.15.47:3300/0 conn(0x7fe3800b0f60 msgr2=0x7fe38015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 --2- 172.21.15.8:0/2394122123 >> v2:172.21.15.47:3300/0 conn(0x7fe3800b0f60 0x7fe38015eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 >> v1:172.21.15.47:6789/0 conn(0x7fe38015f0c0 legacy=0x7fe3800c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38015bc00 con 0x7fe380154f50 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fe374001670 con 0x7fe380154f50 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 >> v1:172.21.15.8:6789/0 conn(0x7fe380154f50 legacy=0x7fe38015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe368003970 0x7fe368003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.964+0000 7fe37f400640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe368004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe37f400640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe368005180 0x7fe36800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38015bee0 con 0x7fe3680047c0 2024-05-26T15:40:58.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36800c0d0 con 0x7fe368005180 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36800c290 con 0x7fe368003970 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe37fe00640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe368004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe385800640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe368005180 0x7fe36800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe384e00640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe368003970 0x7fe368003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe37fe00640 1 -- 172.21.15.8:0/2394122123 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe368003970 msgr2=0x7fe368003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe37fe00640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe368003970 0x7fe368003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe37fe00640 1 -- 172.21.15.8:0/2394122123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe368005180 msgr2=0x7fe36800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe37fe00640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe368005180 0x7fe36800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe37fe00640 1 -- 172.21.15.8:0/2394122123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe368003520 con 0x7fe3680047c0 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe385800640 1 -- 172.21.15.8:0/2394122123 reap_dead start 2024-05-26T15:40:58.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.965+0000 7fe384e00640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe368003970 0x7fe368003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.966+0000 7fe37fe00640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe368004c40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe37000ba30 tx=0x7fe3680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31fffe92736f947 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.967+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37002ade0 con 0x7fe3680047c0 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.967+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37002e070 con 0x7fe3680047c0 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.967+0000 7fe37f400640 1 -- 172.21.15.8:0/2394122123 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370034620 con 0x7fe3680047c0 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.967+0000 7fe386200640 1 -- 172.21.15.8:0/2394122123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 msgr2=0x7fe368004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.967+0000 7fe386200640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe368004c40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe37000ba30 tx=0x7fe3680057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.967+0000 7fe386200640 1 -- 172.21.15.8:0/2394122123 shutdown_connections 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.967+0000 7fe386200640 1 --2- 172.21.15.8:0/2394122123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe368004c40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.967+0000 7fe386200640 1 -- 172.21.15.8:0/2394122123 >> 172.21.15.8:0/2394122123 conn(0x7fe380070480 msgr2=0x7fe380070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.968+0000 7fe386200640 1 -- 172.21.15.8:0/2394122123 shutdown_connections 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.968+0000 7fe386200640 1 -- 172.21.15.8:0/2394122123 wait complete. 2024-05-26T15:40:58.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.969+0000 7fe386200640 1 Processor -- start 2024-05-26T15:40:58.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.970+0000 7fe386200640 1 -- start start 2024-05-26T15:40:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.970+0000 7fe386200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe3801f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.970+0000 7fe386200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3801513a0 0x7fe38014f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.970+0000 7fe386200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3800c9e20 0x7fe3800ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.970+0000 7fe386200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800ca810 con 0x7fe3680047c0 2024-05-26T15:40:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.970+0000 7fe386200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe380152850 con 0x7fe3801513a0 2024-05-26T15:40:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe386200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe380151c40 con 0x7fe3800c9e20 2024-05-26T15:40:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe384e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe3801f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe384e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe3801f6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42336/0 (socket says 172.21.15.8:42336) 2024-05-26T15:40:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe384e00640 1 -- 172.21.15.8:0/3414584981 learned_addr learned my addr 172.21.15.8:0/3414584981 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:58.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe37fe00640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3801513a0 0x7fe38014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe385800640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3800c9e20 0x7fe3800ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe384e00640 1 -- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3800c9e20 msgr2=0x7fe3800ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe384e00640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3800c9e20 0x7fe3800ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe384e00640 1 -- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3801513a0 msgr2=0x7fe38014f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe384e00640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3801513a0 0x7fe38014f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.971+0000 7fe384e00640 1 -- 172.21.15.8:0/3414584981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe380151f20 con 0x7fe3680047c0 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.972+0000 7fe384e00640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe3801f6ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe37400d810 tx=0x7fe37400dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.972+0000 7fe37cc00640 1 -- 172.21.15.8:0/3414584981 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740074e0 con 0x7fe3680047c0 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.972+0000 7fe37cc00640 1 -- 172.21.15.8:0/3414584981 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe374007640 con 0x7fe3680047c0 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.972+0000 7fe386200640 1 -- 172.21.15.8:0/3414584981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe380152200 con 0x7fe3680047c0 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.972+0000 7fe37cc00640 1 -- 172.21.15.8:0/3414584981 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740049e0 con 0x7fe3680047c0 2024-05-26T15:40:58.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.972+0000 7fe386200640 1 -- 172.21.15.8:0/3414584981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe380151820 con 0x7fe3680047c0 2024-05-26T15:40:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.973+0000 7fe386200640 1 -- 172.21.15.8:0/3414584981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe380151a10 con 0x7fe3680047c0 2024-05-26T15:40:58.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.974+0000 7fe37cc00640 1 -- 172.21.15.8:0/3414584981 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe374004b40 con 0x7fe3680047c0 2024-05-26T15:40:58.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.976+0000 7fe37cc00640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe36406ac30 0x7fe36406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.977+0000 7fe37cc00640 1 -- 172.21.15.8:0/3414584981 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe374089150 con 0x7fe3680047c0 2024-05-26T15:40:58.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.977+0000 7fe37fe00640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe36406ac30 0x7fe36406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:58.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.978+0000 7fe37fe00640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe36406ac30 0x7fe36406d0f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe37000ba00 tx=0x7fe370030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:58.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:58.981+0000 7fe37cc00640 1 -- 172.21.15.8:0/3414584981 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe374053eb0 con 0x7fe3680047c0 2024-05-26T15:40:59.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.185+0000 7fe386200640 1 -- 172.21.15.8:0/3414584981 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe38004e280 con 0x7fe3680047c0 2024-05-26T15:40:59.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.187+0000 7fe37cc00640 1 -- 172.21.15.8:0/3414584981 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7fe3740574d0 con 0x7fe3680047c0 2024-05-26T15:40:59.187 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:59.188 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:40:59.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.189+0000 7fe386200640 1 -- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe36406ac30 msgr2=0x7fe36406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.189+0000 7fe386200640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe36406ac30 0x7fe36406d0f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe37000ba00 tx=0x7fe370030000 comp rx=0 tx=0).stop 2024-05-26T15:40:59.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.189+0000 7fe386200640 1 -- 172.21.15.8:0/3414584981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 msgr2=0x7fe3801f6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.189+0000 7fe386200640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe3801f6ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe37400d810 tx=0x7fe37400dcd0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.189+0000 7fe386200640 1 -- 172.21.15.8:0/3414584981 shutdown_connections 2024-05-26T15:40:59.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.189+0000 7fe386200640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe3800c9e20 0x7fe3800ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.189+0000 7fe386200640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe36406ac30 0x7fe36406d0f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.189+0000 7fe386200640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3801513a0 0x7fe38014f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.189+0000 7fe386200640 1 --2- 172.21.15.8:0/3414584981 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe3680047c0 0x7fe3801f6ff0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.189+0000 7fe386200640 1 -- 172.21.15.8:0/3414584981 >> 172.21.15.8:0/3414584981 conn(0x7fe380070480 msgr2=0x7fe38015c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:59.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.190+0000 7fe386200640 1 -- 172.21.15.8:0/3414584981 shutdown_connections 2024-05-26T15:40:59.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.190+0000 7fe386200640 1 -- 172.21.15.8:0/3414584981 wait complete. 2024-05-26T15:40:59.208 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-26T15:40:59.208 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:40:59.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.429+0000 7f215e800640 1 Processor -- start 2024-05-26T15:40:59.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.429+0000 7f215e800640 1 -- start start 2024-05-26T15:40:59.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.431+0000 7f215e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2158154f50 0x7f21580b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.431+0000 7f215e800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f215815ae70 0x7f215815eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.431+0000 7f215e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f215815f0c0 0x7f21580c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.431+0000 7f215e800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215815bee0 con 0x7f215815ae70 2024-05-26T15:40:59.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.431+0000 7f215e800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21580b0ba0 con 0x7f215815f0c0 2024-05-26T15:40:59.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.431+0000 7f215e800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215815b640 con 0x7f2158154f50 2024-05-26T15:40:59.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.431+0000 7f215ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f215815ae70 0x7f215815eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.431+0000 7f215ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f215815ae70 0x7f215815eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42340/0 (socket says 172.21.15.8:42340) 2024-05-26T15:40:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.431+0000 7f215ca00640 1 -- 172.21.15.8:0/1785013652 learned_addr learned my addr 172.21.15.8:0/1785013652 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.432+0000 7f215d400640 1 --2- 172.21.15.8:0/1785013652 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2158154f50 0x7f21580b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.432+0000 7f215de00640 1 --2- 172.21.15.8:0/1785013652 >> v2:172.21.15.47:3300/0 conn(0x7f215815f0c0 0x7f21580c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.432+0000 7f215ca00640 1 -- 172.21.15.8:0/1785013652 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2158154f50 msgr2=0x7f21580b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.432+0000 7f215ca00640 1 --2- 172.21.15.8:0/1785013652 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2158154f50 0x7f21580b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.432+0000 7f215ca00640 1 -- 172.21.15.8:0/1785013652 >> v2:172.21.15.47:3300/0 conn(0x7f215815f0c0 msgr2=0x7f21580c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.432+0000 7f215ca00640 1 --2- 172.21.15.8:0/1785013652 >> v2:172.21.15.47:3300/0 conn(0x7f215815f0c0 0x7f21580c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.432+0000 7f215ca00640 1 -- 172.21.15.8:0/1785013652 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215815b920 con 0x7f215815ae70 2024-05-26T15:40:59.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.432+0000 7f215d400640 1 --2- 172.21.15.8:0/1785013652 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2158154f50 0x7f21580b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.433+0000 7f215ca00640 1 --2- 172.21.15.8:0/1785013652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 0x7f215815eb80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2158070fa0 tx=0x7f214402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04721a7bacb2283 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.433+0000 7f2157e00640 1 -- 172.21.15.8:0/1785013652 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214402ae90 con 0x7f215815ae70 2024-05-26T15:40:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.433+0000 7f2157e00640 1 -- 172.21.15.8:0/1785013652 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2144032440 con 0x7f215815ae70 2024-05-26T15:40:59.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.433+0000 7f2157e00640 1 -- 172.21.15.8:0/1785013652 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21440327d0 con 0x7f215815ae70 2024-05-26T15:40:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.434+0000 7f215e800640 1 -- 172.21.15.8:0/1785013652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 msgr2=0x7f215815eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.434+0000 7f215e800640 1 --2- 172.21.15.8:0/1785013652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 0x7f215815eb80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2158070fa0 tx=0x7f214402a140 comp rx=0 tx=0).stop 2024-05-26T15:40:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.434+0000 7f215e800640 1 -- 172.21.15.8:0/1785013652 shutdown_connections 2024-05-26T15:40:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.434+0000 7f215e800640 1 --2- 172.21.15.8:0/1785013652 >> v2:172.21.15.47:3300/0 conn(0x7f215815f0c0 0x7f21580c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.434+0000 7f215e800640 1 --2- 172.21.15.8:0/1785013652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 0x7f215815eb80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.434+0000 7f215e800640 1 --2- 172.21.15.8:0/1785013652 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2158154f50 0x7f21580b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.434+0000 7f215e800640 1 -- 172.21.15.8:0/1785013652 >> 172.21.15.8:0/1785013652 conn(0x7f2158070480 msgr2=0x7f2158070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.434+0000 7f215e800640 1 -- 172.21.15.8:0/1785013652 shutdown_connections 2024-05-26T15:40:59.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.434+0000 7f215e800640 1 -- 172.21.15.8:0/1785013652 wait complete. 2024-05-26T15:40:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.436+0000 7f215e800640 1 Processor -- start 2024-05-26T15:40:59.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.436+0000 7f215e800640 1 -- start start 2024-05-26T15:40:59.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.437+0000 7f215e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2158154f50 0x7f215814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.437+0000 7f215e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 0x7f21580cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.437+0000 7f215e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f215815f0c0 0x7f21580ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.437+0000 7f215e800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215814cb50 con 0x7f215815ae70 2024-05-26T15:40:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.437+0000 7f215e800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21580cbb20 con 0x7f2158154f50 2024-05-26T15:40:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.437+0000 7f215e800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21580cbe00 con 0x7f215815f0c0 2024-05-26T15:40:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.437+0000 7f215ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 0x7f21580cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.437+0000 7f215ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 0x7f21580cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42344/0 (socket says 172.21.15.8:42344) 2024-05-26T15:40:59.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.437+0000 7f215ca00640 1 -- 172.21.15.8:0/2332037739 learned_addr learned my addr 172.21.15.8:0/2332037739 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.438+0000 7f215d400640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2158154f50 0x7f215814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.438+0000 7f215de00640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f215815f0c0 0x7f21580ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.438+0000 7f215ca00640 1 -- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f215815f0c0 msgr2=0x7f21580ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.438+0000 7f215ca00640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f215815f0c0 0x7f21580ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.438+0000 7f215ca00640 1 -- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2158154f50 msgr2=0x7f215814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.438+0000 7f215ca00640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2158154f50 0x7f215814f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.438+0000 7f215ca00640 1 -- 172.21.15.8:0/2332037739 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440094d0 con 0x7f215815ae70 2024-05-26T15:40:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.438+0000 7f215ca00640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 0x7f21580cb490 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f214402a180 tx=0x7f21440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.439+0000 7f2155600640 1 -- 172.21.15.8:0/2332037739 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144030b80 con 0x7f215815ae70 2024-05-26T15:40:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.439+0000 7f2155600640 1 -- 172.21.15.8:0/2332037739 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2144030ce0 con 0x7f215815ae70 2024-05-26T15:40:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.439+0000 7f2155600640 1 -- 172.21.15.8:0/2332037739 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214403d680 con 0x7f215815ae70 2024-05-26T15:40:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.439+0000 7f215e800640 1 -- 172.21.15.8:0/2332037739 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21580cc0e0 con 0x7f215815ae70 2024-05-26T15:40:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.439+0000 7f215e800640 1 -- 172.21.15.8:0/2332037739 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21580cc6a0 con 0x7f215815ae70 2024-05-26T15:40:59.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.440+0000 7f215e800640 1 -- 172.21.15.8:0/2332037739 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2158153d90 con 0x7f215815ae70 2024-05-26T15:40:59.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.441+0000 7f2155600640 1 -- 172.21.15.8:0/2332037739 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2144039040 con 0x7f215815ae70 2024-05-26T15:40:59.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.442+0000 7f2155600640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f213806ac00 0x7f213806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.443+0000 7f2155600640 1 -- 172.21.15.8:0/2332037739 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f21440aa650 con 0x7f215815ae70 2024-05-26T15:40:59.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.443+0000 7f215d400640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f213806ac00 0x7f213806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.444+0000 7f215d400640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f213806ac00 0x7f213806d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f214c00a980 tx=0x7f214c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:59.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.447+0000 7f2155600640 1 -- 172.21.15.8:0/2332037739 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2144075320 con 0x7f215815ae70 2024-05-26T15:40:59.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.684+0000 7f215e800640 1 -- 172.21.15.8:0/2332037739 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f215804e280 con 0x7f215815ae70 2024-05-26T15:40:59.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.686+0000 7f2155600640 1 -- 172.21.15.8:0/2332037739 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4718 (secure 0 0 0) 0x7f2144078940 con 0x7f215815ae70 2024-05-26T15:40:59.684 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:40:59.684 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:39:32.881224+0000","modified":"2024-05-26T15:40:01.486240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-26T15:40:59.685 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2024-05-26T15:40:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.688+0000 7f215e800640 1 -- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f213806ac00 msgr2=0x7f213806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f213806ac00 0x7f213806d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f214c00a980 tx=0x7f214c008040 comp rx=0 tx=0).stop 2024-05-26T15:40:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 -- 172.21.15.8:0/2332037739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 msgr2=0x7f21580cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 0x7f21580cb490 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f214402a180 tx=0x7f21440046c0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 -- 172.21.15.8:0/2332037739 shutdown_connections 2024-05-26T15:40:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f215815f0c0 0x7f21580ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f215815ae70 0x7f21580cb490 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f213806ac00 0x7f213806d0c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 --2- 172.21.15.8:0/2332037739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2158154f50 0x7f215814f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 -- 172.21.15.8:0/2332037739 >> 172.21.15.8:0/2332037739 conn(0x7f2158070480 msgr2=0x7f215815cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 -- 172.21.15.8:0/2332037739 shutdown_connections 2024-05-26T15:40:59.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.689+0000 7f215e800640 1 -- 172.21.15.8:0/2332037739 wait complete. 2024-05-26T15:40:59.707 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:40:59.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.917+0000 7fc393e00640 1 Processor -- start 2024-05-26T15:40:59.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.917+0000 7fc393e00640 1 -- start start 2024-05-26T15:40:59.917 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.919+0000 7fc393e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc39415ca50 0x7fc3940b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.919+0000 7fc393e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940b3d70 con 0x7fc39406a580 2024-05-26T15:40:59.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.919+0000 7fc393e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc394071cb0 con 0x7fc39406fc90 2024-05-26T15:40:59.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.919+0000 7fc393e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39406eed0 con 0x7fc39415ca50 2024-05-26T15:40:59.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.920+0000 7fc393400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc39406a580 0x7fc39415ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36700/0 (socket says 172.21.15.8:36700) 2024-05-26T15:40:59.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.920+0000 7fc393400640 1 -- 172.21.15.8:0/1546436958 learned_addr learned my addr 172.21.15.8:0/1546436958 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:40:59.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.920+0000 7fc392a00640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc39415ca50 0x7fc3940b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.920+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097769205 0 0) 0x7fc3940b3d70 con 0x7fc39406a580 2024-05-26T15:40:59.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.920+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc378003520 con 0x7fc39406a580 2024-05-26T15:40:59.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3612673100 0 0) 0x7fc378003520 con 0x7fc39406a580 2024-05-26T15:40:59.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc39415ca50 msgr2=0x7fc3940b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc39415ca50 0x7fc3940b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 >> v1:172.21.15.47:6789/0 conn(0x7fc39406fc90 legacy=0x7fc394069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39406f1b0 con 0x7fc39406a580 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fc38c001a10 con 0x7fc39406a580 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 >> v1:172.21.15.8:6789/0 conn(0x7fc39406a580 legacy=0x7fc39415ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3780039a0 0x7fc378003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 0x7fc378004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc39415ca50 0x7fc378005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39406eed0 con 0x7fc378004350 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37800b980 con 0x7fc3780039a0 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37800bb40 con 0x7fc39415ca50 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.921+0000 7fc392000640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 0x7fc378004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.922+0000 7fc392a00640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3780039a0 0x7fc378003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.922+0000 7fc393400640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc39415ca50 0x7fc378005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.922+0000 7fc392000640 1 -- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc39415ca50 msgr2=0x7fc378005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.922+0000 7fc392000640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc39415ca50 0x7fc378005080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.922+0000 7fc392000640 1 -- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3780039a0 msgr2=0x7fc378003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:40:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.922+0000 7fc392000640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3780039a0 0x7fc378003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.922+0000 7fc392000640 1 -- 172.21.15.8:0/1546436958 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc378003520 con 0x7fc378004350 2024-05-26T15:40:59.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.922+0000 7fc392a00640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3780039a0 0x7fc378003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:40:59.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.923+0000 7fc392000640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 0x7fc378004820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc380001830 tx=0x7fc3780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162a8598aaa8419e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:59.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.923+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38002abc0 con 0x7fc378004350 2024-05-26T15:40:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.923+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38002ad40 con 0x7fc378004350 2024-05-26T15:40:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.923+0000 7fc391600640 1 -- 172.21.15.8:0/1546436958 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380032680 con 0x7fc378004350 2024-05-26T15:40:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.924+0000 7fc393e00640 1 -- 172.21.15.8:0/1546436958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 msgr2=0x7fc378004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.924+0000 7fc393e00640 1 --2- 172.21.15.8:0/1546436958 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 0x7fc378004820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc380001830 tx=0x7fc3780057f0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.924+0000 7fc393400640 1 -- 172.21.15.8:0/1546436958 reap_dead start 2024-05-26T15:40:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.924+0000 7fc393e00640 1 -- 172.21.15.8:0/1546436958 shutdown_connections 2024-05-26T15:40:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.924+0000 7fc393e00640 1 -- 172.21.15.8:0/1546436958 >> 172.21.15.8:0/1546436958 conn(0x7fc3940b13f0 msgr2=0x7fc3940b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:40:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.924+0000 7fc393e00640 1 -- 172.21.15.8:0/1546436958 shutdown_connections 2024-05-26T15:40:59.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.924+0000 7fc393e00640 1 -- 172.21.15.8:0/1546436958 wait complete. 2024-05-26T15:40:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.926+0000 7fc393e00640 1 Processor -- start 2024-05-26T15:40:59.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.926+0000 7fc393e00640 1 -- start start 2024-05-26T15:40:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.927+0000 7fc393e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 0x7fc3940cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.927+0000 7fc393e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3941549a0 0x7fc394154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.927+0000 7fc393e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc394146b80 0x7fc394147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.927+0000 7fc393e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3941545b0 con 0x7fc378004350 2024-05-26T15:40:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.927+0000 7fc393e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc394155340 con 0x7fc3941549a0 2024-05-26T15:40:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.927+0000 7fc393e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc394156650 con 0x7fc394146b80 2024-05-26T15:40:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.927+0000 7fc392a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 0x7fc3940cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.927+0000 7fc392a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 0x7fc3940cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42360/0 (socket says 172.21.15.8:42360) 2024-05-26T15:40:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.927+0000 7fc392a00640 1 -- 172.21.15.8:0/3467455543 learned_addr learned my addr 172.21.15.8:0/3467455543 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:40:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.928+0000 7fc393400640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc394146b80 0x7fc394147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.928+0000 7fc392000640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3941549a0 0x7fc394154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.928+0000 7fc392a00640 1 -- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc394146b80 msgr2=0x7fc394147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.928+0000 7fc392a00640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc394146b80 0x7fc394147010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.928+0000 7fc392a00640 1 -- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3941549a0 msgr2=0x7fc394154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:40:59.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.928+0000 7fc392a00640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3941549a0 0x7fc394154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:40:59.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.928+0000 7fc392a00640 1 -- 172.21.15.8:0/3467455543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394147550 con 0x7fc378004350 2024-05-26T15:40:59.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.928+0000 7fc392a00640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 0x7fc3940cd9b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc3840108c0 tx=0x7fc384010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:59.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.928+0000 7fc38aa00640 1 -- 172.21.15.8:0/3467455543 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38400eb00 con 0x7fc378004350 2024-05-26T15:40:59.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.929+0000 7fc38aa00640 1 -- 172.21.15.8:0/3467455543 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38400ec60 con 0x7fc378004350 2024-05-26T15:40:59.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.929+0000 7fc393e00640 1 -- 172.21.15.8:0/3467455543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3941555b0 con 0x7fc378004350 2024-05-26T15:40:59.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.929+0000 7fc38aa00640 1 -- 172.21.15.8:0/3467455543 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38401c400 con 0x7fc378004350 2024-05-26T15:40:59.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.929+0000 7fc393e00640 1 -- 172.21.15.8:0/3467455543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc394155b70 con 0x7fc378004350 2024-05-26T15:40:59.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.930+0000 7fc393e00640 1 -- 172.21.15.8:0/3467455543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39404e280 con 0x7fc378004350 2024-05-26T15:40:59.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.931+0000 7fc38aa00640 1 -- 172.21.15.8:0/3467455543 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc38401c560 con 0x7fc378004350 2024-05-26T15:40:59.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.932+0000 7fc38aa00640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc37406ac30 0x7fc37406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:40:59.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.933+0000 7fc38aa00640 1 -- 172.21.15.8:0/3467455543 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc384089d40 con 0x7fc378004350 2024-05-26T15:40:59.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.933+0000 7fc392000640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc37406ac30 0x7fc37406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:40:59.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.935+0000 7fc392000640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc37406ac30 0x7fc37406d0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc380001830 tx=0x7fc380009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:40:59.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:40:59.937+0000 7fc38aa00640 1 -- 172.21.15.8:0/3467455543 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc384054ac0 con 0x7fc378004350 2024-05-26T15:41:00.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.174+0000 7fc393e00640 1 -- 172.21.15.8:0/3467455543 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3940cf140 con 0x7fc378004350 2024-05-26T15:41:00.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.175+0000 7fc38aa00640 1 -- 172.21.15.8:0/3467455543 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4718 (secure 0 0 0) 0x7fc3840580e0 con 0x7fc378004350 2024-05-26T15:41:00.174 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:00.174 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/384485744","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":384485744},{"type":"v1","addr":"172.21.15.8:6834","nonce":384485744}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1741847973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1741847973},{"type":"v1","addr":"172.21.15.8:6835","nonce":1741847973}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/580400504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":580400504},{"type":"v1","addr":"172.21.15.47:6836","nonce":580400504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:39:32.881224+0000","modified":"2024-05-26T15:40:01.486240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6837/1464782370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":1464782370},{"type":"v1","addr":"172.21.15.47:6837","nonce":1464782370}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-26T15:41:00.179 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2024-05-26T15:41:00.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 -- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc37406ac30 msgr2=0x7fc37406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc37406ac30 0x7fc37406d0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc380001830 tx=0x7fc380009030 comp rx=0 tx=0).stop 2024-05-26T15:41:00.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 -- 172.21.15.8:0/3467455543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 msgr2=0x7fc3940cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 0x7fc3940cd9b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc3840108c0 tx=0x7fc384010d80 comp rx=0 tx=0).stop 2024-05-26T15:41:00.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 -- 172.21.15.8:0/3467455543 shutdown_connections 2024-05-26T15:41:00.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc394146b80 0x7fc394147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc37406ac30 0x7fc37406d0f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc3941549a0 0x7fc394154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 --2- 172.21.15.8:0/3467455543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc378004350 0x7fc3940cd9b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 -- 172.21.15.8:0/3467455543 >> 172.21.15.8:0/3467455543 conn(0x7fc3940b13f0 msgr2=0x7fc3940cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:00.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 -- 172.21.15.8:0/3467455543 shutdown_connections 2024-05-26T15:41:00.180 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.178+0000 7fc393e00640 1 -- 172.21.15.8:0/3467455543 wait complete. 2024-05-26T15:41:00.196 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:41:00.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.402+0000 7f7350200640 1 Processor -- start 2024-05-26T15:41:00.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.402+0000 7f7350200640 1 -- start start 2024-05-26T15:41:00.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.403+0000 7f7350200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7348144150 0x7f73480b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.403+0000 7f7350200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7348070d70 0x7f73480cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.403+0000 7f7350200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73480b1db0 con 0x7f7348144530 2024-05-26T15:41:00.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.404+0000 7f7350200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480cc8f0 con 0x7f7348070d70 2024-05-26T15:41:00.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.404+0000 7f7350200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480cbac0 con 0x7f7348144150 2024-05-26T15:41:00.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.404+0000 7f734ce00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7348144530 0x7f7348070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:36704/0 (socket says 172.21.15.8:36704) 2024-05-26T15:41:00.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.404+0000 7f734ce00640 1 -- 172.21.15.8:0/108825348 learned_addr learned my addr 172.21.15.8:0/108825348 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:00.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.404+0000 7f734d800640 1 --2- 172.21.15.8:0/108825348 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7348144150 0x7f73480b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.404+0000 7f734e200640 1 --2- 172.21.15.8:0/108825348 >> v2:172.21.15.47:3300/0 conn(0x7f7348070d70 0x7f73480cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.404 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.404+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46329380 0 0) 0x7f73480b1db0 con 0x7f7348144530 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.404+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7330003520 con 0x7f7348144530 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1880732415 0 0) 0x7f7330003520 con 0x7f7348144530 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7348144150 msgr2=0x7f73480b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 --2- 172.21.15.8:0/108825348 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7348144150 0x7f73480b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 >> v2:172.21.15.47:3300/0 conn(0x7f7348070d70 msgr2=0x7f73480cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 --2- 172.21.15.8:0/108825348 >> v2:172.21.15.47:3300/0 conn(0x7f7348070d70 0x7f73480cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480ccb90 con 0x7f7348144530 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f7334001670 con 0x7f7348144530 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 >> v1:172.21.15.8:6789/0 conn(0x7f7348144530 legacy=0x7f7348070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 --2- 172.21.15.8:0/108825348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7330003970 0x7f7330003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 --2- 172.21.15.8:0/108825348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73300047c0 0x7f7330004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 --2- 172.21.15.8:0/108825348 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7348144150 0x7f7330005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480cc8f0 con 0x7f73300047c0 2024-05-26T15:41:00.405 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480cbac0 con 0x7f7330003970 2024-05-26T15:41:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733000fd90 con 0x7f7348144150 2024-05-26T15:41:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.405+0000 7f734ce00640 1 --2- 172.21.15.8:0/108825348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73300047c0 0x7f7330004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.406+0000 7f734ce00640 1 -- 172.21.15.8:0/108825348 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7348144150 msgr2=0x7f7330005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.406+0000 7f734ce00640 1 --2- 172.21.15.8:0/108825348 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7348144150 0x7f7330005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.406+0000 7f734ce00640 1 -- 172.21.15.8:0/108825348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7330003970 msgr2=0x7f7330003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.406+0000 7f734ce00640 1 --2- 172.21.15.8:0/108825348 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7330003970 0x7f7330003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.406+0000 7f734ce00640 1 -- 172.21.15.8:0/108825348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7330003520 con 0x7f73300047c0 2024-05-26T15:41:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.407+0000 7f734ce00640 1 --2- 172.21.15.8:0/108825348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73300047c0 0x7f7330004c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f733400c0e0 tx=0x7f73300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f450e36603c60fb server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.407+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334005ad0 con 0x7f73300047c0 2024-05-26T15:41:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.407+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733402d070 con 0x7f73300047c0 2024-05-26T15:41:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.407+0000 7f7347e00640 1 -- 172.21.15.8:0/108825348 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334005e90 con 0x7f73300047c0 2024-05-26T15:41:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.407+0000 7f7350200640 1 -- 172.21.15.8:0/108825348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73300047c0 msgr2=0x7f7330004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.407+0000 7f7350200640 1 --2- 172.21.15.8:0/108825348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73300047c0 0x7f7330004c40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f733400c0e0 tx=0x7f73300057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.407+0000 7f734e200640 1 -- 172.21.15.8:0/108825348 reap_dead start 2024-05-26T15:41:00.407 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.408+0000 7f7350200640 1 -- 172.21.15.8:0/108825348 shutdown_connections 2024-05-26T15:41:00.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.408+0000 7f7350200640 1 -- 172.21.15.8:0/108825348 >> 172.21.15.8:0/108825348 conn(0x7f73480b0570 msgr2=0x7f73480b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:00.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.408+0000 7f7350200640 1 -- 172.21.15.8:0/108825348 shutdown_connections 2024-05-26T15:41:00.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.408+0000 7f7350200640 1 -- 172.21.15.8:0/108825348 wait complete. 2024-05-26T15:41:00.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.409+0000 7f7350200640 1 Processor -- start 2024-05-26T15:41:00.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.410+0000 7f7350200640 1 -- start start 2024-05-26T15:41:00.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.410+0000 7f7350200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73300047c0 0x7f7348159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.410+0000 7f7350200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734813e080 0x7f734813f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.410+0000 7f7350200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7348159f30 0x7f734815d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f7350200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7348159d90 con 0x7f734813e080 2024-05-26T15:41:00.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f7350200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734813fbb0 con 0x7f7348159f30 2024-05-26T15:41:00.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f7350200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734813e5f0 con 0x7f73300047c0 2024-05-26T15:41:00.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f734ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734813e080 0x7f734813f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f734ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734813e080 0x7f734813f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42384/0 (socket says 172.21.15.8:42384) 2024-05-26T15:41:00.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f734ce00640 1 -- 172.21.15.8:0/2873502162 learned_addr learned my addr 172.21.15.8:0/2873502162 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:00.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f734d800640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73300047c0 0x7f7348159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f734e200640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7348159f30 0x7f734815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f734ce00640 1 -- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73300047c0 msgr2=0x7f7348159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f734ce00640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73300047c0 0x7f7348159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f734ce00640 1 -- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7348159f30 msgr2=0x7f734815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f734ce00640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7348159f30 0x7f734815d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.411+0000 7f734ce00640 1 -- 172.21.15.8:0/2873502162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734813eb90 con 0x7f734813e080 2024-05-26T15:41:00.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.412+0000 7f734ce00640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734813e080 0x7f734813f670 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f733402ac50 tx=0x7f7334001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:00.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.412+0000 7f7345600640 1 -- 172.21.15.8:0/2873502162 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334005bc0 con 0x7f734813e080 2024-05-26T15:41:00.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.412+0000 7f7345600640 1 -- 172.21.15.8:0/2873502162 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7334005d20 con 0x7f734813e080 2024-05-26T15:41:00.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.412+0000 7f7345600640 1 -- 172.21.15.8:0/2873502162 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334007290 con 0x7f734813e080 2024-05-26T15:41:00.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.412+0000 7f7350200640 1 -- 172.21.15.8:0/2873502162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734813ee70 con 0x7f734813e080 2024-05-26T15:41:00.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.412+0000 7f7350200640 1 -- 172.21.15.8:0/2873502162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734815a660 con 0x7f734813e080 2024-05-26T15:41:00.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.413+0000 7f7350200640 1 -- 172.21.15.8:0/2873502162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73480672c0 con 0x7f734813e080 2024-05-26T15:41:00.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.414+0000 7f7345600640 1 -- 172.21.15.8:0/2873502162 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f733402f030 con 0x7f734813e080 2024-05-26T15:41:00.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.415+0000 7f7345600640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f732806ac00 0x7f732806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.415+0000 7f7345600640 1 -- 172.21.15.8:0/2873502162 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f73340a9890 con 0x7f734813e080 2024-05-26T15:41:00.414 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.416+0000 7f734d800640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f732806ac00 0x7f732806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.417+0000 7f734d800640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f732806ac00 0x7f732806d0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f733c009970 tx=0x7f733c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:00.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.420+0000 7f7345600640 1 -- 172.21.15.8:0/2873502162 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7334074710 con 0x7f734813e080 2024-05-26T15:41:00.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.614+0000 7f7350200640 1 -- 172.21.15.8:0/2873502162 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73480672c0 con 0x7f734813e080 2024-05-26T15:41:00.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.616+0000 7f7345600640 1 -- 172.21.15.8:0/2873502162 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18218 (secure 0 0 0) 0x7f7334077d30 con 0x7f734813e080 2024-05-26T15:41:00.615 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:00.615 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:40:15.613427+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:39:31.319843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-26T15:39:31.879470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-26T15:39:35.408580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:41:00.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 -- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f732806ac00 msgr2=0x7f732806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f732806ac00 0x7f732806d0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f733c009970 tx=0x7f733c008040 comp rx=0 tx=0).stop 2024-05-26T15:41:00.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 -- 172.21.15.8:0/2873502162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734813e080 msgr2=0x7f734813f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734813e080 0x7f734813f670 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f733402ac50 tx=0x7f7334001930 comp rx=0 tx=0).stop 2024-05-26T15:41:00.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 -- 172.21.15.8:0/2873502162 shutdown_connections 2024-05-26T15:41:00.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f732806ac00 0x7f732806d0c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7348159f30 0x7f734815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f734813e080 0x7f734813f670 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 --2- 172.21.15.8:0/2873502162 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73300047c0 0x7f7348159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 -- 172.21.15.8:0/2873502162 >> 172.21.15.8:0/2873502162 conn(0x7f73480b0570 msgr2=0x7f734806a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:00.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 -- 172.21.15.8:0/2873502162 shutdown_connections 2024-05-26T15:41:00.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.619+0000 7f7350200640 1 -- 172.21.15.8:0/2873502162 wait complete. 2024-05-26T15:41:00.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-26T15:41:00.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.839+0000 7fb80f600640 1 Processor -- start 2024-05-26T15:41:00.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.840+0000 7fb80f600640 1 -- start start 2024-05-26T15:41:00.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.841+0000 7fb80f600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb808144150 0x7fb8080b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.841+0000 7fb80f600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb808144530 0x7fb808070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.841+0000 7fb80f600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8080b1db0 con 0x7fb808070ba0 2024-05-26T15:41:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.841+0000 7fb80f600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb808071050 con 0x7fb808144150 2024-05-26T15:41:00.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.841+0000 7fb80f600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080cc8f0 con 0x7fb808144530 2024-05-26T15:41:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.842+0000 7fb80cc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb808144150 0x7fb8080b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.842+0000 7fb80cc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb808144150 0x7fb8080b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42400/0 (socket says 172.21.15.8:42400) 2024-05-26T15:41:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.842+0000 7fb80cc00640 1 -- 172.21.15.8:0/3724911663 learned_addr learned my addr 172.21.15.8:0/3724911663 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.842+0000 7fb807e00640 1 --2- 172.21.15.8:0/3724911663 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb808144530 0x7fb808070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.842+0000 7fb80cc00640 1 -- 172.21.15.8:0/3724911663 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb808144530 msgr2=0x7fb808070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.842+0000 7fb80cc00640 1 --2- 172.21.15.8:0/3724911663 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb808144530 0x7fb808070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.842+0000 7fb80cc00640 1 -- 172.21.15.8:0/3724911663 >> v1:172.21.15.47:6789/0 conn(0x7fb808070ba0 legacy=0x7fb8080cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:00.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.842+0000 7fb80cc00640 1 -- 172.21.15.8:0/3724911663 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8080cbac0 con 0x7fb808144150 2024-05-26T15:41:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.843+0000 7fb80cc00640 1 --2- 172.21.15.8:0/3724911663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808144150 0x7fb8080b1870 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009870 tx=0x7fb7fc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc23df3f5dc9357 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.844+0000 7fb807400640 1 -- 172.21.15.8:0/3724911663 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc032440 con 0x7fb808144150 2024-05-26T15:41:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.844+0000 7fb807400640 1 -- 172.21.15.8:0/3724911663 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc0325a0 con 0x7fb808144150 2024-05-26T15:41:00.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.844+0000 7fb807400640 1 -- 172.21.15.8:0/3724911663 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc032930 con 0x7fb808144150 2024-05-26T15:41:00.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.844+0000 7fb80f600640 1 -- 172.21.15.8:0/3724911663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808144150 msgr2=0x7fb8080b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.844+0000 7fb80f600640 1 --2- 172.21.15.8:0/3724911663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808144150 0x7fb8080b1870 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009870 tx=0x7fb7fc02a210 comp rx=0 tx=0).stop 2024-05-26T15:41:00.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.844+0000 7fb80f600640 1 -- 172.21.15.8:0/3724911663 shutdown_connections 2024-05-26T15:41:00.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.844+0000 7fb80f600640 1 --2- 172.21.15.8:0/3724911663 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb808144530 0x7fb808070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.844+0000 7fb80f600640 1 --2- 172.21.15.8:0/3724911663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808144150 0x7fb8080b1870 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.844+0000 7fb80f600640 1 -- 172.21.15.8:0/3724911663 >> 172.21.15.8:0/3724911663 conn(0x7fb8080b0570 msgr2=0x7fb8080b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:00.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.844+0000 7fb80f600640 1 -- 172.21.15.8:0/3724911663 shutdown_connections 2024-05-26T15:41:00.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.845+0000 7fb80f600640 1 -- 172.21.15.8:0/3724911663 wait complete. 2024-05-26T15:41:00.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.846+0000 7fb80f600640 1 Processor -- start 2024-05-26T15:41:00.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.846+0000 7fb80f600640 1 -- start start 2024-05-26T15:41:00.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.847+0000 7fb80f600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808070ba0 0x7fb8080ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.847+0000 7fb80f600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb808144150 0x7fb808139770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.847+0000 7fb80f600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808144530 0x7fb808142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.847+0000 7fb80f600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080adaf0 con 0x7fb808070ba0 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.847+0000 7fb80f600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080ae220 con 0x7fb808144530 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.847+0000 7fb80f600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8081e45e0 con 0x7fb808144150 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.847+0000 7fb80cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808070ba0 0x7fb8080ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb80cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808070ba0 0x7fb8080ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42414/0 (socket says 172.21.15.8:42414) 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb80cc00640 1 -- 172.21.15.8:0/2056201603 learned_addr learned my addr 172.21.15.8:0/2056201603 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb807e00640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb808144150 0x7fb808139770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb80cc00640 1 -- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb808144150 msgr2=0x7fb808139770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb80cc00640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb808144150 0x7fb808139770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb80cc00640 1 -- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808144530 msgr2=0x7fb808142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb80cc00640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808144530 0x7fb808142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:00.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb80cc00640 1 -- 172.21.15.8:0/2056201603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0094d0 con 0x7fb808070ba0 2024-05-26T15:41:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb80cc00640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808070ba0 0x7fb8080ad5b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009870 tx=0x7fb7fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb804c00640 1 -- 172.21.15.8:0/2056201603 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc032440 con 0x7fb808070ba0 2024-05-26T15:41:00.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb804c00640 1 -- 172.21.15.8:0/2056201603 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7fc030b80 con 0x7fb808070ba0 2024-05-26T15:41:00.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.848+0000 7fb804c00640 1 -- 172.21.15.8:0/2056201603 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc03d420 con 0x7fb808070ba0 2024-05-26T15:41:00.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.849+0000 7fb80f600640 1 -- 172.21.15.8:0/2056201603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8080ae470 con 0x7fb808070ba0 2024-05-26T15:41:00.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.849+0000 7fb80f600640 1 -- 172.21.15.8:0/2056201603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8080aea30 con 0x7fb808070ba0 2024-05-26T15:41:00.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.850+0000 7fb80f600640 1 -- 172.21.15.8:0/2056201603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8080672c0 con 0x7fb808070ba0 2024-05-26T15:41:00.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.851+0000 7fb804c00640 1 -- 172.21.15.8:0/2056201603 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7fc039040 con 0x7fb808070ba0 2024-05-26T15:41:00.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.852+0000 7fb804c00640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb7e806ac00 0x7fb7e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:00.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.852+0000 7fb804c00640 1 -- 172.21.15.8:0/2056201603 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb7fc0aa340 con 0x7fb808070ba0 2024-05-26T15:41:00.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.853+0000 7fb807e00640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb7e806ac00 0x7fb7e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:00.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.854+0000 7fb807e00640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb7e806ac00 0x7fb7e806d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4006fd0 tx=0x7fb7f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:00.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:00.857+0000 7fb804c00640 1 -- 172.21.15.8:0/2056201603 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb7fc075250 con 0x7fb808070ba0 2024-05-26T15:41:01.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.094+0000 7fb80f600640 1 -- 172.21.15.8:0/2056201603 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb8080cb240 con 0x7fb808070ba0 2024-05-26T15:41:01.094 INFO:tasks.ceph.mon.a.smithi008.stderr:2024-05-26T15:41:01.096+0000 7f3e01a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-26T15:41:01.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.111+0000 7fb804c00640 1 -- 172.21.15.8:0/2056201603 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb7fc078870 con 0x7fb808070ba0 2024-05-26T15:41:01.110 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-26T15:41:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.114+0000 7fb80f600640 1 -- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb7e806ac00 msgr2=0x7fb7e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.114+0000 7fb80f600640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb7e806ac00 0x7fb7e806d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4006fd0 tx=0x7fb7f4008040 comp rx=0 tx=0).stop 2024-05-26T15:41:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.114+0000 7fb80f600640 1 -- 172.21.15.8:0/2056201603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808070ba0 msgr2=0x7fb8080ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.114+0000 7fb80f600640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808070ba0 0x7fb8080ad5b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009870 tx=0x7fb7fc0046c0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.114+0000 7fb80f600640 1 -- 172.21.15.8:0/2056201603 shutdown_connections 2024-05-26T15:41:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.114+0000 7fb80f600640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb7e806ac00 0x7fb7e806d0c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.114+0000 7fb80f600640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb808144530 0x7fb808142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.114+0000 7fb80f600640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb808144150 0x7fb808139770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.114+0000 7fb80f600640 1 --2- 172.21.15.8:0/2056201603 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb808070ba0 0x7fb8080ad5b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.114+0000 7fb80f600640 1 -- 172.21.15.8:0/2056201603 >> 172.21.15.8:0/2056201603 conn(0x7fb8080b0570 msgr2=0x7fb8080b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:01.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.115+0000 7fb80f600640 1 -- 172.21.15.8:0/2056201603 shutdown_connections 2024-05-26T15:41:01.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.115+0000 7fb80f600640 1 -- 172.21.15.8:0/2056201603 wait complete. 2024-05-26T15:41:01.131 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-26T15:41:01.141 INFO:tasks.ceph.mds.b.smithi047.stderr: -6040> 2024-05-26T15:39:34.279+0000 7f0978600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-26T15:41:01.231 INFO:tasks.ceph.mds.b.smithi047.stdout:starting mds.b at 2024-05-26T15:41:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.329+0000 7f425ca00640 1 Processor -- start 2024-05-26T15:41:01.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.330+0000 7f425ca00640 1 -- start start 2024-05-26T15:41:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.331+0000 7f425ca00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42580cdc70 0x7f425806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.331+0000 7f425ca00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425806cf90 con 0x7f42580cd890 2024-05-26T15:41:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.331+0000 7f425ca00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42580ce200 con 0x7f4258071390 2024-05-26T15:41:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.331+0000 7f425ca00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42580cc0a0 con 0x7f42580cdc70 2024-05-26T15:41:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.332+0000 7f4257400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f42580cd890 0x7f425815ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38988/0 (socket says 172.21.15.8:38988) 2024-05-26T15:41:01.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.332+0000 7f4257400640 1 -- 172.21.15.8:0/1774309763 learned_addr learned my addr 172.21.15.8:0/1774309763 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:01.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.332+0000 7f4257e00640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42580cdc70 0x7f425806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:01.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.332+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814297524 0 0) 0x7f425806cf90 con 0x7f42580cd890 2024-05-26T15:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.332+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f423c003520 con 0x7f42580cd890 2024-05-26T15:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1977191919 0 0) 0x7f423c003520 con 0x7f42580cd890 2024-05-26T15:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42580cdc70 msgr2=0x7f425806dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42580cdc70 0x7f425806dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 >> v1:172.21.15.47:6789/0 conn(0x7f4258071390 legacy=0x7f425815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425806d230 con 0x7f42580cd890 2024-05-26T15:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f4248001670 con 0x7f42580cd890 2024-05-26T15:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 >> v1:172.21.15.8:6789/0 conn(0x7f42580cd890 legacy=0x7f425815ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0039a0 0x7f423c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:01.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c0047c0 0x7f423c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42580cdc70 0x7f423c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42580cc0a0 con 0x7f423c0047c0 2024-05-26T15:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c00ba60 con 0x7f423c0039a0 2024-05-26T15:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c00bc20 con 0x7f42580cdc70 2024-05-26T15:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.333+0000 7f4256a00640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c0047c0 0x7f423c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.334+0000 7f4257400640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0039a0 0x7f423c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.334+0000 7f4257e00640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42580cdc70 0x7f423c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.334+0000 7f4256a00640 1 -- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42580cdc70 msgr2=0x7f423c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.334+0000 7f4256a00640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42580cdc70 0x7f423c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.334+0000 7f4256a00640 1 -- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0039a0 msgr2=0x7f423c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.334+0000 7f4256a00640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0039a0 0x7f423c003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.334+0000 7f4256a00640 1 -- 172.21.15.8:0/1774309763 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c003520 con 0x7f423c0047c0 2024-05-26T15:41:01.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.335+0000 7f4256a00640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c0047c0 0x7f423c004c40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4258071820 tx=0x7f423c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99021e25500c4fd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:01.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.335+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440052d0 con 0x7f423c0047c0 2024-05-26T15:41:01.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.335+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244005430 con 0x7f423c0047c0 2024-05-26T15:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.335+0000 7f4256000640 1 -- 172.21.15.8:0/1774309763 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424402ab70 con 0x7f423c0047c0 2024-05-26T15:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.336+0000 7f425ca00640 1 -- 172.21.15.8:0/1774309763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c0047c0 msgr2=0x7f423c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.336+0000 7f425ca00640 1 --2- 172.21.15.8:0/1774309763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f423c0047c0 0x7f423c004c40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4258071820 tx=0x7f423c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.336+0000 7f4257e00640 1 -- 172.21.15.8:0/1774309763 reap_dead start 2024-05-26T15:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.336+0000 7f425ca00640 1 -- 172.21.15.8:0/1774309763 shutdown_connections 2024-05-26T15:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.336+0000 7f425ca00640 1 -- 172.21.15.8:0/1774309763 >> 172.21.15.8:0/1774309763 conn(0x7f42580ce4d0 msgr2=0x7f42580ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.336+0000 7f425ca00640 1 -- 172.21.15.8:0/1774309763 shutdown_connections 2024-05-26T15:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.336+0000 7f425ca00640 1 -- 172.21.15.8:0/1774309763 wait complete. 2024-05-26T15:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.338+0000 7f425ca00640 1 Processor -- start 2024-05-26T15:41:01.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.338+0000 7f425ca00640 1 -- start start 2024-05-26T15:41:01.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f425ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0047c0 0x7f425814e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f425ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42580accf0 0x7f42581f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f425ca00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42581535b0 0x7f4258153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f425ca00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42581f6ed0 con 0x7f42580accf0 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f425ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425814ea80 con 0x7f423c0047c0 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f425ca00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4258153120 con 0x7f42581535b0 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f4256a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42580accf0 0x7f42581f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f4256a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42580accf0 0x7f42581f5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45278/0 (socket says 172.21.15.8:45278) 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f4256a00640 1 -- 172.21.15.8:0/1838612781 learned_addr learned my addr 172.21.15.8:0/1838612781 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f4256a00640 1 -- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42581535b0 msgr2=0x7f4258153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f4257400640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0047c0 0x7f425814e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f4257e00640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42581535b0 0x7f4258153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f4256a00640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42581535b0 0x7f4258153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f4256a00640 1 -- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0047c0 msgr2=0x7f425814e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f4256a00640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0047c0 0x7f425814e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.339+0000 7f4256a00640 1 -- 172.21.15.8:0/1838612781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42581f6910 con 0x7f42580accf0 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.340+0000 7f4256a00640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42580accf0 0x7f42581f5fa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f424402a450 tx=0x7f4244001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.340+0000 7f424f400640 1 -- 172.21.15.8:0/1838612781 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440072c0 con 0x7f42580accf0 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.340+0000 7f424f400640 1 -- 172.21.15.8:0/1838612781 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244007420 con 0x7f42580accf0 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.340+0000 7f425ca00640 1 -- 172.21.15.8:0/1838612781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42581f6bf0 con 0x7f42580accf0 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.340+0000 7f424f400640 1 -- 172.21.15.8:0/1838612781 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42440067d0 con 0x7f42580accf0 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.340+0000 7f425ca00640 1 -- 172.21.15.8:0/1838612781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42581f64e0 con 0x7f42580accf0 2024-05-26T15:41:01.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.341+0000 7f425ca00640 1 -- 172.21.15.8:0/1838612781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4258152c10 con 0x7f42580accf0 2024-05-26T15:41:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.342+0000 7f424f400640 1 -- 172.21.15.8:0/1838612781 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4244006930 con 0x7f42580accf0 2024-05-26T15:41:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.343+0000 7f424f400640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f423806ac30 0x7f423806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.344+0000 7f424f400640 1 -- 172.21.15.8:0/1838612781 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f42440a9390 con 0x7f42580accf0 2024-05-26T15:41:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.344+0000 7f4257400640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f423806ac30 0x7f423806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.345+0000 7f4257400640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f423806ac30 0x7f423806d0f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f42480017e0 tx=0x7f4248009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:01.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.348+0000 7f424f400640 1 -- 172.21.15.8:0/1838612781 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4258152c10 con 0x7f42580accf0 2024-05-26T15:41:01.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:01.588+0000 7f425ca00640 1 -- 172.21.15.8:0/1838612781 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4258152c10 con 0x7f42580accf0 2024-05-26T15:41:02.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.115+0000 7f424f400640 1 -- 172.21.15.8:0/1838612781 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4258152c10 con 0x7f42580accf0 2024-05-26T15:41:02.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.119+0000 7f425ca00640 1 -- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f423806ac30 msgr2=0x7f423806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:02.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.119+0000 7f425ca00640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f423806ac30 0x7f423806d0f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f42480017e0 tx=0x7f4248009040 comp rx=0 tx=0).stop 2024-05-26T15:41:02.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.119+0000 7f425ca00640 1 -- 172.21.15.8:0/1838612781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42580accf0 msgr2=0x7f42581f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:02.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.119+0000 7f425ca00640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42580accf0 0x7f42581f5fa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f424402a450 tx=0x7f4244001120 comp rx=0 tx=0).stop 2024-05-26T15:41:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.119+0000 7f425ca00640 1 -- 172.21.15.8:0/1838612781 shutdown_connections 2024-05-26T15:41:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.119+0000 7f425ca00640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42581535b0 0x7f4258153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.119+0000 7f425ca00640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42580accf0 0x7f42581f5fa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.119+0000 7f425ca00640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f423806ac30 0x7f423806d0f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.119+0000 7f425ca00640 1 --2- 172.21.15.8:0/1838612781 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f423c0047c0 0x7f425814e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.120+0000 7f425ca00640 1 -- 172.21.15.8:0/1838612781 >> 172.21.15.8:0/1838612781 conn(0x7f42580ce4d0 msgr2=0x7f42580b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.120+0000 7f425ca00640 1 -- 172.21.15.8:0/1838612781 shutdown_connections 2024-05-26T15:41:02.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.120+0000 7f425ca00640 1 -- 172.21.15.8:0/1838612781 wait complete. 2024-05-26T15:41:02.140 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-26T15:41:02.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.363+0000 7fd4ce600640 1 Processor -- start 2024-05-26T15:41:02.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.364+0000 7fd4ce600640 1 -- start start 2024-05-26T15:41:02.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.366+0000 7fd4ce600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd4c80cc400 0x7fd4c80aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:02.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.366+0000 7fd4ce600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd4c80b3cb0 0x7fd4c80b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:02.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.366+0000 7fd4ce600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c80b4640 con 0x7fd4c80af1b0 2024-05-26T15:41:02.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.366+0000 7fd4ce600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c80ae220 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.366+0000 7fd4ce600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c815ba80 con 0x7fd4c80cc400 2024-05-26T15:41:02.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.366+0000 7fd4c7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd4c80b3cb0 0x7fd4c80b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:02.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.366+0000 7fd4c7400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd4c80cc400 0x7fd4c80aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:02.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.366+0000 7fd4c7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd4c80b3cb0 0x7fd4c80b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:57430/0 (socket says 172.21.15.8:57430) 2024-05-26T15:41:02.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.366+0000 7fd4c7e00640 1 -- 172.21.15.8:0/1439676556 learned_addr learned my addr 172.21.15.8:0/1439676556 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:02.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.367+0000 7fd4c7e00640 1 -- 172.21.15.8:0/1439676556 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd4c80cc400 msgr2=0x7fd4c80aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:02.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.367+0000 7fd4c7e00640 1 --2- 172.21.15.8:0/1439676556 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd4c80cc400 0x7fd4c80aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:02.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.367+0000 7fd4c7e00640 1 -- 172.21.15.8:0/1439676556 >> v1:172.21.15.47:6789/0 conn(0x7fd4c80af1b0 legacy=0x7fd4c815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:02.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.367+0000 7fd4c7e00640 1 -- 172.21.15.8:0/1439676556 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c815bd60 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.369+0000 7fd4c7e00640 1 --2- 172.21.15.8:0/1439676556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4c80b3cb0 0x7fd4c80b4100 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009870 tx=0x7fd4c002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef04c13d0645d9f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.369+0000 7fd4c6000640 1 -- 172.21.15.8:0/1439676556 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0032440 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.370+0000 7fd4c6000640 1 -- 172.21.15.8:0/1439676556 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c00325a0 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.370+0000 7fd4c6000640 1 -- 172.21.15.8:0/1439676556 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0032930 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.370+0000 7fd4ce600640 1 -- 172.21.15.8:0/1439676556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4c80b3cb0 msgr2=0x7fd4c80b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:02.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.370+0000 7fd4ce600640 1 --2- 172.21.15.8:0/1439676556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4c80b3cb0 0x7fd4c80b4100 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009870 tx=0x7fd4c002a1c0 comp rx=0 tx=0).stop 2024-05-26T15:41:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.370+0000 7fd4ce600640 1 -- 172.21.15.8:0/1439676556 shutdown_connections 2024-05-26T15:41:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.370+0000 7fd4ce600640 1 --2- 172.21.15.8:0/1439676556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4c80b3cb0 0x7fd4c80b4100 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.370+0000 7fd4ce600640 1 --2- 172.21.15.8:0/1439676556 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd4c80cc400 0x7fd4c80aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:02.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.370+0000 7fd4ce600640 1 -- 172.21.15.8:0/1439676556 >> 172.21.15.8:0/1439676556 conn(0x7fd4c806a660 msgr2=0x7fd4c80b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:02.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.371+0000 7fd4ce600640 1 -- 172.21.15.8:0/1439676556 shutdown_connections 2024-05-26T15:41:02.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.371+0000 7fd4ce600640 1 -- 172.21.15.8:0/1439676556 wait complete. 2024-05-26T15:41:02.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.373+0000 7fd4ce600640 1 Processor -- start 2024-05-26T15:41:02.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.373+0000 7fd4ce600640 1 -- start start 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4ce600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4c80b3cb0 0x7fd4c814c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4ce600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4c80cc400 0x7fd4c81f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4ce600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd4c815d4e0 0x7fd4c81f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4ce600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81f3150 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4ce600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81f28b0 con 0x7fd4c80cc400 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4ce600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81f2b90 con 0x7fd4c815d4e0 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4c7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4c80b3cb0 0x7fd4c814c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4c7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4c80b3cb0 0x7fd4c814c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45292/0 (socket says 172.21.15.8:45292) 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4c7400640 1 -- 172.21.15.8:0/3958563879 learned_addr learned my addr 172.21.15.8:0/3958563879 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4c6a00640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4c80cc400 0x7fd4c81f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:02.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4c7400640 1 -- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd4c815d4e0 msgr2=0x7fd4c81f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:02.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4c7400640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd4c815d4e0 0x7fd4c81f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:02.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4c7400640 1 -- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4c80cc400 msgr2=0x7fd4c81f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:02.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4c7400640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4c80cc400 0x7fd4c81f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:02.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.375+0000 7fd4c7400640 1 -- 172.21.15.8:0/3958563879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c00094d0 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.376+0000 7fd4c7400640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4c80b3cb0 0x7fd4c814c5c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800efc0 tx=0x7fd4b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:02.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.376+0000 7fd4bf400640 1 -- 172.21.15.8:0/3958563879 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8009b80 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.376+0000 7fd4bf400640 1 -- 172.21.15.8:0/3958563879 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b800f040 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.376+0000 7fd4bf400640 1 -- 172.21.15.8:0/3958563879 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b80146a0 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.376+0000 7fd4ce600640 1 -- 172.21.15.8:0/3958563879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c81f2e70 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.376+0000 7fd4ce600640 1 -- 172.21.15.8:0/3958563879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c815d990 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.377+0000 7fd4ce600640 1 -- 172.21.15.8:0/3958563879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c815dbb0 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.379+0000 7fd4bf400640 1 -- 172.21.15.8:0/3958563879 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd4b8014800 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.380+0000 7fd4bf400640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd4a406ac00 0x7fd4a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.380+0000 7fd4bf400640 1 -- 172.21.15.8:0/3958563879 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fd4b808a520 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.380+0000 7fd4c6a00640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd4a406ac00 0x7fd4a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:02.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.381+0000 7fd4c6a00640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd4a406ac00 0x7fd4a406d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80cab90 tx=0x7fd4b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:02.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.385+0000 7fd4bf400640 1 -- 172.21.15.8:0/3958563879 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd4b8055360 con 0x7fd4c80b3cb0 2024-05-26T15:41:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:02.583+0000 7fd4ce600640 1 -- 172.21.15.8:0/3958563879 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd4c80681d0 con 0x7fd4c80b3cb0 2024-05-26T15:41:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.126+0000 7fd4bf400640 1 -- 172.21.15.8:0/3958563879 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd4b8058980 con 0x7fd4c80b3cb0 2024-05-26T15:41:03.125 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2024-05-26T15:41:03.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.131+0000 7fd4ce600640 1 -- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd4a406ac00 msgr2=0x7fd4a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.131+0000 7fd4ce600640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd4a406ac00 0x7fd4a406d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80cab90 tx=0x7fd4b0009040 comp rx=0 tx=0).stop 2024-05-26T15:41:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.131+0000 7fd4ce600640 1 -- 172.21.15.8:0/3958563879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4c80b3cb0 msgr2=0x7fd4c814c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.131+0000 7fd4ce600640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4c80b3cb0 0x7fd4c814c5c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800efc0 tx=0x7fd4b800c490 comp rx=0 tx=0).stop 2024-05-26T15:41:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.131+0000 7fd4ce600640 1 -- 172.21.15.8:0/3958563879 shutdown_connections 2024-05-26T15:41:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.131+0000 7fd4ce600640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd4c815d4e0 0x7fd4c81f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.131+0000 7fd4ce600640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd4a406ac00 0x7fd4a406d0c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.131+0000 7fd4ce600640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4c80cc400 0x7fd4c81f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:03.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.131+0000 7fd4ce600640 1 --2- 172.21.15.8:0/3958563879 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd4c80b3cb0 0x7fd4c814c5c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.131+0000 7fd4ce600640 1 -- 172.21.15.8:0/3958563879 >> 172.21.15.8:0/3958563879 conn(0x7fd4c806a660 msgr2=0x7fd4c806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.132+0000 7fd4ce600640 1 -- 172.21.15.8:0/3958563879 shutdown_connections 2024-05-26T15:41:03.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.132+0000 7fd4ce600640 1 -- 172.21.15.8:0/3958563879 wait complete. 2024-05-26T15:41:03.155 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-26T15:41:03.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.363+0000 7f3c25400640 1 Processor -- start 2024-05-26T15:41:03.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.363+0000 7f3c25400640 1 -- start start 2024-05-26T15:41:03.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.364+0000 7f3c25400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c2015ff90 0x7f3c200b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:03.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.364+0000 7f3c25400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c200d0b40 con 0x7f3c200b4b20 2024-05-26T15:41:03.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.364+0000 7f3c25400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c200d0e20 con 0x7f3c200b5ac0 2024-05-26T15:41:03.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.365+0000 7f3c25400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200d1100 con 0x7f3c2015ff90 2024-05-26T15:41:03.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.365+0000 7f3c24a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3c200b4b20 0x7f3c200d1be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38992/0 (socket says 172.21.15.8:38992) 2024-05-26T15:41:03.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.365+0000 7f3c24a00640 1 -- 172.21.15.8:0/1784837255 learned_addr learned my addr 172.21.15.8:0/1784837255 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:03.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.365+0000 7f3c1fe00640 1 --2- 172.21.15.8:0/1784837255 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c2015ff90 0x7f3c200b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:03.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.365+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141437280 0 0) 0x7f3c200d0b40 con 0x7f3c200b4b20 2024-05-26T15:41:03.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.365+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c04003520 con 0x7f3c200b4b20 2024-05-26T15:41:03.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 242629940 0 0) 0x7f3c04003520 con 0x7f3c200b4b20 2024-05-26T15:41:03.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c2015ff90 msgr2=0x7f3c200b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 --2- 172.21.15.8:0/1784837255 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c2015ff90 0x7f3c200b82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 >> v1:172.21.15.47:6789/0 conn(0x7f3c200b5ac0 legacy=0x7f3c200b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c200d13e0 con 0x7f3c200b4b20 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f3c180019f0 con 0x7f3c200b4b20 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 >> v1:172.21.15.8:6789/0 conn(0x7f3c200b4b20 legacy=0x7f3c200d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 --2- 172.21.15.8:0/1784837255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c040039a0 0x7f3c04003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 --2- 172.21.15.8:0/1784837255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c040047c0 0x7f3c04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 --2- 172.21.15.8:0/1784837255 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c2015ff90 0x7f3c04005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200d1100 con 0x7f3c040039a0 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0400ba60 con 0x7f3c040047c0 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0400bc20 con 0x7f3c2015ff90 2024-05-26T15:41:03.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.366+0000 7f3c1fe00640 1 --2- 172.21.15.8:0/1784837255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c040039a0 0x7f3c04003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:03.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.367+0000 7f3c1fe00640 1 -- 172.21.15.8:0/1784837255 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c2015ff90 msgr2=0x7f3c04005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:03.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.367+0000 7f3c1fe00640 1 --2- 172.21.15.8:0/1784837255 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c2015ff90 0x7f3c04005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:03.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.367+0000 7f3c1fe00640 1 -- 172.21.15.8:0/1784837255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c040047c0 msgr2=0x7f3c04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:03.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.367+0000 7f3c1fe00640 1 --2- 172.21.15.8:0/1784837255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c040047c0 0x7f3c04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:03.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.367+0000 7f3c1fe00640 1 -- 172.21.15.8:0/1784837255 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04003520 con 0x7f3c040039a0 2024-05-26T15:41:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.368+0000 7f3c1fe00640 1 --2- 172.21.15.8:0/1784837255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c040039a0 0x7f3c04003dc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009a90 tx=0x7f3c040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5bd62ae7244725 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.368+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10031400 con 0x7f3c040039a0 2024-05-26T15:41:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.368+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1002d050 con 0x7f3c040039a0 2024-05-26T15:41:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.368+0000 7f3c1f400640 1 -- 172.21.15.8:0/1784837255 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10031780 con 0x7f3c040039a0 2024-05-26T15:41:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.369+0000 7f3c25400640 1 -- 172.21.15.8:0/1784837255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c040039a0 msgr2=0x7f3c04003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.369+0000 7f3c25400640 1 --2- 172.21.15.8:0/1784837255 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c040039a0 0x7f3c04003dc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009a90 tx=0x7f3c040057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.369+0000 7f3c24a00640 1 -- 172.21.15.8:0/1784837255 reap_dead start 2024-05-26T15:41:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.369+0000 7f3c25400640 1 -- 172.21.15.8:0/1784837255 shutdown_connections 2024-05-26T15:41:03.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.369+0000 7f3c25400640 1 -- 172.21.15.8:0/1784837255 >> 172.21.15.8:0/1784837255 conn(0x7f3c2006b8c0 msgr2=0x7f3c200cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:03.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.369+0000 7f3c25400640 1 -- 172.21.15.8:0/1784837255 shutdown_connections 2024-05-26T15:41:03.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.369+0000 7f3c25400640 1 -- 172.21.15.8:0/1784837255 wait complete. 2024-05-26T15:41:03.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.371+0000 7f3c25400640 1 Processor -- start 2024-05-26T15:41:03.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.371+0000 7f3c25400640 1 -- start start 2024-05-26T15:41:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c25400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c040039a0 0x7f3c2014e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c25400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c200aea00 0x7f3c200ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c25400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c200acef0 0x7f3c200c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c25400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200ad3a0 con 0x7f3c200acef0 2024-05-26T15:41:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c25400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2014fa20 con 0x7f3c200aea00 2024-05-26T15:41:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c25400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200c8e20 con 0x7f3c040039a0 2024-05-26T15:41:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c24a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c200acef0 0x7f3c200c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c24a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c200acef0 0x7f3c200c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45314/0 (socket says 172.21.15.8:45314) 2024-05-26T15:41:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c24a00640 1 -- 172.21.15.8:0/3967043867 learned_addr learned my addr 172.21.15.8:0/3967043867 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:03.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c17e00640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c200aea00 0x7f3c200ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.372+0000 7f3c1fe00640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c040039a0 0x7f3c2014e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c24a00640 1 -- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c040039a0 msgr2=0x7f3c2014e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c24a00640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c040039a0 0x7f3c2014e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c24a00640 1 -- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c200aea00 msgr2=0x7f3c200ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c24a00640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c200aea00 0x7f3c200ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:03.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c24a00640 1 -- 172.21.15.8:0/3967043867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2014f0f0 con 0x7f3c200acef0 2024-05-26T15:41:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c24a00640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c200acef0 0x7f3c200c8080 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3c200d07d0 tx=0x7f3c1800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c1cc00640 1 -- 172.21.15.8:0/3967043867 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800a610 con 0x7f3c200acef0 2024-05-26T15:41:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c1cc00640 1 -- 172.21.15.8:0/3967043867 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1800a790 con 0x7f3c200acef0 2024-05-26T15:41:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c25400640 1 -- 172.21.15.8:0/3967043867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2014f3d0 con 0x7f3c200acef0 2024-05-26T15:41:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c1cc00640 1 -- 172.21.15.8:0/3967043867 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800ab40 con 0x7f3c200acef0 2024-05-26T15:41:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.373+0000 7f3c25400640 1 -- 172.21.15.8:0/3967043867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2014ecb0 con 0x7f3c200acef0 2024-05-26T15:41:03.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.374+0000 7f3c25400640 1 -- 172.21.15.8:0/3967043867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2014fbb0 con 0x7f3c200acef0 2024-05-26T15:41:03.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.375+0000 7f3c1cc00640 1 -- 172.21.15.8:0/3967043867 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c1800aca0 con 0x7f3c200acef0 2024-05-26T15:41:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.376+0000 7f3c1cc00640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3bfc06ac00 0x7f3bfc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.377+0000 7f3c1cc00640 1 -- 172.21.15.8:0/3967043867 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6340+0+0 (secure 0 0 0) 0x7f3c180892b0 con 0x7f3c200acef0 2024-05-26T15:41:03.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.377+0000 7f3c1fe00640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3bfc06ac00 0x7f3bfc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:03.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.378+0000 7f3c1fe00640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3bfc06ac00 0x7f3bfc06d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c10033000 tx=0x7f3c10008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:03.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.381+0000 7f3c1cc00640 1 -- 172.21.15.8:0/3967043867 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3c180541b0 con 0x7f3c200acef0 2024-05-26T15:41:03.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:03.580+0000 7f3c25400640 1 -- 172.21.15.8:0/3967043867 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c200ce930 con 0x7f3c200acef0 2024-05-26T15:41:04.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.129+0000 7f3c1cc00640 1 -- 172.21.15.8:0/3967043867 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3c180577d0 con 0x7f3c200acef0 2024-05-26T15:41:04.327 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.135+0000 7f3c25400640 1 -- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3bfc06ac00 msgr2=0x7f3bfc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.135+0000 7f3c25400640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3bfc06ac00 0x7f3bfc06d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c10033000 tx=0x7f3c10008030 comp rx=0 tx=0).stop 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.135+0000 7f3c25400640 1 -- 172.21.15.8:0/3967043867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c200acef0 msgr2=0x7f3c200c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.135+0000 7f3c25400640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c200acef0 0x7f3c200c8080 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3c200d07d0 tx=0x7f3c1800ccd0 comp rx=0 tx=0).stop 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.136+0000 7f3c25400640 1 -- 172.21.15.8:0/3967043867 shutdown_connections 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.136+0000 7f3c25400640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c200acef0 0x7f3c200c8080 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.136+0000 7f3c25400640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3bfc06ac00 0x7f3bfc06d0c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.136+0000 7f3c25400640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c200aea00 0x7f3c200ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.136+0000 7f3c25400640 1 --2- 172.21.15.8:0/3967043867 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c040039a0 0x7f3c2014e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.136+0000 7f3c25400640 1 -- 172.21.15.8:0/3967043867 >> 172.21.15.8:0/3967043867 conn(0x7f3c2006b8c0 msgr2=0x7f3c200cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.136+0000 7f3c25400640 1 -- 172.21.15.8:0/3967043867 shutdown_connections 2024-05-26T15:41:04.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.136+0000 7f3c25400640 1 -- 172.21.15.8:0/3967043867 wait complete. 2024-05-26T15:41:04.329 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-26T15:41:04.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.550+0000 7ff48e800640 1 Processor -- start 2024-05-26T15:41:04.548 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.550+0000 7ff48e800640 1 -- start start 2024-05-26T15:41:04.550 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.551+0000 7ff48e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff48806b480 0x7ff4880d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:04.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.551+0000 7ff48e800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff48806b860 0x7ff4880cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:04.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.552+0000 7ff48e800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4880d1cb0 con 0x7ff4880cde70 2024-05-26T15:41:04.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.552+0000 7ff48e800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4880d10c0 con 0x7ff48806b860 2024-05-26T15:41:04.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.552+0000 7ff48e800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880d1380 con 0x7ff48806b480 2024-05-26T15:41:04.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.552+0000 7ff48de00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff4880cde70 0x7ff48815fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:38998/0 (socket says 172.21.15.8:38998) 2024-05-26T15:41:04.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.552+0000 7ff48de00640 1 -- 172.21.15.8:0/4020464273 learned_addr learned my addr 172.21.15.8:0/4020464273 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:04.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.552+0000 7ff48ca00640 1 --2- 172.21.15.8:0/4020464273 >> v2:172.21.15.8:3300/0 conn(0x7ff48806b860 0x7ff4880cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:04.551 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.552+0000 7ff48d400640 1 --2- 172.21.15.8:0/4020464273 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff48806b480 0x7ff4880d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:04.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.553+0000 7ff487e00640 1 -- 172.21.15.8:0/4020464273 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195007107 0 0) 0x7ff4880d1cb0 con 0x7ff4880cde70 2024-05-26T15:41:04.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.553+0000 7ff487e00640 1 -- 172.21.15.8:0/4020464273 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff470003520 con 0x7ff4880cde70 2024-05-26T15:41:04.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.553+0000 7ff48ca00640 1 -- 172.21.15.8:0/4020464273 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff48806b480 msgr2=0x7ff4880d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:04.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.553+0000 7ff48ca00640 1 --2- 172.21.15.8:0/4020464273 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff48806b480 0x7ff4880d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:04.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.553+0000 7ff48ca00640 1 -- 172.21.15.8:0/4020464273 >> v1:172.21.15.8:6789/0 conn(0x7ff4880cde70 legacy=0x7ff48815fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:04.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.553+0000 7ff48ca00640 1 -- 172.21.15.8:0/4020464273 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880d1660 con 0x7ff48806b860 2024-05-26T15:41:04.552 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.554+0000 7ff48ca00640 1 --2- 172.21.15.8:0/4020464273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff48806b860 0x7ff4880cd930 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff4740097a0 tx=0x7ff47402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8876d121bf5eefb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:04.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.554+0000 7ff487e00640 1 -- 172.21.15.8:0/4020464273 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474032440 con 0x7ff48806b860 2024-05-26T15:41:04.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.554+0000 7ff487e00640 1 -- 172.21.15.8:0/4020464273 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4740325a0 con 0x7ff48806b860 2024-05-26T15:41:04.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.554+0000 7ff487e00640 1 -- 172.21.15.8:0/4020464273 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474032910 con 0x7ff48806b860 2024-05-26T15:41:04.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.555+0000 7ff48e800640 1 -- 172.21.15.8:0/4020464273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff48806b860 msgr2=0x7ff4880cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:04.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.555+0000 7ff48e800640 1 --2- 172.21.15.8:0/4020464273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff48806b860 0x7ff4880cd930 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff4740097a0 tx=0x7ff47402a180 comp rx=0 tx=0).stop 2024-05-26T15:41:04.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.555+0000 7ff48e800640 1 -- 172.21.15.8:0/4020464273 shutdown_connections 2024-05-26T15:41:04.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.555+0000 7ff48e800640 1 --2- 172.21.15.8:0/4020464273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff48806b860 0x7ff4880cd930 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:04.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.555+0000 7ff48e800640 1 --2- 172.21.15.8:0/4020464273 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff48806b480 0x7ff4880d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:04.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.555+0000 7ff48e800640 1 -- 172.21.15.8:0/4020464273 >> 172.21.15.8:0/4020464273 conn(0x7ff4880cfa10 msgr2=0x7ff4880d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:04.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.555+0000 7ff48e800640 1 -- 172.21.15.8:0/4020464273 shutdown_connections 2024-05-26T15:41:04.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.555+0000 7ff48e800640 1 -- 172.21.15.8:0/4020464273 wait complete. 2024-05-26T15:41:04.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.558+0000 7ff48e800640 1 Processor -- start 2024-05-26T15:41:04.556 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.558+0000 7ff48e800640 1 -- start start 2024-05-26T15:41:04.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.559+0000 7ff48e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff48806b480 0x7ff4880cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:04.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.559+0000 7ff48e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff48806b860 0x7ff488150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:04.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cde70 0x7ff4880cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:04.559 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48e800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881511f0 con 0x7ff4880cde70 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48e800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c9b60 con 0x7ff48806b480 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48e800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4880c9e40 con 0x7ff48806b860 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cde70 0x7ff4880cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cde70 0x7ff4880cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45330/0 (socket says 172.21.15.8:45330) 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48de00640 1 -- 172.21.15.8:0/2757583482 learned_addr learned my addr 172.21.15.8:0/2757583482 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48ca00640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff48806b860 0x7ff488150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48d400640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff48806b480 0x7ff4880cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48de00640 1 -- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff48806b860 msgr2=0x7ff488150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48de00640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff48806b860 0x7ff488150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48de00640 1 -- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff48806b480 msgr2=0x7ff4880cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48de00640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff48806b480 0x7ff4880cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:04.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.560+0000 7ff48de00640 1 -- 172.21.15.8:0/2757583482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474009400 con 0x7ff4880cde70 2024-05-26T15:41:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.561+0000 7ff48de00640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cde70 0x7ff4880cac00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff48000caa0 tx=0x7ff48000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.561+0000 7ff485600640 1 -- 172.21.15.8:0/2757583482 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48000aba0 con 0x7ff4880cde70 2024-05-26T15:41:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.561+0000 7ff485600640 1 -- 172.21.15.8:0/2757583482 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48000ad00 con 0x7ff4880cde70 2024-05-26T15:41:04.561 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.561+0000 7ff485600640 1 -- 172.21.15.8:0/2757583482 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480012640 con 0x7ff4880cde70 2024-05-26T15:41:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.561+0000 7ff48e800640 1 -- 172.21.15.8:0/2757583482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4880ca120 con 0x7ff4880cde70 2024-05-26T15:41:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.561+0000 7ff48e800640 1 -- 172.21.15.8:0/2757583482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4880ca6e0 con 0x7ff4880cde70 2024-05-26T15:41:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.563+0000 7ff48e800640 1 -- 172.21.15.8:0/2757583482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4880ca8d0 con 0x7ff4880cde70 2024-05-26T15:41:04.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.564+0000 7ff485600640 1 -- 172.21.15.8:0/2757583482 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff480007070 con 0x7ff4880cde70 2024-05-26T15:41:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.564+0000 7ff485600640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff46806ac30 0x7ff46806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.565+0000 7ff485600640 1 -- 172.21.15.8:0/2757583482 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7ff480089340 con 0x7ff4880cde70 2024-05-26T15:41:04.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.565+0000 7ff48d400640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff46806ac30 0x7ff46806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:04.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.566+0000 7ff48d400640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff46806ac30 0x7ff46806d0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff47c006fd0 tx=0x7ff47c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:04.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.569+0000 7ff485600640 1 -- 172.21.15.8:0/2757583482 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff480054430 con 0x7ff4880cde70 2024-05-26T15:41:04.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:04.775+0000 7ff48e800640 1 -- 172.21.15.8:0/2757583482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff48804e210 con 0x7ff4880cde70 2024-05-26T15:41:05.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.146+0000 7ff485600640 1 -- 172.21.15.8:0/2757583482 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7ff480057a50 con 0x7ff4880cde70 2024-05-26T15:41:05.145 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data_ec' removed 2024-05-26T15:41:05.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.151+0000 7ff48e800640 1 -- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff46806ac30 msgr2=0x7ff46806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:05.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.151+0000 7ff48e800640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff46806ac30 0x7ff46806d0f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff47c006fd0 tx=0x7ff47c008040 comp rx=0 tx=0).stop 2024-05-26T15:41:05.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.151+0000 7ff48e800640 1 -- 172.21.15.8:0/2757583482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cde70 msgr2=0x7ff4880cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:05.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.151+0000 7ff48e800640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cde70 0x7ff4880cac00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff48000caa0 tx=0x7ff48000cf60 comp rx=0 tx=0).stop 2024-05-26T15:41:05.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.151+0000 7ff48e800640 1 -- 172.21.15.8:0/2757583482 shutdown_connections 2024-05-26T15:41:05.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.151+0000 7ff48e800640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4880cde70 0x7ff4880cac00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:05.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.151+0000 7ff48e800640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff48806b860 0x7ff488150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:05.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.152+0000 7ff48e800640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff46806ac30 0x7ff46806d0f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:05.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.152+0000 7ff48e800640 1 --2- 172.21.15.8:0/2757583482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff48806b480 0x7ff4880cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:05.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.152+0000 7ff48e800640 1 -- 172.21.15.8:0/2757583482 >> 172.21.15.8:0/2757583482 conn(0x7ff4880cfa10 msgr2=0x7ff4880d2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:05.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.152+0000 7ff48e800640 1 -- 172.21.15.8:0/2757583482 shutdown_connections 2024-05-26T15:41:05.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.152+0000 7ff48e800640 1 -- 172.21.15.8:0/2757583482 wait complete. 2024-05-26T15:41:05.175 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-26T15:41:05.175 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-26T15:41:05.175 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-26T15:41:05.175 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:41:05.176 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-26T15:41:05.176 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-26T15:41:05.176 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-26T15:41:05.176 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:41:05.176 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-26T15:41:05.176 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-26T15:41:05.176 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-26T15:41:05.176 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:41:05.177 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-26T15:41:05.177 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-26T15:41:05.177 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-26T15:41:05.177 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:41:05.194 INFO:tasks.ceph.mds.a:Stopped 2024-05-26T15:41:05.194 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-26T15:41:05.203 INFO:tasks.ceph.mds.b:Stopped 2024-05-26T15:41:05.203 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-26T15:41:05.204 INFO:tasks.ceph.mds.c:Stopped 2024-05-26T15:41:05.204 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-26T15:41:05.205 INFO:tasks.ceph.mds.d:Stopped 2024-05-26T15:41:05.205 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-26T15:41:05.249 INFO:tasks.ceph.mds.a:Started 2024-05-26T15:41:05.250 DEBUG:teuthology.parallel:result is None 2024-05-26T15:41:05.252 INFO:tasks.ceph.mds.b:Started 2024-05-26T15:41:05.252 DEBUG:teuthology.parallel:result is None 2024-05-26T15:41:05.256 INFO:tasks.ceph.mds.c:Started 2024-05-26T15:41:05.256 DEBUG:teuthology.parallel:result is None 2024-05-26T15:41:05.258 INFO:tasks.ceph.mds.d:Started 2024-05-26T15:41:05.258 DEBUG:teuthology.parallel:result is None 2024-05-26T15:41:05.258 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-26T15:41:05.403 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2024-05-26T15:41:05.406 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2024-05-26T15:41:05.411 INFO:tasks.ceph.mds.b.smithi047.stdout:starting mds.b at 2024-05-26T15:41:05.411 INFO:tasks.ceph.mds.d.smithi047.stdout:starting mds.d at 2024-05-26T15:41:05.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.457+0000 7f1e57000640 1 Processor -- start 2024-05-26T15:41:05.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.457+0000 7f1e57000640 1 -- start start 2024-05-26T15:41:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.458+0000 7f1e57000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1e50161030 0x7f1e500cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.458+0000 7f1e57000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1e5015cf60 0x7f1e500cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.458+0000 7f1e57000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e501617e0 con 0x7f1e5015cb80 2024-05-26T15:41:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.458+0000 7f1e57000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e500cce00 con 0x7f1e50161030 2024-05-26T15:41:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.458+0000 7f1e57000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e50161500 con 0x7f1e5015cf60 2024-05-26T15:41:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.458+0000 7f1e47e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1e50161030 0x7f1e500cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.458+0000 7f1e47e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1e50161030 0x7f1e500cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45360/0 (socket says 172.21.15.8:45360) 2024-05-26T15:41:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.458+0000 7f1e47e00640 1 -- 172.21.15.8:0/3110186766 learned_addr learned my addr 172.21.15.8:0/3110186766 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:05.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.459+0000 7f1e55000640 1 --2- 172.21.15.8:0/3110186766 >> v2:172.21.15.47:3300/0 conn(0x7f1e5015cf60 0x7f1e500cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.459+0000 7f1e47e00640 1 -- 172.21.15.8:0/3110186766 >> v2:172.21.15.47:3300/0 conn(0x7f1e5015cf60 msgr2=0x7f1e500cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.459+0000 7f1e47e00640 1 --2- 172.21.15.8:0/3110186766 >> v2:172.21.15.47:3300/0 conn(0x7f1e5015cf60 0x7f1e500cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.459+0000 7f1e47e00640 1 -- 172.21.15.8:0/3110186766 >> v1:172.21.15.47:6789/0 conn(0x7f1e5015cb80 legacy=0x7f1e50160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.459+0000 7f1e47e00640 1 -- 172.21.15.8:0/3110186766 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e500cd470 con 0x7f1e50161030 2024-05-26T15:41:05.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.459+0000 7f1e55000640 1 --2- 172.21.15.8:0/3110186766 >> v2:172.21.15.47:3300/0 conn(0x7f1e5015cf60 0x7f1e500cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:05.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.460+0000 7f1e47e00640 1 --2- 172.21.15.8:0/3110186766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 0x7f1e500cdf50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1e5006e290 tx=0x7f1e3802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414d66067b961af6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:05.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.460+0000 7f1e4f400640 1 -- 172.21.15.8:0/3110186766 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38032440 con 0x7f1e50161030 2024-05-26T15:41:05.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.460+0000 7f1e4f400640 1 -- 172.21.15.8:0/3110186766 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e380325a0 con 0x7f1e50161030 2024-05-26T15:41:05.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.460+0000 7f1e4f400640 1 -- 172.21.15.8:0/3110186766 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38032930 con 0x7f1e50161030 2024-05-26T15:41:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.461+0000 7f1e57000640 1 -- 172.21.15.8:0/3110186766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 msgr2=0x7f1e500cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.461+0000 7f1e57000640 1 --2- 172.21.15.8:0/3110186766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 0x7f1e500cdf50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1e5006e290 tx=0x7f1e3802a160 comp rx=0 tx=0).stop 2024-05-26T15:41:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.461+0000 7f1e57000640 1 -- 172.21.15.8:0/3110186766 shutdown_connections 2024-05-26T15:41:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.461+0000 7f1e57000640 1 --2- 172.21.15.8:0/3110186766 >> v2:172.21.15.47:3300/0 conn(0x7f1e5015cf60 0x7f1e500cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.461+0000 7f1e57000640 1 --2- 172.21.15.8:0/3110186766 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 0x7f1e500cdf50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.461+0000 7f1e57000640 1 -- 172.21.15.8:0/3110186766 >> 172.21.15.8:0/3110186766 conn(0x7f1e500b0570 msgr2=0x7f1e500b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.461+0000 7f1e57000640 1 -- 172.21.15.8:0/3110186766 shutdown_connections 2024-05-26T15:41:05.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.461+0000 7f1e57000640 1 -- 172.21.15.8:0/3110186766 wait complete. 2024-05-26T15:41:05.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.463+0000 7f1e57000640 1 Processor -- start 2024-05-26T15:41:05.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.463+0000 7f1e57000640 1 -- start start 2024-05-26T15:41:05.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e57000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1e5015cb80 0x7f1e501f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e57000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e5015cf60 0x7f1e500ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e57000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 0x7f1e500ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e57000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5015e500 con 0x7f1e50161030 2024-05-26T15:41:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e57000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5015e7e0 con 0x7f1e5015cf60 2024-05-26T15:41:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e57000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5015eac0 con 0x7f1e5015cb80 2024-05-26T15:41:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e55000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 0x7f1e500ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e55000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 0x7f1e500ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45362/0 (socket says 172.21.15.8:45362) 2024-05-26T15:41:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e55000640 1 -- 172.21.15.8:0/1930475638 learned_addr learned my addr 172.21.15.8:0/1930475638 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e47e00640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e5015cf60 0x7f1e500ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:05.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.464+0000 7f1e4fe00640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1e5015cb80 0x7f1e501f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e55000640 1 -- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1e5015cb80 msgr2=0x7f1e501f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e55000640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1e5015cb80 0x7f1e501f1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e55000640 1 -- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e5015cf60 msgr2=0x7f1e500ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e55000640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e5015cf60 0x7f1e500ac910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e55000640 1 -- 172.21.15.8:0/1930475638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e380094d0 con 0x7f1e50161030 2024-05-26T15:41:05.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e47e00640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e5015cf60 0x7f1e500ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:41:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e55000640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 0x7f1e500ace50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800ce80 tx=0x7f1e4800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e4cc00640 1 -- 172.21.15.8:0/1930475638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800d840 con 0x7f1e50161030 2024-05-26T15:41:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e4cc00640 1 -- 172.21.15.8:0/1930475638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4800d9e0 con 0x7f1e50161030 2024-05-26T15:41:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e57000640 1 -- 172.21.15.8:0/1930475638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5015eda0 con 0x7f1e50161030 2024-05-26T15:41:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.465+0000 7f1e4cc00640 1 -- 172.21.15.8:0/1930475638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4800dd90 con 0x7f1e50161030 2024-05-26T15:41:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.466+0000 7f1e57000640 1 -- 172.21.15.8:0/1930475638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e501f2520 con 0x7f1e50161030 2024-05-26T15:41:05.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.467+0000 7f1e57000640 1 -- 172.21.15.8:0/1930475638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5015f2c0 con 0x7f1e50161030 2024-05-26T15:41:05.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.468+0000 7f1e4cc00640 1 -- 172.21.15.8:0/1930475638 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e48015440 con 0x7f1e50161030 2024-05-26T15:41:05.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.469+0000 7f1e4cc00640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1e2c06ac00 0x7f1e2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:05.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.469+0000 7f1e4cc00640 1 -- 172.21.15.8:0/1930475638 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1e48089be0 con 0x7f1e50161030 2024-05-26T15:41:05.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.469+0000 7f1e4fe00640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1e2c06ac00 0x7f1e2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:05.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.470+0000 7f1e4fe00640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1e2c06ac00 0x7f1e2c06d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1e40000f60 tx=0x7f1e40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:05.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.473+0000 7f1e4cc00640 1 -- 172.21.15.8:0/1930475638 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1e5015f2c0 con 0x7f1e50161030 2024-05-26T15:41:05.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:05.692+0000 7f1e57000640 1 -- 172.21.15.8:0/1930475638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1e5015f2c0 con 0x7f1e50161030 2024-05-26T15:41:06.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.447+0000 7f1e4cc00640 1 -- 172.21.15.8:0/1930475638 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1e5015f2c0 con 0x7f1e50161030 2024-05-26T15:41:06.446 INFO:teuthology.orchestra.run.smithi008.stderr: removed all blocklist entries 2024-05-26T15:41:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 -- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1e2c06ac00 msgr2=0x7f1e2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1e2c06ac00 0x7f1e2c06d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1e40000f60 tx=0x7f1e40009040 comp rx=0 tx=0).stop 2024-05-26T15:41:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 -- 172.21.15.8:0/1930475638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 msgr2=0x7f1e500ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 0x7f1e500ace50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1e4800ce80 tx=0x7f1e4800a710 comp rx=0 tx=0).stop 2024-05-26T15:41:06.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 -- 172.21.15.8:0/1930475638 shutdown_connections 2024-05-26T15:41:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e50161030 0x7f1e500ace50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1e2c06ac00 0x7f1e2c06d0c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e5015cf60 0x7f1e500ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 --2- 172.21.15.8:0/1930475638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1e5015cb80 0x7f1e501f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 -- 172.21.15.8:0/1930475638 >> 172.21.15.8:0/1930475638 conn(0x7f1e500b0570 msgr2=0x7f1e500b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 -- 172.21.15.8:0/1930475638 shutdown_connections 2024-05-26T15:41:06.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.451+0000 7f1e57000640 1 -- 172.21.15.8:0/1930475638 wait complete. 2024-05-26T15:41:06.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-26T15:41:06.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.679+0000 7fedda600640 1 Processor -- start 2024-05-26T15:41:06.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.679+0000 7fedda600640 1 -- start start 2024-05-26T15:41:06.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.681+0000 7fedda600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fedd40b03d0 0x7fedd40cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:06.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.681+0000 7fedda600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fedd40cc580 0x7fedd41625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:06.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.681+0000 7fedda600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd4161540 con 0x7fedd4157ff0 2024-05-26T15:41:06.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.681+0000 7fedda600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd41621c0 con 0x7fedd40b03d0 2024-05-26T15:41:06.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.681+0000 7fedda600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd41583d0 con 0x7fedd40cc580 2024-05-26T15:41:06.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.681+0000 7fedd3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fedd40b03d0 0x7fedd40cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:06.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.681+0000 7fedd3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fedd40b03d0 0x7fedd40cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45370/0 (socket says 172.21.15.8:45370) 2024-05-26T15:41:06.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.681+0000 7fedd3e00640 1 -- 172.21.15.8:0/2033503091 learned_addr learned my addr 172.21.15.8:0/2033503091 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:06.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.682+0000 7fedd9c00640 1 --2- 172.21.15.8:0/2033503091 >> v2:172.21.15.47:3300/0 conn(0x7fedd40cc580 0x7fedd41625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:06.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.682+0000 7fedd3e00640 1 -- 172.21.15.8:0/2033503091 >> v2:172.21.15.47:3300/0 conn(0x7fedd40cc580 msgr2=0x7fedd41625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:06.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.682+0000 7fedd3e00640 1 --2- 172.21.15.8:0/2033503091 >> v2:172.21.15.47:3300/0 conn(0x7fedd40cc580 0x7fedd41625f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.682+0000 7fedd3e00640 1 -- 172.21.15.8:0/2033503091 >> v1:172.21.15.47:6789/0 conn(0x7fedd4157ff0 legacy=0x7fedd40afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:06.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.682+0000 7fedd3e00640 1 -- 172.21.15.8:0/2033503091 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd4161820 con 0x7fedd40b03d0 2024-05-26T15:41:06.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.683+0000 7fedd3e00640 1 --2- 172.21.15.8:0/2033503091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40b03d0 0x7fedd40cc040 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b11d0 tx=0x7fedc002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54243b92dcf6ce66 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:06.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.683+0000 7fedd3400640 1 -- 172.21.15.8:0/2033503091 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0032440 con 0x7fedd40b03d0 2024-05-26T15:41:06.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.683+0000 7fedd3400640 1 -- 172.21.15.8:0/2033503091 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc00325a0 con 0x7fedd40b03d0 2024-05-26T15:41:06.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.683+0000 7fedd3400640 1 -- 172.21.15.8:0/2033503091 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0032930 con 0x7fedd40b03d0 2024-05-26T15:41:06.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.684+0000 7fedda600640 1 -- 172.21.15.8:0/2033503091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40b03d0 msgr2=0x7fedd40cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:06.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.684+0000 7fedda600640 1 --2- 172.21.15.8:0/2033503091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40b03d0 0x7fedd40cc040 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b11d0 tx=0x7fedc002a230 comp rx=0 tx=0).stop 2024-05-26T15:41:06.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.684+0000 7fedda600640 1 -- 172.21.15.8:0/2033503091 shutdown_connections 2024-05-26T15:41:06.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.684+0000 7fedda600640 1 --2- 172.21.15.8:0/2033503091 >> v2:172.21.15.47:3300/0 conn(0x7fedd40cc580 0x7fedd41625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.684+0000 7fedda600640 1 --2- 172.21.15.8:0/2033503091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40b03d0 0x7fedd40cc040 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.684+0000 7fedda600640 1 -- 172.21.15.8:0/2033503091 >> 172.21.15.8:0/2033503091 conn(0x7fedd4070480 msgr2=0x7fedd4070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:06.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.684+0000 7fedda600640 1 -- 172.21.15.8:0/2033503091 shutdown_connections 2024-05-26T15:41:06.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.684+0000 7fedda600640 1 -- 172.21.15.8:0/2033503091 wait complete. 2024-05-26T15:41:06.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.686+0000 7fedda600640 1 Processor -- start 2024-05-26T15:41:06.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.686+0000 7fedda600640 1 -- start start 2024-05-26T15:41:06.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.687+0000 7fedda600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd40b03d0 0x7fedd41501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:06.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.687+0000 7fedda600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40cc580 0x7fedd415d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:06.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.687+0000 7fedda600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedd4157ff0 0x7fedd415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:06.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.687+0000 7fedda600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4151c20 con 0x7fedd40cc580 2024-05-26T15:41:06.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.687+0000 7fedda600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4150d10 con 0x7fedd40b03d0 2024-05-26T15:41:06.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.687+0000 7fedda600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd41f68b0 con 0x7fedd4157ff0 2024-05-26T15:41:06.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.687+0000 7fedd3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40cc580 0x7fedd415d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:06.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.687+0000 7fedd3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40cc580 0x7fedd415d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45378/0 (socket says 172.21.15.8:45378) 2024-05-26T15:41:06.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.687+0000 7fedd3e00640 1 -- 172.21.15.8:0/1559114025 learned_addr learned my addr 172.21.15.8:0/1559114025 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:06.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.688+0000 7fedd9200640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd40b03d0 0x7fedd41501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:06.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.688+0000 7fedd3e00640 1 -- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedd4157ff0 msgr2=0x7fedd415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:06.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.688+0000 7fedd3e00640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedd4157ff0 0x7fedd415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.688+0000 7fedd3e00640 1 -- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd40b03d0 msgr2=0x7fedd41501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:06.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.688+0000 7fedd3e00640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd40b03d0 0x7fedd41501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.688+0000 7fedd3e00640 1 -- 172.21.15.8:0/1559114025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc00094d0 con 0x7fedd40cc580 2024-05-26T15:41:06.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.688+0000 7fedd9200640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd40b03d0 0x7fedd41501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:06.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.688+0000 7fedd3e00640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40cc580 0x7fedd415d680 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fedc0000c00 tx=0x7fedc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:06.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.688+0000 7fedd0c00640 1 -- 172.21.15.8:0/1559114025 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0032440 con 0x7fedd40cc580 2024-05-26T15:41:06.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.689+0000 7fedd0c00640 1 -- 172.21.15.8:0/1559114025 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc0030b80 con 0x7fedd40cc580 2024-05-26T15:41:06.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.689+0000 7fedda600640 1 -- 172.21.15.8:0/1559114025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd4150a30 con 0x7fedd40cc580 2024-05-26T15:41:06.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.689+0000 7fedd0c00640 1 -- 172.21.15.8:0/1559114025 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc003d420 con 0x7fedd40cc580 2024-05-26T15:41:06.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.689+0000 7fedda600640 1 -- 172.21.15.8:0/1559114025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd41f6de0 con 0x7fedd40cc580 2024-05-26T15:41:06.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.690+0000 7fedda600640 1 -- 172.21.15.8:0/1559114025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd41635c0 con 0x7fedd40cc580 2024-05-26T15:41:06.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.691+0000 7fedd0c00640 1 -- 172.21.15.8:0/1559114025 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fedc0039040 con 0x7fedd40cc580 2024-05-26T15:41:06.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.692+0000 7fedd0c00640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fedb406ac00 0x7fedb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:06.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.692+0000 7fedd0c00640 1 -- 172.21.15.8:0/1559114025 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fedc00a9ee0 con 0x7fedd40cc580 2024-05-26T15:41:06.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.692+0000 7fedd9200640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fedb406ac00 0x7fedb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:06.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.694+0000 7fedd9200640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fedb406ac00 0x7fedb406d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b0370 tx=0x7fedc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:06.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.697+0000 7fedd0c00640 1 -- 172.21.15.8:0/1559114025 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fedc0075230 con 0x7fedd40cc580 2024-05-26T15:41:06.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.970+0000 7fedda600640 1 -- 172.21.15.8:0/1559114025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fedd404e280 con 0x7fedd40cc580 2024-05-26T15:41:06.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.971+0000 7fedd0c00640 1 -- 172.21.15.8:0/1559114025 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fedc0078850 con 0x7fedd40cc580 2024-05-26T15:41:06.969 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: "auth_dump": [ 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.a", 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3V1NmZ26wMRAAoZoNjeFBUXMxHbYTfCOtBA==", 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.970 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.b", 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB4V1Nmy8AOFRAAjOVwhaaLUK6wSxy7D1Z3QA==", 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.c", 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB4V1NmX+V9BhAAx6S6tCtBR2tDklqe7CG7wA==", 2024-05-26T15:41:06.971 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.d", 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB4V1NmXO+YIRAA88P2s22Ru5aq9vPYoW92qw==", 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2024-05-26T15:41:06.972 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.0", 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB7V1NmUOpZARAAc3uRvjCYeU4lJw7r1s3AiQ==", 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.973 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.1", 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB+V1Nmk/3GKxAAp8wyZeQKXPi9V+o7LVAbKg==", 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.2", 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCBV1NmLTbpOBAAaC6G7SPiVuU6KmTlRSClbA==", 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.974 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.3", 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCFV1NmYoKqFhAAflK4KjRRmrOu+EgBuQT7jg==", 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.975 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.4", 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCKV1NmqHWPBBAAruqt9oErqNVChgDC1iRGGA==", 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.5", 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCNV1NmgukeHxAAvVd3SjLYAJ6QZKmNwMmWow==", 2024-05-26T15:41:06.976 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.6", 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCQV1Nmd4vuOBAAJHtG1d3rWdmKu/7rTPOlBw==", 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.977 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.7", 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCUV1Nm/CGlBxAA8STfkaBPPGT7qdfhMsO42g==", 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.0", 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB4V1NmxdRoLhAAY+pqIQGp2qO1BhQMGzQCHg==", 2024-05-26T15:41:06.978 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.1", 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB5V1NmdWPVBxAAOZColRSycWDkdlALIYEyow==", 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2024-05-26T15:41:06.979 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.2", 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB4V1NmosBQOBAAKKnJi6JYefpiRa0WliTUyw==", 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.3", 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB5V1Nmu2cxEhAA7SM7KN9DjHqazqVSC1Fjeg==", 2024-05-26T15:41:06.980 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.admin", 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB2V1NmT7pDLBAA8v0iG713juyg3PQu/tILEg==", 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2024-05-26T15:41:06.981 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-mds", 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCcV1Nm3/CsNhAA8q8BcQ+CtFCAZ+VpvZe1yA==", 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-mds" 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-mgr", 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCcV1NmEhCtNhAAJepI9HNr8MuYGkO0otT+bg==", 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.982 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-osd", 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCcV1NmHCmtNhAAbMA+jyjtFj+IK6bKCeBTHQ==", 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-osd" 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rbd", 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCcV1NmsUGtNhAATQpSZAExr7MMT90UlDZ1gw==", 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-26T15:41:06.983 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCcV1Nmf1qtNhAA07LGPxwnST6K2/QCyvl0AQ==", 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.bootstrap-rgw", 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCcV1NmPXStNhAApG9iY8tM5OSqFAg+lKbFRw==", 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-26T15:41:06.984 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mgr.x", 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3V1Nm+T1xJhAA3mTY1BPQLGk3uIbA1mic8Q==", 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile mgr", 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mgr.y", 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3V1NmaWlhHBAAAmAg0cJJXK6UzcMmFMT/yw==", 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:41:06.985 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2024-05-26T15:41:06.986 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile mgr", 2024-05-26T15:41:06.986 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:41:06.986 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.986 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:06.986 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-05-26T15:41:06.986 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 -- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fedb406ac00 msgr2=0x7fedb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fedb406ac00 0x7fedb406d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b0370 tx=0x7fedc4008040 comp rx=0 tx=0).stop 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 -- 172.21.15.8:0/1559114025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40cc580 msgr2=0x7fedd415d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40cc580 0x7fedd415d680 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fedc0000c00 tx=0x7fedc00046c0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 -- 172.21.15.8:0/1559114025 shutdown_connections 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedd4157ff0 0x7fedd415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedd40cc580 0x7fedd415d680 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fedb406ac00 0x7fedb406d0c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 --2- 172.21.15.8:0/1559114025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedd40b03d0 0x7fedd41501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 -- 172.21.15.8:0/1559114025 >> 172.21.15.8:0/1559114025 conn(0x7fedd4070480 msgr2=0x7fedd4070860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 -- 172.21.15.8:0/1559114025 shutdown_connections 2024-05-26T15:41:06.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:06.974+0000 7fedda600640 1 -- 172.21.15.8:0/1559114025 wait complete. 2024-05-26T15:41:06.993 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-26T15:41:07.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.206+0000 7fa04b200640 1 Processor -- start 2024-05-26T15:41:07.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.206+0000 7fa04b200640 1 -- start start 2024-05-26T15:41:07.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.208+0000 7fa04b200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa04c0b0630 0x7fa04c0b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.208+0000 7fa04b200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c15b2f0 con 0x7fa04c0cdfe0 2024-05-26T15:41:07.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.208+0000 7fa04b200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c15b5d0 con 0x7fa04c0cb890 2024-05-26T15:41:07.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.208+0000 7fa04b200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c15be70 con 0x7fa04c0b0630 2024-05-26T15:41:07.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.209+0000 7fa049e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa04c0cdfe0 0x7fa04c06c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39008/0 (socket says 172.21.15.8:39008) 2024-05-26T15:41:07.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.209+0000 7fa049e00640 1 -- 172.21.15.8:0/2674281785 learned_addr learned my addr 172.21.15.8:0/2674281785 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:07.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.209+0000 7fa043e00640 1 --2- 172.21.15.8:0/2674281785 >> v2:172.21.15.47:3300/0 conn(0x7fa04c0b0630 0x7fa04c0b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.209+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372104207 0 0) 0x7fa04c15b2f0 con 0x7fa04c0cdfe0 2024-05-26T15:41:07.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.209+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa030003520 con 0x7fa04c0cdfe0 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 788351938 0 0) 0x7fa030003520 con 0x7fa04c0cdfe0 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 >> v2:172.21.15.47:3300/0 conn(0x7fa04c0b0630 msgr2=0x7fa04c0b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 --2- 172.21.15.8:0/2674281785 >> v2:172.21.15.47:3300/0 conn(0x7fa04c0b0630 0x7fa04c0b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 >> v1:172.21.15.47:6789/0 conn(0x7fa04c0cb890 legacy=0x7fa04c0cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c15b8b0 con 0x7fa04c0cdfe0 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fa03c001670 con 0x7fa04c0cdfe0 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 >> v1:172.21.15.8:6789/0 conn(0x7fa04c0cdfe0 legacy=0x7fa04c06c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0300039c0 0x7fa030003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0300047c0 0x7fa030004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030005180 0x7fa03000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c15be70 con 0x7fa0300047c0 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03000c080 con 0x7fa030005180 2024-05-26T15:41:07.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03000c240 con 0x7fa0300039c0 2024-05-26T15:41:07.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.210+0000 7fa043e00640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0300047c0 0x7fa030004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.211+0000 7fa049e00640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0300039c0 0x7fa030003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.211+0000 7fa04a800640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030005180 0x7fa03000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.211+0000 7fa043e00640 1 -- 172.21.15.8:0/2674281785 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0300039c0 msgr2=0x7fa030003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:07.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.211+0000 7fa043e00640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0300039c0 0x7fa030003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.211+0000 7fa043e00640 1 -- 172.21.15.8:0/2674281785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030005180 msgr2=0x7fa03000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:07.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.211+0000 7fa043e00640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa030005180 0x7fa03000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.211+0000 7fa043e00640 1 -- 172.21.15.8:0/2674281785 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa030003520 con 0x7fa0300047c0 2024-05-26T15:41:07.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.211+0000 7fa04a800640 1 -- 172.21.15.8:0/2674281785 reap_dead start 2024-05-26T15:41:07.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.211+0000 7fa049e00640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0300039c0 0x7fa030003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:07.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.212+0000 7fa043e00640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0300047c0 0x7fa030004c40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa034009ac0 tx=0x7fa0300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f0bf81f3978cd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:07.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.212+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034031400 con 0x7fa0300047c0 2024-05-26T15:41:07.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.212+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03402d050 con 0x7fa0300047c0 2024-05-26T15:41:07.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.212+0000 7fa049400640 1 -- 172.21.15.8:0/2674281785 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa034031780 con 0x7fa0300047c0 2024-05-26T15:41:07.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.213+0000 7fa04b200640 1 -- 172.21.15.8:0/2674281785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0300047c0 msgr2=0x7fa030004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.213+0000 7fa04b200640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0300047c0 0x7fa030004c40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa034009ac0 tx=0x7fa0300057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.213+0000 7fa04b200640 1 -- 172.21.15.8:0/2674281785 shutdown_connections 2024-05-26T15:41:07.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.213+0000 7fa04b200640 1 --2- 172.21.15.8:0/2674281785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa0300047c0 0x7fa030004c40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.213+0000 7fa04b200640 1 -- 172.21.15.8:0/2674281785 >> 172.21.15.8:0/2674281785 conn(0x7fa04c069e70 msgr2=0x7fa04c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:07.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.213+0000 7fa04b200640 1 -- 172.21.15.8:0/2674281785 shutdown_connections 2024-05-26T15:41:07.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.213+0000 7fa04b200640 1 -- 172.21.15.8:0/2674281785 wait complete. 2024-05-26T15:41:07.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.215+0000 7fa04b200640 1 Processor -- start 2024-05-26T15:41:07.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.215+0000 7fa04b200640 1 -- start start 2024-05-26T15:41:07.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.216+0000 7fa04b200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0300047c0 0x7fa04c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.216+0000 7fa04b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa04c142540 0x7fa04c0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.216+0000 7fa04b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa04c0ac840 0x7fa04c0aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.216+0000 7fa04b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0acd40 con 0x7fa04c0ac840 2024-05-26T15:41:07.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.216+0000 7fa04b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0ad020 con 0x7fa04c142540 2024-05-26T15:41:07.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.216+0000 7fa04b200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0ad300 con 0x7fa0300047c0 2024-05-26T15:41:07.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.216+0000 7fa04a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa04c0ac840 0x7fa04c0aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.216+0000 7fa04a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa04c0ac840 0x7fa04c0aa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45390/0 (socket says 172.21.15.8:45390) 2024-05-26T15:41:07.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.216+0000 7fa04a800640 1 -- 172.21.15.8:0/465486556 learned_addr learned my addr 172.21.15.8:0/465486556 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:07.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa043e00640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa04c142540 0x7fa04c0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa049e00640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0300047c0 0x7fa04c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa04a800640 1 -- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0300047c0 msgr2=0x7fa04c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa04a800640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0300047c0 0x7fa04c154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa04a800640 1 -- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa04c142540 msgr2=0x7fa04c0a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa04a800640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa04c142540 0x7fa04c0a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa04a800640 1 -- 172.21.15.8:0/465486556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c0ad5e0 con 0x7fa04c0ac840 2024-05-26T15:41:07.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa04a800640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa04c0ac840 0x7fa04c0aa250 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa0440012e0 tx=0x7fa04400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:07.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa042000640 1 -- 172.21.15.8:0/465486556 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044003d80 con 0x7fa04c0ac840 2024-05-26T15:41:07.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa042000640 1 -- 172.21.15.8:0/465486556 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0440050f0 con 0x7fa04c0ac840 2024-05-26T15:41:07.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa042000640 1 -- 172.21.15.8:0/465486556 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa044005460 con 0x7fa04c0ac840 2024-05-26T15:41:07.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.217+0000 7fa04b200640 1 -- 172.21.15.8:0/465486556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c0ae270 con 0x7fa04c0ac840 2024-05-26T15:41:07.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.218+0000 7fa04b200640 1 -- 172.21.15.8:0/465486556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c142160 con 0x7fa04c0ac840 2024-05-26T15:41:07.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.219+0000 7fa04b200640 1 -- 172.21.15.8:0/465486556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c06ae00 con 0x7fa04c0ac840 2024-05-26T15:41:07.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.220+0000 7fa042000640 1 -- 172.21.15.8:0/465486556 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa0440055c0 con 0x7fa04c0ac840 2024-05-26T15:41:07.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.221+0000 7fa042000640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa02806ac00 0x7fa02806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.221+0000 7fa042000640 1 -- 172.21.15.8:0/465486556 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa044088a00 con 0x7fa04c0ac840 2024-05-26T15:41:07.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.221+0000 7fa049e00640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa02806ac00 0x7fa02806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.223+0000 7fa049e00640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa02806ac00 0x7fa02806d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa03c000c00 tx=0x7fa03c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:07.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.225+0000 7fa042000640 1 -- 172.21.15.8:0/465486556 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa044053e90 con 0x7fa04c0ac840 2024-05-26T15:41:07.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.497+0000 7fa04b200640 1 -- 172.21.15.8:0/465486556 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa04c04e280 con 0x7fa04c0ac840 2024-05-26T15:41:07.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.505+0000 7fa042000640 1 -- 172.21.15.8:0/465486556 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa044018070 con 0x7fa04c0ac840 2024-05-26T15:41:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.507+0000 7fa04b200640 1 -- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa02806ac00 msgr2=0x7fa02806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.507+0000 7fa04b200640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa02806ac00 0x7fa02806d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa03c000c00 tx=0x7fa03c009040 comp rx=0 tx=0).stop 2024-05-26T15:41:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.507+0000 7fa04b200640 1 -- 172.21.15.8:0/465486556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa04c0ac840 msgr2=0x7fa04c0aa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.507+0000 7fa04b200640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa04c0ac840 0x7fa04c0aa250 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa0440012e0 tx=0x7fa04400d9f0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.508+0000 7fa04b200640 1 -- 172.21.15.8:0/465486556 shutdown_connections 2024-05-26T15:41:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.508+0000 7fa04b200640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa04c0ac840 0x7fa04c0aa250 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.508+0000 7fa04b200640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa02806ac00 0x7fa02806d0c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.508+0000 7fa04b200640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa04c142540 0x7fa04c0a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.508+0000 7fa04b200640 1 --2- 172.21.15.8:0/465486556 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa0300047c0 0x7fa04c154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.508+0000 7fa04b200640 1 -- 172.21.15.8:0/465486556 >> 172.21.15.8:0/465486556 conn(0x7fa04c069e70 msgr2=0x7fa04c071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.508+0000 7fa04b200640 1 -- 172.21.15.8:0/465486556 shutdown_connections 2024-05-26T15:41:07.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.508+0000 7fa04b200640 1 -- 172.21.15.8:0/465486556 wait complete. 2024-05-26T15:41:07.526 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-26T15:41:07.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.739+0000 7f0d84e00640 1 Processor -- start 2024-05-26T15:41:07.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.740+0000 7f0d84e00640 1 -- start start 2024-05-26T15:41:07.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.741+0000 7f0d84e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0d80144270 0x7f0d800b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.742+0000 7f0d84e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d800cbba0 con 0x7f0d80070660 2024-05-26T15:41:07.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.742+0000 7f0d84e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d800cc9f0 con 0x7f0d800cdbe0 2024-05-26T15:41:07.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.742+0000 7f0d84e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d800cbe80 con 0x7f0d80144270 2024-05-26T15:41:07.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.742+0000 7f0d75400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0d80070660 0x7f0d800cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39016/0 (socket says 172.21.15.8:39016) 2024-05-26T15:41:07.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.742+0000 7f0d75400640 1 -- 172.21.15.8:0/2816810564 learned_addr learned my addr 172.21.15.8:0/2816810564 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.742+0000 7f0d7de00640 1 --2- 172.21.15.8:0/2816810564 >> v2:172.21.15.47:3300/0 conn(0x7f0d80144270 0x7f0d800b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.742+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261931095 0 0) 0x7f0d800cbba0 con 0x7f0d80070660 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d64003520 con 0x7f0d80070660 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3897853592 0 0) 0x7f0d64003520 con 0x7f0d80070660 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 >> v2:172.21.15.47:3300/0 conn(0x7f0d80144270 msgr2=0x7f0d800b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 --2- 172.21.15.8:0/2816810564 >> v2:172.21.15.47:3300/0 conn(0x7f0d80144270 0x7f0d800b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 >> v1:172.21.15.47:6789/0 conn(0x7f0d800cdbe0 legacy=0x7f0d800cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800cccd0 con 0x7f0d80070660 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f0d68001670 con 0x7f0d80070660 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 >> v1:172.21.15.8:6789/0 conn(0x7f0d80070660 legacy=0x7f0d800cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d64003970 0x7f0d64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d640047c0 0x7f0d64004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64005180 0x7f0d6400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d800cbe80 con 0x7f0d640047c0 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6400c020 con 0x7f0d64005180 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.743+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6400c1e0 con 0x7f0d64003970 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.744+0000 7f0d75400640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d640047c0 0x7f0d64004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.744+0000 7f0d7de00640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d64003970 0x7f0d64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.744+0000 7f0d7e800640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64005180 0x7f0d6400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.744+0000 7f0d75400640 1 -- 172.21.15.8:0/2816810564 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d64003970 msgr2=0x7f0d64003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.744+0000 7f0d75400640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d64003970 0x7f0d64003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.744+0000 7f0d75400640 1 -- 172.21.15.8:0/2816810564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64005180 msgr2=0x7f0d6400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.744+0000 7f0d75400640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64005180 0x7f0d6400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.744+0000 7f0d75400640 1 -- 172.21.15.8:0/2816810564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d64003520 con 0x7f0d640047c0 2024-05-26T15:41:07.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.744+0000 7f0d7e800640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d64005180 0x7f0d6400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:07.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.744+0000 7f0d7e800640 1 -- 172.21.15.8:0/2816810564 reap_dead start 2024-05-26T15:41:07.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.745+0000 7f0d75400640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d640047c0 0x7f0d64004c40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c240 tx=0x7f0d640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b37199af01aff0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:07.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.745+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6802e070 con 0x7f0d640047c0 2024-05-26T15:41:07.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.745+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d680058d0 con 0x7f0d640047c0 2024-05-26T15:41:07.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.745+0000 7f0d7d400640 1 -- 172.21.15.8:0/2816810564 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68005d00 con 0x7f0d640047c0 2024-05-26T15:41:07.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.746+0000 7f0d84e00640 1 -- 172.21.15.8:0/2816810564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d640047c0 msgr2=0x7f0d64004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.746+0000 7f0d84e00640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d640047c0 0x7f0d64004c40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c240 tx=0x7f0d640057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.746+0000 7f0d84e00640 1 -- 172.21.15.8:0/2816810564 shutdown_connections 2024-05-26T15:41:07.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.746+0000 7f0d84e00640 1 --2- 172.21.15.8:0/2816810564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d640047c0 0x7f0d64004c40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.746+0000 7f0d84e00640 1 -- 172.21.15.8:0/2816810564 >> 172.21.15.8:0/2816810564 conn(0x7f0d800b0570 msgr2=0x7f0d800b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:07.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.746+0000 7f0d84e00640 1 -- 172.21.15.8:0/2816810564 shutdown_connections 2024-05-26T15:41:07.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.746+0000 7f0d84e00640 1 -- 172.21.15.8:0/2816810564 wait complete. 2024-05-26T15:41:07.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.748+0000 7f0d84e00640 1 Processor -- start 2024-05-26T15:41:07.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.748+0000 7f0d84e00640 1 -- start start 2024-05-26T15:41:07.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.749+0000 7f0d84e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d640047c0 0x7f0d801f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.749+0000 7f0d84e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d8006e0b0 0x7f0d80135610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.749+0000 7f0d84e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d80135b50 0x7f0d800af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.749+0000 7f0d84e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801f66b0 con 0x7f0d8006e0b0 2024-05-26T15:41:07.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.749+0000 7f0d84e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80136090 con 0x7f0d640047c0 2024-05-26T15:41:07.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.749+0000 7f0d84e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80136370 con 0x7f0d80135b50 2024-05-26T15:41:07.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d75400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d8006e0b0 0x7f0d80135610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d75400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d8006e0b0 0x7f0d80135610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45410/0 (socket says 172.21.15.8:45410) 2024-05-26T15:41:07.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d75400640 1 -- 172.21.15.8:0/1082730598 learned_addr learned my addr 172.21.15.8:0/1082730598 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:07.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d7de00640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d640047c0 0x7f0d801f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d7e800640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d80135b50 0x7f0d800af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d75400640 1 -- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d80135b50 msgr2=0x7f0d800af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d75400640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d80135b50 0x7f0d800af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d75400640 1 -- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d640047c0 msgr2=0x7f0d801f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:07.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d75400640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d640047c0 0x7f0d801f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:07.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d75400640 1 -- 172.21.15.8:0/1082730598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d80136650 con 0x7f0d8006e0b0 2024-05-26T15:41:07.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.750+0000 7f0d7e800640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d80135b50 0x7f0d800af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:07.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.751+0000 7f0d75400640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d8006e0b0 0x7f0d80135610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0d68001930 tx=0x7f0d68001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:07.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.751+0000 7f0d76a00640 1 -- 172.21.15.8:0/1082730598 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68005e70 con 0x7f0d8006e0b0 2024-05-26T15:41:07.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.751+0000 7f0d76a00640 1 -- 172.21.15.8:0/1082730598 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d680049f0 con 0x7f0d8006e0b0 2024-05-26T15:41:07.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.751+0000 7f0d84e00640 1 -- 172.21.15.8:0/1082730598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d80136930 con 0x7f0d8006e0b0 2024-05-26T15:41:07.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.751+0000 7f0d76a00640 1 -- 172.21.15.8:0/1082730598 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68004da0 con 0x7f0d8006e0b0 2024-05-26T15:41:07.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.751+0000 7f0d84e00640 1 -- 172.21.15.8:0/1082730598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d801f37e0 con 0x7f0d8006e0b0 2024-05-26T15:41:07.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.752+0000 7f0d84e00640 1 -- 172.21.15.8:0/1082730598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8015cc50 con 0x7f0d8006e0b0 2024-05-26T15:41:07.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.753+0000 7f0d76a00640 1 -- 172.21.15.8:0/1082730598 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0d68005040 con 0x7f0d8006e0b0 2024-05-26T15:41:07.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.754+0000 7f0d76a00640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0d5c06ac00 0x7f0d5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:07.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.754+0000 7f0d76a00640 1 -- 172.21.15.8:0/1082730598 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0d680a90d0 con 0x7f0d8006e0b0 2024-05-26T15:41:07.753 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.755+0000 7f0d7de00640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0d5c06ac00 0x7f0d5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:07.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.756+0000 7f0d7de00640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0d5c06ac00 0x7f0d5c06d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0d80068640 tx=0x7f0d70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:07.756 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:07.758+0000 7f0d76a00640 1 -- 172.21.15.8:0/1082730598 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0d680744b0 con 0x7f0d8006e0b0 2024-05-26T15:41:08.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.029+0000 7f0d84e00640 1 -- 172.21.15.8:0/1082730598 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0d8015cc50 con 0x7f0d8006e0b0 2024-05-26T15:41:08.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.036+0000 7f0d76a00640 1 -- 172.21.15.8:0/1082730598 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0d68077ad0 con 0x7f0d8006e0b0 2024-05-26T15:41:08.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.039+0000 7f0d84e00640 1 -- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0d5c06ac00 msgr2=0x7f0d5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.039+0000 7f0d84e00640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0d5c06ac00 0x7f0d5c06d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0d80068640 tx=0x7f0d70008040 comp rx=0 tx=0).stop 2024-05-26T15:41:08.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.039+0000 7f0d84e00640 1 -- 172.21.15.8:0/1082730598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d8006e0b0 msgr2=0x7f0d80135610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.039+0000 7f0d84e00640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d8006e0b0 0x7f0d80135610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0d68001930 tx=0x7f0d68001a00 comp rx=0 tx=0).stop 2024-05-26T15:41:08.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.039+0000 7f0d84e00640 1 -- 172.21.15.8:0/1082730598 shutdown_connections 2024-05-26T15:41:08.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.039+0000 7f0d84e00640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0d80135b50 0x7f0d800af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.039+0000 7f0d84e00640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d8006e0b0 0x7f0d80135610 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.039+0000 7f0d84e00640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0d5c06ac00 0x7f0d5c06d0c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.039+0000 7f0d84e00640 1 --2- 172.21.15.8:0/1082730598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0d640047c0 0x7f0d801f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.039+0000 7f0d84e00640 1 -- 172.21.15.8:0/1082730598 >> 172.21.15.8:0/1082730598 conn(0x7f0d800b0570 msgr2=0x7f0d800b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:08.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.040+0000 7f0d84e00640 1 -- 172.21.15.8:0/1082730598 shutdown_connections 2024-05-26T15:41:08.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.040+0000 7f0d84e00640 1 -- 172.21.15.8:0/1082730598 wait complete. 2024-05-26T15:41:08.057 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-26T15:41:08.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.256+0000 7f11a2a00640 1 Processor -- start 2024-05-26T15:41:08.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.256+0000 7f11a2a00640 1 -- start start 2024-05-26T15:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.258+0000 7f11a2a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c0b2080 0x7f119c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.258+0000 7f11a2a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c070e60 con 0x7f119c070a30 2024-05-26T15:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.258+0000 7f11a2a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c153980 con 0x7f119c1535a0 2024-05-26T15:41:08.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.258+0000 7f11a2a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0b2580 con 0x7f119c0b2080 2024-05-26T15:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.258+0000 7f11a2000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f119c070a30 0x7f119c06c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39028/0 (socket says 172.21.15.8:39028) 2024-05-26T15:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.258+0000 7f11a2000640 1 -- 172.21.15.8:0/1026999599 learned_addr learned my addr 172.21.15.8:0/1026999599 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f11a0c00640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c0b2080 0x7f119c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876468555 0 0) 0x7f119c070e60 con 0x7f119c070a30 2024-05-26T15:41:08.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1184003520 con 0x7f119c070a30 2024-05-26T15:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3074066404 0 0) 0x7f1184003520 con 0x7f119c070a30 2024-05-26T15:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c0b2080 msgr2=0x7f119c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c0b2080 0x7f119c0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 >> v1:172.21.15.47:6789/0 conn(0x7f119c1535a0 legacy=0x7f119c0ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c0b2860 con 0x7f119c070a30 2024-05-26T15:41:08.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f1194001690 con 0x7f119c070a30 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 >> v1:172.21.15.8:6789/0 conn(0x7f119c070a30 legacy=0x7f119c06c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11840039a0 0x7f1184003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.259+0000 7f119be00640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11840047c0 0x7f1184004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f119be00640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c0b2080 0x7f1184005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0b2580 con 0x7f11840039a0 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118400ba60 con 0x7f11840047c0 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118400bc20 con 0x7f119c0b2080 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f11a1600640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11840039a0 0x7f1184003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f11a2000640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c0b2080 0x7f1184005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f11a0c00640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11840047c0 0x7f1184004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f11a1600640 1 -- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c0b2080 msgr2=0x7f1184005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f11a1600640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f119c0b2080 0x7f1184005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f11a1600640 1 -- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11840047c0 msgr2=0x7f1184004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:08.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f11a1600640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11840047c0 0x7f1184004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f11a1600640 1 -- 172.21.15.8:0/1026999599 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184003520 con 0x7f11840039a0 2024-05-26T15:41:08.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.260+0000 7f11a0c00640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11840047c0 0x7f1184004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.262+0000 7f11a1600640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11840039a0 0x7f1184003dc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1190001e20 tx=0x7f11840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7da50b7dc96555 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.262+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119002ae10 con 0x7f11840039a0 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.262+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1190003970 con 0x7f11840039a0 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.262+0000 7f119be00640 1 -- 172.21.15.8:0/1026999599 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190003d20 con 0x7f11840039a0 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.262+0000 7f11a2a00640 1 -- 172.21.15.8:0/1026999599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11840039a0 msgr2=0x7f1184003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.262+0000 7f11a2a00640 1 --2- 172.21.15.8:0/1026999599 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11840039a0 0x7f1184003dc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1190001e20 tx=0x7f11840057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.263+0000 7f11a2000640 1 -- 172.21.15.8:0/1026999599 reap_dead start 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.263+0000 7f11a2a00640 1 -- 172.21.15.8:0/1026999599 shutdown_connections 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.263+0000 7f11a2a00640 1 -- 172.21.15.8:0/1026999599 >> 172.21.15.8:0/1026999599 conn(0x7f119c069e70 msgr2=0x7f119c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.263+0000 7f11a2a00640 1 -- 172.21.15.8:0/1026999599 shutdown_connections 2024-05-26T15:41:08.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.263+0000 7f11a2a00640 1 -- 172.21.15.8:0/1026999599 wait complete. 2024-05-26T15:41:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.265+0000 7f11a2a00640 1 Processor -- start 2024-05-26T15:41:08.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.265+0000 7f11a2a00640 1 -- start start 2024-05-26T15:41:08.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.266+0000 7f11a2a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f11840039a0 0x7f119c0aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.266+0000 7f11a2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f119c0aca10 0x7f119c146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.266+0000 7f11a2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c147460 0x7f119c147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.266+0000 7f11a2a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c147910 con 0x7f119c0aca10 2024-05-26T15:41:08.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.266+0000 7f11a2a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0af310 con 0x7f119c147460 2024-05-26T15:41:08.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.266+0000 7f11a2a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c0af5f0 con 0x7f11840039a0 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.266+0000 7f11a0c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f119c0aca10 0x7f119c146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.266+0000 7f11a0c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f119c0aca10 0x7f119c146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45426/0 (socket says 172.21.15.8:45426) 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.266+0000 7f11a0c00640 1 -- 172.21.15.8:0/3451709891 learned_addr learned my addr 172.21.15.8:0/3451709891 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a2000640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c147460 0x7f119c147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a1600640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f11840039a0 0x7f119c0aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a0c00640 1 -- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f11840039a0 msgr2=0x7f119c0aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a0c00640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f11840039a0 0x7f119c0aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a0c00640 1 -- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c147460 msgr2=0x7f119c147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a0c00640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c147460 0x7f119c147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a0c00640 1 -- 172.21.15.8:0/3451709891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c0af8d0 con 0x7f119c0aca10 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a1600640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f11840039a0 0x7f119c0aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:08.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a2000640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c147460 0x7f119c147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:08.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a0c00640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f119c0aca10 0x7f119c146f20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f118800f980 tx=0x7f118800fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:08.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f1199600640 1 -- 172.21.15.8:0/3451709891 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118800dc50 con 0x7f119c0aca10 2024-05-26T15:41:08.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f1199600640 1 -- 172.21.15.8:0/3451709891 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118800ddb0 con 0x7f119c0aca10 2024-05-26T15:41:08.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f1199600640 1 -- 172.21.15.8:0/3451709891 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188012680 con 0x7f119c0aca10 2024-05-26T15:41:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.267+0000 7f11a2a00640 1 -- 172.21.15.8:0/3451709891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c0af000 con 0x7f119c0aca10 2024-05-26T15:41:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.268+0000 7f11a2a00640 1 -- 172.21.15.8:0/3451709891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c148300 con 0x7f119c0aca10 2024-05-26T15:41:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.269+0000 7f11a2a00640 1 -- 172.21.15.8:0/3451709891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c04e280 con 0x7f119c0aca10 2024-05-26T15:41:08.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.270+0000 7f1199600640 1 -- 172.21.15.8:0/3451709891 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f11880127e0 con 0x7f119c0aca10 2024-05-26T15:41:08.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.271+0000 7f1199600640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f117c06ac00 0x7f117c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.271+0000 7f1199600640 1 -- 172.21.15.8:0/3451709891 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1188089550 con 0x7f119c0aca10 2024-05-26T15:41:08.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.271+0000 7f11a1600640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f117c06ac00 0x7f117c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.273+0000 7f11a1600640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f117c06ac00 0x7f117c06d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1190032000 tx=0x7f119002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:08.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.275+0000 7f1199600640 1 -- 172.21.15.8:0/3451709891 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f11880549f0 con 0x7f119c0aca10 2024-05-26T15:41:08.547 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.548+0000 7f11a2a00640 1 -- 172.21.15.8:0/3451709891 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f119c147a50 con 0x7f119c0aca10 2024-05-26T15:41:08.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.556+0000 7f1199600640 1 -- 172.21.15.8:0/3451709891 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f119c147a50 con 0x7f119c0aca10 2024-05-26T15:41:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.558+0000 7f11a2a00640 1 -- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f117c06ac00 msgr2=0x7f117c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.558+0000 7f11a2a00640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f117c06ac00 0x7f117c06d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1190032000 tx=0x7f119002e000 comp rx=0 tx=0).stop 2024-05-26T15:41:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.559+0000 7f11a2a00640 1 -- 172.21.15.8:0/3451709891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f119c0aca10 msgr2=0x7f119c146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.559+0000 7f11a2a00640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f119c0aca10 0x7f119c146f20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f118800f980 tx=0x7f118800fe40 comp rx=0 tx=0).stop 2024-05-26T15:41:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.559+0000 7f11a2a00640 1 -- 172.21.15.8:0/3451709891 shutdown_connections 2024-05-26T15:41:08.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.559+0000 7f11a2a00640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f117c06ac00 0x7f117c06d0c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.559+0000 7f11a2a00640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c147460 0x7f119c147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.559+0000 7f11a2a00640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f119c0aca10 0x7f119c146f20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.559+0000 7f11a2a00640 1 --2- 172.21.15.8:0/3451709891 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f11840039a0 0x7f119c0aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.559+0000 7f11a2a00640 1 -- 172.21.15.8:0/3451709891 >> 172.21.15.8:0/3451709891 conn(0x7f119c069e70 msgr2=0x7f119c153c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.559+0000 7f11a2a00640 1 -- 172.21.15.8:0/3451709891 shutdown_connections 2024-05-26T15:41:08.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.559+0000 7f11a2a00640 1 -- 172.21.15.8:0/3451709891 wait complete. 2024-05-26T15:41:08.576 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-26T15:41:08.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.781+0000 7fd830800640 1 Processor -- start 2024-05-26T15:41:08.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.782+0000 7fd830800640 1 -- start start 2024-05-26T15:41:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.783+0000 7fd830800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd8281594e0 0x7fd828070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.783+0000 7fd830800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd828070ba0 0x7fd8280b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.783+0000 7fd830800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280cd540 con 0x7fd828159100 2024-05-26T15:41:08.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.783+0000 7fd830800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd828070fb0 con 0x7fd8281594e0 2024-05-26T15:41:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.783+0000 7fd830800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82806da80 con 0x7fd828070ba0 2024-05-26T15:41:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.784+0000 7fd82e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd828070ba0 0x7fd8280b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.784+0000 7fd82d400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd8281594e0 0x7fd828070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.784+0000 7fd82e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd828070ba0 0x7fd8280b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:47454/0 (socket says 172.21.15.8:47454) 2024-05-26T15:41:08.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.784+0000 7fd82e800640 1 -- 172.21.15.8:0/242355207 learned_addr learned my addr 172.21.15.8:0/242355207 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.785+0000 7fd82e800640 1 -- 172.21.15.8:0/242355207 >> v2:172.21.15.47:3300/0 conn(0x7fd8281594e0 msgr2=0x7fd828070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.785+0000 7fd82e800640 1 --2- 172.21.15.8:0/242355207 >> v2:172.21.15.47:3300/0 conn(0x7fd8281594e0 0x7fd828070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.785+0000 7fd82e800640 1 -- 172.21.15.8:0/242355207 >> v1:172.21.15.47:6789/0 conn(0x7fd828159100 legacy=0x7fd8280cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.785+0000 7fd82e800640 1 -- 172.21.15.8:0/242355207 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82806dd60 con 0x7fd828070ba0 2024-05-26T15:41:08.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.785+0000 7fd82d400640 1 --2- 172.21.15.8:0/242355207 >> v2:172.21.15.47:3300/0 conn(0x7fd8281594e0 0x7fd828070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:41:08.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.786+0000 7fd82e800640 1 --2- 172.21.15.8:0/242355207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd828070ba0 0x7fd8280b2d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd824009e50 tx=0x7fd82402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c151226a661f534 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:08.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.786+0000 7fd82ca00640 1 -- 172.21.15.8:0/242355207 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824031600 con 0x7fd828070ba0 2024-05-26T15:41:08.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.786+0000 7fd82ca00640 1 -- 172.21.15.8:0/242355207 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82402d050 con 0x7fd828070ba0 2024-05-26T15:41:08.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.786+0000 7fd82ca00640 1 -- 172.21.15.8:0/242355207 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824031980 con 0x7fd828070ba0 2024-05-26T15:41:08.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.787+0000 7fd830800640 1 -- 172.21.15.8:0/242355207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd828070ba0 msgr2=0x7fd8280b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.787+0000 7fd830800640 1 --2- 172.21.15.8:0/242355207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd828070ba0 0x7fd8280b2d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd824009e50 tx=0x7fd82402a710 comp rx=0 tx=0).stop 2024-05-26T15:41:08.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.787+0000 7fd830800640 1 -- 172.21.15.8:0/242355207 shutdown_connections 2024-05-26T15:41:08.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.787+0000 7fd830800640 1 --2- 172.21.15.8:0/242355207 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd828070ba0 0x7fd8280b2d80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.787+0000 7fd830800640 1 --2- 172.21.15.8:0/242355207 >> v2:172.21.15.47:3300/0 conn(0x7fd8281594e0 0x7fd828070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.787+0000 7fd830800640 1 -- 172.21.15.8:0/242355207 >> 172.21.15.8:0/242355207 conn(0x7fd8280b0570 msgr2=0x7fd8280b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:08.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.787+0000 7fd830800640 1 -- 172.21.15.8:0/242355207 shutdown_connections 2024-05-26T15:41:08.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.787+0000 7fd830800640 1 -- 172.21.15.8:0/242355207 wait complete. 2024-05-26T15:41:08.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.789+0000 7fd830800640 1 Processor -- start 2024-05-26T15:41:08.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.789+0000 7fd830800640 1 -- start start 2024-05-26T15:41:08.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.790+0000 7fd830800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd828070ba0 0x7fd828146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.790+0000 7fd830800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd828159100 0x7fd828146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.790+0000 7fd830800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8281594e0 0x7fd828153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.790+0000 7fd830800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828146cd0 con 0x7fd828159100 2024-05-26T15:41:08.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.790+0000 7fd830800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82814eba0 con 0x7fd828070ba0 2024-05-26T15:41:08.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.790+0000 7fd830800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82814ee80 con 0x7fd8281594e0 2024-05-26T15:41:08.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.791+0000 7fd82d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd828159100 0x7fd828146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.791+0000 7fd82d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd828159100 0x7fd828146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45438/0 (socket says 172.21.15.8:45438) 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.791+0000 7fd82d400640 1 -- 172.21.15.8:0/1000027869 learned_addr learned my addr 172.21.15.8:0/1000027869 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.791+0000 7fd82e800640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8281594e0 0x7fd828153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.791+0000 7fd82de00640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd828070ba0 0x7fd828146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.791+0000 7fd82d400640 1 -- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8281594e0 msgr2=0x7fd828153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.791+0000 7fd82d400640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8281594e0 0x7fd828153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.792+0000 7fd82d400640 1 -- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd828070ba0 msgr2=0x7fd828146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.792+0000 7fd82d400640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd828070ba0 0x7fd828146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.792+0000 7fd82d400640 1 -- 172.21.15.8:0/1000027869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818009400 con 0x7fd828159100 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.792+0000 7fd82e800640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8281594e0 0x7fd828153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.792+0000 7fd82d400640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd828159100 0x7fd828146790 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd81800e960 tx=0x7fd81800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:08.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.792+0000 7fd822000640 1 -- 172.21.15.8:0/1000027869 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81800ca00 con 0x7fd828159100 2024-05-26T15:41:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.792+0000 7fd822000640 1 -- 172.21.15.8:0/1000027869 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81800cb60 con 0x7fd828159100 2024-05-26T15:41:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.792+0000 7fd830800640 1 -- 172.21.15.8:0/1000027869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd824009b30 con 0x7fd828159100 2024-05-26T15:41:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.792+0000 7fd822000640 1 -- 172.21.15.8:0/1000027869 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818013470 con 0x7fd828159100 2024-05-26T15:41:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.792+0000 7fd830800640 1 -- 172.21.15.8:0/1000027869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82814d290 con 0x7fd828159100 2024-05-26T15:41:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.794+0000 7fd830800640 1 -- 172.21.15.8:0/1000027869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8280681d0 con 0x7fd828159100 2024-05-26T15:41:08.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.794+0000 7fd822000640 1 -- 172.21.15.8:0/1000027869 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd8180135d0 con 0x7fd828159100 2024-05-26T15:41:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.795+0000 7fd822000640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd80c06ac30 0x7fd80c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.796+0000 7fd822000640 1 -- 172.21.15.8:0/1000027869 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd8180893b0 con 0x7fd828159100 2024-05-26T15:41:08.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.796+0000 7fd82de00640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd80c06ac30 0x7fd80c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:08.795 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.797+0000 7fd82de00640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd80c06ac30 0x7fd80c06d0f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd81c000f60 tx=0x7fd81c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:08.798 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:08.800+0000 7fd822000640 1 -- 172.21.15.8:0/1000027869 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd818054790 con 0x7fd828159100 2024-05-26T15:41:09.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.061+0000 7fd830800640 1 -- 172.21.15.8:0/1000027869 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd8280b2bf0 con 0x7fd828159100 2024-05-26T15:41:09.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.070+0000 7fd822000640 1 -- 172.21.15.8:0/1000027869 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd818057db0 con 0x7fd828159100 2024-05-26T15:41:09.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.072+0000 7fd830800640 1 -- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd80c06ac30 msgr2=0x7fd80c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.072+0000 7fd830800640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd80c06ac30 0x7fd80c06d0f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd81c000f60 tx=0x7fd81c009040 comp rx=0 tx=0).stop 2024-05-26T15:41:09.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.072+0000 7fd830800640 1 -- 172.21.15.8:0/1000027869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd828159100 msgr2=0x7fd828146790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.072+0000 7fd830800640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd828159100 0x7fd828146790 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd81800e960 tx=0x7fd81800ee20 comp rx=0 tx=0).stop 2024-05-26T15:41:09.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.073+0000 7fd830800640 1 -- 172.21.15.8:0/1000027869 shutdown_connections 2024-05-26T15:41:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.073+0000 7fd830800640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8281594e0 0x7fd828153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.073+0000 7fd830800640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd828159100 0x7fd828146790 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.073+0000 7fd830800640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd80c06ac30 0x7fd80c06d0f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.073+0000 7fd830800640 1 --2- 172.21.15.8:0/1000027869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd828070ba0 0x7fd828146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.073+0000 7fd830800640 1 -- 172.21.15.8:0/1000027869 >> 172.21.15.8:0/1000027869 conn(0x7fd8280b0570 msgr2=0x7fd8280cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.073+0000 7fd830800640 1 -- 172.21.15.8:0/1000027869 shutdown_connections 2024-05-26T15:41:09.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.073+0000 7fd830800640 1 -- 172.21.15.8:0/1000027869 wait complete. 2024-05-26T15:41:09.090 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-26T15:41:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.299+0000 7ffbeb000640 1 Processor -- start 2024-05-26T15:41:09.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.299+0000 7ffbeb000640 1 -- start start 2024-05-26T15:41:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.300+0000 7ffbeb000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ffbe415cbf0 0x7ffbe40cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.300+0000 7ffbeb000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe40cce30 con 0x7ffbe40cb8d0 2024-05-26T15:41:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.301+0000 7ffbeb000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe41617c0 con 0x7ffbe4160920 2024-05-26T15:41:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.301+0000 7ffbeb000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe41614e0 con 0x7ffbe415cbf0 2024-05-26T15:41:09.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.301+0000 7ffbe9000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ffbe40cb8d0 0x7ffbe406caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39036/0 (socket says 172.21.15.8:39036) 2024-05-26T15:41:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.301+0000 7ffbe9000640 1 -- 172.21.15.8:0/1266250932 learned_addr learned my addr 172.21.15.8:0/1266250932 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.301+0000 7ffbe3e00640 1 --2- 172.21.15.8:0/1266250932 >> v2:172.21.15.8:3300/0 conn(0x7ffbe415cbf0 0x7ffbe40cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.301+0000 7ffbe2a00640 1 -- 172.21.15.8:0/1266250932 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525169759 0 0) 0x7ffbe40cce30 con 0x7ffbe40cb8d0 2024-05-26T15:41:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.301+0000 7ffbe2a00640 1 -- 172.21.15.8:0/1266250932 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbc8003520 con 0x7ffbe40cb8d0 2024-05-26T15:41:09.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.302+0000 7ffbe3e00640 1 -- 172.21.15.8:0/1266250932 >> v1:172.21.15.47:6789/0 conn(0x7ffbe4160920 legacy=0x7ffbe40cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.302+0000 7ffbe3e00640 1 -- 172.21.15.8:0/1266250932 >> v1:172.21.15.8:6789/0 conn(0x7ffbe40cb8d0 legacy=0x7ffbe406caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.302+0000 7ffbe3e00640 1 -- 172.21.15.8:0/1266250932 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40cd3e0 con 0x7ffbe415cbf0 2024-05-26T15:41:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.303+0000 7ffbe3e00640 1 --2- 172.21.15.8:0/1266250932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe415cbf0 0x7ffbe40cdec0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ffbe41619b0 tx=0x7ffbd402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d03787a89e2cd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.303+0000 7ffbe2a00640 1 -- 172.21.15.8:0/1266250932 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4032440 con 0x7ffbe415cbf0 2024-05-26T15:41:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.303+0000 7ffbe2a00640 1 -- 172.21.15.8:0/1266250932 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd40325a0 con 0x7ffbe415cbf0 2024-05-26T15:41:09.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.303+0000 7ffbe2a00640 1 -- 172.21.15.8:0/1266250932 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd4032910 con 0x7ffbe415cbf0 2024-05-26T15:41:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.304+0000 7ffbeb000640 1 -- 172.21.15.8:0/1266250932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe415cbf0 msgr2=0x7ffbe40cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.304+0000 7ffbeb000640 1 --2- 172.21.15.8:0/1266250932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe415cbf0 0x7ffbe40cdec0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ffbe41619b0 tx=0x7ffbd402a210 comp rx=0 tx=0).stop 2024-05-26T15:41:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.304+0000 7ffbeb000640 1 -- 172.21.15.8:0/1266250932 shutdown_connections 2024-05-26T15:41:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.304+0000 7ffbeb000640 1 --2- 172.21.15.8:0/1266250932 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe415cbf0 0x7ffbe40cdec0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.304+0000 7ffbeb000640 1 -- 172.21.15.8:0/1266250932 >> 172.21.15.8:0/1266250932 conn(0x7ffbe40b0570 msgr2=0x7ffbe40b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.304+0000 7ffbeb000640 1 -- 172.21.15.8:0/1266250932 shutdown_connections 2024-05-26T15:41:09.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.304+0000 7ffbeb000640 1 -- 172.21.15.8:0/1266250932 wait complete. 2024-05-26T15:41:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.306+0000 7ffbeb000640 1 Processor -- start 2024-05-26T15:41:09.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.306+0000 7ffbeb000640 1 -- start start 2024-05-26T15:41:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbeb000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe40cb8d0 0x7ffbe41490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbeb000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4160920 0x7ffbe40ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbeb000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffbe40ace50 0x7ffbe415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbeb000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40ad300 con 0x7ffbe4160920 2024-05-26T15:41:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbeb000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe41f3690 con 0x7ffbe40cb8d0 2024-05-26T15:41:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbeb000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe41f3970 con 0x7ffbe40ace50 2024-05-26T15:41:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbe3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4160920 0x7ffbe40ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbe3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4160920 0x7ffbe40ac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45458/0 (socket says 172.21.15.8:45458) 2024-05-26T15:41:09.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbe3400640 1 -- 172.21.15.8:0/4026846660 learned_addr learned my addr 172.21.15.8:0/4026846660 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbe3e00640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe40cb8d0 0x7ffbe41490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbe9000640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffbe40ace50 0x7ffbe415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbe3400640 1 -- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffbe40ace50 msgr2=0x7ffbe415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbe3400640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffbe40ace50 0x7ffbe415b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbe3400640 1 -- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe40cb8d0 msgr2=0x7ffbe41490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.307+0000 7ffbe3400640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe40cb8d0 0x7ffbe41490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.308+0000 7ffbe3400640 1 -- 172.21.15.8:0/4026846660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4009400 con 0x7ffbe4160920 2024-05-26T15:41:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.308+0000 7ffbe3400640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4160920 0x7ffbe40ac910 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000c450 tx=0x7ffbd000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.308+0000 7ffbdbe00640 1 -- 172.21.15.8:0/4026846660 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd00052d0 con 0x7ffbe4160920 2024-05-26T15:41:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.308+0000 7ffbdbe00640 1 -- 172.21.15.8:0/4026846660 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd0005430 con 0x7ffbe4160920 2024-05-26T15:41:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.308+0000 7ffbdbe00640 1 -- 172.21.15.8:0/4026846660 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0012870 con 0x7ffbe4160920 2024-05-26T15:41:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.308+0000 7ffbeb000640 1 -- 172.21.15.8:0/4026846660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe41f3c50 con 0x7ffbe4160920 2024-05-26T15:41:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.308+0000 7ffbeb000640 1 -- 172.21.15.8:0/4026846660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe41f4210 con 0x7ffbe4160920 2024-05-26T15:41:09.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.310+0000 7ffbeb000640 1 -- 172.21.15.8:0/4026846660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe41f4430 con 0x7ffbe4160920 2024-05-26T15:41:09.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.310+0000 7ffbdbe00640 1 -- 172.21.15.8:0/4026846660 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffbd00129d0 con 0x7ffbe4160920 2024-05-26T15:41:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.312+0000 7ffbdbe00640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffbc406ac00 0x7ffbc406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.312+0000 7ffbdbe00640 1 -- 172.21.15.8:0/4026846660 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ffbd0088cb0 con 0x7ffbe4160920 2024-05-26T15:41:09.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.312+0000 7ffbe3e00640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffbc406ac00 0x7ffbc406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.314+0000 7ffbe3e00640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffbc406ac00 0x7ffbc406d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4034000 tx=0x7ffbd402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:09.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.316+0000 7ffbdbe00640 1 -- 172.21.15.8:0/4026846660 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ffbd00540a0 con 0x7ffbe4160920 2024-05-26T15:41:09.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.591+0000 7ffbeb000640 1 -- 172.21.15.8:0/4026846660 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ffbe40681d0 con 0x7ffbe4160920 2024-05-26T15:41:09.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.600+0000 7ffbdbe00640 1 -- 172.21.15.8:0/4026846660 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffbd00576c0 con 0x7ffbe4160920 2024-05-26T15:41:09.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.603+0000 7ffbeb000640 1 -- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffbc406ac00 msgr2=0x7ffbc406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.603+0000 7ffbeb000640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffbc406ac00 0x7ffbc406d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4034000 tx=0x7ffbd402e000 comp rx=0 tx=0).stop 2024-05-26T15:41:09.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.603+0000 7ffbeb000640 1 -- 172.21.15.8:0/4026846660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4160920 msgr2=0x7ffbe40ac910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.603+0000 7ffbeb000640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4160920 0x7ffbe40ac910 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000c450 tx=0x7ffbd000c910 comp rx=0 tx=0).stop 2024-05-26T15:41:09.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.604+0000 7ffbeb000640 1 -- 172.21.15.8:0/4026846660 shutdown_connections 2024-05-26T15:41:09.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.604+0000 7ffbeb000640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ffbe40ace50 0x7ffbe415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.604+0000 7ffbeb000640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbe4160920 0x7ffbe40ac910 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.604+0000 7ffbeb000640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ffbc406ac00 0x7ffbc406d0c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.604+0000 7ffbeb000640 1 --2- 172.21.15.8:0/4026846660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffbe40cb8d0 0x7ffbe41490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.604+0000 7ffbeb000640 1 -- 172.21.15.8:0/4026846660 >> 172.21.15.8:0/4026846660 conn(0x7ffbe40b0570 msgr2=0x7ffbe415d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:09.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.604+0000 7ffbeb000640 1 -- 172.21.15.8:0/4026846660 shutdown_connections 2024-05-26T15:41:09.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.604+0000 7ffbeb000640 1 -- 172.21.15.8:0/4026846660 wait complete. 2024-05-26T15:41:09.621 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-26T15:41:09.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.832+0000 7f5d8b000640 1 Processor -- start 2024-05-26T15:41:09.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.833+0000 7f5d8b000640 1 -- start start 2024-05-26T15:41:09.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.834+0000 7f5d8b000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5d84142fc0 0x7f5d840b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.834+0000 7f5d8b000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d840cb960 0x7f5d8406cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.834+0000 7f5d8b000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8406c6c0 con 0x7f5d841433a0 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.834+0000 7f5d8b000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d840b1e90 con 0x7f5d840cb960 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.834+0000 7f5d8b000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8415dbc0 con 0x7f5d84142fc0 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.835+0000 7f5d89000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d840cb960 0x7f5d8406cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.835+0000 7f5d89000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5d840cb960 0x7f5d8406cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45462/0 (socket says 172.21.15.8:45462) 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.835+0000 7f5d89000640 1 -- 172.21.15.8:0/2267857151 learned_addr learned my addr 172.21.15.8:0/2267857151 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.835+0000 7f5d83e00640 1 --2- 172.21.15.8:0/2267857151 >> v2:172.21.15.47:3300/0 conn(0x7f5d84142fc0 0x7f5d840b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.835+0000 7f5d89000640 1 -- 172.21.15.8:0/2267857151 >> v2:172.21.15.47:3300/0 conn(0x7f5d84142fc0 msgr2=0x7f5d840b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.835+0000 7f5d89000640 1 --2- 172.21.15.8:0/2267857151 >> v2:172.21.15.47:3300/0 conn(0x7f5d84142fc0 0x7f5d840b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.835+0000 7f5d89000640 1 -- 172.21.15.8:0/2267857151 >> v1:172.21.15.47:6789/0 conn(0x7f5d841433a0 legacy=0x7f5d840cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:09.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.835+0000 7f5d89000640 1 -- 172.21.15.8:0/2267857151 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8415de80 con 0x7f5d840cb960 2024-05-26T15:41:09.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.836+0000 7f5d89000640 1 --2- 172.21.15.8:0/2267857151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d840cb960 0x7f5d8406cb50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5d84071790 tx=0x7f5d7c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b380f0dee0f06e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:09.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.837+0000 7f5d82a00640 1 -- 172.21.15.8:0/2267857151 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c032440 con 0x7f5d840cb960 2024-05-26T15:41:09.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.837+0000 7f5d82a00640 1 -- 172.21.15.8:0/2267857151 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c0325a0 con 0x7f5d840cb960 2024-05-26T15:41:09.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.837+0000 7f5d82a00640 1 -- 172.21.15.8:0/2267857151 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c032930 con 0x7f5d840cb960 2024-05-26T15:41:09.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.837+0000 7f5d8b000640 1 -- 172.21.15.8:0/2267857151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d840cb960 msgr2=0x7f5d8406cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.837+0000 7f5d8b000640 1 --2- 172.21.15.8:0/2267857151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d840cb960 0x7f5d8406cb50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5d84071790 tx=0x7f5d7c02a230 comp rx=0 tx=0).stop 2024-05-26T15:41:09.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.837+0000 7f5d8b000640 1 -- 172.21.15.8:0/2267857151 shutdown_connections 2024-05-26T15:41:09.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.837+0000 7f5d8b000640 1 --2- 172.21.15.8:0/2267857151 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d840cb960 0x7f5d8406cb50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.837+0000 7f5d8b000640 1 --2- 172.21.15.8:0/2267857151 >> v2:172.21.15.47:3300/0 conn(0x7f5d84142fc0 0x7f5d840b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.837+0000 7f5d8b000640 1 -- 172.21.15.8:0/2267857151 >> 172.21.15.8:0/2267857151 conn(0x7f5d840b0570 msgr2=0x7f5d840b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:09.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.838+0000 7f5d8b000640 1 -- 172.21.15.8:0/2267857151 shutdown_connections 2024-05-26T15:41:09.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.838+0000 7f5d8b000640 1 -- 172.21.15.8:0/2267857151 wait complete. 2024-05-26T15:41:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.839+0000 7f5d8b000640 1 Processor -- start 2024-05-26T15:41:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.839+0000 7f5d8b000640 1 -- start start 2024-05-26T15:41:09.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.840+0000 7f5d8b000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d840cb960 0x7f5d8413ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.840+0000 7f5d8b000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d84142fc0 0x7f5d8415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.840+0000 7f5d8b000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d841433a0 0x7f5d8413e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.840+0000 7f5d8b000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8413b680 con 0x7f5d841433a0 2024-05-26T15:41:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.840+0000 7f5d8b000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840ac0b0 con 0x7f5d84142fc0 2024-05-26T15:41:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.840+0000 7f5d8b000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8413ec30 con 0x7f5d840cb960 2024-05-26T15:41:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d89000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d841433a0 0x7f5d8413e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d89000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d841433a0 0x7f5d8413e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45470/0 (socket says 172.21.15.8:45470) 2024-05-26T15:41:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d89000640 1 -- 172.21.15.8:0/3640394125 learned_addr learned my addr 172.21.15.8:0/3640394125 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d83e00640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d840cb960 0x7f5d8413ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d89000640 1 -- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d840cb960 msgr2=0x7f5d8413ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d89000640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d840cb960 0x7f5d8413ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d89000640 1 -- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d84142fc0 msgr2=0x7f5d8415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d83400640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d84142fc0 0x7f5d8415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d89000640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d84142fc0 0x7f5d8415a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d89000640 1 -- 172.21.15.8:0/3640394125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c0094d0 con 0x7f5d841433a0 2024-05-26T15:41:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d83400640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d84142fc0 0x7f5d8415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.841+0000 7f5d89000640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d841433a0 0x7f5d8413e6f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0090b0 tx=0x7f5d7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.842+0000 7f5d7be00640 1 -- 172.21.15.8:0/3640394125 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c032440 con 0x7f5d841433a0 2024-05-26T15:41:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.842+0000 7f5d7be00640 1 -- 172.21.15.8:0/3640394125 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c030b80 con 0x7f5d841433a0 2024-05-26T15:41:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.842+0000 7f5d8b000640 1 -- 172.21.15.8:0/3640394125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8413b3a0 con 0x7f5d841433a0 2024-05-26T15:41:09.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.842+0000 7f5d7be00640 1 -- 172.21.15.8:0/3640394125 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c03d420 con 0x7f5d841433a0 2024-05-26T15:41:09.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.842+0000 7f5d8b000640 1 -- 172.21.15.8:0/3640394125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d840abd40 con 0x7f5d841433a0 2024-05-26T15:41:09.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.843+0000 7f5d8b000640 1 -- 172.21.15.8:0/3640394125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d840ab8c0 con 0x7f5d841433a0 2024-05-26T15:41:09.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.844+0000 7f5d7be00640 1 -- 172.21.15.8:0/3640394125 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5d7c039040 con 0x7f5d841433a0 2024-05-26T15:41:09.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.845+0000 7f5d7be00640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5d6006ac30 0x7f5d6006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.845+0000 7f5d7be00640 1 -- 172.21.15.8:0/3640394125 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5d7c0a9d20 con 0x7f5d841433a0 2024-05-26T15:41:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.845+0000 7f5d83e00640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5d6006ac30 0x7f5d6006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:09.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.847+0000 7f5d83e00640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5d6006ac30 0x7f5d6006d0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d74006fd0 tx=0x7f5d74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:09.849+0000 7f5d7be00640 1 -- 172.21.15.8:0/3640394125 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5d840ab8c0 con 0x7f5d841433a0 2024-05-26T15:41:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.118+0000 7f5d8b000640 1 -- 172.21.15.8:0/3640394125 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f5d840ab8c0 con 0x7f5d841433a0 2024-05-26T15:41:10.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.128+0000 7f5d7be00640 1 -- 172.21.15.8:0/3640394125 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5d840ab8c0 con 0x7f5d841433a0 2024-05-26T15:41:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.130+0000 7f5d8b000640 1 -- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5d6006ac30 msgr2=0x7f5d6006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.130+0000 7f5d8b000640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5d6006ac30 0x7f5d6006d0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5d74006fd0 tx=0x7f5d74008040 comp rx=0 tx=0).stop 2024-05-26T15:41:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.130+0000 7f5d8b000640 1 -- 172.21.15.8:0/3640394125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d841433a0 msgr2=0x7f5d8413e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.130+0000 7f5d8b000640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d841433a0 0x7f5d8413e6f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0090b0 tx=0x7f5d7c0046c0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.130+0000 7f5d8b000640 1 -- 172.21.15.8:0/3640394125 shutdown_connections 2024-05-26T15:41:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.130+0000 7f5d8b000640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5d841433a0 0x7f5d8413e6f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.130+0000 7f5d8b000640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5d6006ac30 0x7f5d6006d0f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.130+0000 7f5d8b000640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d84142fc0 0x7f5d8415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.130+0000 7f5d8b000640 1 --2- 172.21.15.8:0/3640394125 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5d840cb960 0x7f5d8413ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.130+0000 7f5d8b000640 1 -- 172.21.15.8:0/3640394125 >> 172.21.15.8:0/3640394125 conn(0x7f5d840b0570 msgr2=0x7f5d8415cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.131+0000 7f5d8b000640 1 -- 172.21.15.8:0/3640394125 shutdown_connections 2024-05-26T15:41:10.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.131+0000 7f5d8b000640 1 -- 172.21.15.8:0/3640394125 wait complete. 2024-05-26T15:41:10.147 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:41:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.359+0000 7fdf05800640 1 Processor -- start 2024-05-26T15:41:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.360+0000 7fdf05800640 1 -- start start 2024-05-26T15:41:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.361+0000 7fdf05800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdf00154f50 0x7fdf000b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdf05800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdf000c36c0 0x7fdf000c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdf05800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0015b640 con 0x7fdf0015ae70 2024-05-26T15:41:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdf05800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0015bee0 con 0x7fdf00154f50 2024-05-26T15:41:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdf05800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf000b0ba0 con 0x7fdf000c36c0 2024-05-26T15:41:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdeffe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdf00154f50 0x7fdf000b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdef7e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fdf0015ae70 0x7fdf0015eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:39042/0 (socket says 172.21.15.8:39042) 2024-05-26T15:41:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdef7e00640 1 -- 172.21.15.8:0/1940812070 learned_addr learned my addr 172.21.15.8:0/1940812070 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdf04e00640 1 --2- 172.21.15.8:0/1940812070 >> v2:172.21.15.47:3300/0 conn(0x7fdf000c36c0 0x7fdf000c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdeffe00640 1 -- 172.21.15.8:0/1940812070 >> v2:172.21.15.47:3300/0 conn(0x7fdf000c36c0 msgr2=0x7fdf000c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdeffe00640 1 --2- 172.21.15.8:0/1940812070 >> v2:172.21.15.47:3300/0 conn(0x7fdf000c36c0 0x7fdf000c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.362+0000 7fdeffe00640 1 -- 172.21.15.8:0/1940812070 >> v1:172.21.15.8:6789/0 conn(0x7fdf0015ae70 legacy=0x7fdf0015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.363+0000 7fdeffe00640 1 -- 172.21.15.8:0/1940812070 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0015b920 con 0x7fdf00154f50 2024-05-26T15:41:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.363+0000 7fdeff400640 1 -- 172.21.15.8:0/1940812070 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181087752 0 0) 0x7fdf0015b640 con 0x7fdf0015ae70 2024-05-26T15:41:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.363+0000 7fdf04e00640 1 --2- 172.21.15.8:0/1940812070 >> v2:172.21.15.47:3300/0 conn(0x7fdf000c36c0 0x7fdf000c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.364+0000 7fdeffe00640 1 --2- 172.21.15.8:0/1940812070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00154f50 0x7fdf000b0f60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdf000c6990 tx=0x7fdef002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8e05bc6dff8a1e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.364+0000 7fdeff400640 1 -- 172.21.15.8:0/1940812070 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0032440 con 0x7fdf00154f50 2024-05-26T15:41:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.364+0000 7fdeff400640 1 -- 172.21.15.8:0/1940812070 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef00325a0 con 0x7fdf00154f50 2024-05-26T15:41:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.364+0000 7fdeff400640 1 -- 172.21.15.8:0/1940812070 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0032930 con 0x7fdf00154f50 2024-05-26T15:41:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.365+0000 7fdf05800640 1 -- 172.21.15.8:0/1940812070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00154f50 msgr2=0x7fdf000b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.365+0000 7fdf05800640 1 --2- 172.21.15.8:0/1940812070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00154f50 0x7fdf000b0f60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdf000c6990 tx=0x7fdef002a1a0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.365+0000 7fdf05800640 1 -- 172.21.15.8:0/1940812070 shutdown_connections 2024-05-26T15:41:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.365+0000 7fdf05800640 1 --2- 172.21.15.8:0/1940812070 >> v2:172.21.15.47:3300/0 conn(0x7fdf000c36c0 0x7fdf000c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.365+0000 7fdf05800640 1 --2- 172.21.15.8:0/1940812070 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf00154f50 0x7fdf000b0f60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.365+0000 7fdf05800640 1 -- 172.21.15.8:0/1940812070 >> 172.21.15.8:0/1940812070 conn(0x7fdf00070480 msgr2=0x7fdf00070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.365+0000 7fdf05800640 1 -- 172.21.15.8:0/1940812070 shutdown_connections 2024-05-26T15:41:10.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.365+0000 7fdf05800640 1 -- 172.21.15.8:0/1940812070 wait complete. 2024-05-26T15:41:10.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.367+0000 7fdf05800640 1 Processor -- start 2024-05-26T15:41:10.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.367+0000 7fdf05800640 1 -- start start 2024-05-26T15:41:10.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.368+0000 7fdf05800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf000c36c0 0x7fdf000c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.368+0000 7fdf05800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf00154f50 0x7fdf0014f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.368+0000 7fdf05800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf0015ae70 0x7fdf0014f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.368+0000 7fdf05800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000cb690 con 0x7fdf000c36c0 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.368+0000 7fdf05800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0014fcd0 con 0x7fdf0015ae70 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.368+0000 7fdf05800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000c8e40 con 0x7fdf00154f50 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.368+0000 7fdeffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf000c36c0 0x7fdf000c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.368+0000 7fdeffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf000c36c0 0x7fdf000c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45488/0 (socket says 172.21.15.8:45488) 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.368+0000 7fdeffe00640 1 -- 172.21.15.8:0/4115236155 learned_addr learned my addr 172.21.15.8:0/4115236155 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.369+0000 7fdeffe00640 1 -- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf00154f50 msgr2=0x7fdf0014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.369+0000 7fdeffe00640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf00154f50 0x7fdf0014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.369+0000 7fdeffe00640 1 -- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf0015ae70 msgr2=0x7fdf0014f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.369+0000 7fdeffe00640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf0015ae70 0x7fdf0014f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.369+0000 7fdeffe00640 1 -- 172.21.15.8:0/4115236155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0009400 con 0x7fdf000c36c0 2024-05-26T15:41:10.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.369+0000 7fdeffe00640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf000c36c0 0x7fdf000c83f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009890 tx=0x7fdef00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.369+0000 7fdefcc00640 1 -- 172.21.15.8:0/4115236155 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0030b80 con 0x7fdf000c36c0 2024-05-26T15:41:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.370+0000 7fdefcc00640 1 -- 172.21.15.8:0/4115236155 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef0030d00 con 0x7fdf000c36c0 2024-05-26T15:41:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.370+0000 7fdefcc00640 1 -- 172.21.15.8:0/4115236155 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef003d680 con 0x7fdf000c36c0 2024-05-26T15:41:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.370+0000 7fdf05800640 1 -- 172.21.15.8:0/4115236155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf000cbb20 con 0x7fdf000c36c0 2024-05-26T15:41:10.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.370+0000 7fdf05800640 1 -- 172.21.15.8:0/4115236155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf000cb040 con 0x7fdf000c36c0 2024-05-26T15:41:10.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.371+0000 7fdf05800640 1 -- 172.21.15.8:0/4115236155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0004e280 con 0x7fdf000c36c0 2024-05-26T15:41:10.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.372+0000 7fdefcc00640 1 -- 172.21.15.8:0/4115236155 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdef0039040 con 0x7fdf000c36c0 2024-05-26T15:41:10.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.373+0000 7fdefcc00640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdedc06ac30 0x7fdedc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.373+0000 7fdefcc00640 1 -- 172.21.15.8:0/4115236155 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdef00a9d00 con 0x7fdf000c36c0 2024-05-26T15:41:10.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.373+0000 7fdef7e00640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdedc06ac30 0x7fdedc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:10.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.375+0000 7fdef7e00640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdedc06ac30 0x7fdedc06d0f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdee8007fd0 tx=0x7fdee8007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:10.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.378+0000 7fdefcc00640 1 -- 172.21.15.8:0/4115236155 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdef0075100 con 0x7fdf000c36c0 2024-05-26T15:41:10.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.578+0000 7fdf05800640 1 -- 172.21.15.8:0/4115236155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf000714a0 con 0x7fdf000c36c0 2024-05-26T15:41:10.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.581+0000 7fdefcc00640 1 -- 172.21.15.8:0/4115236155 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+12498 (secure 0 0 0) 0x7fdef0006e10 con 0x7fdf000c36c0 2024-05-26T15:41:10.579 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:10.580 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":35,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:41:06.439507+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:41:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.583+0000 7fdf05800640 1 -- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdedc06ac30 msgr2=0x7fdedc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.583+0000 7fdf05800640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdedc06ac30 0x7fdedc06d0f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdee8007fd0 tx=0x7fdee8007960 comp rx=0 tx=0).stop 2024-05-26T15:41:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.584+0000 7fdf05800640 1 -- 172.21.15.8:0/4115236155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf000c36c0 msgr2=0x7fdf000c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.584+0000 7fdf05800640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf000c36c0 0x7fdf000c83f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009890 tx=0x7fdef00046c0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.584+0000 7fdf05800640 1 -- 172.21.15.8:0/4115236155 shutdown_connections 2024-05-26T15:41:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.584+0000 7fdf05800640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdedc06ac30 0x7fdedc06d0f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.584+0000 7fdf05800640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdf0015ae70 0x7fdf0014f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.584+0000 7fdf05800640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fdf00154f50 0x7fdf0014f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.584+0000 7fdf05800640 1 --2- 172.21.15.8:0/4115236155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf000c36c0 0x7fdf000c83f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.584+0000 7fdf05800640 1 -- 172.21.15.8:0/4115236155 >> 172.21.15.8:0/4115236155 conn(0x7fdf00070480 msgr2=0x7fdf000c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.584+0000 7fdf05800640 1 -- 172.21.15.8:0/4115236155 shutdown_connections 2024-05-26T15:41:10.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.584+0000 7fdf05800640 1 -- 172.21.15.8:0/4115236155 wait complete. 2024-05-26T15:41:10.603 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-26T15:41:10.603 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:41:10.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.824+0000 7f65a6000640 1 Processor -- start 2024-05-26T15:41:10.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.825+0000 7f65a6000640 1 -- start start 2024-05-26T15:41:10.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.826+0000 7f65a6000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f65a01599a0 0x7f65a006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.826+0000 7f65a6000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f65a015d300 0x7f65a006da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.826+0000 7f65a6000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65a00cc3d0 0x7f65a0070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.826+0000 7f65a6000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a00cd570 con 0x7f65a01599a0 2024-05-26T15:41:10.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.826+0000 7f65a6000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a00cc960 con 0x7f65a015d300 2024-05-26T15:41:10.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.826+0000 7f65a6000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a00ccc40 con 0x7f65a00cc3d0 2024-05-26T15:41:10.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.827+0000 7f65a4c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f65a01599a0 0x7f65a006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:10.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.827+0000 7f65a4c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f65a01599a0 0x7f65a006d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45498/0 (socket says 172.21.15.8:45498) 2024-05-26T15:41:10.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.827+0000 7f65a4c00640 1 -- 172.21.15.8:0/3643033500 learned_addr learned my addr 172.21.15.8:0/3643033500 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:10.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.827+0000 7f65a4c00640 1 -- 172.21.15.8:0/3643033500 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65a00cc3d0 msgr2=0x7f65a0070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:10.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.827+0000 7f65a4c00640 1 --2- 172.21.15.8:0/3643033500 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65a00cc3d0 0x7f65a0070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.827+0000 7f65a4c00640 1 -- 172.21.15.8:0/3643033500 >> v2:172.21.15.47:3300/0 conn(0x7f65a015d300 msgr2=0x7f65a006da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:10.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.827+0000 7f65a4c00640 1 --2- 172.21.15.8:0/3643033500 >> v2:172.21.15.47:3300/0 conn(0x7f65a015d300 0x7f65a006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.827+0000 7f65a4c00640 1 -- 172.21.15.8:0/3643033500 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a00ccf20 con 0x7f65a01599a0 2024-05-26T15:41:10.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.828+0000 7f65a4c00640 1 --2- 172.21.15.8:0/3643033500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a01599a0 0x7f65a006d4d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f65a0068020 tx=0x7f659002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e0319e5a363c88 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:10.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.829+0000 7f659f400640 1 -- 172.21.15.8:0/3643033500 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659002ae90 con 0x7f65a01599a0 2024-05-26T15:41:10.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.829+0000 7f659f400640 1 -- 172.21.15.8:0/3643033500 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6590032440 con 0x7f65a01599a0 2024-05-26T15:41:10.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.829+0000 7f659f400640 1 -- 172.21.15.8:0/3643033500 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65900327d0 con 0x7f65a01599a0 2024-05-26T15:41:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.829+0000 7f65a6000640 1 -- 172.21.15.8:0/3643033500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a01599a0 msgr2=0x7f65a006d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.829+0000 7f65a6000640 1 --2- 172.21.15.8:0/3643033500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a01599a0 0x7f65a006d4d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f65a0068020 tx=0x7f659002a140 comp rx=0 tx=0).stop 2024-05-26T15:41:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.829+0000 7f65a6000640 1 -- 172.21.15.8:0/3643033500 shutdown_connections 2024-05-26T15:41:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.829+0000 7f65a6000640 1 --2- 172.21.15.8:0/3643033500 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65a00cc3d0 0x7f65a0070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.829+0000 7f65a6000640 1 --2- 172.21.15.8:0/3643033500 >> v2:172.21.15.47:3300/0 conn(0x7f65a015d300 0x7f65a006da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.830+0000 7f65a6000640 1 --2- 172.21.15.8:0/3643033500 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a01599a0 0x7f65a006d4d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.830+0000 7f65a6000640 1 -- 172.21.15.8:0/3643033500 >> 172.21.15.8:0/3643033500 conn(0x7f65a00ce4f0 msgr2=0x7f65a00ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:10.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.830+0000 7f65a6000640 1 -- 172.21.15.8:0/3643033500 shutdown_connections 2024-05-26T15:41:10.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.830+0000 7f65a6000640 1 -- 172.21.15.8:0/3643033500 wait complete. 2024-05-26T15:41:10.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.831+0000 7f65a6000640 1 Processor -- start 2024-05-26T15:41:10.830 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.832+0000 7f65a6000640 1 -- start start 2024-05-26T15:41:10.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f65a6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65a00cc3d0 0x7f65a013dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f65a6000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a015d300 0x7f65a013a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f65a6000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65a0159e00 0x7f65a015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f65a6000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a013d930 con 0x7f65a015d300 2024-05-26T15:41:10.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f65a6000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a014f510 con 0x7f65a00cc3d0 2024-05-26T15:41:10.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f65a6000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a015c290 con 0x7f65a0159e00 2024-05-26T15:41:10.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f659fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a015d300 0x7f65a013a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:10.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f659fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a015d300 0x7f65a013a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45512/0 (socket says 172.21.15.8:45512) 2024-05-26T15:41:10.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f659fe00640 1 -- 172.21.15.8:0/2578526028 learned_addr learned my addr 172.21.15.8:0/2578526028 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:10.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f65a5600640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65a0159e00 0x7f65a015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:10.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.833+0000 7f65a4c00640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65a00cc3d0 0x7f65a013dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:10.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.834+0000 7f659fe00640 1 -- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65a0159e00 msgr2=0x7f65a015a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.834+0000 7f659fe00640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65a0159e00 0x7f65a015a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.834+0000 7f659fe00640 1 -- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65a00cc3d0 msgr2=0x7f65a013dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:10.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.834+0000 7f659fe00640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65a00cc3d0 0x7f65a013dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:10.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.834+0000 7f659fe00640 1 -- 172.21.15.8:0/2578526028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900094d0 con 0x7f65a015d300 2024-05-26T15:41:10.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.834+0000 7f659fe00640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a015d300 0x7f65a013a820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f658c00b410 tx=0x7f658c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:10.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.834+0000 7f659cc00640 1 -- 172.21.15.8:0/2578526028 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c011830 con 0x7f65a015d300 2024-05-26T15:41:10.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.834+0000 7f659cc00640 1 -- 172.21.15.8:0/2578526028 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0119b0 con 0x7f65a015d300 2024-05-26T15:41:10.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.834+0000 7f659cc00640 1 -- 172.21.15.8:0/2578526028 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c011d60 con 0x7f65a015d300 2024-05-26T15:41:10.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.834+0000 7f65a6000640 1 -- 172.21.15.8:0/2578526028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a015ac50 con 0x7f65a015d300 2024-05-26T15:41:10.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.835+0000 7f65a6000640 1 -- 172.21.15.8:0/2578526028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a013d270 con 0x7f65a015d300 2024-05-26T15:41:10.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.836+0000 7f65a6000640 1 -- 172.21.15.8:0/2578526028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a013da70 con 0x7f65a015d300 2024-05-26T15:41:10.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.837+0000 7f659cc00640 1 -- 172.21.15.8:0/2578526028 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f658c01a400 con 0x7f65a015d300 2024-05-26T15:41:10.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.837+0000 7f659cc00640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f658006ac00 0x7f658006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:10.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.838+0000 7f659cc00640 1 -- 172.21.15.8:0/2578526028 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f658c089360 con 0x7f65a015d300 2024-05-26T15:41:10.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.838+0000 7f65a4c00640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f658006ac00 0x7f658006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:10.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.839+0000 7f65a4c00640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f658006ac00 0x7f658006d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6590034000 tx=0x7f659002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:10.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:10.842+0000 7f659cc00640 1 -- 172.21.15.8:0/2578526028 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f65a013da70 con 0x7f65a015d300 2024-05-26T15:41:11.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.039+0000 7f65a6000640 1 -- 172.21.15.8:0/2578526028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65a013da70 con 0x7f65a015d300 2024-05-26T15:41:11.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.039+0000 7f659cc00640 1 -- 172.21.15.8:0/2578526028 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65a013da70 con 0x7f65a015d300 2024-05-26T15:41:11.038 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:41:11.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.042+0000 7f65a6000640 1 -- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f658006ac00 msgr2=0x7f658006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.042+0000 7f65a6000640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f658006ac00 0x7f658006d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6590034000 tx=0x7f659002e000 comp rx=0 tx=0).stop 2024-05-26T15:41:11.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.042+0000 7f65a6000640 1 -- 172.21.15.8:0/2578526028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a015d300 msgr2=0x7f65a013a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.042+0000 7f65a6000640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a015d300 0x7f65a013a820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f658c00b410 tx=0x7f658c00b8d0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.042+0000 7f65a6000640 1 -- 172.21.15.8:0/2578526028 shutdown_connections 2024-05-26T15:41:11.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.042+0000 7f65a6000640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f65a0159e00 0x7f65a015a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.043+0000 7f65a6000640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65a015d300 0x7f65a013a820 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.043+0000 7f65a6000640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f658006ac00 0x7f658006d0c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.043+0000 7f65a6000640 1 --2- 172.21.15.8:0/2578526028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65a00cc3d0 0x7f65a013dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.043+0000 7f65a6000640 1 -- 172.21.15.8:0/2578526028 >> 172.21.15.8:0/2578526028 conn(0x7f65a00ce4f0 msgr2=0x7f65a00af510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:11.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.043+0000 7f65a6000640 1 -- 172.21.15.8:0/2578526028 shutdown_connections 2024-05-26T15:41:11.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.043+0000 7f65a6000640 1 -- 172.21.15.8:0/2578526028 wait complete. 2024-05-26T15:41:11.059 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-26T15:41:11.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.266+0000 7f82df200640 1 Processor -- start 2024-05-26T15:41:11.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.266+0000 7f82df200640 1 -- start start 2024-05-26T15:41:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.267+0000 7f82df200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e0142580 0x7f82e00cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.267+0000 7f82df200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e00ccdc0 con 0x7f82e00ce100 2024-05-26T15:41:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.267+0000 7f82df200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e0142960 con 0x7f82e006dc80 2024-05-26T15:41:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.267+0000 7f82df200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00cd060 con 0x7f82e0142580 2024-05-26T15:41:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.268+0000 7f82dd400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f82e00ce100 0x7f82e006d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53430/0 (socket says 172.21.15.8:53430) 2024-05-26T15:41:11.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.268+0000 7f82dd400640 1 -- 172.21.15.8:0/1955420173 learned_addr learned my addr 172.21.15.8:0/1955420173 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.268+0000 7f82dde00640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e0142580 0x7f82e00cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.268+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797652259 0 0) 0x7f82e00ccdc0 con 0x7f82e00ce100 2024-05-26T15:41:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.268+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c4005730 con 0x7f82e00ce100 2024-05-26T15:41:11.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1856992942 0 0) 0x7f82c4005730 con 0x7f82e00ce100 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e0142580 msgr2=0x7f82e00cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e0142580 0x7f82e00cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 >> v1:172.21.15.47:6789/0 conn(0x7f82e006dc80 legacy=0x7f82e0159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00cd340 con 0x7f82e00ce100 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f82cc001670 con 0x7f82e00ce100 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 >> v1:172.21.15.8:6789/0 conn(0x7f82e00ce100 legacy=0x7f82e006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4005bb0 0x7f82c4005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e0142580 0x7f82c40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c4006f10 0x7f82c4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00cd060 con 0x7f82c4006f10 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c400dc70 con 0x7f82c4005bb0 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c400de30 con 0x7f82e0142580 2024-05-26T15:41:11.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.269+0000 7f82de800640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c4006f10 0x7f82c4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.270+0000 7f82dde00640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4005bb0 0x7f82c4005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.270+0000 7f82dd400640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e0142580 0x7f82c40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.270+0000 7f82de800640 1 -- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e0142580 msgr2=0x7f82c40069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.270+0000 7f82de800640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e0142580 0x7f82c40069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.270+0000 7f82de800640 1 -- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4005bb0 msgr2=0x7f82c4005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.270+0000 7f82de800640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82c4005bb0 0x7f82c4005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.270+0000 7f82de800640 1 -- 172.21.15.8:0/1955420173 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c4005730 con 0x7f82c4006f10 2024-05-26T15:41:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.271+0000 7f82de800640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c4006f10 0x7f82c4007390 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f82d8001e20 tx=0x7f82c4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddd5a0f47141265 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.271+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d802ae40 con 0x7f82c4006f10 2024-05-26T15:41:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.271+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d8003970 con 0x7f82c4006f10 2024-05-26T15:41:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.271+0000 7f82dca00640 1 -- 172.21.15.8:0/1955420173 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8003d20 con 0x7f82c4006f10 2024-05-26T15:41:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.272+0000 7f82df200640 1 -- 172.21.15.8:0/1955420173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c4006f10 msgr2=0x7f82c4007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.272+0000 7f82df200640 1 --2- 172.21.15.8:0/1955420173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82c4006f10 0x7f82c4007390 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f82d8001e20 tx=0x7f82c4007a00 comp rx=0 tx=0).stop 2024-05-26T15:41:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.272+0000 7f82de800640 1 -- 172.21.15.8:0/1955420173 reap_dead start 2024-05-26T15:41:11.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.272+0000 7f82df200640 1 -- 172.21.15.8:0/1955420173 shutdown_connections 2024-05-26T15:41:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.272+0000 7f82df200640 1 -- 172.21.15.8:0/1955420173 >> 172.21.15.8:0/1955420173 conn(0x7f82e00662e0 msgr2=0x7f82e0069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.272+0000 7f82df200640 1 -- 172.21.15.8:0/1955420173 shutdown_connections 2024-05-26T15:41:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.272+0000 7f82df200640 1 -- 172.21.15.8:0/1955420173 wait complete. 2024-05-26T15:41:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.274+0000 7f82df200640 1 Processor -- start 2024-05-26T15:41:11.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.274+0000 7f82df200640 1 -- start start 2024-05-26T15:41:11.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.275+0000 7f82df200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e01592a0 0x7f82e00a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.275+0000 7f82df200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e013d2c0 0x7f82e00a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.275+0000 7f82df200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e00a9400 0x7f82e0140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.275+0000 7f82df200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e0159680 con 0x7f82e01592a0 2024-05-26T15:41:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.275+0000 7f82df200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00a7e20 con 0x7f82e013d2c0 2024-05-26T15:41:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.275+0000 7f82df200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00a8100 con 0x7f82e00a9400 2024-05-26T15:41:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.275+0000 7f82dde00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e01592a0 0x7f82e00a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.275+0000 7f82dde00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e01592a0 0x7f82e00a74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58128/0 (socket says 172.21.15.8:58128) 2024-05-26T15:41:11.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.275+0000 7f82dde00640 1 -- 172.21.15.8:0/1137746404 learned_addr learned my addr 172.21.15.8:0/1137746404 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.276+0000 7f82dde00640 1 -- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e00a9400 msgr2=0x7f82e0140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.276+0000 7f82dde00640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e00a9400 0x7f82e0140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.276+0000 7f82dde00640 1 -- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e013d2c0 msgr2=0x7f82e00a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.276+0000 7f82dde00640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e013d2c0 0x7f82e00a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.276+0000 7f82dde00640 1 -- 172.21.15.8:0/1137746404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00a83e0 con 0x7f82e01592a0 2024-05-26T15:41:11.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.276+0000 7f82dde00640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e01592a0 0x7f82e00a74b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f82d0011600 tx=0x7f82d0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.276+0000 7f82d6000640 1 -- 172.21.15.8:0/1137746404 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0015870 con 0x7f82e01592a0 2024-05-26T15:41:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.276+0000 7f82d6000640 1 -- 172.21.15.8:0/1137746404 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d00159d0 con 0x7f82e01592a0 2024-05-26T15:41:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.276+0000 7f82d6000640 1 -- 172.21.15.8:0/1137746404 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d0015d40 con 0x7f82e01592a0 2024-05-26T15:41:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.276+0000 7f82df200640 1 -- 172.21.15.8:0/1137746404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e00a86c0 con 0x7f82e01592a0 2024-05-26T15:41:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.277+0000 7f82df200640 1 -- 172.21.15.8:0/1137746404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e00a79f0 con 0x7f82e01592a0 2024-05-26T15:41:11.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.278+0000 7f82df200640 1 -- 172.21.15.8:0/1137746404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e00a7be0 con 0x7f82e01592a0 2024-05-26T15:41:11.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.279+0000 7f82d6000640 1 -- 172.21.15.8:0/1137746404 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f82d000f490 con 0x7f82e01592a0 2024-05-26T15:41:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.280+0000 7f82d6000640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac30 0x7f82c006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.280+0000 7f82d6000640 1 -- 172.21.15.8:0/1137746404 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f82d0089670 con 0x7f82e01592a0 2024-05-26T15:41:11.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.280+0000 7f82dd400640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac30 0x7f82c006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.282+0000 7f82dd400640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac30 0x7f82c006d0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f82cc001050 tx=0x7f82cc000f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:11.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.284+0000 7f82d6000640 1 -- 172.21.15.8:0/1137746404 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f82e00a7be0 con 0x7f82e01592a0 2024-05-26T15:41:11.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.486+0000 7f82df200640 1 -- 172.21.15.8:0/1137746404 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f82e00a7be0 con 0x7f82e01592a0 2024-05-26T15:41:11.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.487+0000 7f82d6000640 1 -- 172.21.15.8:0/1137746404 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f82e00a7be0 con 0x7f82e01592a0 2024-05-26T15:41:11.486 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:11.486 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2024-05-26T15:41:11.486 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:41:11.486 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2024-05-26T15:41:11.486 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2024-05-26T15:41:11.486 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:41:11.486 INFO:teuthology.orchestra.run.smithi008.stdout:] 2024-05-26T15:41:11.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.489+0000 7f82df200640 1 -- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac30 msgr2=0x7f82c006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.489+0000 7f82df200640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac30 0x7f82c006d0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f82cc001050 tx=0x7f82cc000f40 comp rx=0 tx=0).stop 2024-05-26T15:41:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.489+0000 7f82df200640 1 -- 172.21.15.8:0/1137746404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e01592a0 msgr2=0x7f82e00a74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.489+0000 7f82df200640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e01592a0 0x7f82e00a74b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f82d0011600 tx=0x7f82d0011ac0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.490+0000 7f82df200640 1 -- 172.21.15.8:0/1137746404 shutdown_connections 2024-05-26T15:41:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.490+0000 7f82df200640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f82e00a9400 0x7f82e0140af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.490+0000 7f82df200640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f82c006ac30 0x7f82c006d0f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.490+0000 7f82df200640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f82e013d2c0 0x7f82e00a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.490+0000 7f82df200640 1 --2- 172.21.15.8:0/1137746404 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f82e01592a0 0x7f82e00a74b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.490+0000 7f82df200640 1 -- 172.21.15.8:0/1137746404 >> 172.21.15.8:0/1137746404 conn(0x7f82e00662e0 msgr2=0x7f82e00b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.490+0000 7f82df200640 1 -- 172.21.15.8:0/1137746404 shutdown_connections 2024-05-26T15:41:11.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.490+0000 7f82df200640 1 -- 172.21.15.8:0/1137746404 wait complete. 2024-05-26T15:41:11.507 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-26T15:41:11.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-26T15:41:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.718+0000 7f2eb6200640 1 Processor -- start 2024-05-26T15:41:11.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.718+0000 7f2eb6200640 1 -- start start 2024-05-26T15:41:11.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.720+0000 7f2eb6200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb014ffc0 0x7f2eb00b2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.720+0000 7f2eb6200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2eb0070370 0x7f2eb0070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.720+0000 7f2eb6200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb00b1b90 con 0x7f2eb014fbe0 2024-05-26T15:41:11.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.720+0000 7f2eb6200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb0070d40 con 0x7f2eb0070370 2024-05-26T15:41:11.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.720+0000 7f2eb6200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00b1560 con 0x7f2eb014ffc0 2024-05-26T15:41:11.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.720+0000 7f2eb4e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2eb014fbe0 0x7f2eb0159360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53440/0 (socket says 172.21.15.8:53440) 2024-05-26T15:41:11.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.720+0000 7f2eb4e00640 1 -- 172.21.15.8:0/3037336064 learned_addr learned my addr 172.21.15.8:0/3037336064 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960885899 0 0) 0x7f2eb00b1b90 con 0x7f2eb014fbe0 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eb5800640 1 --2- 172.21.15.8:0/3037336064 >> v2:172.21.15.47:3300/0 conn(0x7f2eb0070370 0x7f2eb0070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e94003520 con 0x7f2eb014fbe0 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eafe00640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb014ffc0 0x7f2eb00b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3694462348 0 0) 0x7f2e94003520 con 0x7f2eb014fbe0 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb014ffc0 msgr2=0x7f2eb00b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb014ffc0 0x7f2eb00b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 >> v2:172.21.15.47:3300/0 conn(0x7f2eb0070370 msgr2=0x7f2eb0070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 --2- 172.21.15.8:0/3037336064 >> v2:172.21.15.47:3300/0 conn(0x7f2eb0070370 0x7f2eb0070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb0159e90 con 0x7f2eb014fbe0 2024-05-26T15:41:11.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f2ea0001670 con 0x7f2eb014fbe0 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 >> v1:172.21.15.8:6789/0 conn(0x7f2eb014fbe0 legacy=0x7f2eb0159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e94003970 0x7f2e94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb014ffc0 0x7f2e940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e94004d00 0x7f2e94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0070d40 con 0x7f2e94003970 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00b1560 con 0x7f2e94004d00 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.721+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9400db90 con 0x7f2eb014ffc0 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.722+0000 7f2eb4e00640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e94003970 0x7f2e94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.722+0000 7f2eb5800640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e94004d00 0x7f2e94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.722+0000 7f2eafe00640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb014ffc0 0x7f2e940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.722+0000 7f2eb4e00640 1 -- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb014ffc0 msgr2=0x7f2e940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.722+0000 7f2eb4e00640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb014ffc0 0x7f2e940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.722+0000 7f2eb4e00640 1 -- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e94004d00 msgr2=0x7f2e94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:11.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.722+0000 7f2eb4e00640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e94004d00 0x7f2e94005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.722+0000 7f2eb4e00640 1 -- 172.21.15.8:0/3037336064 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e94003520 con 0x7f2e94003970 2024-05-26T15:41:11.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.722+0000 7f2eafe00640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb014ffc0 0x7f2e940047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:11.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.723+0000 7f2eb4e00640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e94003970 0x7f2e94003d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000c160 tx=0x7f2e940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3831437376974b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:11.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.724+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0005ad0 con 0x7f2e94003970 2024-05-26T15:41:11.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.724+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea002d070 con 0x7f2e94003970 2024-05-26T15:41:11.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.724+0000 7f2eaf400640 1 -- 172.21.15.8:0/3037336064 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0005e70 con 0x7f2e94003970 2024-05-26T15:41:11.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.724+0000 7f2eb6200640 1 -- 172.21.15.8:0/3037336064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e94003970 msgr2=0x7f2e94003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.724+0000 7f2eb6200640 1 --2- 172.21.15.8:0/3037336064 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2e94003970 0x7f2e94003d90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000c160 tx=0x7f2e940057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.724+0000 7f2eb5800640 1 -- 172.21.15.8:0/3037336064 reap_dead start 2024-05-26T15:41:11.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.724+0000 7f2eb6200640 1 -- 172.21.15.8:0/3037336064 shutdown_connections 2024-05-26T15:41:11.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.724+0000 7f2eb6200640 1 -- 172.21.15.8:0/3037336064 >> 172.21.15.8:0/3037336064 conn(0x7f2eb0069e70 msgr2=0x7f2eb006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:11.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.724+0000 7f2eb6200640 1 -- 172.21.15.8:0/3037336064 shutdown_connections 2024-05-26T15:41:11.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.724+0000 7f2eb6200640 1 -- 172.21.15.8:0/3037336064 wait complete. 2024-05-26T15:41:11.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.726+0000 7f2eb6200640 1 Processor -- start 2024-05-26T15:41:11.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.726+0000 7f2eb6200640 1 -- start start 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.727+0000 7f2eb6200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e94003970 0x7f2eb014ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.727+0000 7f2eb6200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb00cbba0 0x7f2eb00cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.727+0000 7f2eb6200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb01e2870 0x7f2eb01e2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb6200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb01e3230 con 0x7f2eb01e2870 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb6200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00cc710 con 0x7f2e94003970 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb6200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb00cc9f0 con 0x7f2eb00cbba0 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb5800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb01e2870 0x7f2eb01e2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb5800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb01e2870 0x7f2eb01e2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58150/0 (socket says 172.21.15.8:58150) 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb5800640 1 -- 172.21.15.8:0/4121524130 learned_addr learned my addr 172.21.15.8:0/4121524130 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eafe00640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb00cbba0 0x7f2eb00cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb4e00640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e94003970 0x7f2eb014ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb5800640 1 -- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb00cbba0 msgr2=0x7f2eb00cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb5800640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb00cbba0 0x7f2eb00cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb5800640 1 -- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e94003970 msgr2=0x7f2eb014ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:11.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb5800640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e94003970 0x7f2eb014ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:11.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb5800640 1 -- 172.21.15.8:0/4121524130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00cccd0 con 0x7f2eb01e2870 2024-05-26T15:41:11.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eafe00640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb00cbba0 0x7f2eb00cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:11.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.728+0000 7f2eb4e00640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e94003970 0x7f2eb014ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:11.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.729+0000 7f2eb5800640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb01e2870 0x7f2eb01e2cf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0071570 tx=0x7f2ea80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:11.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.729+0000 7f2eacc00640 1 -- 172.21.15.8:0/4121524130 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800e070 con 0x7f2eb01e2870 2024-05-26T15:41:11.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.729+0000 7f2eacc00640 1 -- 172.21.15.8:0/4121524130 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea8011e10 con 0x7f2eb01e2870 2024-05-26T15:41:11.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.729+0000 7f2eb6200640 1 -- 172.21.15.8:0/4121524130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb00ccfb0 con 0x7f2eb01e2870 2024-05-26T15:41:11.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.729+0000 7f2eacc00640 1 -- 172.21.15.8:0/4121524130 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8003990 con 0x7f2eb01e2870 2024-05-26T15:41:11.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.729+0000 7f2eb6200640 1 -- 172.21.15.8:0/4121524130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb01509c0 con 0x7f2eb01e2870 2024-05-26T15:41:11.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.730+0000 7f2eb6200640 1 -- 172.21.15.8:0/4121524130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb00cd4d0 con 0x7f2eb01e2870 2024-05-26T15:41:11.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.731+0000 7f2eacc00640 1 -- 172.21.15.8:0/4121524130 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2ea8003af0 con 0x7f2eb01e2870 2024-05-26T15:41:11.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.732+0000 7f2eacc00640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2e9006ac30 0x7f2e9006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:11.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.732+0000 7f2eacc00640 1 -- 172.21.15.8:0/4121524130 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2ea80896a0 con 0x7f2eb01e2870 2024-05-26T15:41:11.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.733+0000 7f2eb4e00640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2e9006ac30 0x7f2e9006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:11.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.734+0000 7f2eb4e00640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2e9006ac30 0x7f2e9006d0f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0001050 tx=0x7f2ea0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:11.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.737+0000 7f2eacc00640 1 -- 172.21.15.8:0/4121524130 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2eb00cd4d0 con 0x7f2eb01e2870 2024-05-26T15:41:11.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:11.937+0000 7f2eb6200640 1 -- 172.21.15.8:0/4121524130 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2eb00cd4d0 con 0x7f2eb01e2870 2024-05-26T15:41:12.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.207+0000 7f2eacc00640 1 -- 172.21.15.8:0/4121524130 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2eb00cd4d0 con 0x7f2eb01e2870 2024-05-26T15:41:12.206 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2024-05-26T15:41:12.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.211+0000 7f2eb6200640 1 -- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2e9006ac30 msgr2=0x7f2e9006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:12.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.211+0000 7f2eb6200640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2e9006ac30 0x7f2e9006d0f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0001050 tx=0x7f2ea0009030 comp rx=0 tx=0).stop 2024-05-26T15:41:12.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.211+0000 7f2eb6200640 1 -- 172.21.15.8:0/4121524130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb01e2870 msgr2=0x7f2eb01e2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:12.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.211+0000 7f2eb6200640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb01e2870 0x7f2eb01e2cf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0071570 tx=0x7f2ea80115a0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.212+0000 7f2eb6200640 1 -- 172.21.15.8:0/4121524130 shutdown_connections 2024-05-26T15:41:12.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.212+0000 7f2eb6200640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2eb01e2870 0x7f2eb01e2cf0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.212+0000 7f2eb6200640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2eb00cbba0 0x7f2eb00cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.212+0000 7f2eb6200640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2e9006ac30 0x7f2e9006d0f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.212+0000 7f2eb6200640 1 --2- 172.21.15.8:0/4121524130 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e94003970 0x7f2eb014ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.212+0000 7f2eb6200640 1 -- 172.21.15.8:0/4121524130 >> 172.21.15.8:0/4121524130 conn(0x7f2eb0069e70 msgr2=0x7f2eb014efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:12.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.212+0000 7f2eb6200640 1 -- 172.21.15.8:0/4121524130 shutdown_connections 2024-05-26T15:41:12.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.212+0000 7f2eb6200640 1 -- 172.21.15.8:0/4121524130 wait complete. 2024-05-26T15:41:12.236 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-26T15:41:12.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.445+0000 7f5e57200640 1 Processor -- start 2024-05-26T15:41:12.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.446+0000 7f5e57200640 1 -- start start 2024-05-26T15:41:12.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.447+0000 7f5e57200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5e580d0020 0x7f5e580d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.447+0000 7f5e57200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5e580b82c0 0x7f5e580b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.447+0000 7f5e57200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e580d20d0 con 0x7f5e5815ca00 2024-05-26T15:41:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.447+0000 7f5e57200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e580d06b0 con 0x7f5e580b82c0 2024-05-26T15:41:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.447+0000 7f5e57200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e580d12b0 con 0x7f5e580d0020 2024-05-26T15:41:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.447+0000 7f5e55e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5e5815ca00 0x7f5e580cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53442/0 (socket says 172.21.15.8:53442) 2024-05-26T15:41:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.447+0000 7f5e55e00640 1 -- 172.21.15.8:0/3451240336 learned_addr learned my addr 172.21.15.8:0/3451240336 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:12.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.447+0000 7f5e56800640 1 --2- 172.21.15.8:0/3451240336 >> v2:172.21.15.8:3300/0 conn(0x7f5e580b82c0 0x7f5e580b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:12.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.448+0000 7f5e55400640 1 --2- 172.21.15.8:0/3451240336 >> v2:172.21.15.47:3300/0 conn(0x7f5e580d0020 0x7f5e580d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:12.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.448+0000 7f5e54a00640 1 -- 172.21.15.8:0/3451240336 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074583866 0 0) 0x7f5e580d20d0 con 0x7f5e5815ca00 2024-05-26T15:41:12.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.448+0000 7f5e54a00640 1 -- 172.21.15.8:0/3451240336 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e3c003520 con 0x7f5e5815ca00 2024-05-26T15:41:12.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.448+0000 7f5e56800640 1 -- 172.21.15.8:0/3451240336 >> v2:172.21.15.47:3300/0 conn(0x7f5e580d0020 msgr2=0x7f5e580d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:12.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.448+0000 7f5e56800640 1 --2- 172.21.15.8:0/3451240336 >> v2:172.21.15.47:3300/0 conn(0x7f5e580d0020 0x7f5e580d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.448+0000 7f5e56800640 1 -- 172.21.15.8:0/3451240336 >> v1:172.21.15.8:6789/0 conn(0x7f5e5815ca00 legacy=0x7f5e580cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:12.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.448+0000 7f5e56800640 1 -- 172.21.15.8:0/3451240336 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580d14c0 con 0x7f5e580b82c0 2024-05-26T15:41:12.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.449+0000 7f5e56800640 1 --2- 172.21.15.8:0/3451240336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 0x7f5e580b5ad0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5e580d0cc0 tx=0x7f5e5002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91298e6a3a184de server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:12.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.449+0000 7f5e54a00640 1 -- 172.21.15.8:0/3451240336 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50032440 con 0x7f5e580b82c0 2024-05-26T15:41:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.449+0000 7f5e54a00640 1 -- 172.21.15.8:0/3451240336 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e500325a0 con 0x7f5e580b82c0 2024-05-26T15:41:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.449+0000 7f5e54a00640 1 -- 172.21.15.8:0/3451240336 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50032930 con 0x7f5e580b82c0 2024-05-26T15:41:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.450+0000 7f5e57200640 1 -- 172.21.15.8:0/3451240336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 msgr2=0x7f5e580b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.450+0000 7f5e57200640 1 --2- 172.21.15.8:0/3451240336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 0x7f5e580b5ad0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5e580d0cc0 tx=0x7f5e5002a1a0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.450+0000 7f5e57200640 1 -- 172.21.15.8:0/3451240336 shutdown_connections 2024-05-26T15:41:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.450+0000 7f5e57200640 1 --2- 172.21.15.8:0/3451240336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 0x7f5e580b5ad0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.450+0000 7f5e57200640 1 --2- 172.21.15.8:0/3451240336 >> v2:172.21.15.47:3300/0 conn(0x7f5e580d0020 0x7f5e580d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.450+0000 7f5e57200640 1 -- 172.21.15.8:0/3451240336 >> 172.21.15.8:0/3451240336 conn(0x7f5e5806b640 msgr2=0x7f5e5806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.450+0000 7f5e57200640 1 -- 172.21.15.8:0/3451240336 shutdown_connections 2024-05-26T15:41:12.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.450+0000 7f5e57200640 1 -- 172.21.15.8:0/3451240336 wait complete. 2024-05-26T15:41:12.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.452+0000 7f5e57200640 1 Processor -- start 2024-05-26T15:41:12.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.452+0000 7f5e57200640 1 -- start start 2024-05-26T15:41:12.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.453+0000 7f5e57200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 0x7f5e580cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:12.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.453+0000 7f5e57200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5e580d0020 0x7f5e58151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:12.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.453+0000 7f5e57200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e5815ca00 0x7f5e580cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:12.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.453+0000 7f5e57200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e58154850 con 0x7f5e580b82c0 2024-05-26T15:41:12.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.453+0000 7f5e57200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580cbfb0 con 0x7f5e5815ca00 2024-05-26T15:41:12.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.453+0000 7f5e57200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580c9b30 con 0x7f5e580d0020 2024-05-26T15:41:12.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.453+0000 7f5e55e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 0x7f5e580cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:12.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.453+0000 7f5e55e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 0x7f5e580cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58164/0 (socket says 172.21.15.8:58164) 2024-05-26T15:41:12.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.453+0000 7f5e55e00640 1 -- 172.21.15.8:0/3220627430 learned_addr learned my addr 172.21.15.8:0/3220627430 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:12.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e55e00640 1 -- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5e580d0020 msgr2=0x7f5e58151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:12.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e55e00640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5e580d0020 0x7f5e58151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e56800640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e5815ca00 0x7f5e580cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:12.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e55e00640 1 -- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e5815ca00 msgr2=0x7f5e580cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:12.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e55e00640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e5815ca00 0x7f5e580cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:12.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e55e00640 1 -- 172.21.15.8:0/3220627430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e50009400 con 0x7f5e580b82c0 2024-05-26T15:41:12.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e55e00640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 0x7f5e580cc440 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800cbc0 tx=0x7f5e4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:12.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e4e000640 1 -- 172.21.15.8:0/3220627430 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800ad40 con 0x7f5e580b82c0 2024-05-26T15:41:12.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e4e000640 1 -- 172.21.15.8:0/3220627430 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e48012400 con 0x7f5e580b82c0 2024-05-26T15:41:12.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e4e000640 1 -- 172.21.15.8:0/3220627430 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800aea0 con 0x7f5e580b82c0 2024-05-26T15:41:12.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.454+0000 7f5e57200640 1 -- 172.21.15.8:0/3220627430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e580c9dd0 con 0x7f5e580b82c0 2024-05-26T15:41:12.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.455+0000 7f5e57200640 1 -- 172.21.15.8:0/3220627430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e580ca390 con 0x7f5e580b82c0 2024-05-26T15:41:12.454 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.456+0000 7f5e57200640 1 -- 172.21.15.8:0/3220627430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5804e210 con 0x7f5e580b82c0 2024-05-26T15:41:12.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.457+0000 7f5e4e000640 1 -- 172.21.15.8:0/3220627430 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e48007070 con 0x7f5e580b82c0 2024-05-26T15:41:12.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.458+0000 7f5e4e000640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e3406ac00 0x7f5e3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:12.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.458+0000 7f5e4e000640 1 -- 172.21.15.8:0/3220627430 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f5e48089260 con 0x7f5e580b82c0 2024-05-26T15:41:12.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.459+0000 7f5e55400640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e3406ac00 0x7f5e3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:12.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.460+0000 7f5e55400640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e3406ac00 0x7f5e3406d0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e580d2790 tx=0x7f5e40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:12.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.463+0000 7f5e4e000640 1 -- 172.21.15.8:0/3220627430 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5e48054580 con 0x7f5e580b82c0 2024-05-26T15:41:12.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:12.672+0000 7f5e57200640 1 -- 172.21.15.8:0/3220627430 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5e580cfab0 con 0x7f5e580b82c0 2024-05-26T15:41:13.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.215+0000 7f5e4e000640 1 -- 172.21.15.8:0/3220627430 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5e48057ba0 con 0x7f5e580b82c0 2024-05-26T15:41:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2024-05-26T15:41:13.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.228+0000 7f5e57200640 1 -- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e3406ac00 msgr2=0x7f5e3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.228+0000 7f5e57200640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e3406ac00 0x7f5e3406d0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e580d2790 tx=0x7f5e40008040 comp rx=0 tx=0).stop 2024-05-26T15:41:13.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.228+0000 7f5e57200640 1 -- 172.21.15.8:0/3220627430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 msgr2=0x7f5e580cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.228+0000 7f5e57200640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 0x7f5e580cc440 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800cbc0 tx=0x7f5e4800a430 comp rx=0 tx=0).stop 2024-05-26T15:41:13.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.229+0000 7f5e57200640 1 -- 172.21.15.8:0/3220627430 shutdown_connections 2024-05-26T15:41:13.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.229+0000 7f5e57200640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5e3406ac00 0x7f5e3406d0c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.229+0000 7f5e57200640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e5815ca00 0x7f5e580cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.229+0000 7f5e57200640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5e580d0020 0x7f5e58151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.229+0000 7f5e57200640 1 --2- 172.21.15.8:0/3220627430 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5e580b82c0 0x7f5e580cc440 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.229+0000 7f5e57200640 1 -- 172.21.15.8:0/3220627430 >> 172.21.15.8:0/3220627430 conn(0x7f5e5806b640 msgr2=0x7f5e581561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:13.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.229+0000 7f5e57200640 1 -- 172.21.15.8:0/3220627430 shutdown_connections 2024-05-26T15:41:13.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.230+0000 7f5e57200640 1 -- 172.21.15.8:0/3220627430 wait complete. 2024-05-26T15:41:13.262 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-26T15:41:13.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.445+0000 7f4002200640 1 Processor -- start 2024-05-26T15:41:13.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.445+0000 7f4002200640 1 -- start start 2024-05-26T15:41:13.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.447+0000 7f4002200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3ffc144140 0x7f3ffc0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.447+0000 7f4002200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc144520 con 0x7f3ffc0cd7c0 2024-05-26T15:41:13.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.447+0000 7f4002200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ffc0cdd80 con 0x7f3ffc070ba0 2024-05-26T15:41:13.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.447+0000 7f4002200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ffc0ce060 con 0x7f3ffc144140 2024-05-26T15:41:13.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.447+0000 7f3ffaa00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3ffc0cd7c0 0x7f3ffc070490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53446/0 (socket says 172.21.15.8:53446) 2024-05-26T15:41:13.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.447+0000 7f3ffaa00640 1 -- 172.21.15.8:0/334345823 learned_addr learned my addr 172.21.15.8:0/334345823 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:13.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffb400640 1 --2- 172.21.15.8:0/334345823 >> v2:172.21.15.47:3300/0 conn(0x7f3ffc144140 0x7f3ffc0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000322371 0 0) 0x7f3ffc144520 con 0x7f3ffc0cd7c0 2024-05-26T15:41:13.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe0003520 con 0x7f3ffc0cd7c0 2024-05-26T15:41:13.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640593570 0 0) 0x7f3fe0003520 con 0x7f3ffc0cd7c0 2024-05-26T15:41:13.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 >> v2:172.21.15.47:3300/0 conn(0x7f3ffc144140 msgr2=0x7f3ffc0cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:13.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffa000640 1 --2- 172.21.15.8:0/334345823 >> v2:172.21.15.47:3300/0 conn(0x7f3ffc144140 0x7f3ffc0cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 >> v1:172.21.15.47:6789/0 conn(0x7f3ffc070ba0 legacy=0x7f3ffc06cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0ce340 con 0x7f3ffc0cd7c0 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f3fe8001670 con 0x7f3ffc0cd7c0 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 >> v1:172.21.15.8:6789/0 conn(0x7f3ffc0cd7c0 legacy=0x7f3ffc070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.448+0000 7f3ffa000640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fe00039e0 0x7f3fe0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffa000640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00047c0 0x7f3fe0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffa000640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3fe00052a0 0x7f3fe000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc0ce060 con 0x7f3fe00047c0 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe000c1f0 con 0x7f3fe00039e0 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe000c3b0 con 0x7f3fe00052a0 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffaa00640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00047c0 0x7f3fe0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffbe00640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3fe00052a0 0x7f3fe000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffb400640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fe00039e0 0x7f3fe0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffaa00640 1 -- 172.21.15.8:0/334345823 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3fe00052a0 msgr2=0x7f3fe000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffaa00640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3fe00052a0 0x7f3fe000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffaa00640 1 -- 172.21.15.8:0/334345823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fe00039e0 msgr2=0x7f3fe0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:13.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffaa00640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fe00039e0 0x7f3fe0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffaa00640 1 -- 172.21.15.8:0/334345823 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0003520 con 0x7f3fe00047c0 2024-05-26T15:41:13.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffbe00640 1 -- 172.21.15.8:0/334345823 reap_dead start 2024-05-26T15:41:13.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.449+0000 7f3ffb400640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fe00039e0 0x7f3fe0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.451+0000 7f3ffaa00640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00047c0 0x7f3fe0004c40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800c210 tx=0x7f3fe00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db15c4a3780e846 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.451+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8005ad0 con 0x7f3fe00047c0 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.451+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe802d070 con 0x7f3fe00047c0 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.451+0000 7f3ffa000640 1 -- 172.21.15.8:0/334345823 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8007070 con 0x7f3fe00047c0 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.452+0000 7f4002200640 1 -- 172.21.15.8:0/334345823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00047c0 msgr2=0x7f3fe0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.452+0000 7f4002200640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00047c0 0x7f3fe0004c40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800c210 tx=0x7f3fe00057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.452+0000 7f4002200640 1 -- 172.21.15.8:0/334345823 shutdown_connections 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.452+0000 7f4002200640 1 --2- 172.21.15.8:0/334345823 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3fe00047c0 0x7f3fe0004c40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.452+0000 7f4002200640 1 -- 172.21.15.8:0/334345823 >> 172.21.15.8:0/334345823 conn(0x7f3ffc069e70 msgr2=0x7f3ffc06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.452+0000 7f4002200640 1 -- 172.21.15.8:0/334345823 shutdown_connections 2024-05-26T15:41:13.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.452+0000 7f4002200640 1 -- 172.21.15.8:0/334345823 wait complete. 2024-05-26T15:41:13.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.454+0000 7f4002200640 1 Processor -- start 2024-05-26T15:41:13.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.454+0000 7f4002200640 1 -- start start 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.455+0000 7f4002200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fe00047c0 0x7f3ffc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.455+0000 7f4002200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ffc13bbe0 0x7f3ffc15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.455+0000 7f4002200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc13afb0 0x7f3ffc13b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f4002200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc13b970 con 0x7f3ffc13afb0 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f4002200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc15a7e0 con 0x7f3fe00047c0 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f4002200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc15c9a0 con 0x7f3ffc13bbe0 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f3ffbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc13afb0 0x7f3ffc13b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f3ffbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc13afb0 0x7f3ffc13b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58182/0 (socket says 172.21.15.8:58182) 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f3ffbe00640 1 -- 172.21.15.8:0/1195876158 learned_addr learned my addr 172.21.15.8:0/1195876158 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f3ffaa00640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ffc13bbe0 0x7f3ffc15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f3ffb400640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fe00047c0 0x7f3ffc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f3ffbe00640 1 -- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ffc13bbe0 msgr2=0x7f3ffc15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f3ffbe00640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ffc13bbe0 0x7f3ffc15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f3ffbe00640 1 -- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fe00047c0 msgr2=0x7f3ffc15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f3ffbe00640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fe00047c0 0x7f3ffc15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.456+0000 7f3ffbe00640 1 -- 172.21.15.8:0/1195876158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc0cefa0 con 0x7f3ffc13afb0 2024-05-26T15:41:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.457+0000 7f3ffbe00640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc13afb0 0x7f3ffc13b430 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4007fd0 tx=0x7f3ff400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.457+0000 7f3ff3400640 1 -- 172.21.15.8:0/1195876158 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4003970 con 0x7f3ffc13afb0 2024-05-26T15:41:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.457+0000 7f3ff3400640 1 -- 172.21.15.8:0/1195876158 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff4003af0 con 0x7f3ffc13afb0 2024-05-26T15:41:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.457+0000 7f3ff3400640 1 -- 172.21.15.8:0/1195876158 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4003ea0 con 0x7f3ffc13afb0 2024-05-26T15:41:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.457+0000 7f4002200640 1 -- 172.21.15.8:0/1195876158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc15b900 con 0x7f3ffc13afb0 2024-05-26T15:41:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.457+0000 7f4002200640 1 -- 172.21.15.8:0/1195876158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc15bec0 con 0x7f3ffc13afb0 2024-05-26T15:41:13.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.458+0000 7f4002200640 1 -- 172.21.15.8:0/1195876158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc04e210 con 0x7f3ffc13afb0 2024-05-26T15:41:13.458 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.460+0000 7f3ff3400640 1 -- 172.21.15.8:0/1195876158 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3ff40050d0 con 0x7f3ffc13afb0 2024-05-26T15:41:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.461+0000 7f3ff3400640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3fdc06ac30 0x7f3fdc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.459 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.461+0000 7f3ff3400640 1 -- 172.21.15.8:0/1195876158 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f3ff4089c30 con 0x7f3ffc13afb0 2024-05-26T15:41:13.460 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.462+0000 7f3ffb400640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3fdc06ac30 0x7f3fdc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.463+0000 7f3ffb400640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3fdc06ac30 0x7f3fdc06d0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc068640 tx=0x7f3fec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:13.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.465+0000 7f3ff3400640 1 -- 172.21.15.8:0/1195876158 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3ff4054da0 con 0x7f3ffc13afb0 2024-05-26T15:41:13.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.701+0000 7f4002200640 1 -- 172.21.15.8:0/1195876158 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3ffc06e480 con 0x7f3ffc13afb0 2024-05-26T15:41:13.711 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.712+0000 7f3ff3400640 1 -- 172.21.15.8:0/1195876158 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3ff40583c0 con 0x7f3ffc13afb0 2024-05-26T15:41:13.713 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 5 and data pool 6 2024-05-26T15:41:13.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.717+0000 7f4002200640 1 -- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3fdc06ac30 msgr2=0x7f3fdc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.717+0000 7f4002200640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3fdc06ac30 0x7f3fdc06d0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc068640 tx=0x7f3fec008040 comp rx=0 tx=0).stop 2024-05-26T15:41:13.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.717+0000 7f4002200640 1 -- 172.21.15.8:0/1195876158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc13afb0 msgr2=0x7f3ffc13b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.717+0000 7f4002200640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc13afb0 0x7f3ffc13b430 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4007fd0 tx=0x7f3ff400ec10 comp rx=0 tx=0).stop 2024-05-26T15:41:13.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.718+0000 7f4002200640 1 -- 172.21.15.8:0/1195876158 shutdown_connections 2024-05-26T15:41:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.718+0000 7f4002200640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3ffc13afb0 0x7f3ffc13b430 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.718+0000 7f4002200640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3ffc13bbe0 0x7f3ffc15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.718+0000 7f4002200640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3fdc06ac30 0x7f3fdc06d0f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.718+0000 7f4002200640 1 --2- 172.21.15.8:0/1195876158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3fe00047c0 0x7f3ffc15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.718+0000 7f4002200640 1 -- 172.21.15.8:0/1195876158 >> 172.21.15.8:0/1195876158 conn(0x7f3ffc069e70 msgr2=0x7f3ffc1430c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.719+0000 7f4002200640 1 -- 172.21.15.8:0/1195876158 shutdown_connections 2024-05-26T15:41:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.719+0000 7f4002200640 1 -- 172.21.15.8:0/1195876158 wait complete. 2024-05-26T15:41:13.746 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:41:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.922+0000 7fb2c3000640 1 Processor -- start 2024-05-26T15:41:13.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.922+0000 7fb2c3000640 1 -- start start 2024-05-26T15:41:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.923+0000 7fb2c3000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc144530 0x7fb2bc0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.923+0000 7fb2c3000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc0b1db0 con 0x7fb2bc144150 2024-05-26T15:41:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.923+0000 7fb2c3000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc0cc8f0 con 0x7fb2bc070d70 2024-05-26T15:41:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.923+0000 7fb2c3000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0cbac0 con 0x7fb2bc144530 2024-05-26T15:41:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.923+0000 7fb2bbe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb2bc144150 0x7fb2bc070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53460/0 (socket says 172.21.15.8:53460) 2024-05-26T15:41:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.923+0000 7fb2bbe00640 1 -- 172.21.15.8:0/1072675540 learned_addr learned my addr 172.21.15.8:0/1072675540 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:13.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.924+0000 7fb2bb400640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc144530 0x7fb2bc0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.924+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683787485 0 0) 0x7fb2bc0b1db0 con 0x7fb2bc144150 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.924+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2a0003520 con 0x7fb2bc144150 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.924+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 657607952 0 0) 0x7fb2a0003520 con 0x7fb2bc144150 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.924+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc144530 msgr2=0x7fb2bc0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.924+0000 7fb2baa00640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc144530 0x7fb2bc0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.924+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 >> v1:172.21.15.47:6789/0 conn(0x7fb2bc070d70 legacy=0x7fb2bc0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.924+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc0ccb90 con 0x7fb2bc144150 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.924+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fb2ac001670 con 0x7fb2bc144150 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.924+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 >> v1:172.21.15.8:6789/0 conn(0x7fb2bc144150 legacy=0x7fb2bc070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2baa00640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 0x7fb2a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2baa00640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2a00047c0 0x7fb2a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2baa00640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc144530 0x7fb2a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc0cbac0 con 0x7fb2a00039a0 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a000bab0 con 0x7fb2a00047c0 2024-05-26T15:41:13.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a000bc70 con 0x7fb2bc144530 2024-05-26T15:41:13.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2bbe00640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 0x7fb2a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2bb400640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2a00047c0 0x7fb2a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2bbe00640 1 -- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc144530 msgr2=0x7fb2a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:13.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2c1000640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc144530 0x7fb2a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2bbe00640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc144530 0x7fb2a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2bbe00640 1 -- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2a00047c0 msgr2=0x7fb2a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:13.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2bbe00640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2a00047c0 0x7fb2a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2bbe00640 1 -- 172.21.15.8:0/1072675540 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0003520 con 0x7fb2a00039a0 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.925+0000 7fb2c1000640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc144530 0x7fb2a00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.927+0000 7fb2bbe00640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 0x7fb2a0003dc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c190 tx=0x7fb2a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326924d1e03cd1b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.927+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac005ad0 con 0x7fb2a00039a0 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.927+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac02d070 con 0x7fb2a00039a0 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.927+0000 7fb2baa00640 1 -- 172.21.15.8:0/1072675540 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac005e90 con 0x7fb2a00039a0 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.927+0000 7fb2c3000640 1 -- 172.21.15.8:0/1072675540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 msgr2=0x7fb2a0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.927+0000 7fb2c3000640 1 --2- 172.21.15.8:0/1072675540 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 0x7fb2a0003dc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c190 tx=0x7fb2a00057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.927+0000 7fb2c1000640 1 -- 172.21.15.8:0/1072675540 reap_dead start 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.928+0000 7fb2c3000640 1 -- 172.21.15.8:0/1072675540 shutdown_connections 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.928+0000 7fb2c3000640 1 -- 172.21.15.8:0/1072675540 >> 172.21.15.8:0/1072675540 conn(0x7fb2bc0b0570 msgr2=0x7fb2bc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.928+0000 7fb2c3000640 1 -- 172.21.15.8:0/1072675540 shutdown_connections 2024-05-26T15:41:13.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.928+0000 7fb2c3000640 1 -- 172.21.15.8:0/1072675540 wait complete. 2024-05-26T15:41:13.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.930+0000 7fb2c3000640 1 Processor -- start 2024-05-26T15:41:13.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.930+0000 7fb2c3000640 1 -- start start 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.931+0000 7fb2c3000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 0x7fb2bc155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.931+0000 7fb2c3000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2bc13ffb0 0x7fb2bc140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.931+0000 7fb2c3000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc1553a0 0x7fb2bc15d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.931+0000 7fb2c3000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc141610 con 0x7fb2a00039a0 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.931+0000 7fb2c3000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc1413e0 con 0x7fb2bc13ffb0 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.931+0000 7fb2c3000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc13f1f0 con 0x7fb2bc1553a0 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.931+0000 7fb2bbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 0x7fb2bc155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.931+0000 7fb2bbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 0x7fb2bc155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58190/0 (socket says 172.21.15.8:58190) 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.931+0000 7fb2bbe00640 1 -- 172.21.15.8:0/3127548008 learned_addr learned my addr 172.21.15.8:0/3127548008 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2c1000640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc1553a0 0x7fb2bc15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2bb400640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2bc13ffb0 0x7fb2bc140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2bbe00640 1 -- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc1553a0 msgr2=0x7fb2bc15d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2bbe00640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc1553a0 0x7fb2bc15d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2bbe00640 1 -- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2bc13ffb0 msgr2=0x7fb2bc140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2bbe00640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2bc13ffb0 0x7fb2bc140ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2bbe00640 1 -- 172.21.15.8:0/3127548008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc13f4d0 con 0x7fb2a00039a0 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2bb400640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2bc13ffb0 0x7fb2bc140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2bbe00640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 0x7fb2bc155c00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac02ad00 tx=0x7fb2bc0cca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2b3e00640 1 -- 172.21.15.8:0/3127548008 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac005bc0 con 0x7fb2a00039a0 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2b3e00640 1 -- 172.21.15.8:0/3127548008 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac005d20 con 0x7fb2a00039a0 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2b3e00640 1 -- 172.21.15.8:0/3127548008 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac007290 con 0x7fb2a00039a0 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.932+0000 7fb2c3000640 1 -- 172.21.15.8:0/3127548008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc13f7b0 con 0x7fb2a00039a0 2024-05-26T15:41:13.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.933+0000 7fb2c3000640 1 -- 172.21.15.8:0/3127548008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc155820 con 0x7fb2a00039a0 2024-05-26T15:41:13.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.934+0000 7fb2c3000640 1 -- 172.21.15.8:0/3127548008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc0681d0 con 0x7fb2a00039a0 2024-05-26T15:41:13.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.935+0000 7fb2b3e00640 1 -- 172.21.15.8:0/3127548008 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb2ac02f030 con 0x7fb2a00039a0 2024-05-26T15:41:13.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.936+0000 7fb2b3e00640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb29806ac30 0x7fb29806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:13.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.936+0000 7fb2b3e00640 1 -- 172.21.15.8:0/3127548008 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb2ac0a9460 con 0x7fb2a00039a0 2024-05-26T15:41:13.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.936+0000 7fb2bb400640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb29806ac30 0x7fb29806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:13.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.938+0000 7fb2bb400640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb29806ac30 0x7fb29806d0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0b1060 tx=0x7fb2a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:13.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:13.940+0000 7fb2b3e00640 1 -- 172.21.15.8:0/3127548008 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb2ac074590 con 0x7fb2a00039a0 2024-05-26T15:41:14.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.139+0000 7fb2c3000640 1 -- 172.21.15.8:0/3127548008 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2bc0681d0 con 0x7fb2a00039a0 2024-05-26T15:41:14.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.143+0000 7fb2b3e00640 1 -- 172.21.15.8:0/3127548008 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16223 (secure 0 0 0) 0x7fb2ac077bb0 con 0x7fb2a00039a0 2024-05-26T15:41:14.141 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:14.142 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:41:13.704238+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:41:11.994768+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-26T15:41:12.729228+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:41:14.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 -- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb29806ac30 msgr2=0x7fb29806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb29806ac30 0x7fb29806d0f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc0b1060 tx=0x7fb2a4008040 comp rx=0 tx=0).stop 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 -- 172.21.15.8:0/3127548008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 msgr2=0x7fb2bc155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 0x7fb2bc155c00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac02ad00 tx=0x7fb2bc0cca80 comp rx=0 tx=0).stop 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 -- 172.21.15.8:0/3127548008 shutdown_connections 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb2bc1553a0 0x7fb2bc15d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb29806ac30 0x7fb29806d0f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2bc13ffb0 0x7fb2bc140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 --2- 172.21.15.8:0/3127548008 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb2a00039a0 0x7fb2bc155c00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 -- 172.21.15.8:0/3127548008 >> 172.21.15.8:0/3127548008 conn(0x7fb2bc0b0570 msgr2=0x7fb2bc159180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 -- 172.21.15.8:0/3127548008 shutdown_connections 2024-05-26T15:41:14.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.146+0000 7fb2c3000640 1 -- 172.21.15.8:0/3127548008 wait complete. 2024-05-26T15:41:14.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:41:14.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.377+0000 7f421fe00640 1 Processor -- start 2024-05-26T15:41:14.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.377+0000 7f421fe00640 1 -- start start 2024-05-26T15:41:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.379+0000 7f421fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4220154f50 0x7f42200b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.379+0000 7f421fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f422015ae70 0x7f422015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.379+0000 7f421fe00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422015b640 con 0x7f422015f0c0 2024-05-26T15:41:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.379+0000 7f421fe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422015bee0 con 0x7f4220154f50 2024-05-26T15:41:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.379+0000 7f421fe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42200b0ba0 con 0x7f422015ae70 2024-05-26T15:41:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.379+0000 7f421f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f422015f0c0 0x7f42200c36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53468/0 (socket says 172.21.15.8:53468) 2024-05-26T15:41:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.379+0000 7f421f400640 1 -- 172.21.15.8:0/702443520 learned_addr learned my addr 172.21.15.8:0/702443520 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421ea00640 1 --2- 172.21.15.8:0/702443520 >> v2:172.21.15.47:3300/0 conn(0x7f4220154f50 0x7f42200b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717057031 0 0) 0x7f422015b640 con 0x7f422015f0c0 2024-05-26T15:41:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4204003520 con 0x7f422015f0c0 2024-05-26T15:41:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421e000640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f422015ae70 0x7f422015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4204442929 0 0) 0x7f4204003520 con 0x7f422015f0c0 2024-05-26T15:41:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f422015ae70 msgr2=0x7f422015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f422015ae70 0x7f422015eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 >> v2:172.21.15.47:3300/0 conn(0x7f4220154f50 msgr2=0x7f42200b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 --2- 172.21.15.8:0/702443520 >> v2:172.21.15.47:3300/0 conn(0x7f4220154f50 0x7f42200b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422015b920 con 0x7f422015f0c0 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f42180019f0 con 0x7f422015f0c0 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 >> v1:172.21.15.8:6789/0 conn(0x7f422015f0c0 legacy=0x7f42200c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f422015ae70 0x7f42040039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4204003f70 0x7f42040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4204004d00 0x7f4204005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422015bee0 con 0x7f4204004d00 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420400ba90 con 0x7f4204003f70 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.380+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420400bc50 con 0x7f422015ae70 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.381+0000 7f421f400640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4204004d00 0x7f4204005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.381+0000 7f421e000640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4204003f70 0x7f42040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.381+0000 7f421ea00640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f422015ae70 0x7f42040039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.381+0000 7f421f400640 1 -- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f422015ae70 msgr2=0x7f42040039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.381+0000 7f421f400640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f422015ae70 0x7f42040039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.381+0000 7f421f400640 1 -- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4204003f70 msgr2=0x7f42040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.381+0000 7f421f400640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4204003f70 0x7f42040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.381+0000 7f421f400640 1 -- 172.21.15.8:0/702443520 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204003520 con 0x7f4204004d00 2024-05-26T15:41:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.381+0000 7f421ea00640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f422015ae70 0x7f42040039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.382+0000 7f421f400640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4204004d00 0x7f4204005180 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f421800a760 tx=0x7f42040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821ef07371ff704 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.383+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421802b980 con 0x7f4204004d00 2024-05-26T15:41:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.383+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421802bae0 con 0x7f4204004d00 2024-05-26T15:41:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.383+0000 7f421d600640 1 -- 172.21.15.8:0/702443520 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218034470 con 0x7f4204004d00 2024-05-26T15:41:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.383+0000 7f421fe00640 1 -- 172.21.15.8:0/702443520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4204004d00 msgr2=0x7f4204005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.383+0000 7f421fe00640 1 --2- 172.21.15.8:0/702443520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4204004d00 0x7f4204005180 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f421800a760 tx=0x7f42040057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.383+0000 7f421f400640 1 -- 172.21.15.8:0/702443520 reap_dead start 2024-05-26T15:41:14.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.383+0000 7f421fe00640 1 -- 172.21.15.8:0/702443520 shutdown_connections 2024-05-26T15:41:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.383+0000 7f421fe00640 1 -- 172.21.15.8:0/702443520 >> 172.21.15.8:0/702443520 conn(0x7f4220070480 msgr2=0x7f4220070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.383+0000 7f421fe00640 1 -- 172.21.15.8:0/702443520 shutdown_connections 2024-05-26T15:41:14.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.383+0000 7f421fe00640 1 -- 172.21.15.8:0/702443520 wait complete. 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.385+0000 7f421fe00640 1 Processor -- start 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.385+0000 7f421fe00640 1 -- start start 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.386+0000 7f421fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4204004d00 0x7f4220149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.386+0000 7f421fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4220140110 0x7f42200b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.386+0000 7f421fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422014b450 0x7f42201598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.386+0000 7f421fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42200cb510 con 0x7f422014b450 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.386+0000 7f421fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42200b3fe0 con 0x7f4204004d00 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.386+0000 7f421fe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42200b42c0 con 0x7f4220140110 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.386+0000 7f421f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422014b450 0x7f42201598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.386+0000 7f421f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422014b450 0x7f42201598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58212/0 (socket says 172.21.15.8:58212) 2024-05-26T15:41:14.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.386+0000 7f421f400640 1 -- 172.21.15.8:0/1545718652 learned_addr learned my addr 172.21.15.8:0/1545718652 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.387+0000 7f421f400640 1 -- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4220140110 msgr2=0x7f42200b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.387+0000 7f421e000640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4220140110 0x7f42200b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.387+0000 7f421f400640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4220140110 0x7f42200b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.387+0000 7f421f400640 1 -- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4204004d00 msgr2=0x7f4220149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.387+0000 7f421ea00640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4204004d00 0x7f4220149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.387+0000 7f421f400640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4204004d00 0x7f4220149c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.387+0000 7f421f400640 1 -- 172.21.15.8:0/1545718652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42200b45a0 con 0x7f422014b450 2024-05-26T15:41:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.387+0000 7f421f400640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422014b450 0x7f42201598c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f421800a760 tx=0x7f4218001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.388+0000 7f4216a00640 1 -- 172.21.15.8:0/1545718652 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218038070 con 0x7f422014b450 2024-05-26T15:41:14.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.388+0000 7f4216a00640 1 -- 172.21.15.8:0/1545718652 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4218034470 con 0x7f422014b450 2024-05-26T15:41:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.388+0000 7f4216a00640 1 -- 172.21.15.8:0/1545718652 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218034820 con 0x7f422014b450 2024-05-26T15:41:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.388+0000 7f421fe00640 1 -- 172.21.15.8:0/1545718652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42200cb1a0 con 0x7f422014b450 2024-05-26T15:41:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.388+0000 7f421fe00640 1 -- 172.21.15.8:0/1545718652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422014b8d0 con 0x7f422014b450 2024-05-26T15:41:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.389+0000 7f421fe00640 1 -- 172.21.15.8:0/1545718652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422014bbb0 con 0x7f422014b450 2024-05-26T15:41:14.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.390+0000 7f4216a00640 1 -- 172.21.15.8:0/1545718652 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4218031070 con 0x7f422014b450 2024-05-26T15:41:14.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.391+0000 7f4216a00640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f420006ac00 0x7f420006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.391+0000 7f4216a00640 1 -- 172.21.15.8:0/1545718652 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f421803b040 con 0x7f422014b450 2024-05-26T15:41:14.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.392+0000 7f421ea00640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f420006ac00 0x7f420006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.393+0000 7f421ea00640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f420006ac00 0x7f420006d0c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4210009a40 tx=0x7f4210008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:14.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.395+0000 7f4216a00640 1 -- 172.21.15.8:0/1545718652 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f42180dc900 con 0x7f422014b450 2024-05-26T15:41:14.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.596+0000 7f421fe00640 1 -- 172.21.15.8:0/1545718652 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42200cb330 con 0x7f422014b450 2024-05-26T15:41:14.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.600+0000 7f4216a00640 1 -- 172.21.15.8:0/1545718652 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16223 (secure 0 0 0) 0x7f4218044090 con 0x7f422014b450 2024-05-26T15:41:14.598 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:14.599 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:41:13.704238+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:41:11.994768+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-26T15:41:12.729228+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:41:14.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.602+0000 7f421fe00640 1 -- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f420006ac00 msgr2=0x7f420006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.602+0000 7f421fe00640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f420006ac00 0x7f420006d0c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4210009a40 tx=0x7f4210008040 comp rx=0 tx=0).stop 2024-05-26T15:41:14.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.602+0000 7f421fe00640 1 -- 172.21.15.8:0/1545718652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422014b450 msgr2=0x7f42201598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.602+0000 7f421fe00640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422014b450 0x7f42201598c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f421800a760 tx=0x7f4218001cb0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.603+0000 7f421fe00640 1 -- 172.21.15.8:0/1545718652 shutdown_connections 2024-05-26T15:41:14.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.603+0000 7f421fe00640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f422014b450 0x7f42201598c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.603+0000 7f421fe00640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4220140110 0x7f42200b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.603+0000 7f421fe00640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f420006ac00 0x7f420006d0c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.603+0000 7f421fe00640 1 --2- 172.21.15.8:0/1545718652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4204004d00 0x7f4220149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.603+0000 7f421fe00640 1 -- 172.21.15.8:0/1545718652 >> 172.21.15.8:0/1545718652 conn(0x7f4220070480 msgr2=0x7f42201490e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:14.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.603+0000 7f421fe00640 1 -- 172.21.15.8:0/1545718652 shutdown_connections 2024-05-26T15:41:14.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.603+0000 7f421fe00640 1 -- 172.21.15.8:0/1545718652 wait complete. 2024-05-26T15:41:14.621 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-26T15:41:14.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.839+0000 7f3029000640 1 Processor -- start 2024-05-26T15:41:14.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.839+0000 7f3029000640 1 -- start start 2024-05-26T15:41:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.841+0000 7f3029000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3024070ba0 0x7f30240cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.841+0000 7f3029000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f30240cd7c0 0x7f302406cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.841+0000 7f3029000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3024144520 con 0x7f3024144140 2024-05-26T15:41:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.841+0000 7f3029000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30240cdd80 con 0x7f3024070ba0 2024-05-26T15:41:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.841+0000 7f3029000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30240ce060 con 0x7f30240cd7c0 2024-05-26T15:41:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.841+0000 7f3021e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3024144140 0x7f3024070490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53480/0 (socket says 172.21.15.8:53480) 2024-05-26T15:41:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.841+0000 7f3021e00640 1 -- 172.21.15.8:0/1447435285 learned_addr learned my addr 172.21.15.8:0/1447435285 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:14.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.842+0000 7f301be00640 1 --2- 172.21.15.8:0/1447435285 >> v2:172.21.15.8:3300/0 conn(0x7f3024070ba0 0x7f30240cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.842+0000 7f3022800640 1 --2- 172.21.15.8:0/1447435285 >> v2:172.21.15.47:3300/0 conn(0x7f30240cd7c0 0x7f302406cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.842+0000 7f3021400640 1 -- 172.21.15.8:0/1447435285 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767433625 0 0) 0x7f3024144520 con 0x7f3024144140 2024-05-26T15:41:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.842+0000 7f301be00640 1 -- 172.21.15.8:0/1447435285 >> v2:172.21.15.47:3300/0 conn(0x7f30240cd7c0 msgr2=0x7f302406cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.842+0000 7f301be00640 1 --2- 172.21.15.8:0/1447435285 >> v2:172.21.15.47:3300/0 conn(0x7f30240cd7c0 0x7f302406cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.842+0000 7f301be00640 1 -- 172.21.15.8:0/1447435285 >> v1:172.21.15.8:6789/0 conn(0x7f3024144140 legacy=0x7f3024070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.842+0000 7f301be00640 1 -- 172.21.15.8:0/1447435285 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240ce340 con 0x7f3024070ba0 2024-05-26T15:41:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.843+0000 7f301be00640 1 --2- 172.21.15.8:0/1447435285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3024070ba0 0x7f30240cbf50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f302406e980 tx=0x7f300c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db427d4a6758c86e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3021400640 1 -- 172.21.15.8:0/1447435285 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c032440 con 0x7f3024070ba0 2024-05-26T15:41:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3021400640 1 -- 172.21.15.8:0/1447435285 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c0325a0 con 0x7f3024070ba0 2024-05-26T15:41:14.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3021400640 1 -- 172.21.15.8:0/1447435285 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c032930 con 0x7f3024070ba0 2024-05-26T15:41:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3029000640 1 -- 172.21.15.8:0/1447435285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3024070ba0 msgr2=0x7f30240cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3029000640 1 --2- 172.21.15.8:0/1447435285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3024070ba0 0x7f30240cbf50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f302406e980 tx=0x7f300c02a1a0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3029000640 1 -- 172.21.15.8:0/1447435285 shutdown_connections 2024-05-26T15:41:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3029000640 1 --2- 172.21.15.8:0/1447435285 >> v2:172.21.15.47:3300/0 conn(0x7f30240cd7c0 0x7f302406cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3029000640 1 --2- 172.21.15.8:0/1447435285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3024070ba0 0x7f30240cbf50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3029000640 1 -- 172.21.15.8:0/1447435285 >> 172.21.15.8:0/1447435285 conn(0x7f3024069e70 msgr2=0x7f302406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3029000640 1 -- 172.21.15.8:0/1447435285 shutdown_connections 2024-05-26T15:41:14.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.844+0000 7f3029000640 1 -- 172.21.15.8:0/1447435285 wait complete. 2024-05-26T15:41:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.846+0000 7f3029000640 1 Processor -- start 2024-05-26T15:41:14.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.846+0000 7f3029000640 1 -- start start 2024-05-26T15:41:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.847+0000 7f3029000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30240cd7c0 0x7f30240ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.847+0000 7f3029000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3024144140 0x7f30240b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.847+0000 7f3029000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f302412f6a0 0x7f302412fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.847+0000 7f3029000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240b2020 con 0x7f302412f6a0 2024-05-26T15:41:14.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.847+0000 7f3029000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240b2230 con 0x7f30240cd7c0 2024-05-26T15:41:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.847+0000 7f3029000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3024130070 con 0x7f3024144140 2024-05-26T15:41:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.847+0000 7f3022800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f302412f6a0 0x7f302412fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f3022800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f302412f6a0 0x7f302412fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58228/0 (socket says 172.21.15.8:58228) 2024-05-26T15:41:14.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f3022800640 1 -- 172.21.15.8:0/3461891355 learned_addr learned my addr 172.21.15.8:0/3461891355 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f3021e00640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30240cd7c0 0x7f30240ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f301be00640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3024144140 0x7f30240b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f3022800640 1 -- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3024144140 msgr2=0x7f30240b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f3022800640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3024144140 0x7f30240b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f3022800640 1 -- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30240cd7c0 msgr2=0x7f30240ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f3022800640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30240cd7c0 0x7f30240ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f3022800640 1 -- 172.21.15.8:0/3461891355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c009400 con 0x7f302412f6a0 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f3021e00640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30240cd7c0 0x7f30240ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.848+0000 7f3022800640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f302412f6a0 0x7f302412fb30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f301c007e40 tx=0x7f301c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.849+0000 7f301a000640 1 -- 172.21.15.8:0/3461891355 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c014620 con 0x7f302412f6a0 2024-05-26T15:41:14.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.849+0000 7f301a000640 1 -- 172.21.15.8:0/3461891355 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c00ee90 con 0x7f302412f6a0 2024-05-26T15:41:14.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.849+0000 7f301a000640 1 -- 172.21.15.8:0/3461891355 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0149e0 con 0x7f302412f6a0 2024-05-26T15:41:14.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.849+0000 7f3029000640 1 -- 172.21.15.8:0/3461891355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30240cefa0 con 0x7f302412f6a0 2024-05-26T15:41:14.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.849+0000 7f3029000640 1 -- 172.21.15.8:0/3461891355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30240a7a50 con 0x7f302412f6a0 2024-05-26T15:41:14.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.850+0000 7f3029000640 1 -- 172.21.15.8:0/3461891355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302404e210 con 0x7f302412f6a0 2024-05-26T15:41:14.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.851+0000 7f301a000640 1 -- 172.21.15.8:0/3461891355 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f301c014b40 con 0x7f302412f6a0 2024-05-26T15:41:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.852+0000 7f301a000640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f300006ac00 0x7f300006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:14.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.852+0000 7f301a000640 1 -- 172.21.15.8:0/3461891355 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f301c089e70 con 0x7f302412f6a0 2024-05-26T15:41:14.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.853+0000 7f3021e00640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f300006ac00 0x7f300006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:14.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.854+0000 7f3021e00640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f300006ac00 0x7f300006d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3014000f60 tx=0x7f3014009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:14.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:14.857+0000 7f301a000640 1 -- 172.21.15.8:0/3461891355 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f301c054f10 con 0x7f302412f6a0 2024-05-26T15:41:15.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.095+0000 7f3029000640 1 -- 172.21.15.8:0/3461891355 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f302406e160 con 0x7f302412f6a0 2024-05-26T15:41:15.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.727+0000 7f301a000640 1 -- 172.21.15.8:0/3461891355 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f301c058530 con 0x7f302412f6a0 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 -- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f300006ac00 msgr2=0x7f300006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f300006ac00 0x7f300006d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3014000f60 tx=0x7f3014009040 comp rx=0 tx=0).stop 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 -- 172.21.15.8:0/3461891355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f302412f6a0 msgr2=0x7f302412fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f302412f6a0 0x7f302412fb30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f301c007e40 tx=0x7f301c00e4b0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 -- 172.21.15.8:0/3461891355 shutdown_connections 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f302412f6a0 0x7f302412fb30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3024144140 0x7f30240b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f300006ac00 0x7f300006d0c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 --2- 172.21.15.8:0/3461891355 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30240cd7c0 0x7f30240ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 -- 172.21.15.8:0/3461891355 >> 172.21.15.8:0/3461891355 conn(0x7f3024069e70 msgr2=0x7f30240cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 -- 172.21.15.8:0/3461891355 shutdown_connections 2024-05-26T15:41:15.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.730+0000 7f3029000640 1 -- 172.21.15.8:0/3461891355 wait complete. 2024-05-26T15:41:15.750 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-26T15:41:15.750 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-26T15:41:15.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.968+0000 7f3a25400640 1 Processor -- start 2024-05-26T15:41:15.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.968+0000 7f3a25400640 1 -- start start 2024-05-26T15:41:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.969+0000 7f3a25400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a2006d5e0 0x7f3a2016bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.969+0000 7f3a25400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2006cbd0 con 0x7f3a20164770 2024-05-26T15:41:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.969+0000 7f3a25400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a20161500 con 0x7f3a20165820 2024-05-26T15:41:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.969+0000 7f3a25400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200b2410 con 0x7f3a2006d5e0 2024-05-26T15:41:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.970+0000 7f3a1e800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3a20164770 0x7f3a2006c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53484/0 (socket says 172.21.15.8:53484) 2024-05-26T15:41:15.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.970+0000 7f3a1e800640 1 -- 172.21.15.8:0/3756011654 learned_addr learned my addr 172.21.15.8:0/3756011654 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.970+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821581328 0 0) 0x7f3a2006cbd0 con 0x7f3a20164770 2024-05-26T15:41:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.970+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a04003520 con 0x7f3a20164770 2024-05-26T15:41:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1f200640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a2006d5e0 0x7f3a2016bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321262371 0 0) 0x7f3a04003520 con 0x7f3a20164770 2024-05-26T15:41:15.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a2006d5e0 msgr2=0x7f3a2016bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a2006d5e0 0x7f3a2016bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 >> v1:172.21.15.47:6789/0 conn(0x7f3a20165820 legacy=0x7f3a2006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a200b26f0 con 0x7f3a20164770 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1f200640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a2006d5e0 0x7f3a2016bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f3a10001670 con 0x7f3a20164770 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 >> v1:172.21.15.8:6789/0 conn(0x7f3a20164770 legacy=0x7f3a2006c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a04003a10 0x7f3a04003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a2006d5e0 0x7f3a040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a04004e00 0x7f3a04005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200b2410 con 0x7f3a04003a10 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0400bcf0 con 0x7f3a04004e00 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0400beb0 con 0x7f3a2006d5e0 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.971+0000 7f3a1e800640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a04003a10 0x7f3a04003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:15.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.972+0000 7f3a1e800640 1 -- 172.21.15.8:0/3756011654 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a2006d5e0 msgr2=0x7f3a040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:15.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.972+0000 7f3a1e800640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a2006d5e0 0x7f3a040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.972+0000 7f3a1e800640 1 -- 172.21.15.8:0/3756011654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a04004e00 msgr2=0x7f3a04005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:15.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.972+0000 7f3a1e800640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a04004e00 0x7f3a04005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.972+0000 7f3a1e800640 1 -- 172.21.15.8:0/3756011654 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04003520 con 0x7f3a04003a10 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.973+0000 7f3a1e800640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a04003a10 0x7f3a04003e30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c0e0 tx=0x7f3a040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd73ea3eb46314cc server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.973+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10005ad0 con 0x7f3a04003a10 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.973+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1002d070 con 0x7f3a04003a10 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.973+0000 7f3a1de00640 1 -- 172.21.15.8:0/3756011654 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10007070 con 0x7f3a04003a10 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.974+0000 7f3a25400640 1 -- 172.21.15.8:0/3756011654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a04003a10 msgr2=0x7f3a04003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.974+0000 7f3a25400640 1 --2- 172.21.15.8:0/3756011654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a04003a10 0x7f3a04003e30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c0e0 tx=0x7f3a040057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.974+0000 7f3a1f200640 1 -- 172.21.15.8:0/3756011654 reap_dead start 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.974+0000 7f3a25400640 1 -- 172.21.15.8:0/3756011654 shutdown_connections 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.974+0000 7f3a25400640 1 -- 172.21.15.8:0/3756011654 >> 172.21.15.8:0/3756011654 conn(0x7f3a20069e70 msgr2=0x7f3a2006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.974+0000 7f3a25400640 1 -- 172.21.15.8:0/3756011654 shutdown_connections 2024-05-26T15:41:15.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.974+0000 7f3a25400640 1 -- 172.21.15.8:0/3756011654 wait complete. 2024-05-26T15:41:15.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.976+0000 7f3a25400640 1 Processor -- start 2024-05-26T15:41:15.974 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.976+0000 7f3a25400640 1 -- start start 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.977+0000 7f3a25400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a04003a10 0x7f3a2014d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.977+0000 7f3a25400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a200cd660 0x7f3a200cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.977+0000 7f3a25400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a201500c0 0x7f3a20150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.977+0000 7f3a25400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a200ce020 con 0x7f3a200cd660 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.977+0000 7f3a25400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20151020 con 0x7f3a04003a10 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.977+0000 7f3a25400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20150a80 con 0x7f3a201500c0 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.977+0000 7f3a17e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a200cd660 0x7f3a200cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.977+0000 7f3a17e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a200cd660 0x7f3a200cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58234/0 (socket says 172.21.15.8:58234) 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.977+0000 7f3a17e00640 1 -- 172.21.15.8:0/3698296914 learned_addr learned my addr 172.21.15.8:0/3698296914 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.977+0000 7f3a1e800640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a04003a10 0x7f3a2014d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a17e00640 1 -- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a201500c0 msgr2=0x7f3a20150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:15.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a17e00640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a201500c0 0x7f3a20150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a17e00640 1 -- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a04003a10 msgr2=0x7f3a2014d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:15.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a17e00640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a04003a10 0x7f3a2014d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:15.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a17e00640 1 -- 172.21.15.8:0/3698296914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a20150d40 con 0x7f3a200cd660 2024-05-26T15:41:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a17e00640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a200cd660 0x7f3a200cdae0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800c460 tx=0x7f3a0800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a16a00640 1 -- 172.21.15.8:0/3698296914 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a080052d0 con 0x7f3a200cd660 2024-05-26T15:41:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a16a00640 1 -- 172.21.15.8:0/3698296914 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08005450 con 0x7f3a200cd660 2024-05-26T15:41:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a16a00640 1 -- 172.21.15.8:0/3698296914 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08012870 con 0x7f3a200cd660 2024-05-26T15:41:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a25400640 1 -- 172.21.15.8:0/3698296914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2014e140 con 0x7f3a200cd660 2024-05-26T15:41:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.978+0000 7f3a25400640 1 -- 172.21.15.8:0/3698296914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2014e700 con 0x7f3a200cd660 2024-05-26T15:41:15.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.979+0000 7f3a25400640 1 -- 172.21.15.8:0/3698296914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2014e8c0 con 0x7f3a200cd660 2024-05-26T15:41:15.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.981+0000 7f3a16a00640 1 -- 172.21.15.8:0/3698296914 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3a080129d0 con 0x7f3a200cd660 2024-05-26T15:41:15.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.982+0000 7f3a16a00640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f39fc06ac00 0x7f39fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:15.980 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.982+0000 7f3a16a00640 1 -- 172.21.15.8:0/3698296914 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3a080890b0 con 0x7f3a200cd660 2024-05-26T15:41:15.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.982+0000 7f3a1e800640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f39fc06ac00 0x7f39fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:15.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.984+0000 7f3a1e800640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f39fc06ac00 0x7f39fc06d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3a10032000 tx=0x7f3a1002d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:15.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:15.986+0000 7f3a16a00640 1 -- 172.21.15.8:0/3698296914 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3a08054020 con 0x7f3a200cd660 2024-05-26T15:41:16.161 INFO:tasks.ceph.mds.b.smithi047.stderr:2024-05-26T15:41:16.162+0000 7f59d2c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-26T15:41:16.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.229+0000 7f3a25400640 1 -- 172.21.15.8:0/3698296914 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3a2004e210 con 0x7f3a200cd660 2024-05-26T15:41:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.729+0000 7f3a16a00640 1 -- 172.21.15.8:0/3698296914 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3a08057640 con 0x7f3a200cd660 2024-05-26T15:41:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.733+0000 7f3a25400640 1 -- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f39fc06ac00 msgr2=0x7f39fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.733+0000 7f3a25400640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f39fc06ac00 0x7f39fc06d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3a10032000 tx=0x7f3a1002d000 comp rx=0 tx=0).stop 2024-05-26T15:41:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.733+0000 7f3a25400640 1 -- 172.21.15.8:0/3698296914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a200cd660 msgr2=0x7f3a200cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.733+0000 7f3a25400640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a200cd660 0x7f3a200cdae0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800c460 tx=0x7f3a0800c920 comp rx=0 tx=0).stop 2024-05-26T15:41:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.733+0000 7f3a25400640 1 -- 172.21.15.8:0/3698296914 shutdown_connections 2024-05-26T15:41:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.733+0000 7f3a25400640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3a201500c0 0x7f3a20150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.733+0000 7f3a25400640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3a200cd660 0x7f3a200cdae0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.733+0000 7f3a25400640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f39fc06ac00 0x7f39fc06d0c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.733+0000 7f3a25400640 1 --2- 172.21.15.8:0/3698296914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3a04003a10 0x7f3a2014d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.734+0000 7f3a25400640 1 -- 172.21.15.8:0/3698296914 >> 172.21.15.8:0/3698296914 conn(0x7f3a20069e70 msgr2=0x7f3a20163790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.734+0000 7f3a25400640 1 -- 172.21.15.8:0/3698296914 shutdown_connections 2024-05-26T15:41:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.734+0000 7f3a25400640 1 -- 172.21.15.8:0/3698296914 wait complete. 2024-05-26T15:41:16.754 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-26T15:41:16.755 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:41:16.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.965+0000 7f431d000640 1 Processor -- start 2024-05-26T15:41:16.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.965+0000 7f431d000640 1 -- start start 2024-05-26T15:41:16.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.967+0000 7f431d000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4318157ff0 0x7f43180afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:16.966 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.967+0000 7f431d000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43180b0660 con 0x7f43180b0200 2024-05-26T15:41:16.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.967+0000 7f431d000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43180ccb70 con 0x7f43180cc750 2024-05-26T15:41:16.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.967+0000 7f431d000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43181621c0 con 0x7f4318157ff0 2024-05-26T15:41:16.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.967+0000 7f4316a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f43180b0200 0x7f43180cc040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53490/0 (socket says 172.21.15.8:53490) 2024-05-26T15:41:16.967 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.967+0000 7f4316a00640 1 -- 172.21.15.8:0/407560829 learned_addr learned my addr 172.21.15.8:0/407560829 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:16.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4317400640 1 --2- 172.21.15.8:0/407560829 >> v2:172.21.15.47:3300/0 conn(0x7f4318157ff0 0x7f43180afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:16.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401658339 0 0) 0x7f43180b0660 con 0x7f43180b0200 2024-05-26T15:41:16.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42fc003520 con 0x7f43180b0200 2024-05-26T15:41:16.968 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1056994010 0 0) 0x7f42fc003520 con 0x7f43180b0200 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 >> v2:172.21.15.47:3300/0 conn(0x7f4318157ff0 msgr2=0x7f43180afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4316000640 1 --2- 172.21.15.8:0/407560829 >> v2:172.21.15.47:3300/0 conn(0x7f4318157ff0 0x7f43180afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 >> v1:172.21.15.47:6789/0 conn(0x7f43180cc750 legacy=0x7f43181625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318161540 con 0x7f43180b0200 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f4304001670 con 0x7f43180b0200 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 >> v1:172.21.15.8:6789/0 conn(0x7f43180b0200 legacy=0x7f43180cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.968+0000 7f4316000640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42fc0039c0 0x7f42fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4316000640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42fc0047c0 0x7f42fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4316000640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42fc0051d0 0x7f42fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43181621c0 con 0x7f42fc0051d0 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc00c120 con 0x7f42fc0039c0 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc00c2e0 con 0x7f42fc0047c0 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4317e00640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42fc0051d0 0x7f42fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4316a00640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42fc0047c0 0x7f42fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:16.969 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4317400640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42fc0039c0 0x7f42fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:16.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4317e00640 1 -- 172.21.15.8:0/407560829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42fc0047c0 msgr2=0x7f42fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:16.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4317e00640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f42fc0047c0 0x7f42fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4317e00640 1 -- 172.21.15.8:0/407560829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42fc0039c0 msgr2=0x7f42fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:16.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.969+0000 7f4317e00640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42fc0039c0 0x7f42fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.970+0000 7f4317e00640 1 -- 172.21.15.8:0/407560829 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc003520 con 0x7f42fc0051d0 2024-05-26T15:41:16.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.970+0000 7f4317e00640 1 -- 172.21.15.8:0/407560829 reap_dead start 2024-05-26T15:41:16.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.971+0000 7f4317e00640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42fc0051d0 0x7f42fc00b980 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4310001cb0 tx=0x7f42fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e880c52f1b5640 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:16.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.971+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431002acd0 con 0x7f42fc0051d0 2024-05-26T15:41:16.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.971+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431002ae70 con 0x7f42fc0051d0 2024-05-26T15:41:16.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.971+0000 7f4316000640 1 -- 172.21.15.8:0/407560829 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310003b90 con 0x7f42fc0051d0 2024-05-26T15:41:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.971+0000 7f431d000640 1 -- 172.21.15.8:0/407560829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42fc0051d0 msgr2=0x7f42fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.971+0000 7f431d000640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42fc0051d0 0x7f42fc00b980 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4310001cb0 tx=0x7f42fc0057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.972+0000 7f431d000640 1 -- 172.21.15.8:0/407560829 shutdown_connections 2024-05-26T15:41:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.972+0000 7f431d000640 1 --2- 172.21.15.8:0/407560829 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f42fc0051d0 0x7f42fc00b980 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.972+0000 7f431d000640 1 -- 172.21.15.8:0/407560829 >> 172.21.15.8:0/407560829 conn(0x7f4318070480 msgr2=0x7f4318070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.972+0000 7f431d000640 1 -- 172.21.15.8:0/407560829 shutdown_connections 2024-05-26T15:41:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.972+0000 7f431d000640 1 -- 172.21.15.8:0/407560829 wait complete. 2024-05-26T15:41:16.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.974+0000 7f431d000640 1 Processor -- start 2024-05-26T15:41:16.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.974+0000 7f431d000640 1 -- start start 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f431d000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42fc0051d0 0x7f43180b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f431d000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43181f9c90 0x7f43181f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f431d000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f431815dcc0 0x7f431815e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f431d000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431814dc70 con 0x7f43181f9c90 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f431d000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431815e680 con 0x7f42fc0051d0 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f431d000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43181fa470 con 0x7f431815dcc0 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f4316a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43181f9c90 0x7f43181f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f4316a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43181f9c90 0x7f43181f5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58262/0 (socket says 172.21.15.8:58262) 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f4316a00640 1 -- 172.21.15.8:0/2001766862 learned_addr learned my addr 172.21.15.8:0/2001766862 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f4316a00640 1 -- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f431815dcc0 msgr2=0x7f431815e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f4316a00640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f431815dcc0 0x7f431815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f4316a00640 1 -- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42fc0051d0 msgr2=0x7f43180b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:16.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f4316a00640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42fc0051d0 0x7f43180b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:16.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.975+0000 7f4316a00640 1 -- 172.21.15.8:0/2001766862 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43181fa750 con 0x7f43181f9c90 2024-05-26T15:41:16.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.976+0000 7f4316a00640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43181f9c90 0x7f43181f5e90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f430400e800 tx=0x7f430400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:16.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.976+0000 7f430f400640 1 -- 172.21.15.8:0/2001766862 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400c6c0 con 0x7f43181f9c90 2024-05-26T15:41:16.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.976+0000 7f430f400640 1 -- 172.21.15.8:0/2001766862 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430400c820 con 0x7f43181f9c90 2024-05-26T15:41:16.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.976+0000 7f430f400640 1 -- 172.21.15.8:0/2001766862 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400cbb0 con 0x7f43181f9c90 2024-05-26T15:41:16.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.976+0000 7f431d000640 1 -- 172.21.15.8:0/2001766862 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43181faa30 con 0x7f43181f9c90 2024-05-26T15:41:16.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.976+0000 7f431d000640 1 -- 172.21.15.8:0/2001766862 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43181fa110 con 0x7f43181f9c90 2024-05-26T15:41:16.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.977+0000 7f431d000640 1 -- 172.21.15.8:0/2001766862 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43181fac20 con 0x7f43181f9c90 2024-05-26T15:41:16.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.978+0000 7f430f400640 1 -- 172.21.15.8:0/2001766862 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f430400cd10 con 0x7f43181f9c90 2024-05-26T15:41:16.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.980+0000 7f430f400640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42f806ac00 0x7f42f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:16.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.980+0000 7f430f400640 1 -- 172.21.15.8:0/2001766862 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4304089340 con 0x7f43181f9c90 2024-05-26T15:41:16.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.980+0000 7f4317400640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42f806ac00 0x7f42f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:16.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.982+0000 7f4317400640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42f806ac00 0x7f42f806d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4308006fd0 tx=0x7f430800d280 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:16.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:16.985+0000 7f430f400640 1 -- 172.21.15.8:0/2001766862 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f43181fac20 con 0x7f43181f9c90 2024-05-26T15:41:17.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.229+0000 7f431d000640 1 -- 172.21.15.8:0/2001766862 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43181fac20 con 0x7f43181f9c90 2024-05-26T15:41:17.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.230+0000 7f430f400640 1 -- 172.21.15.8:0/2001766862 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4728 (secure 0 0 0) 0x7f43181fac20 con 0x7f43181f9c90 2024-05-26T15:41:17.230 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:17.230 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4993,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/2455185189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":2455185189},{"type":"v1","addr":"172.21.15.47:6836","nonce":2455185189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/3271632770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3271632770},{"type":"v1","addr":"172.21.15.8:6833","nonce":3271632770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3972699618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3972699618},{"type":"v1","addr":"172.21.15.8:6835","nonce":3972699618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:41:13.704888+0000","modified":"2024-05-26T15:41:16.723528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5313},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5313":{"gid":5313,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.47:6837/2181130163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2181130163},{"type":"v1","addr":"172.21.15.47:6837","nonce":2181130163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-26T15:41:17.230 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 16 2024-05-26T15:41:17.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.233+0000 7f431d000640 1 -- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42f806ac00 msgr2=0x7f42f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.233+0000 7f431d000640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42f806ac00 0x7f42f806d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4308006fd0 tx=0x7f430800d280 comp rx=0 tx=0).stop 2024-05-26T15:41:17.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.233+0000 7f431d000640 1 -- 172.21.15.8:0/2001766862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43181f9c90 msgr2=0x7f43181f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.233+0000 7f431d000640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43181f9c90 0x7f43181f5e90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f430400e800 tx=0x7f430400ecc0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.233+0000 7f431d000640 1 -- 172.21.15.8:0/2001766862 shutdown_connections 2024-05-26T15:41:17.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.233+0000 7f431d000640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f431815dcc0 0x7f431815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.233+0000 7f431d000640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f43181f9c90 0x7f43181f5e90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.233+0000 7f431d000640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f42f806ac00 0x7f42f806d0c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.233+0000 7f431d000640 1 --2- 172.21.15.8:0/2001766862 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42fc0051d0 0x7f43180b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.233+0000 7f431d000640 1 -- 172.21.15.8:0/2001766862 >> 172.21.15.8:0/2001766862 conn(0x7f4318070480 msgr2=0x7f431806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:17.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.234+0000 7f431d000640 1 -- 172.21.15.8:0/2001766862 shutdown_connections 2024-05-26T15:41:17.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.234+0000 7f431d000640 1 -- 172.21.15.8:0/2001766862 wait complete. 2024-05-26T15:41:17.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:41:17.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.463+0000 7f1a40a00640 1 Processor -- start 2024-05-26T15:41:17.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.464+0000 7f1a40a00640 1 -- start start 2024-05-26T15:41:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.465+0000 7f1a40a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1a3c144150 0x7f1a3c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.465+0000 7f1a40a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1a3c070d70 0x7f1a3c0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.465+0000 7f1a40a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3c0b1db0 con 0x7f1a3c144530 2024-05-26T15:41:17.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.465+0000 7f1a40a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3c0cc8f0 con 0x7f1a3c070d70 2024-05-26T15:41:17.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.465+0000 7f1a40a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3c0cbac0 con 0x7f1a3c144150 2024-05-26T15:41:17.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.465+0000 7f1a3a800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1a3c070d70 0x7f1a3c0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.465+0000 7f1a31400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1a3c144530 0x7f1a3c070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53492/0 (socket says 172.21.15.8:53492) 2024-05-26T15:41:17.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.465+0000 7f1a31400640 1 -- 172.21.15.8:0/1880918516 learned_addr learned my addr 172.21.15.8:0/1880918516 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:17.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.466+0000 7f1a39e00640 1 --2- 172.21.15.8:0/1880918516 >> v2:172.21.15.47:3300/0 conn(0x7f1a3c144150 0x7f1a3c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.466+0000 7f1a3a800640 1 -- 172.21.15.8:0/1880918516 >> v2:172.21.15.47:3300/0 conn(0x7f1a3c144150 msgr2=0x7f1a3c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:17.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.466+0000 7f1a3a800640 1 --2- 172.21.15.8:0/1880918516 >> v2:172.21.15.47:3300/0 conn(0x7f1a3c144150 0x7f1a3c0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.466+0000 7f1a3a800640 1 -- 172.21.15.8:0/1880918516 >> v1:172.21.15.8:6789/0 conn(0x7f1a3c144530 legacy=0x7f1a3c070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.466+0000 7f1a3a800640 1 -- 172.21.15.8:0/1880918516 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c0ccb90 con 0x7f1a3c070d70 2024-05-26T15:41:17.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.466+0000 7f1a39400640 1 -- 172.21.15.8:0/1880918516 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941545511 0 0) 0x7f1a3c0b1db0 con 0x7f1a3c144530 2024-05-26T15:41:17.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.467+0000 7f1a3a800640 1 --2- 172.21.15.8:0/1880918516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c070d70 0x7f1a3c0cad90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c06ea10 tx=0x7f1a3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb9a65721c99f6f server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:17.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.467+0000 7f1a39400640 1 -- 172.21.15.8:0/1880918516 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34032440 con 0x7f1a3c070d70 2024-05-26T15:41:17.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.467+0000 7f1a39400640 1 -- 172.21.15.8:0/1880918516 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a340325a0 con 0x7f1a3c070d70 2024-05-26T15:41:17.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.467+0000 7f1a39400640 1 -- 172.21.15.8:0/1880918516 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34032930 con 0x7f1a3c070d70 2024-05-26T15:41:17.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.468+0000 7f1a40a00640 1 -- 172.21.15.8:0/1880918516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c070d70 msgr2=0x7f1a3c0cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.468+0000 7f1a40a00640 1 --2- 172.21.15.8:0/1880918516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c070d70 0x7f1a3c0cad90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c06ea10 tx=0x7f1a3402a1a0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.468+0000 7f1a40a00640 1 -- 172.21.15.8:0/1880918516 shutdown_connections 2024-05-26T15:41:17.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.468+0000 7f1a40a00640 1 --2- 172.21.15.8:0/1880918516 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c070d70 0x7f1a3c0cad90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.468+0000 7f1a40a00640 1 --2- 172.21.15.8:0/1880918516 >> v2:172.21.15.47:3300/0 conn(0x7f1a3c144150 0x7f1a3c0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.468+0000 7f1a40a00640 1 -- 172.21.15.8:0/1880918516 >> 172.21.15.8:0/1880918516 conn(0x7f1a3c0b0570 msgr2=0x7f1a3c0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:17.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.468+0000 7f1a40a00640 1 -- 172.21.15.8:0/1880918516 shutdown_connections 2024-05-26T15:41:17.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.468+0000 7f1a40a00640 1 -- 172.21.15.8:0/1880918516 wait complete. 2024-05-26T15:41:17.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.470+0000 7f1a40a00640 1 Processor -- start 2024-05-26T15:41:17.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.470+0000 7f1a40a00640 1 -- start start 2024-05-26T15:41:17.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.471+0000 7f1a40a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1a3c070d70 0x7f1a3c13ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.471+0000 7f1a40a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a3c144150 0x7f1a3c1432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.471+0000 7f1a40a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c144530 0x7f1a3c159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.471+0000 7f1a40a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c13b5d0 con 0x7f1a3c144530 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.471+0000 7f1a40a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c06c950 con 0x7f1a3c144150 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.471+0000 7f1a40a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c06cc30 con 0x7f1a3c070d70 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a3a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c144530 0x7f1a3c159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a3a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c144530 0x7f1a3c159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58286/0 (socket says 172.21.15.8:58286) 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a3a800640 1 -- 172.21.15.8:0/4232054468 learned_addr learned my addr 172.21.15.8:0/4232054468 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a39e00640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1a3c070d70 0x7f1a3c13ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a31400640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a3c144150 0x7f1a3c1432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a3a800640 1 -- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1a3c070d70 msgr2=0x7f1a3c13ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a3a800640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1a3c070d70 0x7f1a3c13ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a3a800640 1 -- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a3c144150 msgr2=0x7f1a3c1432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a3a800640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a3c144150 0x7f1a3c1432d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a3a800640 1 -- 172.21.15.8:0/4232054468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34009400 con 0x7f1a3c144530 2024-05-26T15:41:17.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.472+0000 7f1a3a800640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c144530 0x7f1a3c159290 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1a34035040 tx=0x7f1a340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:17.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.473+0000 7f1a32a00640 1 -- 172.21.15.8:0/4232054468 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34030a80 con 0x7f1a3c144530 2024-05-26T15:41:17.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.473+0000 7f1a32a00640 1 -- 172.21.15.8:0/4232054468 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a34030be0 con 0x7f1a3c144530 2024-05-26T15:41:17.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.473+0000 7f1a40a00640 1 -- 172.21.15.8:0/4232054468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3c06cf10 con 0x7f1a3c144530 2024-05-26T15:41:17.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.473+0000 7f1a32a00640 1 -- 172.21.15.8:0/4232054468 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34006e10 con 0x7f1a3c144530 2024-05-26T15:41:17.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.473+0000 7f1a40a00640 1 -- 172.21.15.8:0/4232054468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c13b2e0 con 0x7f1a3c144530 2024-05-26T15:41:17.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.474+0000 7f1a40a00640 1 -- 172.21.15.8:0/4232054468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3c06d430 con 0x7f1a3c144530 2024-05-26T15:41:17.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.475+0000 7f1a32a00640 1 -- 172.21.15.8:0/4232054468 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a34039040 con 0x7f1a3c144530 2024-05-26T15:41:17.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.476+0000 7f1a32a00640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a1806ac00 0x7f1a1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.476+0000 7f1a32a00640 1 -- 172.21.15.8:0/4232054468 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1a340a9fe0 con 0x7f1a3c144530 2024-05-26T15:41:17.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.477+0000 7f1a39e00640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a1806ac00 0x7f1a1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.478+0000 7f1a39e00640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a1806ac00 0x7f1a1806d0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009a60 tx=0x7f1a2c003990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:17.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.480+0000 7f1a32a00640 1 -- 172.21.15.8:0/4232054468 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1a3c06d430 con 0x7f1a3c144530 2024-05-26T15:41:17.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.681+0000 7f1a40a00640 1 -- 172.21.15.8:0/4232054468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a3c06d430 con 0x7f1a3c144530 2024-05-26T15:41:17.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.685+0000 7f1a32a00640 1 -- 172.21.15.8:0/4232054468 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16210 (secure 0 0 0) 0x7f1a3c06d430 con 0x7f1a3c144530 2024-05-26T15:41:17.685 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:17.685 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":39,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:41:14.710487+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:41:11.994768+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-26T15:41:12.729228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:41:17.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.687+0000 7f1a40a00640 1 -- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a1806ac00 msgr2=0x7f1a1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.687+0000 7f1a40a00640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a1806ac00 0x7f1a1806d0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009a60 tx=0x7f1a2c003990 comp rx=0 tx=0).stop 2024-05-26T15:41:17.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.688+0000 7f1a40a00640 1 -- 172.21.15.8:0/4232054468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c144530 msgr2=0x7f1a3c159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.688+0000 7f1a40a00640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c144530 0x7f1a3c159290 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1a34035040 tx=0x7f1a340046c0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.688+0000 7f1a40a00640 1 -- 172.21.15.8:0/4232054468 shutdown_connections 2024-05-26T15:41:17.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.688+0000 7f1a40a00640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c144530 0x7f1a3c159290 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.688+0000 7f1a40a00640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1a1806ac00 0x7f1a1806d0c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.688+0000 7f1a40a00640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1a3c144150 0x7f1a3c1432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.688+0000 7f1a40a00640 1 --2- 172.21.15.8:0/4232054468 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1a3c070d70 0x7f1a3c13ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.688+0000 7f1a40a00640 1 -- 172.21.15.8:0/4232054468 >> 172.21.15.8:0/4232054468 conn(0x7f1a3c0b0570 msgr2=0x7f1a3c15e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:17.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.688+0000 7f1a40a00640 1 -- 172.21.15.8:0/4232054468 shutdown_connections 2024-05-26T15:41:17.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.688+0000 7f1a40a00640 1 -- 172.21.15.8:0/4232054468 wait complete. 2024-05-26T15:41:17.708 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-26T15:41:17.708 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:41:17.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.920+0000 7f75b8200640 1 Processor -- start 2024-05-26T15:41:17.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.921+0000 7f75b8200640 1 -- start start 2024-05-26T15:41:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.922+0000 7f75b8200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f75b00cdb20 0x7f75b00cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.922+0000 7f75b8200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f75b00cb210 0x7f75b00cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.922+0000 7f75b8200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f75b0161800 0x7f75b0161c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.922+0000 7f75b8200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b00cd340 con 0x7f75b00cb210 2024-05-26T15:41:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.922+0000 7f75b8200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b01656e0 con 0x7f75b0161800 2024-05-26T15:41:17.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.922+0000 7f75b8200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00cbb90 con 0x7f75b00cdb20 2024-05-26T15:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.923+0000 7f75b4e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f75b00cb210 0x7f75b00cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.923+0000 7f75b4e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f75b00cb210 0x7f75b00cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58298/0 (socket says 172.21.15.8:58298) 2024-05-26T15:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.923+0000 7f75b4e00640 1 -- 172.21.15.8:0/1289949796 learned_addr learned my addr 172.21.15.8:0/1289949796 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.923+0000 7f75b5800640 1 --2- 172.21.15.8:0/1289949796 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f75b00cdb20 0x7f75b00cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.923+0000 7f75b6200640 1 --2- 172.21.15.8:0/1289949796 >> v2:172.21.15.47:3300/0 conn(0x7f75b0161800 0x7f75b0161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.923+0000 7f75b4e00640 1 -- 172.21.15.8:0/1289949796 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f75b00cdb20 msgr2=0x7f75b00cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.923+0000 7f75b4e00640 1 --2- 172.21.15.8:0/1289949796 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f75b00cdb20 0x7f75b00cdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.923+0000 7f75b4e00640 1 -- 172.21.15.8:0/1289949796 >> v2:172.21.15.47:3300/0 conn(0x7f75b0161800 msgr2=0x7f75b0161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.923+0000 7f75b4e00640 1 --2- 172.21.15.8:0/1289949796 >> v2:172.21.15.47:3300/0 conn(0x7f75b0161800 0x7f75b0161c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.924+0000 7f75b4e00640 1 -- 172.21.15.8:0/1289949796 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0165b70 con 0x7f75b00cb210 2024-05-26T15:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.925+0000 7f75b4e00640 1 --2- 172.21.15.8:0/1289949796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00cb210 0x7f75b00cb650 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f75b00ae480 tx=0x7f759c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e72241a75ae5c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:17.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.925+0000 7f75afe00640 1 -- 172.21.15.8:0/1289949796 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c032440 con 0x7f75b00cb210 2024-05-26T15:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.925+0000 7f75afe00640 1 -- 172.21.15.8:0/1289949796 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c0325a0 con 0x7f75b00cb210 2024-05-26T15:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.925+0000 7f75afe00640 1 -- 172.21.15.8:0/1289949796 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c032930 con 0x7f75b00cb210 2024-05-26T15:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.926+0000 7f75b8200640 1 -- 172.21.15.8:0/1289949796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00cb210 msgr2=0x7f75b00cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.926+0000 7f75b8200640 1 --2- 172.21.15.8:0/1289949796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00cb210 0x7f75b00cb650 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f75b00ae480 tx=0x7f759c02a1e0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.926+0000 7f75b8200640 1 -- 172.21.15.8:0/1289949796 shutdown_connections 2024-05-26T15:41:17.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.926+0000 7f75b8200640 1 --2- 172.21.15.8:0/1289949796 >> v2:172.21.15.47:3300/0 conn(0x7f75b0161800 0x7f75b0161c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.926+0000 7f75b8200640 1 --2- 172.21.15.8:0/1289949796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b00cb210 0x7f75b00cb650 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.926+0000 7f75b8200640 1 --2- 172.21.15.8:0/1289949796 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f75b00cdb20 0x7f75b00cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.926+0000 7f75b8200640 1 -- 172.21.15.8:0/1289949796 >> 172.21.15.8:0/1289949796 conn(0x7f75b00b0570 msgr2=0x7f75b00b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:17.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.926+0000 7f75b8200640 1 -- 172.21.15.8:0/1289949796 shutdown_connections 2024-05-26T15:41:17.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.926+0000 7f75b8200640 1 -- 172.21.15.8:0/1289949796 wait complete. 2024-05-26T15:41:17.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.928+0000 7f75b8200640 1 Processor -- start 2024-05-26T15:41:17.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.929+0000 7f75b8200640 1 -- start start 2024-05-26T15:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.930+0000 7f75b8200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f75b00cb210 0x7f75b01f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.930+0000 7f75b8200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b00cdb20 0x7f75b006d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.930+0000 7f75b8200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b0161800 0x7f75b00ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.930+0000 7f75b8200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0153450 con 0x7f75b0161800 2024-05-26T15:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.930+0000 7f75b8200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00a8760 con 0x7f75b00cdb20 2024-05-26T15:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.930+0000 7f75b8200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00a8a00 con 0x7f75b00cb210 2024-05-26T15:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b6200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b0161800 0x7f75b00ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b6200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b0161800 0x7f75b00ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58306/0 (socket says 172.21.15.8:58306) 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b6200640 1 -- 172.21.15.8:0/3625737210 learned_addr learned my addr 172.21.15.8:0/3625737210 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b5800640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f75b00cb210 0x7f75b01f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b4e00640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b00cdb20 0x7f75b006d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b6200640 1 -- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f75b00cb210 msgr2=0x7f75b01f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b6200640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f75b00cb210 0x7f75b01f64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b6200640 1 -- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b00cdb20 msgr2=0x7f75b006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b6200640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b00cdb20 0x7f75b006d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b6200640 1 -- 172.21.15.8:0/3625737210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c0094d0 con 0x7f75b0161800 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b4e00640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b00cdb20 0x7f75b006d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.931+0000 7f75b6200640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b0161800 0x7f75b00ae4e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f75a800cd70 tx=0x7f75a800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.932+0000 7f75ad600640 1 -- 172.21.15.8:0/3625737210 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8003b90 con 0x7f75b0161800 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.932+0000 7f75ad600640 1 -- 172.21.15.8:0/3625737210 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8003cf0 con 0x7f75b0161800 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.932+0000 7f75ad600640 1 -- 172.21.15.8:0/3625737210 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8004240 con 0x7f75b0161800 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.932+0000 7f75b8200640 1 -- 172.21.15.8:0/3625737210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b00a8ce0 con 0x7f75b0161800 2024-05-26T15:41:17.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.932+0000 7f75b8200640 1 -- 172.21.15.8:0/3625737210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b00a92a0 con 0x7f75b0161800 2024-05-26T15:41:17.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.933+0000 7f75b8200640 1 -- 172.21.15.8:0/3625737210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b0164d70 con 0x7f75b0161800 2024-05-26T15:41:17.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.934+0000 7f75ad600640 1 -- 172.21.15.8:0/3625737210 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75a80043a0 con 0x7f75b0161800 2024-05-26T15:41:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.935+0000 7f75ad600640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f759006ac00 0x7f759006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:17.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.935+0000 7f75ad600640 1 -- 172.21.15.8:0/3625737210 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f75a8012070 con 0x7f75b0161800 2024-05-26T15:41:17.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.936+0000 7f75b5800640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f759006ac00 0x7f759006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:17.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.937+0000 7f75b5800640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f759006ac00 0x7f759006d0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75a400a970 tx=0x7f75a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:17.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:17.939+0000 7f75ad600640 1 -- 172.21.15.8:0/3625737210 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f75a8054f00 con 0x7f75b0161800 2024-05-26T15:41:18.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.133+0000 7f75b8200640 1 -- 172.21.15.8:0/3625737210 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75b00a8b70 con 0x7f759006ac00 2024-05-26T15:41:18.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.158+0000 7f75ad600640 1 -- 172.21.15.8:0/3625737210 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272357 (secure 0 0 0) 0x7f75b00a8b70 con 0x7f759006ac00 2024-05-26T15:41:18.161 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:18.162 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.163+0000 7f75b8200640 1 -- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f759006ac00 msgr2=0x7f759006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.163+0000 7f75b8200640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f759006ac00 0x7f759006d0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f75a400a970 tx=0x7f75a4008040 comp rx=0 tx=0).stop 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.163+0000 7f75b8200640 1 -- 172.21.15.8:0/3625737210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b0161800 msgr2=0x7f75b00ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.163+0000 7f75b8200640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b0161800 0x7f75b00ae4e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f75a800cd70 tx=0x7f75a800a660 comp rx=0 tx=0).stop 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.164+0000 7f75b8200640 1 -- 172.21.15.8:0/3625737210 shutdown_connections 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.164+0000 7f75b8200640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75b0161800 0x7f75b00ae4e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.164+0000 7f75b8200640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f759006ac00 0x7f759006d0c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.164+0000 7f75b8200640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75b00cdb20 0x7f75b006d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.164+0000 7f75b8200640 1 --2- 172.21.15.8:0/3625737210 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f75b00cb210 0x7f75b01f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.164+0000 7f75b8200640 1 -- 172.21.15.8:0/3625737210 >> 172.21.15.8:0/3625737210 conn(0x7f75b00b0570 msgr2=0x7f75b00afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:18.164 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.164+0000 7f75b8200640 1 -- 172.21.15.8:0/3625737210 shutdown_connections 2024-05-26T15:41:18.165 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.164+0000 7f75b8200640 1 -- 172.21.15.8:0/3625737210 wait complete. 2024-05-26T15:41:18.182 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-05-26T15:41:16.198490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":253240,"kb_used_data":4284,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754721480,"statfs":{"total":773094113280,"available":772834795520,"internally_reserved":0,"allocated":4386816,"data_stored":2520319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.004977"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:13.203370+0000","last_change":"2024-05-26T15:41:13.203370+0000","last_active":"2024-05-26T15:41:13.203370+0000","last_peered":"2024-05-26T15:41:13.203370+0000","last_clean":"2024-05-26T15:41:13.203370+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:13.203370+0000","last_undegraded":"2024-05-26T15:41:13.203370+0000","last_fullsized":"2024-05-26T15:41:13.203370+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-26T15:41:12.187596+0000","last_change":"2024-05-26T15:41:12.187596+0000","last_active":"2024-05-26T15:41:12.187596+0000","last_peered":"2024-05-26T15:41:12.187596+0000","last_clean":"2024-05-26T15:41:12.187596+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:41:12.187596+0000","last_undegraded":"2024-05-26T15:41:12.187596+0000","last_fullsized":"2024-05-26T15:41:12.187596+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-26T15:41:05.445096+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:41:05.445096+0000","last_peered":"2024-05-26T15:41:05.445096+0000","last_clean":"2024-05-26T15:41:05.445096+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:41:05.445096+0000","last_undegraded":"2024-05-26T15:41:05.445096+0000","last_fullsized":"2024-05-26T15:41:05.445096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":758198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1930000000000001}]},{"osd":1,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.887},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.99299999999999999}]},{"osd":2,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.3100000000000001}]},{"osd":3,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.575}]},{"osd":4,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.5},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.0589999999999999}]},{"osd":5,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":1.05,"5min":1.05,"15min":1.05},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.952}]},{"osd":6,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":1.23,"5min":1.23,"15min":1.23},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.401},{"interface":"front","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.8109999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31512,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":401408,"data_stored":167830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.343},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":2.2669999999999999}]},{"osd":1,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.0940000000000001}]},{"osd":2,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":2.032}]},{"osd":3,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.716},{"interface":"front","average":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":1.5700000000000001}]},{"osd":4,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":1.847},{"interface":"front","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.607}]},{"osd":5,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.4590000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.962},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.6799999999999999}]},{"osd":7,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":2.145},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.9319999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31516,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":397312,"data_stored":166811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.81100000000000005}]},{"osd":1,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.75700000000000001}]},{"osd":2,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.997},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.4159999999999999}]},{"osd":3,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.51}]},{"osd":4,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.353},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.331}]},{"osd":6,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.575},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.1839999999999999}]},{"osd":7,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.635}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31512,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":401408,"data_stored":167830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.165}]},{"osd":1,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.331}]},{"osd":2,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.544}]},{"osd":3,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.52},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.373}]},{"osd":5,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.397},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.206}]},{"osd":6,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.667,"5min":1.667,"15min":1.667},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.6459999999999999}]},{"osd":7,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"min":{"1min":1.147,"5min":1.147,"15min":1.147},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.782,"5min":1.782,"15min":1.782},"min":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"max":{"1min":3.3010000000000002,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.4790000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31508,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":401408,"data_stored":167830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.149},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.0069999999999999}]},{"osd":1,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.91200000000000003}]},{"osd":2,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.389}]},{"osd":4,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.4830000000000001}]},{"osd":5,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.7559999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.6639999999999999}]},{"osd":6,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.524}]},{"osd":7,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.7010000000000001,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.1819999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31504,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":397312,"data_stored":166811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.6339999999999999}]},{"osd":1,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":2.0539999999999998},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":7.4770000000000003}]},{"osd":3,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":2.2330000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":2.1789999999999998}]},{"osd":4,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":10.438000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":3.4420000000000002,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.556}]},{"osd":5,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.472},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":10.798999999999999}]},{"osd":6,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":1.139,"5min":1.139,"15min":1.139},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":7.851},{"interface":"front","average":{"1min":1.607,"5min":1.607,"15min":1.607},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":10.672000000000001}]},{"osd":7,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.734,"15min":1.734},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":10.249000000000001},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":2.121}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31516,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":401408,"data_stored":167830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.78900000000000003}]},{"osd":2,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.74399999999999999}]},{"osd":3,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.89600000000000002}]},{"osd":4,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.98499999999999999}]},{"osd":5,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":3.0089999999999999,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.3240000000000001}]},{"osd":6,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.157},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":2.7999999999999998,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.0960000000000001}]},{"osd":7,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.75,"15min":1.75},"min":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.1160000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":991232,"data_stored":757179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.44700000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.77600000000000002}]},{"osd":2,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.024,"5min":4.024,"15min":4.024},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":3.0899999999999999,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":0.74399999999999999}]},{"osd":4,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.1180000000000001}]},{"osd":5,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":4.0490000000000004,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.3959999999999999}]},{"osd":6,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":3.6680000000000001,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":0.88600000000000001}]},{"osd":7,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.012},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.8399999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.2829999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:41:18.187 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:41:18.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.438+0000 7f7f68e00640 1 Processor -- start 2024-05-26T15:41:18.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.438+0000 7f7f68e00640 1 -- start start 2024-05-26T15:41:18.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.440+0000 7f7f68e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7f64144530 0x7f7f640b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.440+0000 7f7f68e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f64070d70 0x7f7f640cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.440+0000 7f7f68e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f640b1db0 con 0x7f7f64144150 2024-05-26T15:41:18.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.440+0000 7f7f68e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f640cc8f0 con 0x7f7f64144530 2024-05-26T15:41:18.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.440+0000 7f7f68e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f640cbac0 con 0x7f7f64070d70 2024-05-26T15:41:18.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.441+0000 7f7f5be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7f64144530 0x7f7f640b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.441+0000 7f7f62800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f64070d70 0x7f7f640cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.441+0000 7f7f5be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7f64144530 0x7f7f640b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:47308/0 (socket says 172.21.15.8:47308) 2024-05-26T15:41:18.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.441+0000 7f7f5be00640 1 -- 172.21.15.8:0/4216066072 learned_addr learned my addr 172.21.15.8:0/4216066072 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.442+0000 7f7f5be00640 1 -- 172.21.15.8:0/4216066072 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f64070d70 msgr2=0x7f7f640cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.442+0000 7f7f5be00640 1 --2- 172.21.15.8:0/4216066072 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f64070d70 0x7f7f640cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.442+0000 7f7f5be00640 1 -- 172.21.15.8:0/4216066072 >> v1:172.21.15.47:6789/0 conn(0x7f7f64144150 legacy=0x7f7f64070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.442+0000 7f7f5be00640 1 -- 172.21.15.8:0/4216066072 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f640ccb90 con 0x7f7f64144530 2024-05-26T15:41:18.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.443+0000 7f7f5be00640 1 --2- 172.21.15.8:0/4216066072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f64144530 0x7f7f640b1870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009870 tx=0x7f7f4c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=633b811622434064 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:18.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.443+0000 7f7f61400640 1 -- 172.21.15.8:0/4216066072 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c032440 con 0x7f7f64144530 2024-05-26T15:41:18.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.444+0000 7f7f61400640 1 -- 172.21.15.8:0/4216066072 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0325a0 con 0x7f7f64144530 2024-05-26T15:41:18.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.444+0000 7f7f61400640 1 -- 172.21.15.8:0/4216066072 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c032930 con 0x7f7f64144530 2024-05-26T15:41:18.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.444+0000 7f7f68e00640 1 -- 172.21.15.8:0/4216066072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f64144530 msgr2=0x7f7f640b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.444+0000 7f7f68e00640 1 --2- 172.21.15.8:0/4216066072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f64144530 0x7f7f640b1870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009870 tx=0x7f7f4c02a250 comp rx=0 tx=0).stop 2024-05-26T15:41:18.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.444+0000 7f7f68e00640 1 -- 172.21.15.8:0/4216066072 shutdown_connections 2024-05-26T15:41:18.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.444+0000 7f7f68e00640 1 --2- 172.21.15.8:0/4216066072 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f64070d70 0x7f7f640cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.444+0000 7f7f68e00640 1 --2- 172.21.15.8:0/4216066072 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f64144530 0x7f7f640b1870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.444+0000 7f7f68e00640 1 -- 172.21.15.8:0/4216066072 >> 172.21.15.8:0/4216066072 conn(0x7f7f640b0570 msgr2=0x7f7f640b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:18.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.445+0000 7f7f68e00640 1 -- 172.21.15.8:0/4216066072 shutdown_connections 2024-05-26T15:41:18.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.445+0000 7f7f68e00640 1 -- 172.21.15.8:0/4216066072 wait complete. 2024-05-26T15:41:18.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.447+0000 7f7f68e00640 1 Processor -- start 2024-05-26T15:41:18.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.447+0000 7f7f68e00640 1 -- start start 2024-05-26T15:41:18.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.448+0000 7f7f68e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f64070d70 0x7f7f64159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.449+0000 7f7f68e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f64144150 0x7f7f6415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.449+0000 7f7f68e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f64144530 0x7f7f6415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.449+0000 7f7f68e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6415cd60 con 0x7f7f64144530 2024-05-26T15:41:18.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.449+0000 7f7f68e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6415d040 con 0x7f7f64070d70 2024-05-26T15:41:18.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.449+0000 7f7f68e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6415d320 con 0x7f7f64144150 2024-05-26T15:41:18.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.449+0000 7f7f62800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f64144530 0x7f7f6415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.449+0000 7f7f62800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f64144530 0x7f7f6415c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58312/0 (socket says 172.21.15.8:58312) 2024-05-26T15:41:18.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.449+0000 7f7f62800640 1 -- 172.21.15.8:0/3665082148 learned_addr learned my addr 172.21.15.8:0/3665082148 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:18.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.449+0000 7f7f61e00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f64070d70 0x7f7f64159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.449+0000 7f7f5be00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f64144150 0x7f7f6415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f62800640 1 -- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f64144150 msgr2=0x7f7f6415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f62800640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f64144150 0x7f7f6415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f62800640 1 -- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f64070d70 msgr2=0x7f7f64159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f62800640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f64070d70 0x7f7f64159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f62800640 1 -- 172.21.15.8:0/3665082148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c0094d0 con 0x7f7f64144530 2024-05-26T15:41:18.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f61e00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f64070d70 0x7f7f64159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:41:18.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f62800640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f64144530 0x7f7f6415c6e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00efc0 tx=0x7f7f5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:18.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f5a000640 1 -- 172.21.15.8:0/3665082148 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c014480 con 0x7f7f64144530 2024-05-26T15:41:18.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f5a000640 1 -- 172.21.15.8:0/3665082148 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c00f040 con 0x7f7f64144530 2024-05-26T15:41:18.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f5a000640 1 -- 172.21.15.8:0/3665082148 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c014820 con 0x7f7f64144530 2024-05-26T15:41:18.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f68e00640 1 -- 172.21.15.8:0/3665082148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6415d600 con 0x7f7f64144530 2024-05-26T15:41:18.451 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.450+0000 7f7f68e00640 1 -- 172.21.15.8:0/3665082148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6415a090 con 0x7f7f64144530 2024-05-26T15:41:18.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.452+0000 7f7f68e00640 1 -- 172.21.15.8:0/3665082148 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f64140410 con 0x7f7f64144530 2024-05-26T15:41:18.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.453+0000 7f7f5a000640 1 -- 172.21.15.8:0/3665082148 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f5c014980 con 0x7f7f64144530 2024-05-26T15:41:18.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.454+0000 7f7f5a000640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f4006ac00 0x7f7f4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.454+0000 7f7f5a000640 1 -- 172.21.15.8:0/3665082148 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7f5c08a130 con 0x7f7f64144530 2024-05-26T15:41:18.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.454+0000 7f7f61e00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f4006ac00 0x7f7f4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.455+0000 7f7f61e00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f4006ac00 0x7f7f4006d0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7f640ad130 tx=0x7f7f54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:18.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.458+0000 7f7f5a000640 1 -- 172.21.15.8:0/3665082148 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7f5c055130 con 0x7f7f64144530 2024-05-26T15:41:18.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.657+0000 7f7f68e00640 1 -- 172.21.15.8:0/3665082148 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f6415d1b0 con 0x7f7f4006ac00 2024-05-26T15:41:18.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.681+0000 7f7f5a000640 1 -- 172.21.15.8:0/3665082148 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287042 (secure 0 0 0) 0x7f7f6415d1b0 con 0x7f7f4006ac00 2024-05-26T15:41:18.686 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:18.688 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:41:18.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 -- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f4006ac00 msgr2=0x7f7f4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f4006ac00 0x7f7f4006d0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7f640ad130 tx=0x7f7f54009040 comp rx=0 tx=0).stop 2024-05-26T15:41:18.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 -- 172.21.15.8:0/3665082148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f64144530 msgr2=0x7f7f6415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f64144530 0x7f7f6415c6e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00efc0 tx=0x7f7f5c00c490 comp rx=0 tx=0).stop 2024-05-26T15:41:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 -- 172.21.15.8:0/3665082148 shutdown_connections 2024-05-26T15:41:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f64144530 0x7f7f6415c6e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f64144150 0x7f7f6415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f4006ac00 0x7f7f4006d0c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 --2- 172.21.15.8:0/3665082148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f64070d70 0x7f7f64159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 -- 172.21.15.8:0/3665082148 >> 172.21.15.8:0/3665082148 conn(0x7f7f640b0570 msgr2=0x7f7f640b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.687+0000 7f7f68e00640 1 -- 172.21.15.8:0/3665082148 shutdown_connections 2024-05-26T15:41:18.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.688+0000 7f7f68e00640 1 -- 172.21.15.8:0/3665082148 wait complete. 2024-05-26T15:41:18.707 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2024-05-26T15:41:18.199137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253700,"kb_used_data":4732,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754721020,"statfs":{"total":773094113280,"available":772834324480,"internally_reserved":0,"allocated":4845568,"data_stored":2736619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.993160"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.724470+0000","last_change":"2024-05-26T15:41:13.737047+0000","last_active":"2024-05-26T15:41:14.724470+0000","last_peered":"2024-05-26T15:41:14.724470+0000","last_clean":"2024-05-26T15:41:14.724470+0000","last_became_active":"2024-05-26T15:41:13.736322+0000","last_became_peered":"2024-05-26T15:41:13.736322+0000","last_unstale":"2024-05-26T15:41:14.724470+0000","last_undegraded":"2024-05-26T15:41:14.724470+0000","last_fullsized":"2024-05-26T15:41:14.724470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:07:52.423302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.724265+0000","last_change":"2024-05-26T15:41:13.731148+0000","last_active":"2024-05-26T15:41:14.724265+0000","last_peered":"2024-05-26T15:41:14.724265+0000","last_clean":"2024-05-26T15:41:14.724265+0000","last_became_active":"2024-05-26T15:41:13.730780+0000","last_became_peered":"2024-05-26T15:41:13.730780+0000","last_unstale":"2024-05-26T15:41:14.724265+0000","last_undegraded":"2024-05-26T15:41:14.724265+0000","last_fullsized":"2024-05-26T15:41:14.724265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:35:18.763406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.160229+0000","last_change":"2024-05-26T15:41:13.762509+0000","last_active":"2024-05-26T15:41:15.160229+0000","last_peered":"2024-05-26T15:41:15.160229+0000","last_clean":"2024-05-26T15:41:15.160229+0000","last_became_active":"2024-05-26T15:41:13.762239+0000","last_became_peered":"2024-05-26T15:41:13.762239+0000","last_unstale":"2024-05-26T15:41:15.160229+0000","last_undegraded":"2024-05-26T15:41:15.160229+0000","last_fullsized":"2024-05-26T15:41:15.160229+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:36:51.117537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161629+0000","last_change":"2024-05-26T15:41:13.745066+0000","last_active":"2024-05-26T15:41:15.161629+0000","last_peered":"2024-05-26T15:41:15.161629+0000","last_clean":"2024-05-26T15:41:15.161629+0000","last_became_active":"2024-05-26T15:41:13.744632+0000","last_became_peered":"2024-05-26T15:41:13.744632+0000","last_unstale":"2024-05-26T15:41:15.161629+0000","last_undegraded":"2024-05-26T15:41:15.161629+0000","last_fullsized":"2024-05-26T15:41:15.161629+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:27:54.342188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161710+0000","last_change":"2024-05-26T15:41:13.734979+0000","last_active":"2024-05-26T15:41:15.161710+0000","last_peered":"2024-05-26T15:41:15.161710+0000","last_clean":"2024-05-26T15:41:15.161710+0000","last_became_active":"2024-05-26T15:41:13.734646+0000","last_became_peered":"2024-05-26T15:41:13.734646+0000","last_unstale":"2024-05-26T15:41:15.161710+0000","last_undegraded":"2024-05-26T15:41:15.161710+0000","last_fullsized":"2024-05-26T15:41:15.161710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:34:28.664687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162694+0000","last_change":"2024-05-26T15:41:13.738806+0000","last_active":"2024-05-26T15:41:15.162694+0000","last_peered":"2024-05-26T15:41:15.162694+0000","last_clean":"2024-05-26T15:41:15.162694+0000","last_became_active":"2024-05-26T15:41:13.738536+0000","last_became_peered":"2024-05-26T15:41:13.738536+0000","last_unstale":"2024-05-26T15:41:15.162694+0000","last_undegraded":"2024-05-26T15:41:15.162694+0000","last_fullsized":"2024-05-26T15:41:15.162694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:50:22.942390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162354+0000","last_change":"2024-05-26T15:41:13.759992+0000","last_active":"2024-05-26T15:41:15.162354+0000","last_peered":"2024-05-26T15:41:15.162354+0000","last_clean":"2024-05-26T15:41:15.162354+0000","last_became_active":"2024-05-26T15:41:13.755299+0000","last_became_peered":"2024-05-26T15:41:13.755299+0000","last_unstale":"2024-05-26T15:41:15.162354+0000","last_undegraded":"2024-05-26T15:41:15.162354+0000","last_fullsized":"2024-05-26T15:41:15.162354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:27:31.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.723502+0000","last_change":"2024-05-26T15:41:13.746971+0000","last_active":"2024-05-26T15:41:14.723502+0000","last_peered":"2024-05-26T15:41:14.723502+0000","last_clean":"2024-05-26T15:41:14.723502+0000","last_became_active":"2024-05-26T15:41:13.746701+0000","last_became_peered":"2024-05-26T15:41:13.746701+0000","last_unstale":"2024-05-26T15:41:14.723502+0000","last_undegraded":"2024-05-26T15:41:14.723502+0000","last_fullsized":"2024-05-26T15:41:14.723502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:33:28.786501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161390+0000","last_change":"2024-05-26T15:41:13.752342+0000","last_active":"2024-05-26T15:41:15.161390+0000","last_peered":"2024-05-26T15:41:15.161390+0000","last_clean":"2024-05-26T15:41:15.161390+0000","last_became_active":"2024-05-26T15:41:13.752082+0000","last_became_peered":"2024-05-26T15:41:13.752082+0000","last_unstale":"2024-05-26T15:41:15.161390+0000","last_undegraded":"2024-05-26T15:41:15.161390+0000","last_fullsized":"2024-05-26T15:41:15.161390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:27:31.336125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164392+0000","last_change":"2024-05-26T15:41:13.756063+0000","last_active":"2024-05-26T15:41:15.164392+0000","last_peered":"2024-05-26T15:41:15.164392+0000","last_clean":"2024-05-26T15:41:15.164392+0000","last_became_active":"2024-05-26T15:41:13.755727+0000","last_became_peered":"2024-05-26T15:41:13.755727+0000","last_unstale":"2024-05-26T15:41:15.164392+0000","last_undegraded":"2024-05-26T15:41:15.164392+0000","last_fullsized":"2024-05-26T15:41:15.164392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:54:16.009131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164280+0000","last_change":"2024-05-26T15:41:13.755693+0000","last_active":"2024-05-26T15:41:15.164280+0000","last_peered":"2024-05-26T15:41:15.164280+0000","last_clean":"2024-05-26T15:41:15.164280+0000","last_became_active":"2024-05-26T15:41:13.753022+0000","last_became_peered":"2024-05-26T15:41:13.753022+0000","last_unstale":"2024-05-26T15:41:15.164280+0000","last_undegraded":"2024-05-26T15:41:15.164280+0000","last_fullsized":"2024-05-26T15:41:15.164280+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:21:35.249090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.160208+0000","last_change":"2024-05-26T15:41:13.741226+0000","last_active":"2024-05-26T15:41:15.160208+0000","last_peered":"2024-05-26T15:41:15.160208+0000","last_clean":"2024-05-26T15:41:15.160208+0000","last_became_active":"2024-05-26T15:41:13.737327+0000","last_became_peered":"2024-05-26T15:41:13.737327+0000","last_unstale":"2024-05-26T15:41:15.160208+0000","last_undegraded":"2024-05-26T15:41:15.160208+0000","last_fullsized":"2024-05-26T15:41:15.160208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:41:24.415378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163483+0000","last_change":"2024-05-26T15:41:13.760755+0000","last_active":"2024-05-26T15:41:15.163483+0000","last_peered":"2024-05-26T15:41:15.163483+0000","last_clean":"2024-05-26T15:41:15.163483+0000","last_became_active":"2024-05-26T15:41:13.759904+0000","last_became_peered":"2024-05-26T15:41:13.759904+0000","last_unstale":"2024-05-26T15:41:15.163483+0000","last_undegraded":"2024-05-26T15:41:15.163483+0000","last_fullsized":"2024-05-26T15:41:15.163483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:19:36.438744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.726450+0000","last_change":"2024-05-26T15:41:13.749504+0000","last_active":"2024-05-26T15:41:14.726450+0000","last_peered":"2024-05-26T15:41:14.726450+0000","last_clean":"2024-05-26T15:41:14.726450+0000","last_became_active":"2024-05-26T15:41:13.748642+0000","last_became_peered":"2024-05-26T15:41:13.748642+0000","last_unstale":"2024-05-26T15:41:14.726450+0000","last_undegraded":"2024-05-26T15:41:14.726450+0000","last_fullsized":"2024-05-26T15:41:14.726450+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:26:35.545232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163290+0000","last_change":"2024-05-26T15:41:13.755268+0000","last_active":"2024-05-26T15:41:15.163290+0000","last_peered":"2024-05-26T15:41:15.163290+0000","last_clean":"2024-05-26T15:41:15.163290+0000","last_became_active":"2024-05-26T15:41:13.754927+0000","last_became_peered":"2024-05-26T15:41:13.754927+0000","last_unstale":"2024-05-26T15:41:15.163290+0000","last_undegraded":"2024-05-26T15:41:15.163290+0000","last_fullsized":"2024-05-26T15:41:15.163290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:26:35.545232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161929+0000","last_change":"2024-05-26T15:41:13.749034+0000","last_active":"2024-05-26T15:41:15.161929+0000","last_peered":"2024-05-26T15:41:15.161929+0000","last_clean":"2024-05-26T15:41:15.161929+0000","last_became_active":"2024-05-26T15:41:13.747525+0000","last_became_peered":"2024-05-26T15:41:13.747525+0000","last_unstale":"2024-05-26T15:41:15.161929+0000","last_undegraded":"2024-05-26T15:41:15.161929+0000","last_fullsized":"2024-05-26T15:41:15.161929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:26:35.545232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162756+0000","last_change":"2024-05-26T15:41:13.763333+0000","last_active":"2024-05-26T15:41:15.162756+0000","last_peered":"2024-05-26T15:41:15.162756+0000","last_clean":"2024-05-26T15:41:15.162756+0000","last_became_active":"2024-05-26T15:41:13.762193+0000","last_became_peered":"2024-05-26T15:41:13.762193+0000","last_unstale":"2024-05-26T15:41:15.162756+0000","last_undegraded":"2024-05-26T15:41:15.162756+0000","last_fullsized":"2024-05-26T15:41:15.162756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:41:24.415378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.166064+0000","last_change":"2024-05-26T15:41:13.741614+0000","last_active":"2024-05-26T15:41:15.166064+0000","last_peered":"2024-05-26T15:41:15.166064+0000","last_clean":"2024-05-26T15:41:15.166064+0000","last_became_active":"2024-05-26T15:41:13.741346+0000","last_became_peered":"2024-05-26T15:41:13.741346+0000","last_unstale":"2024-05-26T15:41:15.166064+0000","last_undegraded":"2024-05-26T15:41:15.166064+0000","last_fullsized":"2024-05-26T15:41:15.166064+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:13:46.863286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161487+0000","last_change":"2024-05-26T15:41:13.724463+0000","last_active":"2024-05-26T15:41:15.161487+0000","last_peered":"2024-05-26T15:41:15.161487+0000","last_clean":"2024-05-26T15:41:15.161487+0000","last_became_active":"2024-05-26T15:41:13.724114+0000","last_became_peered":"2024-05-26T15:41:13.724114+0000","last_unstale":"2024-05-26T15:41:15.161487+0000","last_undegraded":"2024-05-26T15:41:15.161487+0000","last_fullsized":"2024-05-26T15:41:15.161487+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:02:52.296219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164345+0000","last_change":"2024-05-26T15:41:13.747236+0000","last_active":"2024-05-26T15:41:15.164345+0000","last_peered":"2024-05-26T15:41:15.164345+0000","last_clean":"2024-05-26T15:41:15.164345+0000","last_became_active":"2024-05-26T15:41:13.746880+0000","last_became_peered":"2024-05-26T15:41:13.746880+0000","last_unstale":"2024-05-26T15:41:15.164345+0000","last_undegraded":"2024-05-26T15:41:15.164345+0000","last_fullsized":"2024-05-26T15:41:15.164345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:22:07.157301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163764+0000","last_change":"2024-05-26T15:41:13.757594+0000","last_active":"2024-05-26T15:41:15.163764+0000","last_peered":"2024-05-26T15:41:15.163764+0000","last_clean":"2024-05-26T15:41:15.163764+0000","last_became_active":"2024-05-26T15:41:13.756606+0000","last_became_peered":"2024-05-26T15:41:13.756606+0000","last_unstale":"2024-05-26T15:41:15.163764+0000","last_undegraded":"2024-05-26T15:41:15.163764+0000","last_fullsized":"2024-05-26T15:41:15.163764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:41:24.415378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.726665+0000","last_change":"2024-05-26T15:41:13.740913+0000","last_active":"2024-05-26T15:41:14.726665+0000","last_peered":"2024-05-26T15:41:14.726665+0000","last_clean":"2024-05-26T15:41:14.726665+0000","last_became_active":"2024-05-26T15:41:13.740576+0000","last_became_peered":"2024-05-26T15:41:13.740576+0000","last_unstale":"2024-05-26T15:41:14.726665+0000","last_undegraded":"2024-05-26T15:41:14.726665+0000","last_fullsized":"2024-05-26T15:41:14.726665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:52:48.252427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161945+0000","last_change":"2024-05-26T15:41:13.754029+0000","last_active":"2024-05-26T15:41:15.161945+0000","last_peered":"2024-05-26T15:41:15.161945+0000","last_clean":"2024-05-26T15:41:15.161945+0000","last_became_active":"2024-05-26T15:41:13.753726+0000","last_became_peered":"2024-05-26T15:41:13.753726+0000","last_unstale":"2024-05-26T15:41:15.161945+0000","last_undegraded":"2024-05-26T15:41:15.161945+0000","last_fullsized":"2024-05-26T15:41:15.161945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:50:22.942390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.160636+0000","last_change":"2024-05-26T15:41:13.752649+0000","last_active":"2024-05-26T15:41:15.160636+0000","last_peered":"2024-05-26T15:41:15.160636+0000","last_clean":"2024-05-26T15:41:15.160636+0000","last_became_active":"2024-05-26T15:41:13.752389+0000","last_became_peered":"2024-05-26T15:41:13.752389+0000","last_unstale":"2024-05-26T15:41:15.160636+0000","last_undegraded":"2024-05-26T15:41:15.160636+0000","last_fullsized":"2024-05-26T15:41:15.160636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:37:47.902556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.166191+0000","last_change":"2024-05-26T15:41:13.743159+0000","last_active":"2024-05-26T15:41:15.166191+0000","last_peered":"2024-05-26T15:41:15.166191+0000","last_clean":"2024-05-26T15:41:15.166191+0000","last_became_active":"2024-05-26T15:41:13.742893+0000","last_became_peered":"2024-05-26T15:41:13.742893+0000","last_unstale":"2024-05-26T15:41:15.166191+0000","last_undegraded":"2024-05-26T15:41:15.166191+0000","last_fullsized":"2024-05-26T15:41:15.166191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:07:31.023724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163525+0000","last_change":"2024-05-26T15:41:13.762047+0000","last_active":"2024-05-26T15:41:15.163525+0000","last_peered":"2024-05-26T15:41:15.163525+0000","last_clean":"2024-05-26T15:41:15.163525+0000","last_became_active":"2024-05-26T15:41:13.761772+0000","last_became_peered":"2024-05-26T15:41:13.761772+0000","last_unstale":"2024-05-26T15:41:15.163525+0000","last_undegraded":"2024-05-26T15:41:15.163525+0000","last_fullsized":"2024-05-26T15:41:15.163525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:38:22.645967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.165093+0000","last_change":"2024-05-26T15:41:13.725498+0000","last_active":"2024-05-26T15:41:15.165093+0000","last_peered":"2024-05-26T15:41:15.165093+0000","last_clean":"2024-05-26T15:41:15.165093+0000","last_became_active":"2024-05-26T15:41:13.725183+0000","last_became_peered":"2024-05-26T15:41:13.725183+0000","last_unstale":"2024-05-26T15:41:15.165093+0000","last_undegraded":"2024-05-26T15:41:15.165093+0000","last_fullsized":"2024-05-26T15:41:15.165093+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:40:34.135517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164075+0000","last_change":"2024-05-26T15:41:13.761096+0000","last_active":"2024-05-26T15:41:15.164075+0000","last_peered":"2024-05-26T15:41:15.164075+0000","last_clean":"2024-05-26T15:41:15.164075+0000","last_became_active":"2024-05-26T15:41:13.754724+0000","last_became_peered":"2024-05-26T15:41:13.754724+0000","last_unstale":"2024-05-26T15:41:15.164075+0000","last_undegraded":"2024-05-26T15:41:15.164075+0000","last_fullsized":"2024-05-26T15:41:15.164075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:37:31.785549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164463+0000","last_change":"2024-05-26T15:41:13.736263+0000","last_active":"2024-05-26T15:41:15.164463+0000","last_peered":"2024-05-26T15:41:15.164463+0000","last_clean":"2024-05-26T15:41:15.164463+0000","last_became_active":"2024-05-26T15:41:13.735891+0000","last_became_peered":"2024-05-26T15:41:13.735891+0000","last_unstale":"2024-05-26T15:41:15.164463+0000","last_undegraded":"2024-05-26T15:41:15.164463+0000","last_fullsized":"2024-05-26T15:41:15.164463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:38:51.736316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164528+0000","last_change":"2024-05-26T15:41:13.739257+0000","last_active":"2024-05-26T15:41:15.164528+0000","last_peered":"2024-05-26T15:41:15.164528+0000","last_clean":"2024-05-26T15:41:15.164528+0000","last_became_active":"2024-05-26T15:41:13.738150+0000","last_became_peered":"2024-05-26T15:41:13.738150+0000","last_unstale":"2024-05-26T15:41:15.164528+0000","last_undegraded":"2024-05-26T15:41:15.164528+0000","last_fullsized":"2024-05-26T15:41:15.164528+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:28:50.182529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162131+0000","last_change":"2024-05-26T15:41:13.754276+0000","last_active":"2024-05-26T15:41:15.162131+0000","last_peered":"2024-05-26T15:41:15.162131+0000","last_clean":"2024-05-26T15:41:15.162131+0000","last_became_active":"2024-05-26T15:41:13.753993+0000","last_became_peered":"2024-05-26T15:41:13.753993+0000","last_unstale":"2024-05-26T15:41:15.162131+0000","last_undegraded":"2024-05-26T15:41:15.162131+0000","last_fullsized":"2024-05-26T15:41:15.162131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:13:46.863286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162530+0000","last_change":"2024-05-26T15:41:13.732881+0000","last_active":"2024-05-26T15:41:15.162530+0000","last_peered":"2024-05-26T15:41:15.162530+0000","last_clean":"2024-05-26T15:41:15.162530+0000","last_became_active":"2024-05-26T15:41:13.732619+0000","last_became_peered":"2024-05-26T15:41:13.732619+0000","last_unstale":"2024-05-26T15:41:15.162530+0000","last_undegraded":"2024-05-26T15:41:15.162530+0000","last_fullsized":"2024-05-26T15:41:15.162530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:39:03.567695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162826+0000","last_change":"2024-05-26T15:41:13.762184+0000","last_active":"2024-05-26T15:41:15.162826+0000","last_peered":"2024-05-26T15:41:15.162826+0000","last_clean":"2024-05-26T15:41:15.162826+0000","last_became_active":"2024-05-26T15:41:13.761896+0000","last_became_peered":"2024-05-26T15:41:13.761896+0000","last_unstale":"2024-05-26T15:41:15.162826+0000","last_undegraded":"2024-05-26T15:41:15.162826+0000","last_fullsized":"2024-05-26T15:41:15.162826+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:39:28.689746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.166313+0000","last_change":"2024-05-26T15:41:13.251847+0000","last_active":"2024-05-26T15:41:15.166313+0000","last_peered":"2024-05-26T15:41:15.166313+0000","last_clean":"2024-05-26T15:41:15.166313+0000","last_became_active":"2024-05-26T15:41:13.249854+0000","last_became_peered":"2024-05-26T15:41:13.249854+0000","last_unstale":"2024-05-26T15:41:15.166313+0000","last_undegraded":"2024-05-26T15:41:15.166313+0000","last_fullsized":"2024-05-26T15:41:15.166313+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:58:37.079210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163563+0000","last_change":"2024-05-26T15:41:13.762155+0000","last_active":"2024-05-26T15:41:15.163563+0000","last_peered":"2024-05-26T15:41:15.163563+0000","last_clean":"2024-05-26T15:41:15.163563+0000","last_became_active":"2024-05-26T15:41:13.761862+0000","last_became_peered":"2024-05-26T15:41:13.761862+0000","last_unstale":"2024-05-26T15:41:15.163563+0000","last_undegraded":"2024-05-26T15:41:15.163563+0000","last_fullsized":"2024-05-26T15:41:15.163563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:05:31.554889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.160694+0000","last_change":"2024-05-26T15:41:13.249998+0000","last_active":"2024-05-26T15:41:15.160694+0000","last_peered":"2024-05-26T15:41:15.160694+0000","last_clean":"2024-05-26T15:41:15.160694+0000","last_became_active":"2024-05-26T15:41:13.249740+0000","last_became_peered":"2024-05-26T15:41:13.249740+0000","last_unstale":"2024-05-26T15:41:15.160694+0000","last_undegraded":"2024-05-26T15:41:15.160694+0000","last_fullsized":"2024-05-26T15:41:15.160694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:37:46.886782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.727574+0000","last_change":"2024-05-26T15:41:13.747271+0000","last_active":"2024-05-26T15:41:14.727574+0000","last_peered":"2024-05-26T15:41:14.727574+0000","last_clean":"2024-05-26T15:41:14.727574+0000","last_became_active":"2024-05-26T15:41:13.746403+0000","last_became_peered":"2024-05-26T15:41:13.746403+0000","last_unstale":"2024-05-26T15:41:14.727574+0000","last_undegraded":"2024-05-26T15:41:14.727574+0000","last_fullsized":"2024-05-26T15:41:14.727574+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:39:28.689746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163671+0000","last_change":"2024-05-26T15:41:13.247795+0000","last_active":"2024-05-26T15:41:15.163671+0000","last_peered":"2024-05-26T15:41:15.163671+0000","last_clean":"2024-05-26T15:41:15.163671+0000","last_became_active":"2024-05-26T15:41:13.247443+0000","last_became_peered":"2024-05-26T15:41:13.247443+0000","last_unstale":"2024-05-26T15:41:15.163671+0000","last_undegraded":"2024-05-26T15:41:15.163671+0000","last_fullsized":"2024-05-26T15:41:15.163671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:41:56.390839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.724084+0000","last_change":"2024-05-26T15:41:13.753543+0000","last_active":"2024-05-26T15:41:14.724084+0000","last_peered":"2024-05-26T15:41:14.724084+0000","last_clean":"2024-05-26T15:41:14.724084+0000","last_became_active":"2024-05-26T15:41:13.752996+0000","last_became_peered":"2024-05-26T15:41:13.752996+0000","last_unstale":"2024-05-26T15:41:14.724084+0000","last_undegraded":"2024-05-26T15:41:14.724084+0000","last_fullsized":"2024-05-26T15:41:14.724084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:17:02.162323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.727220+0000","last_change":"2024-05-26T15:41:13.235339+0000","last_active":"2024-05-26T15:41:14.727220+0000","last_peered":"2024-05-26T15:41:14.727220+0000","last_clean":"2024-05-26T15:41:14.727220+0000","last_became_active":"2024-05-26T15:41:13.235011+0000","last_became_peered":"2024-05-26T15:41:13.235011+0000","last_unstale":"2024-05-26T15:41:14.727220+0000","last_undegraded":"2024-05-26T15:41:14.727220+0000","last_fullsized":"2024-05-26T15:41:14.727220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:27:53.326414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.159810+0000","last_change":"2024-05-26T15:41:13.739749+0000","last_active":"2024-05-26T15:41:15.159810+0000","last_peered":"2024-05-26T15:41:15.159810+0000","last_clean":"2024-05-26T15:41:15.159810+0000","last_became_active":"2024-05-26T15:41:13.739449+0000","last_became_peered":"2024-05-26T15:41:13.739449+0000","last_unstale":"2024-05-26T15:41:15.159810+0000","last_undegraded":"2024-05-26T15:41:15.159810+0000","last_fullsized":"2024-05-26T15:41:15.159810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:26:35.545232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164692+0000","last_change":"2024-05-26T15:41:13.253026+0000","last_active":"2024-05-26T15:41:15.164692+0000","last_peered":"2024-05-26T15:41:15.164692+0000","last_clean":"2024-05-26T15:41:15.164692+0000","last_became_active":"2024-05-26T15:41:13.252704+0000","last_became_peered":"2024-05-26T15:41:13.252704+0000","last_unstale":"2024-05-26T15:41:15.164692+0000","last_undegraded":"2024-05-26T15:41:15.164692+0000","last_fullsized":"2024-05-26T15:41:15.164692+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:53:22.868437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163440+0000","last_change":"2024-05-26T15:41:13.749511+0000","last_active":"2024-05-26T15:41:15.163440+0000","last_peered":"2024-05-26T15:41:15.163440+0000","last_clean":"2024-05-26T15:41:15.163440+0000","last_became_active":"2024-05-26T15:41:13.749250+0000","last_became_peered":"2024-05-26T15:41:13.749250+0000","last_unstale":"2024-05-26T15:41:15.163440+0000","last_undegraded":"2024-05-26T15:41:15.163440+0000","last_fullsized":"2024-05-26T15:41:15.163440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:39:28.689746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164097+0000","last_change":"2024-05-26T15:41:13.245616+0000","last_active":"2024-05-26T15:41:15.164097+0000","last_peered":"2024-05-26T15:41:15.164097+0000","last_clean":"2024-05-26T15:41:15.164097+0000","last_became_active":"2024-05-26T15:41:13.245325+0000","last_became_peered":"2024-05-26T15:41:13.245325+0000","last_unstale":"2024-05-26T15:41:15.164097+0000","last_undegraded":"2024-05-26T15:41:15.164097+0000","last_fullsized":"2024-05-26T15:41:15.164097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:34:27.648913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.726862+0000","last_change":"2024-05-26T15:41:13.755920+0000","last_active":"2024-05-26T15:41:14.726862+0000","last_peered":"2024-05-26T15:41:14.726862+0000","last_clean":"2024-05-26T15:41:14.726862+0000","last_became_active":"2024-05-26T15:41:13.755484+0000","last_became_peered":"2024-05-26T15:41:13.755484+0000","last_unstale":"2024-05-26T15:41:14.726862+0000","last_undegraded":"2024-05-26T15:41:14.726862+0000","last_fullsized":"2024-05-26T15:41:14.726862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:41:24.415378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162748+0000","last_change":"2024-05-26T15:41:13.245361+0000","last_active":"2024-05-26T15:41:15.162748+0000","last_peered":"2024-05-26T15:41:15.162748+0000","last_clean":"2024-05-26T15:41:15.162748+0000","last_became_active":"2024-05-26T15:41:13.245010+0000","last_became_peered":"2024-05-26T15:41:13.245010+0000","last_unstale":"2024-05-26T15:41:15.162748+0000","last_undegraded":"2024-05-26T15:41:15.162748+0000","last_fullsized":"2024-05-26T15:41:15.162748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:34:27.648913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.723863+0000","last_change":"2024-05-26T15:41:13.738866+0000","last_active":"2024-05-26T15:41:14.723863+0000","last_peered":"2024-05-26T15:41:14.723863+0000","last_clean":"2024-05-26T15:41:14.723863+0000","last_became_active":"2024-05-26T15:41:13.738625+0000","last_became_peered":"2024-05-26T15:41:13.738625+0000","last_unstale":"2024-05-26T15:41:14.723863+0000","last_undegraded":"2024-05-26T15:41:14.723863+0000","last_fullsized":"2024-05-26T15:41:14.723863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:03:45.592379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.726380+0000","last_change":"2024-05-26T15:41:13.243742+0000","last_active":"2024-05-26T15:41:14.726380+0000","last_peered":"2024-05-26T15:41:14.726380+0000","last_clean":"2024-05-26T15:41:14.726380+0000","last_became_active":"2024-05-26T15:41:13.243342+0000","last_became_peered":"2024-05-26T15:41:13.243342+0000","last_unstale":"2024-05-26T15:41:14.726380+0000","last_undegraded":"2024-05-26T15:41:14.726380+0000","last_fullsized":"2024-05-26T15:41:14.726380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:41:56.390839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161786+0000","last_change":"2024-05-26T15:41:13.732137+0000","last_active":"2024-05-26T15:41:15.161786+0000","last_peered":"2024-05-26T15:41:15.161786+0000","last_clean":"2024-05-26T15:41:15.161786+0000","last_became_active":"2024-05-26T15:41:13.731839+0000","last_became_peered":"2024-05-26T15:41:13.731839+0000","last_unstale":"2024-05-26T15:41:15.161786+0000","last_undegraded":"2024-05-26T15:41:15.161786+0000","last_fullsized":"2024-05-26T15:41:15.161786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:53:23.884211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.724476+0000","last_change":"2024-05-26T15:41:13.238406+0000","last_active":"2024-05-26T15:41:14.724476+0000","last_peered":"2024-05-26T15:41:14.724476+0000","last_clean":"2024-05-26T15:41:14.724476+0000","last_became_active":"2024-05-26T15:41:13.237983+0000","last_became_peered":"2024-05-26T15:41:13.237983+0000","last_unstale":"2024-05-26T15:41:14.724476+0000","last_undegraded":"2024-05-26T15:41:14.724476+0000","last_fullsized":"2024-05-26T15:41:14.724476+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:26:51.697271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162227+0000","last_change":"2024-05-26T15:41:13.737900+0000","last_active":"2024-05-26T15:41:15.162227+0000","last_peered":"2024-05-26T15:41:15.162227+0000","last_clean":"2024-05-26T15:41:15.162227+0000","last_became_active":"2024-05-26T15:41:13.736875+0000","last_became_peered":"2024-05-26T15:41:13.736875+0000","last_unstale":"2024-05-26T15:41:15.162227+0000","last_undegraded":"2024-05-26T15:41:15.162227+0000","last_fullsized":"2024-05-26T15:41:15.162227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:37:31.785549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.165205+0000","last_change":"2024-05-26T15:41:13.252185+0000","last_active":"2024-05-26T15:41:15.165205+0000","last_peered":"2024-05-26T15:41:15.165205+0000","last_clean":"2024-05-26T15:41:15.165205+0000","last_became_active":"2024-05-26T15:41:13.251920+0000","last_became_peered":"2024-05-26T15:41:13.251920+0000","last_unstale":"2024-05-26T15:41:15.165205+0000","last_undegraded":"2024-05-26T15:41:15.165205+0000","last_fullsized":"2024-05-26T15:41:15.165205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:41:56.390839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.160436+0000","last_change":"2024-05-26T15:41:13.738766+0000","last_active":"2024-05-26T15:41:15.160436+0000","last_peered":"2024-05-26T15:41:15.160436+0000","last_clean":"2024-05-26T15:41:15.160436+0000","last_became_active":"2024-05-26T15:41:13.738498+0000","last_became_peered":"2024-05-26T15:41:13.738498+0000","last_unstale":"2024-05-26T15:41:15.160436+0000","last_undegraded":"2024-05-26T15:41:15.160436+0000","last_fullsized":"2024-05-26T15:41:15.160436+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:26:52.713044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164796+0000","last_change":"2024-05-26T15:41:13.250020+0000","last_active":"2024-05-26T15:41:15.164796+0000","last_peered":"2024-05-26T15:41:15.164796+0000","last_clean":"2024-05-26T15:41:15.164796+0000","last_became_active":"2024-05-26T15:41:13.248581+0000","last_became_peered":"2024-05-26T15:41:13.248581+0000","last_unstale":"2024-05-26T15:41:15.164796+0000","last_undegraded":"2024-05-26T15:41:15.164796+0000","last_fullsized":"2024-05-26T15:41:15.164796+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:34:27.648913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.727453+0000","last_change":"2024-05-26T15:41:13.746311+0000","last_active":"2024-05-26T15:41:14.727453+0000","last_peered":"2024-05-26T15:41:14.727453+0000","last_clean":"2024-05-26T15:41:14.727453+0000","last_became_active":"2024-05-26T15:41:13.744186+0000","last_became_peered":"2024-05-26T15:41:13.744186+0000","last_unstale":"2024-05-26T15:41:14.727453+0000","last_undegraded":"2024-05-26T15:41:14.727453+0000","last_fullsized":"2024-05-26T15:41:14.727453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:39:03.567695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.724336+0000","last_change":"2024-05-26T15:41:13.242214+0000","last_active":"2024-05-26T15:41:14.724336+0000","last_peered":"2024-05-26T15:41:14.724336+0000","last_clean":"2024-05-26T15:41:14.724336+0000","last_became_active":"2024-05-26T15:41:13.241857+0000","last_became_peered":"2024-05-26T15:41:13.241857+0000","last_unstale":"2024-05-26T15:41:14.724336+0000","last_undegraded":"2024-05-26T15:41:14.724336+0000","last_fullsized":"2024-05-26T15:41:14.724336+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:27:30.320351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.159835+0000","last_change":"2024-05-26T15:41:13.753152+0000","last_active":"2024-05-26T15:41:15.159835+0000","last_peered":"2024-05-26T15:41:15.159835+0000","last_clean":"2024-05-26T15:41:15.159835+0000","last_became_active":"2024-05-26T15:41:13.752883+0000","last_became_peered":"2024-05-26T15:41:13.752883+0000","last_unstale":"2024-05-26T15:41:15.159835+0000","last_undegraded":"2024-05-26T15:41:15.159835+0000","last_fullsized":"2024-05-26T15:41:15.159835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:37:31.785549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.724085+0000","last_change":"2024-05-26T15:41:13.239368+0000","last_active":"2024-05-26T15:41:14.724085+0000","last_peered":"2024-05-26T15:41:14.724085+0000","last_clean":"2024-05-26T15:41:14.724085+0000","last_became_active":"2024-05-26T15:41:13.239136+0000","last_became_peered":"2024-05-26T15:41:13.239136+0000","last_unstale":"2024-05-26T15:41:14.724085+0000","last_undegraded":"2024-05-26T15:41:14.724085+0000","last_fullsized":"2024-05-26T15:41:14.724085+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:37:30.769775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.723695+0000","last_change":"2024-05-26T15:41:13.734099+0000","last_active":"2024-05-26T15:41:14.723695+0000","last_peered":"2024-05-26T15:41:14.723695+0000","last_clean":"2024-05-26T15:41:14.723695+0000","last_became_active":"2024-05-26T15:41:13.733832+0000","last_became_peered":"2024-05-26T15:41:13.733832+0000","last_unstale":"2024-05-26T15:41:14.723695+0000","last_undegraded":"2024-05-26T15:41:14.723695+0000","last_fullsized":"2024-05-26T15:41:14.723695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:01:24.125304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162754+0000","last_change":"2024-05-26T15:41:13.245495+0000","last_active":"2024-05-26T15:41:15.162754+0000","last_peered":"2024-05-26T15:41:15.162754+0000","last_clean":"2024-05-26T15:41:15.162754+0000","last_became_active":"2024-05-26T15:41:13.245199+0000","last_became_peered":"2024-05-26T15:41:13.245199+0000","last_unstale":"2024-05-26T15:41:15.162754+0000","last_undegraded":"2024-05-26T15:41:15.162754+0000","last_fullsized":"2024-05-26T15:41:15.162754+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:27:53.326414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163846+0000","last_change":"2024-05-26T15:41:13.753580+0000","last_active":"2024-05-26T15:41:15.163846+0000","last_peered":"2024-05-26T15:41:15.163846+0000","last_clean":"2024-05-26T15:41:15.163846+0000","last_became_active":"2024-05-26T15:41:13.752048+0000","last_became_peered":"2024-05-26T15:41:13.752048+0000","last_unstale":"2024-05-26T15:41:15.163846+0000","last_undegraded":"2024-05-26T15:41:15.163846+0000","last_fullsized":"2024-05-26T15:41:15.163846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:38:22.645967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163751+0000","last_change":"2024-05-26T15:41:13.250004+0000","last_active":"2024-05-26T15:41:15.163751+0000","last_peered":"2024-05-26T15:41:15.163751+0000","last_clean":"2024-05-26T15:41:15.163751+0000","last_became_active":"2024-05-26T15:41:13.249689+0000","last_became_peered":"2024-05-26T15:41:13.249689+0000","last_unstale":"2024-05-26T15:41:15.163751+0000","last_undegraded":"2024-05-26T15:41:15.163751+0000","last_fullsized":"2024-05-26T15:41:15.163751+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:04:27.458213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.723933+0000","last_change":"2024-05-26T15:41:13.736758+0000","last_active":"2024-05-26T15:41:14.723933+0000","last_peered":"2024-05-26T15:41:14.723933+0000","last_clean":"2024-05-26T15:41:14.723933+0000","last_became_active":"2024-05-26T15:41:13.736506+0000","last_became_peered":"2024-05-26T15:41:13.736506+0000","last_unstale":"2024-05-26T15:41:14.723933+0000","last_undegraded":"2024-05-26T15:41:14.723933+0000","last_fullsized":"2024-05-26T15:41:14.723933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:35:38.422196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161936+0000","last_change":"2024-05-26T15:41:13.242726+0000","last_active":"2024-05-26T15:41:15.161936+0000","last_peered":"2024-05-26T15:41:15.161936+0000","last_clean":"2024-05-26T15:41:15.161936+0000","last_became_active":"2024-05-26T15:41:13.242449+0000","last_became_peered":"2024-05-26T15:41:13.242449+0000","last_unstale":"2024-05-26T15:41:15.161936+0000","last_undegraded":"2024-05-26T15:41:15.161936+0000","last_fullsized":"2024-05-26T15:41:15.161936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:53:22.868437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.724333+0000","last_change":"2024-05-26T15:41:13.744106+0000","last_active":"2024-05-26T15:41:14.724333+0000","last_peered":"2024-05-26T15:41:14.724333+0000","last_clean":"2024-05-26T15:41:14.724333+0000","last_became_active":"2024-05-26T15:41:13.743642+0000","last_became_peered":"2024-05-26T15:41:13.743642+0000","last_unstale":"2024-05-26T15:41:14.724333+0000","last_undegraded":"2024-05-26T15:41:14.724333+0000","last_fullsized":"2024-05-26T15:41:14.724333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:00:45.057472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.165519+0000","last_change":"2024-05-26T15:41:13.253805+0000","last_active":"2024-05-26T15:41:15.165519+0000","last_peered":"2024-05-26T15:41:15.165519+0000","last_clean":"2024-05-26T15:41:15.165519+0000","last_became_active":"2024-05-26T15:41:13.253509+0000","last_became_peered":"2024-05-26T15:41:13.253509+0000","last_unstale":"2024-05-26T15:41:15.165519+0000","last_undegraded":"2024-05-26T15:41:15.165519+0000","last_fullsized":"2024-05-26T15:41:15.165519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:27:53.326414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164530+0000","last_change":"2024-05-26T15:41:13.752762+0000","last_active":"2024-05-26T15:41:15.164530+0000","last_peered":"2024-05-26T15:41:15.164530+0000","last_clean":"2024-05-26T15:41:15.164530+0000","last_became_active":"2024-05-26T15:41:13.752482+0000","last_became_peered":"2024-05-26T15:41:13.752482+0000","last_unstale":"2024-05-26T15:41:15.164530+0000","last_undegraded":"2024-05-26T15:41:15.164530+0000","last_fullsized":"2024-05-26T15:41:15.164530+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:29:17.402882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.727727+0000","last_change":"2024-05-26T15:41:13.247711+0000","last_active":"2024-05-26T15:41:14.727727+0000","last_peered":"2024-05-26T15:41:14.727727+0000","last_clean":"2024-05-26T15:41:14.727727+0000","last_became_active":"2024-05-26T15:41:13.247382+0000","last_became_peered":"2024-05-26T15:41:13.247382+0000","last_unstale":"2024-05-26T15:41:14.727727+0000","last_undegraded":"2024-05-26T15:41:14.727727+0000","last_fullsized":"2024-05-26T15:41:14.727727+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:02:51.280445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.727569+0000","last_change":"2024-05-26T15:41:13.738948+0000","last_active":"2024-05-26T15:41:14.727569+0000","last_peered":"2024-05-26T15:41:14.727569+0000","last_clean":"2024-05-26T15:41:14.727569+0000","last_became_active":"2024-05-26T15:41:13.736519+0000","last_became_peered":"2024-05-26T15:41:13.736519+0000","last_unstale":"2024-05-26T15:41:14.727569+0000","last_undegraded":"2024-05-26T15:41:14.727569+0000","last_fullsized":"2024-05-26T15:41:14.727569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:38:22.645967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161584+0000","last_change":"2024-05-26T15:41:13.238187+0000","last_active":"2024-05-26T15:41:15.161584+0000","last_peered":"2024-05-26T15:41:15.161584+0000","last_clean":"2024-05-26T15:41:15.161584+0000","last_became_active":"2024-05-26T15:41:13.237895+0000","last_became_peered":"2024-05-26T15:41:13.237895+0000","last_unstale":"2024-05-26T15:41:15.161584+0000","last_undegraded":"2024-05-26T15:41:15.161584+0000","last_fullsized":"2024-05-26T15:41:15.161584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:28:36.210915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161724+0000","last_change":"2024-05-26T15:41:13.730902+0000","last_active":"2024-05-26T15:41:15.161724+0000","last_peered":"2024-05-26T15:41:15.161724+0000","last_clean":"2024-05-26T15:41:15.161724+0000","last_became_active":"2024-05-26T15:41:13.730123+0000","last_became_peered":"2024-05-26T15:41:13.730123+0000","last_unstale":"2024-05-26T15:41:15.161724+0000","last_undegraded":"2024-05-26T15:41:15.161724+0000","last_fullsized":"2024-05-26T15:41:15.161724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:41:57.406612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163358+0000","last_change":"2024-05-26T15:41:13.248396+0000","last_active":"2024-05-26T15:41:15.163358+0000","last_peered":"2024-05-26T15:41:15.163358+0000","last_clean":"2024-05-26T15:41:15.163358+0000","last_became_active":"2024-05-26T15:41:13.243670+0000","last_became_peered":"2024-05-26T15:41:13.243670+0000","last_unstale":"2024-05-26T15:41:15.163358+0000","last_undegraded":"2024-05-26T15:41:15.163358+0000","last_fullsized":"2024-05-26T15:41:15.163358+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:02:51.280445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162232+0000","last_change":"2024-05-26T15:41:13.753868+0000","last_active":"2024-05-26T15:41:15.162232+0000","last_peered":"2024-05-26T15:41:15.162232+0000","last_clean":"2024-05-26T15:41:15.162232+0000","last_became_active":"2024-05-26T15:41:13.753539+0000","last_became_peered":"2024-05-26T15:41:13.753539+0000","last_unstale":"2024-05-26T15:41:15.162232+0000","last_undegraded":"2024-05-26T15:41:15.162232+0000","last_fullsized":"2024-05-26T15:41:15.162232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:05:31.554889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161693+0000","last_change":"2024-05-26T15:41:13.240787+0000","last_active":"2024-05-26T15:41:15.161693+0000","last_peered":"2024-05-26T15:41:15.161693+0000","last_clean":"2024-05-26T15:41:15.161693+0000","last_became_active":"2024-05-26T15:41:13.240468+0000","last_became_peered":"2024-05-26T15:41:13.240468+0000","last_unstale":"2024-05-26T15:41:15.161693+0000","last_undegraded":"2024-05-26T15:41:15.161693+0000","last_fullsized":"2024-05-26T15:41:15.161693+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:17:05.048085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.160392+0000","last_change":"2024-05-26T15:41:13.746588+0000","last_active":"2024-05-26T15:41:15.160392+0000","last_peered":"2024-05-26T15:41:15.160392+0000","last_clean":"2024-05-26T15:41:15.160392+0000","last_became_active":"2024-05-26T15:41:13.746349+0000","last_became_peered":"2024-05-26T15:41:13.746349+0000","last_unstale":"2024-05-26T15:41:15.160392+0000","last_undegraded":"2024-05-26T15:41:15.160392+0000","last_fullsized":"2024-05-26T15:41:15.160392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:29:17.402882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161524+0000","last_change":"2024-05-26T15:41:13.244460+0000","last_active":"2024-05-26T15:41:15.161524+0000","last_peered":"2024-05-26T15:41:15.161524+0000","last_clean":"2024-05-26T15:41:15.161524+0000","last_became_active":"2024-05-26T15:41:13.243908+0000","last_became_peered":"2024-05-26T15:41:13.243908+0000","last_unstale":"2024-05-26T15:41:15.161524+0000","last_undegraded":"2024-05-26T15:41:15.161524+0000","last_fullsized":"2024-05-26T15:41:15.161524+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:37:19.557788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164649+0000","last_change":"2024-05-26T15:41:13.752813+0000","last_active":"2024-05-26T15:41:15.164649+0000","last_peered":"2024-05-26T15:41:15.164649+0000","last_clean":"2024-05-26T15:41:15.164649+0000","last_became_active":"2024-05-26T15:41:13.752504+0000","last_became_peered":"2024-05-26T15:41:13.752504+0000","last_unstale":"2024-05-26T15:41:15.164649+0000","last_undegraded":"2024-05-26T15:41:15.164649+0000","last_fullsized":"2024-05-26T15:41:15.164649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:26:52.713044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162208+0000","last_change":"2024-05-26T15:41:13.251148+0000","last_active":"2024-05-26T15:41:15.162208+0000","last_peered":"2024-05-26T15:41:15.162208+0000","last_clean":"2024-05-26T15:41:15.162208+0000","last_became_active":"2024-05-26T15:41:13.250870+0000","last_became_peered":"2024-05-26T15:41:13.250870+0000","last_unstale":"2024-05-26T15:41:15.162208+0000","last_undegraded":"2024-05-26T15:41:15.162208+0000","last_fullsized":"2024-05-26T15:41:15.162208+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:57:22.313340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.724021+0000","last_change":"2024-05-26T15:41:13.738760+0000","last_active":"2024-05-26T15:41:14.724021+0000","last_peered":"2024-05-26T15:41:14.724021+0000","last_clean":"2024-05-26T15:41:14.724021+0000","last_became_active":"2024-05-26T15:41:13.738515+0000","last_became_peered":"2024-05-26T15:41:13.738515+0000","last_unstale":"2024-05-26T15:41:14.724021+0000","last_undegraded":"2024-05-26T15:41:14.724021+0000","last_fullsized":"2024-05-26T15:41:14.724021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:28:26.647932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.161870+0000","last_change":"2024-05-26T15:41:13.241879+0000","last_active":"2024-05-26T15:41:15.161870+0000","last_peered":"2024-05-26T15:41:15.161870+0000","last_clean":"2024-05-26T15:41:15.161870+0000","last_became_active":"2024-05-26T15:41:13.241180+0000","last_became_peered":"2024-05-26T15:41:13.241180+0000","last_unstale":"2024-05-26T15:41:15.161870+0000","last_undegraded":"2024-05-26T15:41:15.161870+0000","last_fullsized":"2024-05-26T15:41:15.161870+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:42:18.231376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163176+0000","last_change":"2024-05-26T15:41:13.762966+0000","last_active":"2024-05-26T15:41:15.163176+0000","last_peered":"2024-05-26T15:41:15.163176+0000","last_clean":"2024-05-26T15:41:15.163176+0000","last_became_active":"2024-05-26T15:41:13.762690+0000","last_became_peered":"2024-05-26T15:41:13.762690+0000","last_unstale":"2024-05-26T15:41:15.163176+0000","last_undegraded":"2024-05-26T15:41:15.163176+0000","last_fullsized":"2024-05-26T15:41:15.163176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:26:35.545232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.165734+0000","last_change":"2024-05-26T15:41:13.248845+0000","last_active":"2024-05-26T15:41:15.165734+0000","last_peered":"2024-05-26T15:41:15.165734+0000","last_clean":"2024-05-26T15:41:15.165734+0000","last_became_active":"2024-05-26T15:41:13.248469+0000","last_became_peered":"2024-05-26T15:41:13.248469+0000","last_unstale":"2024-05-26T15:41:15.165734+0000","last_undegraded":"2024-05-26T15:41:15.165734+0000","last_fullsized":"2024-05-26T15:41:15.165734+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:57:22.313340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162441+0000","last_change":"2024-05-26T15:41:13.743941+0000","last_active":"2024-05-26T15:41:15.162441+0000","last_peered":"2024-05-26T15:41:15.162441+0000","last_clean":"2024-05-26T15:41:15.162441+0000","last_became_active":"2024-05-26T15:41:13.743642+0000","last_became_peered":"2024-05-26T15:41:13.743642+0000","last_unstale":"2024-05-26T15:41:15.162441+0000","last_undegraded":"2024-05-26T15:41:15.162441+0000","last_fullsized":"2024-05-26T15:41:15.162441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:26:52.713044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.429943+0000","last_change":"2024-05-26T15:41:13.246018+0000","last_active":"2024-05-26T15:41:15.429943+0000","last_peered":"2024-05-26T15:41:15.429943+0000","last_clean":"2024-05-26T15:41:15.429943+0000","last_became_active":"2024-05-26T15:41:13.245721+0000","last_became_peered":"2024-05-26T15:41:13.245721+0000","last_unstale":"2024-05-26T15:41:15.429943+0000","last_undegraded":"2024-05-26T15:41:15.429943+0000","last_fullsized":"2024-05-26T15:41:15.429943+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:43:54.045226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.724388+0000","last_change":"2024-05-26T15:41:13.742088+0000","last_active":"2024-05-26T15:41:14.724388+0000","last_peered":"2024-05-26T15:41:14.724388+0000","last_clean":"2024-05-26T15:41:14.724388+0000","last_became_active":"2024-05-26T15:41:13.740895+0000","last_became_peered":"2024-05-26T15:41:13.740895+0000","last_unstale":"2024-05-26T15:41:14.724388+0000","last_undegraded":"2024-05-26T15:41:14.724388+0000","last_fullsized":"2024-05-26T15:41:14.724388+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:09:20.601842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.160437+0000","last_change":"2024-05-26T15:41:13.237095+0000","last_active":"2024-05-26T15:41:15.160437+0000","last_peered":"2024-05-26T15:41:15.160437+0000","last_clean":"2024-05-26T15:41:15.160437+0000","last_became_active":"2024-05-26T15:41:13.236759+0000","last_became_peered":"2024-05-26T15:41:13.236759+0000","last_unstale":"2024-05-26T15:41:15.160437+0000","last_undegraded":"2024-05-26T15:41:15.160437+0000","last_fullsized":"2024-05-26T15:41:15.160437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:28:49.166755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.160711+0000","last_change":"2024-05-26T15:41:13.734555+0000","last_active":"2024-05-26T15:41:15.160711+0000","last_peered":"2024-05-26T15:41:15.160711+0000","last_clean":"2024-05-26T15:41:15.160711+0000","last_became_active":"2024-05-26T15:41:13.734297+0000","last_became_peered":"2024-05-26T15:41:13.734297+0000","last_unstale":"2024-05-26T15:41:15.160711+0000","last_undegraded":"2024-05-26T15:41:15.160711+0000","last_fullsized":"2024-05-26T15:41:15.160711+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:39:28.689746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.160588+0000","last_change":"2024-05-26T15:41:13.247155+0000","last_active":"2024-05-26T15:41:15.160588+0000","last_peered":"2024-05-26T15:41:15.160588+0000","last_clean":"2024-05-26T15:41:15.160588+0000","last_became_active":"2024-05-26T15:41:13.246870+0000","last_became_peered":"2024-05-26T15:41:13.246870+0000","last_unstale":"2024-05-26T15:41:15.160588+0000","last_undegraded":"2024-05-26T15:41:15.160588+0000","last_fullsized":"2024-05-26T15:41:15.160588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:02:51.280445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.162627+0000","last_change":"2024-05-26T15:41:13.728591+0000","last_active":"2024-05-26T15:41:15.162627+0000","last_peered":"2024-05-26T15:41:15.162627+0000","last_clean":"2024-05-26T15:41:15.162627+0000","last_became_active":"2024-05-26T15:41:13.728335+0000","last_became_peered":"2024-05-26T15:41:13.728335+0000","last_unstale":"2024-05-26T15:41:15.162627+0000","last_undegraded":"2024-05-26T15:41:15.162627+0000","last_fullsized":"2024-05-26T15:41:15.162627+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:52:48.252427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.164755+0000","last_change":"2024-05-26T15:41:13.242449+0000","last_active":"2024-05-26T15:41:15.164755+0000","last_peered":"2024-05-26T15:41:15.164755+0000","last_clean":"2024-05-26T15:41:15.164755+0000","last_became_active":"2024-05-26T15:41:13.242137+0000","last_became_peered":"2024-05-26T15:41:13.242137+0000","last_unstale":"2024-05-26T15:41:15.164755+0000","last_undegraded":"2024-05-26T15:41:15.164755+0000","last_fullsized":"2024-05-26T15:41:15.164755+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:33:17.290216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.726534+0000","last_change":"2024-05-26T15:41:13.740936+0000","last_active":"2024-05-26T15:41:14.726534+0000","last_peered":"2024-05-26T15:41:14.726534+0000","last_clean":"2024-05-26T15:41:14.726534+0000","last_became_active":"2024-05-26T15:41:13.740629+0000","last_became_peered":"2024-05-26T15:41:13.740629+0000","last_unstale":"2024-05-26T15:41:14.726534+0000","last_undegraded":"2024-05-26T15:41:14.726534+0000","last_fullsized":"2024-05-26T15:41:14.726534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:05:31.554889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.726341+0000","last_change":"2024-05-26T15:41:13.237103+0000","last_active":"2024-05-26T15:41:14.726341+0000","last_peered":"2024-05-26T15:41:14.726341+0000","last_clean":"2024-05-26T15:41:14.726341+0000","last_became_active":"2024-05-26T15:41:13.236023+0000","last_became_peered":"2024-05-26T15:41:13.236023+0000","last_unstale":"2024-05-26T15:41:14.726341+0000","last_undegraded":"2024-05-26T15:41:14.726341+0000","last_fullsized":"2024-05-26T15:41:14.726341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:34:27.648913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163464+0000","last_change":"2024-05-26T15:41:13.751960+0000","last_active":"2024-05-26T15:41:15.163464+0000","last_peered":"2024-05-26T15:41:15.163464+0000","last_clean":"2024-05-26T15:41:15.163464+0000","last_became_active":"2024-05-26T15:41:13.751592+0000","last_became_peered":"2024-05-26T15:41:13.751592+0000","last_unstale":"2024-05-26T15:41:15.163464+0000","last_undegraded":"2024-05-26T15:41:15.163464+0000","last_fullsized":"2024-05-26T15:41:15.163464+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:29:17.402882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:14.723612+0000","last_change":"2024-05-26T15:41:13.238269+0000","last_active":"2024-05-26T15:41:14.723612+0000","last_peered":"2024-05-26T15:41:14.723612+0000","last_clean":"2024-05-26T15:41:14.723612+0000","last_became_active":"2024-05-26T15:41:13.237965+0000","last_became_peered":"2024-05-26T15:41:13.237965+0000","last_unstale":"2024-05-26T15:41:14.723612+0000","last_undegraded":"2024-05-26T15:41:14.723612+0000","last_fullsized":"2024-05-26T15:41:14.723612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:29:16.387108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.165301+0000","last_change":"2024-05-26T15:41:13.754742+0000","last_active":"2024-05-26T15:41:15.165301+0000","last_peered":"2024-05-26T15:41:15.165301+0000","last_clean":"2024-05-26T15:41:15.165301+0000","last_became_active":"2024-05-26T15:41:13.751872+0000","last_became_peered":"2024-05-26T15:41:13.751872+0000","last_unstale":"2024-05-26T15:41:15.165301+0000","last_undegraded":"2024-05-26T15:41:15.165301+0000","last_fullsized":"2024-05-26T15:41:15.165301+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:13.203370+0000","last_clean_scrub_stamp":"2024-05-26T15:41:13.203370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:36:51.117537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-05-26T15:41:15.163064+0000","last_change":"2024-05-26T15:41:13.246840+0000","last_active":"2024-05-26T15:41:15.163064+0000","last_peered":"2024-05-26T15:41:15.163064+0000","last_clean":"2024-05-26T15:41:15.163064+0000","last_became_active":"2024-05-26T15:41:13.246544+0000","last_became_peered":"2024-05-26T15:41:13.246544+0000","last_unstale":"2024-05-26T15:41:15.163064+0000","last_undegraded":"2024-05-26T15:41:15.163064+0000","last_fullsized":"2024-05-26T15:41:15.163064+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:41:12.187596+0000","last_clean_scrub_stamp":"2024-05-26T15:41:12.187596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:35:07.842639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-05-26T15:41:13.725015+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:41:13.725015+0000","last_peered":"2024-05-26T15:41:13.725015+0000","last_clean":"2024-05-26T15:41:13.725015+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:41:13.725015+0000","last_undegraded":"2024-05-26T15:41:13.725015+0000","last_fullsized":"2024-05-26T15:41:13.725015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1060864,"data_stored":786279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.038},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.3440000000000001}]},{"osd":1,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.47}]},{"osd":2,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.1100000000000001}]},{"osd":3,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.714},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.5720000000000001}]},{"osd":4,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.1799999999999999}]},{"osd":5,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":1.05,"5min":1.05,"15min":1.05},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.659,"5min":1.659,"15min":1.659},"min":{"1min":1.157,"5min":1.157,"15min":1.157},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.6040000000000001}]},{"osd":6,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":1.23,"5min":1.23,"15min":1.23},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.8380000000000001},{"interface":"front","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.821}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":454656,"data_stored":194859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.95799999999999996}]},{"osd":1,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.196},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.3260000000000001}]},{"osd":2,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.087},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.4590000000000001}]},{"osd":3,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":1.667}]},{"osd":4,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":3.282,"5min":3.282,"15min":3.282},"last":1.627},{"interface":"front","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.581}]},{"osd":5,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":3.4590000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.708},{"interface":"front","average":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.742}]},{"osd":7,"last update":"Sun May 26 15:40:25 2024","interfaces":[{"interface":"back","average":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.8109999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":454656,"data_stored":193370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.2080000000000002,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.488}]},{"osd":1,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.143},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.169}]},{"osd":2,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.3149999999999999}]},{"osd":3,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0049999999999999}]},{"osd":4,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":1.427},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.708}]},{"osd":6,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.7649999999999999}]},{"osd":7,"last update":"Sun May 26 15:40:23 2024","interfaces":[{"interface":"back","average":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"min":{"1min":1.036,"5min":1.036,"15min":1.036},"max":{"1min":3.0659999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.605},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.5469999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":458752,"data_stored":194881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.454}]},{"osd":1,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.238,"5min":2.238,"15min":2.238},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.5489999999999999}]},{"osd":2,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.1439999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.2}]},{"osd":3,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.339}]},{"osd":5,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.4039999999999999}]},{"osd":6,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.667,"5min":1.667,"15min":1.667},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.5840000000000001}]},{"osd":7,"last update":"Sun May 26 15:40:24 2024","interfaces":[{"interface":"back","average":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"min":{"1min":1.147,"5min":1.147,"15min":1.147},"max":{"1min":4.008,"5min":4.008,"15min":4.008},"last":1.492},{"interface":"front","average":{"1min":1.782,"5min":1.782,"15min":1.782},"min":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"max":{"1min":3.3010000000000002,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.5189999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":466944,"data_stored":195875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":1.2929999999999999}]},{"osd":1,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.3740000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.581}]},{"osd":2,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.222}]},{"osd":4,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.7629999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":1.018,"5min":1.018,"15min":1.018},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.3540000000000001}]},{"osd":5,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.9180000000000001,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.7559999999999998,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.4370000000000001}]},{"osd":6,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.863,"5min":2.863,"15min":2.863},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.635}]},{"osd":7,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.7010000000000001,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.6619999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":450560,"data_stored":193328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":0.626},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.747}]},{"osd":3,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.70499999999999996}]},{"osd":4,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":3.4420000000000002,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.1319999999999999}]},{"osd":5,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":2.9820000000000002,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":1.333}]},{"osd":6,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":1.139,"5min":1.139,"15min":1.139},"max":{"1min":3.5600000000000001,"5min":3.5600000000000001,"15min":3.5600000000000001},"last":1.175},{"interface":"front","average":{"1min":1.607,"5min":1.607,"15min":1.607},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":0.72699999999999998}]},{"osd":7,"last update":"Sun May 26 15:40:26 2024","interfaces":[{"interface":"back","average":{"1min":1.734,"5min":1.734,"15min":1.734},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":1.26},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.7989999999999999,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":0.77700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":454656,"data_stored":194367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.78900000000000003}]},{"osd":2,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.74399999999999999}]},{"osd":3,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.29,"15min":1.29},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.7160000000000002,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.89600000000000002}]},{"osd":4,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":0.98499999999999999}]},{"osd":5,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":3.0089999999999999,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.3240000000000001}]},{"osd":6,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.3460000000000001,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.157},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":2.7999999999999998,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.0960000000000001}]},{"osd":7,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.75,"15min":1.75},"min":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":2.9780000000000002,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.1160000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":1044480,"data_stored":783660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.83799999999999997}]},{"osd":2,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.046},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1}]},{"osd":3,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.024,"5min":4.024,"15min":4.024},"last":1.262},{"interface":"front","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":3.0899999999999999,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":1.4399999999999999}]},{"osd":4,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.379},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.8009999999999999}]},{"osd":5,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.5470000000000002,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":4.0490000000000004,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.524}]},{"osd":6,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.554},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":3.6680000000000001,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.323}]},{"osd":7,"last update":"Sun May 26 15:40:21 2024","interfaces":[{"interface":"back","average":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"min":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"max":{"1min":3.0209999999999999,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.754},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.8399999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.879}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:41:18.711 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-26T15:41:18.712 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-26T15:41:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.977+0000 7f9471800640 1 Processor -- start 2024-05-26T15:41:18.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.978+0000 7f9471800640 1 -- start start 2024-05-26T15:41:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.979+0000 7f9471800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f946c099790 0x7f946c098a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.979+0000 7f9471800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946c099bd0 con 0x7f946c098f90 2024-05-26T15:41:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.979+0000 7f9471800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946c0cf7a0 con 0x7f946c0cf3c0 2024-05-26T15:41:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.979+0000 7f9471800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0cc7d0 con 0x7f946c099790 2024-05-26T15:41:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.980+0000 7f9470e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f946c098f90 0x7f946c0b0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53502/0 (socket says 172.21.15.8:53502) 2024-05-26T15:41:18.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.980+0000 7f9470e00640 1 -- 172.21.15.8:0/4207913638 learned_addr learned my addr 172.21.15.8:0/4207913638 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:18.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.980+0000 7f946b400640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f946c099790 0x7f946c098a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.980+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973416643 0 0) 0x7f946c099bd0 con 0x7f946c098f90 2024-05-26T15:41:18.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.980+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9450003520 con 0x7f946c098f90 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.980+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2638496361 0 0) 0x7f9450003520 con 0x7f946c098f90 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f946c099790 msgr2=0x7f946c098a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f946c099790 0x7f946c098a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 >> v1:172.21.15.47:6789/0 conn(0x7f946c0cf3c0 legacy=0x7f946c0ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c0cc210 con 0x7f946c098f90 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f94640019f0 con 0x7f946c098f90 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 >> v1:172.21.15.8:6789/0 conn(0x7f946c098f90 legacy=0x7f946c0b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94500039a0 0x7f9450003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f946c099790 0x7f94500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9450004d00 0x7f9450005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0cc7d0 con 0x7f94500039a0 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945000ba60 con 0x7f9450004d00 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945000bc20 con 0x7f946c099790 2024-05-26T15:41:18.982 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946be00640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94500039a0 0x7f9450003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.981+0000 7f946b400640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f946c099790 0x7f94500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.982+0000 7f946be00640 1 -- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f946c099790 msgr2=0x7f94500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.982+0000 7f946be00640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f946c099790 0x7f94500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.982+0000 7f9470e00640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9450004d00 0x7f9450005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.982+0000 7f946be00640 1 -- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9450004d00 msgr2=0x7f9450005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.982+0000 7f946be00640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9450004d00 0x7f9450005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.982+0000 7f946be00640 1 -- 172.21.15.8:0/4207913638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450003520 con 0x7f94500039a0 2024-05-26T15:41:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.982+0000 7f946b400640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f946c099790 0x7f94500047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.982+0000 7f9470e00640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9450004d00 0x7f9450005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.983+0000 7f946be00640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94500039a0 0x7f9450003dc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f945c001720 tx=0x7f94500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1152bbd8d80aab26 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.983+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c0052d0 con 0x7f94500039a0 2024-05-26T15:41:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.983+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c005430 con 0x7f94500039a0 2024-05-26T15:41:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.983+0000 7f946aa00640 1 -- 172.21.15.8:0/4207913638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c02abc0 con 0x7f94500039a0 2024-05-26T15:41:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.984+0000 7f9471800640 1 -- 172.21.15.8:0/4207913638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94500039a0 msgr2=0x7f9450003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.984+0000 7f9471800640 1 --2- 172.21.15.8:0/4207913638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94500039a0 0x7f9450003dc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f945c001720 tx=0x7f94500057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.984+0000 7f9470e00640 1 -- 172.21.15.8:0/4207913638 reap_dead start 2024-05-26T15:41:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.984+0000 7f9471800640 1 -- 172.21.15.8:0/4207913638 shutdown_connections 2024-05-26T15:41:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.984+0000 7f9471800640 1 -- 172.21.15.8:0/4207913638 >> 172.21.15.8:0/4207913638 conn(0x7f946c0b2170 msgr2=0x7f946c0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.984+0000 7f9471800640 1 -- 172.21.15.8:0/4207913638 shutdown_connections 2024-05-26T15:41:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.984+0000 7f9471800640 1 -- 172.21.15.8:0/4207913638 wait complete. 2024-05-26T15:41:18.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.985+0000 7f9471800640 1 Processor -- start 2024-05-26T15:41:18.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.986+0000 7f9471800640 1 -- start start 2024-05-26T15:41:18.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.987+0000 7f9471800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f94500039a0 0x7f946c150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.987+0000 7f9471800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f946c09d820 0x7f946c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.987+0000 7f9471800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c09dc60 0x7f946c0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.987+0000 7f9471800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0c77f0 con 0x7f946c09d820 2024-05-26T15:41:18.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.987+0000 7f9471800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0c7a90 con 0x7f946c09dc60 2024-05-26T15:41:18.987 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.987+0000 7f9471800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0c7d70 con 0x7f94500039a0 2024-05-26T15:41:18.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.987+0000 7f946b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f946c09d820 0x7f946c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.987+0000 7f946be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f94500039a0 0x7f946c150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.987+0000 7f946b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f946c09d820 0x7f946c0c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58324/0 (socket says 172.21.15.8:58324) 2024-05-26T15:41:18.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.987+0000 7f946b400640 1 -- 172.21.15.8:0/1262610822 learned_addr learned my addr 172.21.15.8:0/1262610822 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:18.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.988+0000 7f9470e00640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c09dc60 0x7f946c0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.988+0000 7f946b400640 1 -- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f94500039a0 msgr2=0x7f946c150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.988+0000 7f946b400640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f94500039a0 0x7f946c150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.988+0000 7f946b400640 1 -- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c09dc60 msgr2=0x7f946c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:18.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.988+0000 7f946b400640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c09dc60 0x7f946c0c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:18.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.988+0000 7f946b400640 1 -- 172.21.15.8:0/1262610822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c0c8050 con 0x7f946c09d820 2024-05-26T15:41:18.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.988+0000 7f9470e00640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c09dc60 0x7f946c0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:41:18.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.988+0000 7f946b400640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f946c09d820 0x7f946c0c8850 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f94580108b0 tx=0x7f9458010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:18.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.989+0000 7f9463e00640 1 -- 172.21.15.8:0/1262610822 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800eb60 con 0x7f946c09d820 2024-05-26T15:41:18.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.989+0000 7f9463e00640 1 -- 172.21.15.8:0/1262610822 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800ecc0 con 0x7f946c09d820 2024-05-26T15:41:18.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.989+0000 7f9463e00640 1 -- 172.21.15.8:0/1262610822 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945801c400 con 0x7f946c09d820 2024-05-26T15:41:18.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.989+0000 7f9471800640 1 -- 172.21.15.8:0/1262610822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946c0c8330 con 0x7f946c09d820 2024-05-26T15:41:18.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.989+0000 7f9471800640 1 -- 172.21.15.8:0/1262610822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c150980 con 0x7f946c09d820 2024-05-26T15:41:18.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.990+0000 7f9471800640 1 -- 172.21.15.8:0/1262610822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946c04e210 con 0x7f946c09d820 2024-05-26T15:41:18.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.992+0000 7f9463e00640 1 -- 172.21.15.8:0/1262610822 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f945801c560 con 0x7f946c09d820 2024-05-26T15:41:18.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.993+0000 7f9463e00640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f944c06ac30 0x7f944c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:18.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.993+0000 7f9463e00640 1 -- 172.21.15.8:0/1262610822 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9458089960 con 0x7f946c09d820 2024-05-26T15:41:18.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.994+0000 7f946be00640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f944c06ac30 0x7f944c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:18.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.995+0000 7f946be00640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f944c06ac30 0x7f944c06d0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f945c032000 tx=0x7f945c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:18.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:18.998+0000 7f9463e00640 1 -- 172.21.15.8:0/1262610822 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9458054970 con 0x7f946c09d820 2024-05-26T15:41:19.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.269+0000 7f9471800640 1 -- 172.21.15.8:0/1262610822 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f946c0ccb20 con 0x7f946c09d820 2024-05-26T15:41:19.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.278+0000 7f9463e00640 1 -- 172.21.15.8:0/1262610822 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9458089070 con 0x7f946c09d820 2024-05-26T15:41:19.277 INFO:teuthology.orchestra.run.smithi008.stderr:updated caps for client.0 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 -- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f944c06ac30 msgr2=0x7f944c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f944c06ac30 0x7f944c06d0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f945c032000 tx=0x7f945c02e000 comp rx=0 tx=0).stop 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 -- 172.21.15.8:0/1262610822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f946c09d820 msgr2=0x7f946c0c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f946c09d820 0x7f946c0c8850 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f94580108b0 tx=0x7f9458010d70 comp rx=0 tx=0).stop 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 -- 172.21.15.8:0/1262610822 shutdown_connections 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f944c06ac30 0x7f944c06d0f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f946c09dc60 0x7f946c0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f946c09d820 0x7f946c0c8850 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 --2- 172.21.15.8:0/1262610822 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f94500039a0 0x7f946c150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 -- 172.21.15.8:0/1262610822 >> 172.21.15.8:0/1262610822 conn(0x7f946c0b2170 msgr2=0x7f946c06f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 -- 172.21.15.8:0/1262610822 shutdown_connections 2024-05-26T15:41:19.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.281+0000 7f9471800640 1 -- 172.21.15.8:0/1262610822 wait complete. 2024-05-26T15:41:19.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:41:19.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.510+0000 7f471fe00640 1 Processor -- start 2024-05-26T15:41:19.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.511+0000 7f471fe00640 1 -- start start 2024-05-26T15:41:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.512+0000 7f471fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47201600d0 0x7f47200cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.512+0000 7f471fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f47200b8720 0x7f47200cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.512+0000 7f471fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47200d1310 0x7f47200d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.512+0000 7f471fe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47200d0ef0 con 0x7f47201600d0 2024-05-26T15:41:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.512+0000 7f471fe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47200b7eb0 con 0x7f47200b8720 2024-05-26T15:41:19.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.512+0000 7f471fe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47201604b0 con 0x7f47200d1310 2024-05-26T15:41:19.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.513+0000 7f471ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47201600d0 0x7f47200cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:19.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.513+0000 7f471ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47201600d0 0x7f47200cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58340/0 (socket says 172.21.15.8:58340) 2024-05-26T15:41:19.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.513+0000 7f471ea00640 1 -- 172.21.15.8:0/2391789399 learned_addr learned my addr 172.21.15.8:0/2391789399 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:19.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.513+0000 7f471e000640 1 --2- 172.21.15.8:0/2391789399 >> v2:172.21.15.47:3300/0 conn(0x7f47200b8720 0x7f47200cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:19.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.513+0000 7f471f400640 1 --2- 172.21.15.8:0/2391789399 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47200d1310 0x7f47200d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:19.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.513+0000 7f471ea00640 1 -- 172.21.15.8:0/2391789399 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47200d1310 msgr2=0x7f47200d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:19.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.514+0000 7f471ea00640 1 --2- 172.21.15.8:0/2391789399 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47200d1310 0x7f47200d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.514+0000 7f471ea00640 1 -- 172.21.15.8:0/2391789399 >> v2:172.21.15.47:3300/0 conn(0x7f47200b8720 msgr2=0x7f47200cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:19.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.514+0000 7f471ea00640 1 --2- 172.21.15.8:0/2391789399 >> v2:172.21.15.47:3300/0 conn(0x7f47200b8720 0x7f47200cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.514+0000 7f471ea00640 1 -- 172.21.15.8:0/2391789399 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47200b7610 con 0x7f47201600d0 2024-05-26T15:41:19.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.515+0000 7f471ea00640 1 --2- 172.21.15.8:0/2391789399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47201600d0 0x7f47200cf990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f47200d0ca0 tx=0x7f471002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4aa812179877af server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.515+0000 7f471d600640 1 -- 172.21.15.8:0/2391789399 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710031600 con 0x7f47201600d0 2024-05-26T15:41:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.515+0000 7f471d600640 1 -- 172.21.15.8:0/2391789399 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471002d050 con 0x7f47201600d0 2024-05-26T15:41:19.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.515+0000 7f471d600640 1 -- 172.21.15.8:0/2391789399 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710031980 con 0x7f47201600d0 2024-05-26T15:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.516+0000 7f471fe00640 1 -- 172.21.15.8:0/2391789399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47201600d0 msgr2=0x7f47200cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.516+0000 7f471fe00640 1 --2- 172.21.15.8:0/2391789399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47201600d0 0x7f47200cf990 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f47200d0ca0 tx=0x7f471002a610 comp rx=0 tx=0).stop 2024-05-26T15:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.516+0000 7f471fe00640 1 -- 172.21.15.8:0/2391789399 shutdown_connections 2024-05-26T15:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.516+0000 7f471fe00640 1 --2- 172.21.15.8:0/2391789399 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47200d1310 0x7f47200d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.516+0000 7f471fe00640 1 --2- 172.21.15.8:0/2391789399 >> v2:172.21.15.47:3300/0 conn(0x7f47200b8720 0x7f47200cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.516+0000 7f471fe00640 1 --2- 172.21.15.8:0/2391789399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47201600d0 0x7f47200cf990 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.516+0000 7f471fe00640 1 -- 172.21.15.8:0/2391789399 >> 172.21.15.8:0/2391789399 conn(0x7f472006b750 msgr2=0x7f472006bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.516+0000 7f471fe00640 1 -- 172.21.15.8:0/2391789399 shutdown_connections 2024-05-26T15:41:19.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.516+0000 7f471fe00640 1 -- 172.21.15.8:0/2391789399 wait complete. 2024-05-26T15:41:19.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.518+0000 7f471fe00640 1 Processor -- start 2024-05-26T15:41:19.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.518+0000 7f471fe00640 1 -- start start 2024-05-26T15:41:19.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.519+0000 7f471fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47200b8720 0x7f47200b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.519+0000 7f471fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47200d1310 0x7f47200c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.519+0000 7f471fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47201600d0 0x7f47200ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.519+0000 7f471fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4720145d70 con 0x7f47200d1310 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4720148c10 con 0x7f47201600d0 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471fe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4720146010 con 0x7f47200b8720 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47200d1310 0x7f47200c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47200d1310 0x7f47200c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58354/0 (socket says 172.21.15.8:58354) 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471e000640 1 -- 172.21.15.8:0/1976603974 learned_addr learned my addr 172.21.15.8:0/1976603974 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471ea00640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47200b8720 0x7f47200b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471f400640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47201600d0 0x7f47200ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471e000640 1 -- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47200b8720 msgr2=0x7f47200b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:19.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471e000640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47200b8720 0x7f47200b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471e000640 1 -- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47201600d0 msgr2=0x7f47200ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:19.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471e000640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47201600d0 0x7f47200ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471e000640 1 -- 172.21.15.8:0/1976603974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4710009b30 con 0x7f47200d1310 2024-05-26T15:41:19.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.520+0000 7f471f400640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47201600d0 0x7f47200ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:19.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.521+0000 7f471e000640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47200d1310 0x7f47200c9cc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f470800d800 tx=0x7f470800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.521+0000 7f4716a00640 1 -- 172.21.15.8:0/1976603974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47080096a0 con 0x7f47200d1310 2024-05-26T15:41:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.521+0000 7f4716a00640 1 -- 172.21.15.8:0/1976603974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4708009800 con 0x7f47200d1310 2024-05-26T15:41:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.521+0000 7f4716a00640 1 -- 172.21.15.8:0/1976603974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708009b90 con 0x7f47200d1310 2024-05-26T15:41:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.521+0000 7f471fe00640 1 -- 172.21.15.8:0/1976603974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47201462f0 con 0x7f47200d1310 2024-05-26T15:41:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.521+0000 7f471fe00640 1 -- 172.21.15.8:0/1976603974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47200b4370 con 0x7f47200d1310 2024-05-26T15:41:19.522 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.522+0000 7f471fe00640 1 -- 172.21.15.8:0/1976603974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472004e280 con 0x7f47200d1310 2024-05-26T15:41:19.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.524+0000 7f4716a00640 1 -- 172.21.15.8:0/1976603974 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4708009cf0 con 0x7f47200d1310 2024-05-26T15:41:19.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.524+0000 7f4716a00640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f46fc06ac30 0x7f46fc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:19.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.525+0000 7f4716a00640 1 -- 172.21.15.8:0/1976603974 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4708089950 con 0x7f47200d1310 2024-05-26T15:41:19.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.525+0000 7f471ea00640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f46fc06ac30 0x7f46fc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:19.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.527+0000 7f471ea00640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f46fc06ac30 0x7f46fc06d0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4710033000 tx=0x7f4710009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:19.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.529+0000 7f4716a00640 1 -- 172.21.15.8:0/1976603974 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4708054950 con 0x7f47200d1310 2024-05-26T15:41:19.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.772+0000 7f471fe00640 1 -- 172.21.15.8:0/1976603974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f472015e7c0 con 0x7f47200d1310 2024-05-26T15:41:19.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.773+0000 7f4716a00640 1 -- 172.21.15.8:0/1976603974 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4728 (secure 0 0 0) 0x7f470800b440 con 0x7f47200d1310 2024-05-26T15:41:19.772 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:19.773 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4993,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6836/2455185189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":2455185189},{"type":"v1","addr":"172.21.15.47:6836","nonce":2455185189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/3271632770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3271632770},{"type":"v1","addr":"172.21.15.8:6833","nonce":3271632770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/3972699618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":3972699618},{"type":"v1","addr":"172.21.15.8:6835","nonce":3972699618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:41:13.704888+0000","modified":"2024-05-26T15:41:16.723528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5313},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5313":{"gid":5313,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.47:6837/2181130163","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2181130163},{"type":"v1","addr":"172.21.15.47:6837","nonce":2181130163}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-26T15:41:19.773 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 16 2024-05-26T15:41:19.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 -- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f46fc06ac30 msgr2=0x7f46fc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:19.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f46fc06ac30 0x7f46fc06d0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4710033000 tx=0x7f4710009000 comp rx=0 tx=0).stop 2024-05-26T15:41:19.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 -- 172.21.15.8:0/1976603974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47200d1310 msgr2=0x7f47200c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47200d1310 0x7f47200c9cc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f470800d800 tx=0x7f470800dcc0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 -- 172.21.15.8:0/1976603974 shutdown_connections 2024-05-26T15:41:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f46fc06ac30 0x7f46fc06d0f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47201600d0 0x7f47200ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47200d1310 0x7f47200c9cc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 --2- 172.21.15.8:0/1976603974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f47200b8720 0x7f47200b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 -- 172.21.15.8:0/1976603974 >> 172.21.15.8:0/1976603974 conn(0x7f472006b750 msgr2=0x7f47200d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 -- 172.21.15.8:0/1976603974 shutdown_connections 2024-05-26T15:41:19.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:19.776+0000 7f471fe00640 1 -- 172.21.15.8:0/1976603974 wait complete. 2024-05-26T15:41:20.198 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-26T15:41:13.704888+0000', 'modified': '2024-05-26T15:41:16.723528+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5313}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5313': {'gid': 5313, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.47:6837/2181130163', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 2181130163}, {'type': 'v1', 'addr': '172.21.15.47:6837', 'nonce': 2181130163}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-26T15:41:20.198 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-26T15:41:20.198 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-26T15:41:20.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.422+0000 7f7f78e00640 1 Processor -- start 2024-05-26T15:41:20.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.422+0000 7f7f78e00640 1 -- start start 2024-05-26T15:41:20.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.423+0000 7f7f78e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7f740c2670 0x7f7f740b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.424+0000 7f7f78e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7f7406e980 0x7f7f740cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.424+0000 7f7f78e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f740b1e80 con 0x7f7f741611a0 2024-05-26T15:41:20.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.424+0000 7f7f78e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f74165a50 con 0x7f7f740c2670 2024-05-26T15:41:20.423 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.424+0000 7f7f78e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7406e4f0 con 0x7f7f7406e980 2024-05-26T15:41:20.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.424+0000 7f7f72a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7f741611a0 0x7f7f740c2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53512/0 (socket says 172.21.15.8:53512) 2024-05-26T15:41:20.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.424+0000 7f7f72a00640 1 -- 172.21.15.8:0/382894173 learned_addr learned my addr 172.21.15.8:0/382894173 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:20.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.424+0000 7f7f73400640 1 --2- 172.21.15.8:0/382894173 >> v2:172.21.15.8:3300/0 conn(0x7f7f740c2670 0x7f7f740b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.425+0000 7f7f73e00640 1 --2- 172.21.15.8:0/382894173 >> v2:172.21.15.47:3300/0 conn(0x7f7f7406e980 0x7f7f740cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.424 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.425+0000 7f7f72000640 1 -- 172.21.15.8:0/382894173 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294465219 0 0) 0x7f7f740b1e80 con 0x7f7f741611a0 2024-05-26T15:41:20.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.425+0000 7f7f72000640 1 -- 172.21.15.8:0/382894173 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f58003520 con 0x7f7f741611a0 2024-05-26T15:41:20.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.425+0000 7f7f73400640 1 -- 172.21.15.8:0/382894173 >> v2:172.21.15.47:3300/0 conn(0x7f7f7406e980 msgr2=0x7f7f740cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:20.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.425+0000 7f7f73400640 1 --2- 172.21.15.8:0/382894173 >> v2:172.21.15.47:3300/0 conn(0x7f7f7406e980 0x7f7f740cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.425+0000 7f7f73400640 1 -- 172.21.15.8:0/382894173 >> v1:172.21.15.8:6789/0 conn(0x7f7f741611a0 legacy=0x7f7f740c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.425+0000 7f7f73400640 1 -- 172.21.15.8:0/382894173 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f741654d0 con 0x7f7f740c2670 2024-05-26T15:41:20.425 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.425+0000 7f7f73e00640 1 --2- 172.21.15.8:0/382894173 >> v2:172.21.15.47:3300/0 conn(0x7f7f7406e980 0x7f7f740cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.426+0000 7f7f73400640 1 --2- 172.21.15.8:0/382894173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 0x7f7f740b1940 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7f7406f7e0 tx=0x7f7f6402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5087ba44bdc53c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.426+0000 7f7f72000640 1 -- 172.21.15.8:0/382894173 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6402ae60 con 0x7f7f740c2670 2024-05-26T15:41:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.426+0000 7f7f72000640 1 -- 172.21.15.8:0/382894173 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64032440 con 0x7f7f740c2670 2024-05-26T15:41:20.426 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.426+0000 7f7f72000640 1 -- 172.21.15.8:0/382894173 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640327d0 con 0x7f7f740c2670 2024-05-26T15:41:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.427+0000 7f7f78e00640 1 -- 172.21.15.8:0/382894173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 msgr2=0x7f7f740b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.427+0000 7f7f78e00640 1 --2- 172.21.15.8:0/382894173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 0x7f7f740b1940 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7f7406f7e0 tx=0x7f7f6402a110 comp rx=0 tx=0).stop 2024-05-26T15:41:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.427+0000 7f7f78e00640 1 -- 172.21.15.8:0/382894173 shutdown_connections 2024-05-26T15:41:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.427+0000 7f7f78e00640 1 --2- 172.21.15.8:0/382894173 >> v2:172.21.15.47:3300/0 conn(0x7f7f7406e980 0x7f7f740cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.427+0000 7f7f78e00640 1 --2- 172.21.15.8:0/382894173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 0x7f7f740b1940 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.427+0000 7f7f78e00640 1 -- 172.21.15.8:0/382894173 >> 172.21.15.8:0/382894173 conn(0x7f7f74098a50 msgr2=0x7f7f740b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.427+0000 7f7f78e00640 1 -- 172.21.15.8:0/382894173 shutdown_connections 2024-05-26T15:41:20.427 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.427+0000 7f7f78e00640 1 -- 172.21.15.8:0/382894173 wait complete. 2024-05-26T15:41:20.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.429+0000 7f7f78e00640 1 Processor -- start 2024-05-26T15:41:20.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.429+0000 7f7f78e00640 1 -- start start 2024-05-26T15:41:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.430+0000 7f7f78e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f7406e980 0x7f7f740cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.430+0000 7f7f78e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 0x7f7f740c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.430+0000 7f7f78e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f741611a0 0x7f7f740b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.430+0000 7f7f78e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7415e2c0 con 0x7f7f740c2670 2024-05-26T15:41:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.430+0000 7f7f78e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740cbe70 con 0x7f7f741611a0 2024-05-26T15:41:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.430+0000 7f7f78e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7415e510 con 0x7f7f7406e980 2024-05-26T15:41:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f72a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 0x7f7f740c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f72a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 0x7f7f740c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58372/0 (socket says 172.21.15.8:58372) 2024-05-26T15:41:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f72a00640 1 -- 172.21.15.8:0/859449956 learned_addr learned my addr 172.21.15.8:0/859449956 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f73400640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f7406e980 0x7f7f740cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f73e00640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f741611a0 0x7f7f740b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f72a00640 1 -- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f7406e980 msgr2=0x7f7f740cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f72a00640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f7406e980 0x7f7f740cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f72a00640 1 -- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f741611a0 msgr2=0x7f7f740b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f72a00640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f741611a0 0x7f7f740b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f72a00640 1 -- 172.21.15.8:0/859449956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64009400 con 0x7f7f740c2670 2024-05-26T15:41:20.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.431+0000 7f7f73400640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f7406e980 0x7f7f740cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:41:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.432+0000 7f7f72a00640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 0x7f7f740c9910 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000cbc0 tx=0x7f7f6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.432+0000 7f7f6b400640 1 -- 172.21.15.8:0/859449956 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000ad40 con 0x7f7f740c2670 2024-05-26T15:41:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.432+0000 7f7f6b400640 1 -- 172.21.15.8:0/859449956 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f60012400 con 0x7f7f740c2670 2024-05-26T15:41:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.432+0000 7f7f6b400640 1 -- 172.21.15.8:0/859449956 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000aea0 con 0x7f7f740c2670 2024-05-26T15:41:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.432+0000 7f7f78e00640 1 -- 172.21.15.8:0/859449956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7415e7f0 con 0x7f7f740c2670 2024-05-26T15:41:20.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.432+0000 7f7f78e00640 1 -- 172.21.15.8:0/859449956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7415edb0 con 0x7f7f740c2670 2024-05-26T15:41:20.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.435+0000 7f7f6b400640 1 -- 172.21.15.8:0/859449956 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f60007070 con 0x7f7f740c2670 2024-05-26T15:41:20.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.436+0000 7f7f6b400640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f5406ac00 0x7f7f5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.436+0000 7f7f6b400640 1 -- 172.21.15.8:0/859449956 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7f60089550 con 0x7f7f740c2670 2024-05-26T15:41:20.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.437+0000 7f7f7d1c9740 1 Processor -- start 2024-05-26T15:41:20.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.437+0000 7f7f73400640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f5406ac00 0x7f7f5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.437+0000 7f7f7d1c9740 1 -- start start 2024-05-26T15:41:20.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.438+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.438+0000 7f7f73400640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f5406ac00 0x7f7f5406d0c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7f64034000 tx=0x7f7f6402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:20.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.438+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1a8c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.438 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.438+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1a8cae0 0x55cca1a8dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.438+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca19f7a70 con 0x55cca1ad6300 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.438+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca19f5200 con 0x55cca1a8cae0 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.438+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca19f0af0 con 0x55cca1ad6910 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.439+0000 7f7f73400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.439+0000 7f7f73400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58386/0 (socket says 172.21.15.8:58386) 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.439+0000 7f7f73400640 1 -- 172.21.15.8:0/4012223469 learned_addr learned my addr 172.21.15.8:0/4012223469 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.439+0000 7f7f73400640 1 -- 172.21.15.8:0/4012223469 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 msgr2=0x55cca1a8c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.439+0000 7f7f73400640 1 --2- 172.21.15.8:0/4012223469 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1a8c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.439+0000 7f7f73400640 1 -- 172.21.15.8:0/4012223469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1a8cae0 msgr2=0x55cca1a8dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.439+0000 7f7f73400640 1 --2- 172.21.15.8:0/4012223469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1a8cae0 0x55cca1a8dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.439+0000 7f7f73400640 1 -- 172.21.15.8:0/4012223469 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cca19bbb90 con 0x55cca1ad6300 2024-05-26T15:41:20.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.439+0000 7f7f73400640 1 --2- 172.21.15.8:0/4012223469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab5d70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7f64032b40 tx=0x7f7f6402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a39320f5926c388 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f5fe00640 1 -- 172.21.15.8:0/4012223469 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6403c830 con 0x55cca1ad6300 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f5fe00640 1 -- 172.21.15.8:0/4012223469 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64043040 con 0x55cca1ad6300 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f5fe00640 1 -- 172.21.15.8:0/4012223469 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6403cb90 con 0x55cca1ad6300 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/4012223469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 msgr2=0x55cca1ab5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/4012223469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab5d70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7f64032b40 tx=0x7f7f6402c000 comp rx=0 tx=0).stop 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/4012223469 shutdown_connections 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/4012223469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1a8cae0 0x55cca1a8dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/4012223469 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1a8c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/4012223469 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab5d70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/4012223469 >> 172.21.15.8:0/4012223469 conn(0x55cca1a8b000 msgr2=0x55cca1ad38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.440+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/4012223469 shutdown_connections 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.441+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/4012223469 wait complete. 2024-05-26T15:41:20.441 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.441+0000 7f7f7d1c9740 1 -- start start 2024-05-26T15:41:20.442 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.441+0000 7f7f7d1c9740 1 Processor -- start 2024-05-26T15:41:20.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1aae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1ad6910 0x55cca1aa94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1aadc40 0x55cca1aad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca1992220 con 0x55cca1ad6300 2024-05-26T15:41:20.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca1991ec0 con 0x55cca1ad6910 2024-05-26T15:41:20.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca1757f20 con 0x55cca1aadc40 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f7d1c9740 10 client.0 _ll_register_callbacks cb 0x55cca19ea160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f73400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1aae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f73400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1aae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58400/0 (socket says 172.21.15.8:58400) 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f73400640 1 -- 172.21.15.8:0/1552591285 learned_addr learned my addr 172.21.15.8:0/1552591285 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f72a00640 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1ad6910 0x55cca1aa94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f73400640 1 -- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1aadc40 msgr2=0x55cca1aad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f73400640 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1aadc40 0x55cca1aad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f73400640 1 -- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1ad6910 msgr2=0x55cca1aa94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f73400640 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1ad6910 0x55cca1aa94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.443+0000 7f7f73400640 1 -- 172.21.15.8:0/1552591285 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f741654d0 con 0x55cca1ad6300 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.444+0000 7f7f73400640 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1aae2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009890 tx=0x7f7f6402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636ea6f15d6b42e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.444+0000 7f7f5cc00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.444+0000 7f7f5cc00640 1 -- 172.21.15.8:0/1552591285 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f640498d0 con 0x55cca1ad6300 2024-05-26T15:41:20.445 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.444+0000 7f7f5cc00640 1 -- 172.21.15.8:0/1552591285 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7f64049a30 con 0x55cca1ad6300 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.444+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/1552591285 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cca1a1ac90 con 0x55cca1ad6300 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.444+0000 7f7f5cc00640 1 -- 172.21.15.8:0/1552591285 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f64049bf0 con 0x55cca1ad6300 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.444+0000 7f7f7d1c9740 10 client.5484 fetch_fsmap learned FSMap version 16 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.444+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/1552591285 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55cca19ef170 con 0x55cca1ad6300 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.445+0000 7f7f5cc00640 1 -- 172.21.15.8:0/1552591285 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cca1a1ac90 con 0x55cca1ad6300 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.445+0000 7f7f5cc00640 1 -- 172.21.15.8:0/1552591285 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7f64046070 con 0x55cca1ad6300 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.445+0000 7f7f7d1c9740 10 client.5484 fetch_fsmap finished waiting for FSMap version 16 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.445+0000 7f7f7d1c9740 10 client.5484 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.445+0000 7f7f7d1c9740 20 client.5484 populate_metadata read hostname 'smithi008' 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.445+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:6834/2181130163,v1:172.21.15.47:6837/2181130163] conn(0x55cca1abbc40 0x55cca1af0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.445+0000 7f7f7d1c9740 4 client.5484 mds_command: new command op to 5313 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-26T15:41:20.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.445+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/1552591285 --> [v2:172.21.15.47:6834/2181130163,v1:172.21.15.47:6837/2181130163] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cca16e43c0 con 0x55cca1abbc40 2024-05-26T15:41:20.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.446+0000 7f7f72a00640 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:6834/2181130163,v1:172.21.15.47:6837/2181130163] conn(0x55cca1abbc40 0x55cca1af0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.447+0000 7f7f72a00640 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:6834/2181130163,v1:172.21.15.47:6837/2181130163] conn(0x55cca1abbc40 0x55cca1af0cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6a2fc41b2368034 server_cookie=b677b0207dbc5340 in_seq=0 out_seq=0 2024-05-26T15:41:20.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.447+0000 7f7f5cc00640 10 client.5484 ms_handle_connect on v2:172.21.15.47:6834/2181130163 2024-05-26T15:41:20.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.448+0000 7f7f5cc00640 1 -- 172.21.15.8:0/1552591285 <== mds.0 v2:172.21.15.47:6834/2181130163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cca16e43c0 con 0x55cca1abbc40 2024-05-26T15:41:20.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.448+0000 7f7f5cc00640 10 client.5484 handle_command_reply: tid=0 2024-05-26T15:41:20.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.448+0000 7f7f7d1c9740 1 client.5484 shutdown 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/1552591285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 msgr2=0x55cca1aae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1aae2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009890 tx=0x7f7f6402c070 comp rx=0 tx=0).stop 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/1552591285 shutdown_connections 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:6834/2181130163,v1:172.21.15.47:6837/2181130163] conn(0x55cca1abbc40 0x55cca1af0cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1aadc40 0x55cca1aad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1ad6910 0x55cca1aa94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/1552591285 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1aae2f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f5cc00640 0 client.5484 ms_handle_reset on v2:172.21.15.47:6834/2181130163 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/1552591285 >> 172.21.15.8:0/1552591285 conn(0x55cca1a8cae0 msgr2=0x55cca1ad40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/1552591285 shutdown_connections 2024-05-26T15:41:20.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/1552591285 wait complete. 2024-05-26T15:41:20.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.449+0000 7f7f7d1c9740 20 client.5484 trim_cache size 0 max 16384 2024-05-26T15:41:20.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.466+0000 7f7f7d1c9740 1 Processor -- start 2024-05-26T15:41:20.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.467+0000 7f7f7d1c9740 1 -- start start 2024-05-26T15:41:20.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.467+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1aadc40 0x55cca1aae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.467+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.467+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1ad2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.467+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca1ab1820 con 0x55cca1ad6300 2024-05-26T15:41:20.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.467+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca1af57b0 con 0x55cca1aadc40 2024-05-26T15:41:20.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.467+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca1aa9cf0 con 0x55cca1ad6910 2024-05-26T15:41:20.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.468+0000 7f7f72a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.468+0000 7f7f72a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58402/0 (socket says 172.21.15.8:58402) 2024-05-26T15:41:20.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.468+0000 7f7f72a00640 1 -- 172.21.15.8:0/3448845265 learned_addr learned my addr 172.21.15.8:0/3448845265 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:20.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.468+0000 7f7f73400640 1 --2- 172.21.15.8:0/3448845265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1aadc40 0x55cca1aae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.468+0000 7f7f73e00640 1 --2- 172.21.15.8:0/3448845265 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1ad2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.468+0000 7f7f72a00640 1 -- 172.21.15.8:0/3448845265 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 msgr2=0x55cca1ad2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:20.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.468+0000 7f7f72a00640 1 --2- 172.21.15.8:0/3448845265 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1ad2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.468+0000 7f7f72a00640 1 -- 172.21.15.8:0/3448845265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1aadc40 msgr2=0x55cca1aae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.468+0000 7f7f72a00640 1 --2- 172.21.15.8:0/3448845265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1aadc40 0x55cca1aae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.468+0000 7f7f72a00640 1 -- 172.21.15.8:0/3448845265 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cca1a24130 con 0x55cca1ad6300 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.469+0000 7f7f72a00640 1 --2- 172.21.15.8:0/3448845265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab99d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f60054710 tx=0x7f7f6005e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd7d73d9f89608c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.469+0000 7f7f68c00640 1 -- 172.21.15.8:0/3448845265 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f600879b0 con 0x55cca1ad6300 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.469+0000 7f7f68c00640 1 -- 172.21.15.8:0/3448845265 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f600565b0 con 0x55cca1ad6300 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.469+0000 7f7f68c00640 1 -- 172.21.15.8:0/3448845265 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f60058470 con 0x55cca1ad6300 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.470+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/3448845265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 msgr2=0x55cca1ab99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.470+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/3448845265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab99d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f60054710 tx=0x7f7f6005e040 comp rx=0 tx=0).stop 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.470+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/3448845265 shutdown_connections 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.470+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/3448845265 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1ad2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.470+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/3448845265 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1ad6300 0x55cca1ab99d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.470+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/3448845265 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1aadc40 0x55cca1aae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.470+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/3448845265 >> 172.21.15.8:0/3448845265 conn(0x55cca1a8cae0 msgr2=0x55cca1a844d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:20.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.470+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/3448845265 shutdown_connections 2024-05-26T15:41:20.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.470+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/3448845265 wait complete. 2024-05-26T15:41:20.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.471+0000 7f7f7d1c9740 1 -- start start 2024-05-26T15:41:20.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.471+0000 7f7f7d1c9740 1 Processor -- start 2024-05-26T15:41:20.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.472+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1aadc40 0x55cca1aac470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.472+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1ad6300 0x55cca1b37f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.472+0000 7f7f7d1c9740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1ab07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.472+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca1b42440 con 0x55cca1aadc40 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.472+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca1aed190 con 0x55cca1ad6300 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.472+0000 7f7f7d1c9740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca1a88410 con 0x55cca1ad6910 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.472+0000 7f7f7d1c9740 10 client.0 _ll_register_callbacks cb 0x55cca1a8ca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.472+0000 7f7f73400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1aadc40 0x55cca1aac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.472+0000 7f7f73400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1aadc40 0x55cca1aac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58418/0 (socket says 172.21.15.8:58418) 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.472+0000 7f7f73400640 1 -- 172.21.15.8:0/321970309 learned_addr learned my addr 172.21.15.8:0/321970309 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f73e00640 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1ab07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f72a00640 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1ad6300 0x55cca1b37f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f73400640 1 -- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 msgr2=0x55cca1ab07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f73400640 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1ab07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f73400640 1 -- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1ad6300 msgr2=0x55cca1b37f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:20.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f73400640 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1ad6300 0x55cca1b37f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f73400640 1 -- 172.21.15.8:0/321970309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7415edb0 con 0x55cca1aadc40 2024-05-26T15:41:20.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f73400640 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1aadc40 0x55cca1aac470 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7f6402a700 tx=0x7f7f64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1850de5c6c9b9b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:20.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f5cc00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:41:20.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f5cc00640 1 -- 172.21.15.8:0/321970309 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64049b60 con 0x55cca1aadc40 2024-05-26T15:41:20.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f5cc00640 1 -- 172.21.15.8:0/321970309 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7f64049e40 con 0x55cca1aadc40 2024-05-26T15:41:20.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.473+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/321970309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cca1aaf030 con 0x55cca1aadc40 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f5cc00640 1 -- 172.21.15.8:0/321970309 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f640060e0 con 0x55cca1aadc40 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f7d1c9740 10 client.5490 fetch_fsmap learned FSMap version 16 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/321970309 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55cca1991430 con 0x55cca1aadc40 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f5cc00640 1 -- 172.21.15.8:0/321970309 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cca1aaf030 con 0x55cca1aadc40 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f5cc00640 1 -- 172.21.15.8:0/321970309 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7f64046040 con 0x55cca1aadc40 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f7d1c9740 10 client.5490 fetch_fsmap finished waiting for FSMap version 16 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f7d1c9740 10 client.5490 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f7d1c9740 20 client.5490 populate_metadata read hostname 'smithi008' 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:6834/2181130163,v1:172.21.15.47:6837/2181130163] conn(0x55cca1ab0f20 0x55cca1b41520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f7d1c9740 4 client.5490 mds_command: new command op to 5313 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.474+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/321970309 --> [v2:172.21.15.47:6834/2181130163,v1:172.21.15.47:6837/2181130163] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f7f64043040 con 0x55cca1ab0f20 2024-05-26T15:41:20.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.475+0000 7f7f72a00640 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:6834/2181130163,v1:172.21.15.47:6837/2181130163] conn(0x55cca1ab0f20 0x55cca1b41520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.476+0000 7f7f72a00640 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:6834/2181130163,v1:172.21.15.47:6837/2181130163] conn(0x55cca1ab0f20 0x55cca1b41520 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d61bd3302122988 server_cookie=39c3ee8f75b72288 in_seq=0 out_seq=0 2024-05-26T15:41:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.476+0000 7f7f5cc00640 10 client.5490 ms_handle_connect on v2:172.21.15.47:6834/2181130163 2024-05-26T15:41:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.476+0000 7f7f5cc00640 1 -- 172.21.15.8:0/321970309 <== mds.0 v2:172.21.15.47:6834/2181130163 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f7f64043040 con 0x55cca1ab0f20 2024-05-26T15:41:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.476+0000 7f7f5cc00640 10 client.5490 handle_command_reply: tid=0 2024-05-26T15:41:20.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.476+0000 7f7f7d1c9740 1 client.5490 shutdown 2024-05-26T15:41:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.476+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/321970309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1aadc40 msgr2=0x55cca1aac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.476+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1aadc40 0x55cca1aac470 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7f6402a700 tx=0x7f7f64004730 comp rx=0 tx=0).stop 2024-05-26T15:41:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.477+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/321970309 shutdown_connections 2024-05-26T15:41:20.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.477+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:6834/2181130163,v1:172.21.15.47:6837/2181130163] conn(0x55cca1ab0f20 0x55cca1b41520 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.477+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55cca1ad6910 0x55cca1ab07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.477+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55cca1ad6300 0x55cca1b37f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.477+0000 7f7f7d1c9740 1 --2- 172.21.15.8:0/321970309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55cca1aadc40 0x55cca1aac470 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.477+0000 7f7f5cc00640 0 client.5490 ms_handle_reset on v2:172.21.15.47:6834/2181130163 2024-05-26T15:41:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.477+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/321970309 >> 172.21.15.8:0/321970309 conn(0x55cca1a8cae0 msgr2=0x55cca1ab99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.477+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/321970309 shutdown_connections 2024-05-26T15:41:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.477+0000 7f7f7d1c9740 1 -- 172.21.15.8:0/321970309 wait complete. 2024-05-26T15:41:20.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.477+0000 7f7f7d1c9740 20 client.5490 trim_cache size 0 max 16384 2024-05-26T15:41:20.479 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "03132396-4584-4cf0-b2e0-b5ae6040045e", 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5313, 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 6.7670450889999998, 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 16, 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 39, 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 39, 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 15.057575333999999 2024-05-26T15:41:20.480 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:41:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 -- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f5406ac00 msgr2=0x7f7f5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f5406ac00 0x7f7f5406d0c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7f64034000 tx=0x7f7f6402e000 comp rx=0 tx=0).stop 2024-05-26T15:41:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 -- 172.21.15.8:0/859449956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 msgr2=0x7f7f740c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 0x7f7f740c9910 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000cbc0 tx=0x7f7f6000a430 comp rx=0 tx=0).stop 2024-05-26T15:41:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 -- 172.21.15.8:0/859449956 shutdown_connections 2024-05-26T15:41:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f5406ac00 0x7f7f5406d0c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f741611a0 0x7f7f740b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f740c2670 0x7f7f740c9910 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 --2- 172.21.15.8:0/859449956 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f7406e980 0x7f7f740cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 -- 172.21.15.8:0/859449956 >> 172.21.15.8:0/859449956 conn(0x7f7f74098a50 msgr2=0x7f7f7415ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:20.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 -- 172.21.15.8:0/859449956 shutdown_connections 2024-05-26T15:41:20.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.478+0000 7f7f78e00640 1 -- 172.21.15.8:0/859449956 wait complete. 2024-05-26T15:41:20.495 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-26T15:41:20.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.690+0000 7f3543200640 1 Processor -- start 2024-05-26T15:41:20.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.690+0000 7f3543200640 1 -- start start 2024-05-26T15:41:20.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.691+0000 7f3543200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35441600d0 0x7f35440cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.691+0000 7f3543200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35440b8720 0x7f35440cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.691+0000 7f3543200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35440b7eb0 con 0x7f35440d1310 2024-05-26T15:41:20.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.691+0000 7f3543200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35440d0ef0 con 0x7f35440b8720 2024-05-26T15:41:20.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.691+0000 7f3543200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35441604b0 con 0x7f35441600d0 2024-05-26T15:41:20.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.692+0000 7f3542800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f35440d1310 0x7f35440d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:53524/0 (socket says 172.21.15.8:53524) 2024-05-26T15:41:20.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.692+0000 7f3542800640 1 -- 172.21.15.8:0/4120058877 learned_addr learned my addr 172.21.15.8:0/4120058877 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:20.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.692+0000 7f353be00640 1 --2- 172.21.15.8:0/4120058877 >> v2:172.21.15.47:3300/0 conn(0x7f35440b8720 0x7f35440cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.692+0000 7f3541e00640 1 --2- 172.21.15.8:0/4120058877 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35441600d0 0x7f35440cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.692+0000 7f3541400640 1 -- 172.21.15.8:0/4120058877 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455349078 0 0) 0x7f35440b7eb0 con 0x7f35440d1310 2024-05-26T15:41:20.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.693+0000 7f3541400640 1 -- 172.21.15.8:0/4120058877 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3528003520 con 0x7f35440d1310 2024-05-26T15:41:20.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.693+0000 7f353be00640 1 -- 172.21.15.8:0/4120058877 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35441600d0 msgr2=0x7f35440cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:20.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.693+0000 7f353be00640 1 --2- 172.21.15.8:0/4120058877 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35441600d0 0x7f35440cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.693+0000 7f353be00640 1 -- 172.21.15.8:0/4120058877 >> v1:172.21.15.8:6789/0 conn(0x7f35440d1310 legacy=0x7f35440d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.693+0000 7f353be00640 1 -- 172.21.15.8:0/4120058877 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35440b7610 con 0x7f35440b8720 2024-05-26T15:41:20.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.694+0000 7f353be00640 1 --2- 172.21.15.8:0/4120058877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35440b8720 0x7f35440cfed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f352c0097a0 tx=0x7f352c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aa043f7351caf9a server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:20.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.695+0000 7f3541400640 1 -- 172.21.15.8:0/4120058877 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c032440 con 0x7f35440b8720 2024-05-26T15:41:20.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.695+0000 7f3541400640 1 -- 172.21.15.8:0/4120058877 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c0325a0 con 0x7f35440b8720 2024-05-26T15:41:20.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.695+0000 7f3541400640 1 -- 172.21.15.8:0/4120058877 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c032930 con 0x7f35440b8720 2024-05-26T15:41:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.696+0000 7f3543200640 1 -- 172.21.15.8:0/4120058877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35440b8720 msgr2=0x7f35440cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.696+0000 7f3543200640 1 --2- 172.21.15.8:0/4120058877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35440b8720 0x7f35440cfed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f352c0097a0 tx=0x7f352c02a180 comp rx=0 tx=0).stop 2024-05-26T15:41:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.696+0000 7f3543200640 1 -- 172.21.15.8:0/4120058877 shutdown_connections 2024-05-26T15:41:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.696+0000 7f3543200640 1 --2- 172.21.15.8:0/4120058877 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35440b8720 0x7f35440cfed0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.696+0000 7f3543200640 1 --2- 172.21.15.8:0/4120058877 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35441600d0 0x7f35440cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.696+0000 7f3543200640 1 -- 172.21.15.8:0/4120058877 >> 172.21.15.8:0/4120058877 conn(0x7f354406b750 msgr2=0x7f354406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.696+0000 7f3543200640 1 -- 172.21.15.8:0/4120058877 shutdown_connections 2024-05-26T15:41:20.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.696+0000 7f3543200640 1 -- 172.21.15.8:0/4120058877 wait complete. 2024-05-26T15:41:20.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.698+0000 7f3543200640 1 Processor -- start 2024-05-26T15:41:20.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.698+0000 7f3543200640 1 -- start start 2024-05-26T15:41:20.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.699+0000 7f3543200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35440b8720 0x7f354414ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.699+0000 7f3543200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35440d1310 0x7f354415ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.699+0000 7f3543200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35441600d0 0x7f3544154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.699+0000 7f3543200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354414cf90 con 0x7f35441600d0 2024-05-26T15:41:20.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.699+0000 7f3543200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354415c250 con 0x7f35440b8720 2024-05-26T15:41:20.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.699+0000 7f3543200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354415b3c0 con 0x7f35440d1310 2024-05-26T15:41:20.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.700+0000 7f3542800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35441600d0 0x7f3544154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.700+0000 7f3542800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35441600d0 0x7f3544154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58434/0 (socket says 172.21.15.8:58434) 2024-05-26T15:41:20.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.700+0000 7f3542800640 1 -- 172.21.15.8:0/567242733 learned_addr learned my addr 172.21.15.8:0/567242733 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:20.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.700+0000 7f3541e00640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35440b8720 0x7f354414ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.700 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.700+0000 7f353be00640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35440d1310 0x7f354415ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.700+0000 7f3542800640 1 -- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35440d1310 msgr2=0x7f354415ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.700+0000 7f3542800640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35440d1310 0x7f354415ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.700+0000 7f3542800640 1 -- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35440b8720 msgr2=0x7f354414ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.700+0000 7f3542800640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35440b8720 0x7f354414ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.700+0000 7f3542800640 1 -- 172.21.15.8:0/567242733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c009400 con 0x7f35441600d0 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.701+0000 7f3542800640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35441600d0 0x7f3544154c00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f353c00cb40 tx=0x7f353c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.701+0000 7f353a000640 1 -- 172.21.15.8:0/567242733 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c00aca0 con 0x7f35441600d0 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.701+0000 7f353a000640 1 -- 172.21.15.8:0/567242733 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c00ae00 con 0x7f35441600d0 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.701+0000 7f353a000640 1 -- 172.21.15.8:0/567242733 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c012620 con 0x7f35441600d0 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.701+0000 7f3543200640 1 -- 172.21.15.8:0/567242733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354415b640 con 0x7f35441600d0 2024-05-26T15:41:20.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.701+0000 7f3543200640 1 -- 172.21.15.8:0/567242733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354415bee0 con 0x7f35441600d0 2024-05-26T15:41:20.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.702+0000 7f3543200640 1 -- 172.21.15.8:0/567242733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354404e280 con 0x7f35441600d0 2024-05-26T15:41:20.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.703+0000 7f353a000640 1 -- 172.21.15.8:0/567242733 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f353c007070 con 0x7f35441600d0 2024-05-26T15:41:20.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.704+0000 7f353a000640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f352006ac00 0x7f352006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:20.703 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.704+0000 7f353a000640 1 -- 172.21.15.8:0/567242733 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f353c0895e0 con 0x7f35441600d0 2024-05-26T15:41:20.704 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.705+0000 7f3541e00640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f352006ac00 0x7f352006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:20.705 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.705+0000 7f3541e00640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f352006ac00 0x7f352006d0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f354415e6c0 tx=0x7f3534008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:20.707 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.708+0000 7f353a000640 1 -- 172.21.15.8:0/567242733 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f353c054560 con 0x7f35441600d0 2024-05-26T15:41:20.946 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.947+0000 7f3543200640 1 -- 172.21.15.8:0/567242733 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f354415c390 con 0x7f35441600d0 2024-05-26T15:41:20.947 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.947+0000 7f353a000640 1 -- 172.21.15.8:0/567242733 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f353c057b80 con 0x7f35441600d0 2024-05-26T15:41:20.947 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-26T15:41:20.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.950+0000 7f3543200640 1 -- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f352006ac00 msgr2=0x7f352006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.950+0000 7f3543200640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f352006ac00 0x7f352006d0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f354415e6c0 tx=0x7f3534008040 comp rx=0 tx=0).stop 2024-05-26T15:41:20.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.950+0000 7f3543200640 1 -- 172.21.15.8:0/567242733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35441600d0 msgr2=0x7f3544154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:20.950 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.950+0000 7f3543200640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35441600d0 0x7f3544154c00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f353c00cb40 tx=0x7f353c00a060 comp rx=0 tx=0).stop 2024-05-26T15:41:20.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.951+0000 7f3543200640 1 -- 172.21.15.8:0/567242733 shutdown_connections 2024-05-26T15:41:20.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.951+0000 7f3543200640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35441600d0 0x7f3544154c00 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.951+0000 7f3543200640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35440d1310 0x7f354415ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.951+0000 7f3543200640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f352006ac00 0x7f352006d0c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.951+0000 7f3543200640 1 --2- 172.21.15.8:0/567242733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35440b8720 0x7f354414ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:20.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.951+0000 7f3543200640 1 -- 172.21.15.8:0/567242733 >> 172.21.15.8:0/567242733 conn(0x7f354406b750 msgr2=0x7f35440d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:20.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.951+0000 7f3543200640 1 -- 172.21.15.8:0/567242733 shutdown_connections 2024-05-26T15:41:20.951 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:20.951+0000 7f3543200640 1 -- 172.21.15.8:0/567242733 wait complete. 2024-05-26T15:41:20.970 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-26T15:41:20.970 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-26T15:41:20.970 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2024-05-26T15:41:20.970 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-26T15:41:20.970 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-26T15:41:20.970 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-26T15:41:20.970 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-26T15:41:20.971 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-26T15:41:20.971 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-26T15:41:20.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:20.971 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:41:21.026 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42519sec preferred_lft 42519sec 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 66:ad:5c:c4:13:98 brd ff:ff:ff:ff:ff:ff 2024-05-26T15:41:21.027 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::10c6:16ff:feae:cd5d/64 scope link 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether f6:a8:54:01:f3:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::f4a8:54ff:fe01:f3ce/64 scope link 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 66:ad:5c:c4:13:98 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::64ad:5cff:fec4:1398/64 scope link 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:41:21.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:21.028 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-26T15:41:21.116 INFO:teuthology.orchestra.run.smithi008.stdout:1 2024-05-26T15:41:21.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:21.120 DEBUG:teuthology.orchestra.run.smithi008:> route 2024-05-26T15:41:21.176 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2024-05-26T15:41:21.176 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-26T15:41:21.176 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-26T15:41:21.177 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-26T15:41:21.177 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-26T15:41:21.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:21.178 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:41:21.178 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:41:21.178 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-26T15:41:21.178 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-26T15:41:21.178 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-26T15:41:21.178 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:41:21.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:21.339 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-05-26T15:41:21.392 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-26T15:41:21.392 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-26T15:41:21.393 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-26T15:41:21.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:21.393 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2024-05-26T15:41:21.481 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:41:21.481 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-26T15:41:21.539 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-26T15:41:21.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:41:21.539 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-26T15:41:21.591 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-26T15:41:21.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:21.591 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:41:21.721 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:41:21.722 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-26T15:41:21.722 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:41:21.749 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:41:21.749 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-26T15:41:21.749 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:41:21.749 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:41:21.749 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:41:21.783 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:41:21.783 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-26T15:41:21.783 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:41:21.783 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:41:21.783 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:41:21.783 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790" 2024-05-26T15:41:21.783 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790:/ 2024-05-26T15:41:21.783 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=03132396-4584-4cf0-b2e0-b5ae6040045e" will pass to kernel 2024-05-26T15:41:21.786 INFO:teuthology.orchestra.run.smithi008.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-26T15:41:21.786 INFO:teuthology.orchestra.run.smithi008.stdout: You just mounted a file system that supports labels which does not 2024-05-26T15:41:21.786 INFO:teuthology.orchestra.run.smithi008.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-26T15:41:21.786 INFO:teuthology.orchestra.run.smithi008.stdout: applications will generate AVC messages and not be allowed access to 2024-05-26T15:41:21.786 INFO:teuthology.orchestra.run.smithi008.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-26T15:41:21.790 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-26T15:41:21.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:21.791 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-26T15:41:21.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:21.875 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:41:21.954 INFO:teuthology.orchestra.run.smithi008.stdout:client5499 2024-05-26T15:41:21.955 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:21.955 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:22.015 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-26T15:41:22.020 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-26T15:41:22.152 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2024-05-26T15:41:22.153 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2024-05-26T15:41:22.153 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-26T15:41:22.153 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2024-05-26T15:41:22.153 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.154 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2024-05-26T15:41:22.154 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.154 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2024-05-26T15:41:22.154 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.154 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2024-05-26T15:41:22.155 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2024-05-26T15:41:22.155 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.155 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2024-05-26T15:41:22.155 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2024-05-26T15:41:22.155 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.155 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-26T15:41:22.156 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2024-05-26T15:41:22.156 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.156 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2024-05-26T15:41:22.156 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-26T15:41:22.156 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.157 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2024-05-26T15:41:22.157 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.157 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2024-05-26T15:41:22.157 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2024-05-26T15:41:22.157 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2024-05-26T15:41:22.157 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2024-05-26T15:41:22.158 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2024-05-26T15:41:22.158 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2024-05-26T15:41:22.158 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2024-05-26T15:41:22.158 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-26T15:41:22.158 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-26T15:41:22.158 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2024-05-26T15:41:22.159 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.159 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-26T15:41:22.159 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.159 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2024-05-26T15:41:22.159 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.160 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2024-05-26T15:41:22.160 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.160 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2024-05-26T15:41:22.160 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2024-05-26T15:41:22.160 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2024-05-26T15:41:22.161 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-26T15:41:22.161 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2024-05-26T15:41:22.161 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:41:22.161 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.161 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2024-05-26T15:41:22.161 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2024-05-26T15:41:22.162 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.162 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2024-05-26T15:41:22.162 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2024-05-26T15:41:22.162 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2024-05-26T15:41:22.162 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.163 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2024-05-26T15:41:22.163 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2024-05-26T15:41:22.163 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.163 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2024-05-26T15:41:22.163 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2024-05-26T15:41:22.163 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2024-05-26T15:41:22.164 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.164 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2024-05-26T15:41:22.164 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2024-05-26T15:41:22.164 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.164 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2024-05-26T15:41:22.165 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.165 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2024-05-26T15:41:22.165 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.165 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2024-05-26T15:41:22.165 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.165 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2024-05-26T15:41:22.166 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2024-05-26T15:41:22.166 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.166 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2024-05-26T15:41:22.166 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2024-05-26T15:41:22.166 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2024-05-26T15:41:22.166 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2024-05-26T15:41:22.167 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 20 2024-05-26T15:41:22.167 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 20 2024-05-26T15:41:22.167 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:41:22.167 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2024-05-26T15:41:22.167 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 10 2024-05-26T15:41:22.167 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2024-05-26T15:41:22.168 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2024-05-26T15:41:22.168 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2024-05-26T15:41:22.168 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2024-05-26T15:41:22.168 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2024-05-26T15:41:22.168 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-05-26T15:41:22.169 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.169 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2024-05-26T15:41:22.169 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:41:22.169 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2024-05-26T15:41:22.169 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-05-26T15:41:22.169 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-05-26T15:41:22.169 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:41:22.170 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:41:22.170 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2024-05-26T15:41:22.170 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.170 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2024-05-26T15:41:22.170 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:41:22.171 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-05-26T15:41:22.171 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2024-05-26T15:41:22.171 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-05-26T15:41:22.171 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2024-05-26T15:41:22.171 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2024-05-26T15:41:22.172 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:41:22.172 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2024-05-26T15:41:22.172 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2024-05-26T15:41:22.172 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:41:22.172 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.172 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-26T15:41:22.173 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2024-05-26T15:41:22.173 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2024-05-26T15:41:22.173 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.173 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2024-05-26T15:41:22.173 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-26T15:41:22.173 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-26T15:41:22.174 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.174 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2024-05-26T15:41:22.174 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2024-05-26T15:41:22.174 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.174 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2024-05-26T15:41:22.174 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2024-05-26T15:41:22.175 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.175 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2024-05-26T15:41:22.175 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2024-05-26T15:41:22.175 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2024-05-26T15:41:22.175 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2024-05-26T15:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-26T15:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-26T15:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2024-05-26T15:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2024-05-26T15:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:41:22.176 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = "" 2024-05-26T15:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-05-26T15:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-05-26T15:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2024-05-26T15:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2024-05-26T15:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2024-05-26T15:41:22.177 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2024-05-26T15:41:22.178 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2024-05-26T15:41:22.178 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2024-05-26T15:41:22.178 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2024-05-26T15:41:22.178 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2024-05-26T15:41:22.178 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2024-05-26T15:41:22.179 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds balancer = 20 2024-05-26T15:41:22.179 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:41:22.179 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2024-05-26T15:41:22.179 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2024-05-26T15:41:22.179 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2024-05-26T15:41:22.179 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2024-05-26T15:41:22.180 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-05-26T15:41:22.180 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-05-26T15:41:22.180 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-05-26T15:41:22.180 INFO:teuthology.orchestra.run.smithi008.stdout: osd_deep_scrub_large_omap_object_key_threshold = 5 2024-05-26T15:41:22.181 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-05-26T15:41:22.181 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-05-26T15:41:22.181 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-26T15:41:22.181 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-05-26T15:41:22.181 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.182 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-05-26T15:41:22.182 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.182 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-05-26T15:41:22.182 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.182 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-05-26T15:41:22.182 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-05-26T15:41:22.183 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.183 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-05-26T15:41:22.183 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-05-26T15:41:22.183 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.183 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-26T15:41:22.183 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-05-26T15:41:22.184 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.184 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-05-26T15:41:22.184 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-26T15:41:22.184 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.184 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-05-26T15:41:22.184 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.185 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-05-26T15:41:22.185 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-05-26T15:41:22.185 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-05-26T15:41:22.185 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-05-26T15:41:22.185 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-05-26T15:41:22.185 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-05-26T15:41:22.186 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-05-26T15:41:22.186 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-26T15:41:22.186 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-26T15:41:22.186 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-05-26T15:41:22.186 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.187 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-26T15:41:22.187 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.187 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-05-26T15:41:22.187 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.187 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-05-26T15:41:22.188 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.188 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-05-26T15:41:22.188 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-05-26T15:41:22.188 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-05-26T15:41:22.188 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-26T15:41:22.188 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on skipped message = False 2024-05-26T15:41:22.189 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:41:22.189 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.189 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-05-26T15:41:22.189 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-05-26T15:41:22.189 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.189 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-05-26T15:41:22.190 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-05-26T15:41:22.190 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-05-26T15:41:22.190 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.190 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-05-26T15:41:22.190 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-05-26T15:41:22.191 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.191 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-05-26T15:41:22.191 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-05-26T15:41:22.191 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-05-26T15:41:22.191 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.192 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-05-26T15:41:22.192 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-05-26T15:41:22.192 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.192 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-05-26T15:41:22.192 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.192 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-05-26T15:41:22.193 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.193 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-05-26T15:41:22.193 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.193 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-05-26T15:41:22.193 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-05-26T15:41:22.193 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.194 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-05-26T15:41:22.194 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-05-26T15:41:22.194 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-05-26T15:41:22.194 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-05-26T15:41:22.194 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 20 2024-05-26T15:41:22.194 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 20 2024-05-26T15:41:22.195 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:41:22.195 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-05-26T15:41:22.195 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 10 2024-05-26T15:41:22.195 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-05-26T15:41:22.195 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-05-26T15:41:22.196 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-05-26T15:41:22.196 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-05-26T15:41:22.196 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-05-26T15:41:22.196 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-26T15:41:22.196 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.196 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-05-26T15:41:22.197 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:41:22.197 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-05-26T15:41:22.197 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-26T15:41:22.197 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-26T15:41:22.197 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:41:22.198 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:41:22.198 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-05-26T15:41:22.198 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.198 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-05-26T15:41:22.198 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:41:22.198 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-26T15:41:22.199 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-05-26T15:41:22.199 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-26T15:41:22.199 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-05-26T15:41:22.199 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-05-26T15:41:22.199 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:41:22.199 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-05-26T15:41:22.200 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-05-26T15:41:22.200 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:41:22.200 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.200 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-26T15:41:22.200 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-05-26T15:41:22.200 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-05-26T15:41:22.201 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.201 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-05-26T15:41:22.201 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-26T15:41:22.201 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-26T15:41:22.201 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.202 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-05-26T15:41:22.202 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-05-26T15:41:22.202 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.202 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-05-26T15:41:22.202 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-05-26T15:41:22.202 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:41:22.203 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-05-26T15:41:22.203 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-05-26T15:41:22.203 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-05-26T15:41:22.203 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-05-26T15:41:22.203 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-26T15:41:22.203 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-26T15:41:22.204 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-05-26T15:41:22.204 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-26T15:41:22.204 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:41:22.204 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = "" 2024-05-26T15:41:22.204 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-26T15:41:22.204 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-26T15:41:22.204 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-05-26T15:41:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-05-26T15:41:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-05-26T15:41:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-26T15:41:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-26T15:41:22.205 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-26T15:41:22.206 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-26T15:41:22.206 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-05-26T15:41:22.206 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-05-26T15:41:22.206 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-05-26T15:41:22.207 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:41:22.207 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-05-26T15:41:22.207 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-05-26T15:41:22.207 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-05-26T15:41:22.207 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-05-26T15:41:22.208 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-26T15:41:22.208 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-26T15:41:22.208 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-26T15:41:22.208 INFO:teuthology.orchestra.run.smithi047.stdout: osd_deep_scrub_large_omap_object_key_threshold = 5 2024-05-26T15:41:22.215 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-26T15:41:22.215 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-26T15:41:22.216 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-26T15:41:22.216 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:41:22.216 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-26T15:41:22.216 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-26T15:41:22.217 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-26T15:41:22.217 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:41:22.217 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-26T15:41:22.217 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-26T15:41:22.217 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-26T15:41:22.217 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:41:22.217 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-26T15:41:22.218 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-26T15:41:22.218 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-26T15:41:22.218 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:41:22.236 INFO:tasks.ceph.mds.b:Stopped 2024-05-26T15:41:22.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-26T15:41:22.239 INFO:tasks.ceph.mds.d:Stopped 2024-05-26T15:41:22.239 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-26T15:41:22.242 INFO:tasks.ceph.mds.a:Stopped 2024-05-26T15:41:22.242 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-26T15:41:22.248 INFO:tasks.ceph.mds.c:Stopped 2024-05-26T15:41:22.249 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-26T15:41:22.287 INFO:tasks.ceph.mds.b:Started 2024-05-26T15:41:22.287 DEBUG:teuthology.parallel:result is None 2024-05-26T15:41:22.293 INFO:tasks.ceph.mds.d:Started 2024-05-26T15:41:22.293 DEBUG:teuthology.parallel:result is None 2024-05-26T15:41:22.296 INFO:tasks.ceph.mds.a:Started 2024-05-26T15:41:22.296 DEBUG:teuthology.parallel:result is None 2024-05-26T15:41:22.302 INFO:tasks.ceph.mds.c:Started 2024-05-26T15:41:22.302 DEBUG:teuthology.parallel:result is None 2024-05-26T15:41:22.302 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:41:22.443 INFO:tasks.ceph.mds.b.smithi047.stdout:starting mds.b at 2024-05-26T15:41:22.448 INFO:tasks.ceph.mds.d.smithi047.stdout:starting mds.d at 2024-05-26T15:41:22.449 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2024-05-26T15:41:22.451 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2024-05-26T15:41:22.452 INFO:tasks.ceph.mon.a.smithi008.stderr:2024-05-26T15:41:22.453+0000 7f3e01a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-26T15:41:22.472 INFO:tasks.ceph.mon.a.smithi008.stderr:2024-05-26T15:41:22.473+0000 7f3e01a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-26T15:41:22.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.488+0000 7fc4db200640 1 Processor -- start 2024-05-26T15:41:22.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.489+0000 7fc4db200640 1 -- start start 2024-05-26T15:41:22.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.491+0000 7fc4db200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc4dc06a490 0x7fc4dc0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:22.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.491+0000 7fc4db200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4dc099010 0x7fc4dc15afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:22.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.491+0000 7fc4db200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4dc0cd480 con 0x7fc4dc0ce950 2024-05-26T15:41:22.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.491+0000 7fc4db200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc0cb630 con 0x7fc4dc06a490 2024-05-26T15:41:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.491+0000 7fc4db200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc15b830 con 0x7fc4dc099010 2024-05-26T15:41:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.491+0000 7fc4d9e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc4dc06a490 0x7fc4dc0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.492+0000 7fc4d9e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc4dc06a490 0x7fc4dc0cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45406/0 (socket says 172.21.15.8:45406) 2024-05-26T15:41:22.491 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.492+0000 7fc4d9e00640 1 -- 172.21.15.8:0/3903899848 learned_addr learned my addr 172.21.15.8:0/3903899848 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:22.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.492+0000 7fc4d9400640 1 --2- 172.21.15.8:0/3903899848 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4dc099010 0x7fc4dc15afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:22.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.492+0000 7fc4d9e00640 1 -- 172.21.15.8:0/3903899848 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4dc099010 msgr2=0x7fc4dc15afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:22.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.492+0000 7fc4d9e00640 1 --2- 172.21.15.8:0/3903899848 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4dc099010 0x7fc4dc15afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:22.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.492+0000 7fc4d9e00640 1 -- 172.21.15.8:0/3903899848 >> v1:172.21.15.47:6789/0 conn(0x7fc4dc0ce950 legacy=0x7fc4dc0cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:22.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.492+0000 7fc4d9e00640 1 -- 172.21.15.8:0/3903899848 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc15bad0 con 0x7fc4dc06a490 2024-05-26T15:41:22.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.494+0000 7fc4d9e00640 1 --2- 172.21.15.8:0/3903899848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc06a490 0x7fc4dc0cb0f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009870 tx=0x7fc4cc02e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ec24358acb39c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.495+0000 7fc4d8a00640 1 -- 172.21.15.8:0/3903899848 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc033510 con 0x7fc4dc06a490 2024-05-26T15:41:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.495+0000 7fc4d8a00640 1 -- 172.21.15.8:0/3903899848 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc031050 con 0x7fc4dc06a490 2024-05-26T15:41:22.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.495+0000 7fc4d8a00640 1 -- 172.21.15.8:0/3903899848 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc033890 con 0x7fc4dc06a490 2024-05-26T15:41:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.496+0000 7fc4db200640 1 -- 172.21.15.8:0/3903899848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc06a490 msgr2=0x7fc4dc0cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.496+0000 7fc4db200640 1 --2- 172.21.15.8:0/3903899848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc06a490 0x7fc4dc0cb0f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009870 tx=0x7fc4cc02e620 comp rx=0 tx=0).stop 2024-05-26T15:41:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.496+0000 7fc4db200640 1 -- 172.21.15.8:0/3903899848 shutdown_connections 2024-05-26T15:41:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.496+0000 7fc4db200640 1 --2- 172.21.15.8:0/3903899848 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4dc099010 0x7fc4dc15afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.496+0000 7fc4db200640 1 --2- 172.21.15.8:0/3903899848 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc06a490 0x7fc4dc0cb0f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.496+0000 7fc4db200640 1 -- 172.21.15.8:0/3903899848 >> 172.21.15.8:0/3903899848 conn(0x7fc4dc098a40 msgr2=0x7fc4dc0b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.496+0000 7fc4db200640 1 -- 172.21.15.8:0/3903899848 shutdown_connections 2024-05-26T15:41:22.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.497+0000 7fc4db200640 1 -- 172.21.15.8:0/3903899848 wait complete. 2024-05-26T15:41:22.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.499+0000 7fc4db200640 1 Processor -- start 2024-05-26T15:41:22.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.499+0000 7fc4db200640 1 -- start start 2024-05-26T15:41:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4db200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4dc06a490 0x7fc4dc150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4db200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc099010 0x7fc4dc0ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4db200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4dc0ce950 0x7fc4dc15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4db200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0adc00 con 0x7fc4dc099010 2024-05-26T15:41:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4db200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0acff0 con 0x7fc4dc0ce950 2024-05-26T15:41:22.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4db200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc0ad2d0 con 0x7fc4dc06a490 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4d9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc099010 0x7fc4dc0ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4d9e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4dc06a490 0x7fc4dc150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4d9400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc099010 0x7fc4dc0ac610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45420/0 (socket says 172.21.15.8:45420) 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4d9400640 1 -- 172.21.15.8:0/329687485 learned_addr learned my addr 172.21.15.8:0/329687485 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.501+0000 7fc4da800640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4dc0ce950 0x7fc4dc15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.502+0000 7fc4d9400640 1 -- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4dc06a490 msgr2=0x7fc4dc150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.502+0000 7fc4d9400640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4dc06a490 0x7fc4dc150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.502+0000 7fc4d9400640 1 -- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4dc0ce950 msgr2=0x7fc4dc15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.502+0000 7fc4d9400640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4dc0ce950 0x7fc4dc15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.502+0000 7fc4d9400640 1 -- 172.21.15.8:0/329687485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc0094d0 con 0x7fc4dc099010 2024-05-26T15:41:22.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.502+0000 7fc4d9400640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc099010 0x7fc4dc0ac610 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800c7f0 tx=0x7fc4c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.502+0000 7fc4d2000640 1 -- 172.21.15.8:0/329687485 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8004220 con 0x7fc4dc099010 2024-05-26T15:41:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.502+0000 7fc4d2000640 1 -- 172.21.15.8:0/329687485 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c80043a0 con 0x7fc4dc099010 2024-05-26T15:41:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.502+0000 7fc4d2000640 1 -- 172.21.15.8:0/329687485 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8007860 con 0x7fc4dc099010 2024-05-26T15:41:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.502+0000 7fc4db200640 1 -- 172.21.15.8:0/329687485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc0ad5b0 con 0x7fc4dc099010 2024-05-26T15:41:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.503+0000 7fc4db200640 1 -- 172.21.15.8:0/329687485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc1509c0 con 0x7fc4dc099010 2024-05-26T15:41:22.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.504+0000 7fc4db200640 1 -- 172.21.15.8:0/329687485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4dc0add70 con 0x7fc4dc099010 2024-05-26T15:41:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.505+0000 7fc4d2000640 1 -- 172.21.15.8:0/329687485 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc4c8007bd0 con 0x7fc4dc099010 2024-05-26T15:41:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.506+0000 7fc4d2000640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4bc06ac00 0x7fc4bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.506+0000 7fc4d2000640 1 -- 172.21.15.8:0/329687485 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fc4c80894a0 con 0x7fc4dc099010 2024-05-26T15:41:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.506+0000 7fc4d9e00640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4bc06ac00 0x7fc4bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.507+0000 7fc4d9e00640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4bc06ac00 0x7fc4bc06d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc037000 tx=0x7fc4cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:22.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.513+0000 7fc4d2000640 1 -- 172.21.15.8:0/329687485 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc4c80544a0 con 0x7fc4dc099010 2024-05-26T15:41:22.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.772+0000 7fc4db200640 1 -- 172.21.15.8:0/329687485 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4dc04e210 con 0x7fc4dc099010 2024-05-26T15:41:22.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.773+0000 7fc4d2000640 1 -- 172.21.15.8:0/329687485 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4723 (secure 0 0 0) 0x7fc4c8057ac0 con 0x7fc4dc099010 2024-05-26T15:41:22.773 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:22.773 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/481709676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":481709676},{"type":"v1","addr":"172.21.15.47:6837","nonce":481709676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/463162567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":463162567},{"type":"v1","addr":"172.21.15.8:6834","nonce":463162567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2479192780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":2479192780},{"type":"v1","addr":"172.21.15.8:6835","nonce":2479192780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:41:13.704888+0000","modified":"2024-05-26T15:41:22.483512+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5122":{"gid":5122,"name":"b","rank":0,"incarnation":20,"state":"up:replay","state_seq":1,"addr":"172.21.15.47:6835/1710654961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1710654961},{"type":"v1","addr":"172.21.15.47:6835","nonce":1710654961}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-26T15:41:22.774 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 20 2024-05-26T15:41:22.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.776+0000 7fc4db200640 1 -- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4bc06ac00 msgr2=0x7fc4bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:22.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4bc06ac00 0x7fc4bc06d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc037000 tx=0x7fc4cc008030 comp rx=0 tx=0).stop 2024-05-26T15:41:22.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 -- 172.21.15.8:0/329687485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc099010 msgr2=0x7fc4dc0ac610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:22.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc099010 0x7fc4dc0ac610 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800c7f0 tx=0x7fc4c800ccb0 comp rx=0 tx=0).stop 2024-05-26T15:41:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 -- 172.21.15.8:0/329687485 shutdown_connections 2024-05-26T15:41:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc4bc06ac00 0x7fc4bc06d0c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4dc0ce950 0x7fc4dc15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4dc099010 0x7fc4dc0ac610 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 --2- 172.21.15.8:0/329687485 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc4dc06a490 0x7fc4dc150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 -- 172.21.15.8:0/329687485 >> 172.21.15.8:0/329687485 conn(0x7fc4dc098a40 msgr2=0x7fc4dc151890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 -- 172.21.15.8:0/329687485 shutdown_connections 2024-05-26T15:41:22.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:22.777+0000 7fc4db200640 1 -- 172.21.15.8:0/329687485 wait complete. 2024-05-26T15:41:23.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-26T15:41:13.704888+0000', 'modified': '2024-05-26T15:41:22.483512+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5122}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5122': {'gid': 5122, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.47:6835/1710654961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 1710654961}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 1710654961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-26T15:41:23.196 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5122:up:replay 2024-05-26T15:41:24.197 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:41:24.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.419+0000 7fbdd2800640 1 Processor -- start 2024-05-26T15:41:24.418 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.419+0000 7fbdd2800640 1 -- start start 2024-05-26T15:41:24.420 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.421+0000 7fbdd2800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbdcc0cb160 0x7fbdcc070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:24.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.421+0000 7fbdd2800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbdcc070ab0 0x7fbdcc06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:24.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.421+0000 7fbdd2800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdcc070ee0 con 0x7fbdcc144180 2024-05-26T15:41:24.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.421+0000 7fbdd2800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdcc0cb5f0 con 0x7fbdcc070ab0 2024-05-26T15:41:24.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.421+0000 7fbdd2800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdcc144560 con 0x7fbdcc0cb160 2024-05-26T15:41:24.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.421+0000 7fbdd1e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbdcc070ab0 0x7fbdcc06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:24.421 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.421+0000 7fbdd1e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbdcc070ab0 0x7fbdcc06c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45436/0 (socket says 172.21.15.8:45436) 2024-05-26T15:41:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.421+0000 7fbdd1e00640 1 -- 172.21.15.8:0/3967520910 learned_addr learned my addr 172.21.15.8:0/3967520910 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.422+0000 7fbdd1e00640 1 -- 172.21.15.8:0/3967520910 >> v2:172.21.15.47:3300/0 conn(0x7fbdcc0cb160 msgr2=0x7fbdcc070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.422+0000 7fbdd1e00640 1 --2- 172.21.15.8:0/3967520910 >> v2:172.21.15.47:3300/0 conn(0x7fbdcc0cb160 0x7fbdcc070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.422+0000 7fbdd1e00640 1 -- 172.21.15.8:0/3967520910 >> v1:172.21.15.8:6789/0 conn(0x7fbdcc144180 legacy=0x7fbdcc06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:24.422 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.422+0000 7fbdd1e00640 1 -- 172.21.15.8:0/3967520910 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc15b190 con 0x7fbdcc070ab0 2024-05-26T15:41:24.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.423+0000 7fbdd1e00640 1 --2- 172.21.15.8:0/3967520910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 0x7fbdcc06c8b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc06abd0 tx=0x7fbdc402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45bc63b98fb8c7c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:24.428 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.423+0000 7fbdcbe00640 1 -- 172.21.15.8:0/3967520910 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4031600 con 0x7fbdcc070ab0 2024-05-26T15:41:24.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.423+0000 7fbdcbe00640 1 -- 172.21.15.8:0/3967520910 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc402d050 con 0x7fbdcc070ab0 2024-05-26T15:41:24.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.423+0000 7fbdcbe00640 1 -- 172.21.15.8:0/3967520910 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4031980 con 0x7fbdcc070ab0 2024-05-26T15:41:24.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.424+0000 7fbdd2800640 1 -- 172.21.15.8:0/3967520910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 msgr2=0x7fbdcc06c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:24.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.424+0000 7fbdd2800640 1 --2- 172.21.15.8:0/3967520910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 0x7fbdcc06c8b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc06abd0 tx=0x7fbdc402a730 comp rx=0 tx=0).stop 2024-05-26T15:41:24.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.424+0000 7fbdd2800640 1 -- 172.21.15.8:0/3967520910 shutdown_connections 2024-05-26T15:41:24.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.424+0000 7fbdd2800640 1 --2- 172.21.15.8:0/3967520910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 0x7fbdcc06c8b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:24.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.424+0000 7fbdd2800640 1 --2- 172.21.15.8:0/3967520910 >> v2:172.21.15.47:3300/0 conn(0x7fbdcc0cb160 0x7fbdcc070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:24.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.424+0000 7fbdd2800640 1 -- 172.21.15.8:0/3967520910 >> 172.21.15.8:0/3967520910 conn(0x7fbdcc069ed0 msgr2=0x7fbdcc06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:24.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.424+0000 7fbdd2800640 1 -- 172.21.15.8:0/3967520910 shutdown_connections 2024-05-26T15:41:24.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.424+0000 7fbdd2800640 1 -- 172.21.15.8:0/3967520910 wait complete. 2024-05-26T15:41:24.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.426+0000 7fbdd2800640 1 Processor -- start 2024-05-26T15:41:24.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.426+0000 7fbdd2800640 1 -- start start 2024-05-26T15:41:24.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd2800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 0x7fbdcc136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:24.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd2800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdcc0cb160 0x7fbdcc0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:24.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdcc144180 0x7fbdcc15d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:24.431 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd2800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0b3280 con 0x7fbdcc070ab0 2024-05-26T15:41:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd2800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc137410 con 0x7fbdcc144180 2024-05-26T15:41:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd2800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc141a50 con 0x7fbdcc0cb160 2024-05-26T15:41:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 0x7fbdcc136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd1400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 0x7fbdcc136ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45446/0 (socket says 172.21.15.8:45446) 2024-05-26T15:41:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd1400640 1 -- 172.21.15.8:0/2682777153 learned_addr learned my addr 172.21.15.8:0/2682777153 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:24.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd1400640 1 -- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdcc0cb160 msgr2=0x7fbdcc0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:24.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd1400640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdcc0cb160 0x7fbdcc0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:24.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd1400640 1 -- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdcc144180 msgr2=0x7fbdcc15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:24.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd1400640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdcc144180 0x7fbdcc15d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:24.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.427+0000 7fbdd1400640 1 -- 172.21.15.8:0/2682777153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4009b30 con 0x7fbdcc070ab0 2024-05-26T15:41:24.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.428+0000 7fbdd1400640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 0x7fbdcc136ed0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000c390 tx=0x7fbdc000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:24.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.428+0000 7fbdc9600640 1 -- 172.21.15.8:0/2682777153 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00052d0 con 0x7fbdcc070ab0 2024-05-26T15:41:24.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.428+0000 7fbdc9600640 1 -- 172.21.15.8:0/2682777153 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc0005450 con 0x7fbdcc070ab0 2024-05-26T15:41:24.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.428+0000 7fbdc9600640 1 -- 172.21.15.8:0/2682777153 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0003830 con 0x7fbdcc070ab0 2024-05-26T15:41:24.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.428+0000 7fbdd2800640 1 -- 172.21.15.8:0/2682777153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdcc0b2700 con 0x7fbdcc070ab0 2024-05-26T15:41:24.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.428+0000 7fbdd2800640 1 -- 172.21.15.8:0/2682777153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdcc0b2cc0 con 0x7fbdcc070ab0 2024-05-26T15:41:24.435 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.429+0000 7fbdd2800640 1 -- 172.21.15.8:0/2682777153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdcc04e210 con 0x7fbdcc070ab0 2024-05-26T15:41:24.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.430+0000 7fbdc9600640 1 -- 172.21.15.8:0/2682777153 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbdc0003990 con 0x7fbdcc070ab0 2024-05-26T15:41:24.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.431+0000 7fbdc9600640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbdac06ac00 0x7fbdac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.431+0000 7fbdc9600640 1 -- 172.21.15.8:0/2682777153 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fbdc0088b70 con 0x7fbdcc070ab0 2024-05-26T15:41:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.432+0000 7fbdd0a00640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbdac06ac00 0x7fbdac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.433+0000 7fbdd0a00640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbdac06ac00 0x7fbdac06d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc067110 tx=0x7fbdb8006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:24.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.436+0000 7fbdc9600640 1 -- 172.21.15.8:0/2682777153 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbdc0053ac0 con 0x7fbdcc070ab0 2024-05-26T15:41:24.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.674+0000 7fbdd2800640 1 -- 172.21.15.8:0/2682777153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdcc0b0ba0 con 0x7fbdcc070ab0 2024-05-26T15:41:24.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.675+0000 7fbdc9600640 1 -- 172.21.15.8:0/2682777153 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4723 (secure 0 0 0) 0x7fbdc0017090 con 0x7fbdcc070ab0 2024-05-26T15:41:24.674 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:24.675 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/481709676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":481709676},{"type":"v1","addr":"172.21.15.47:6837","nonce":481709676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/463162567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":463162567},{"type":"v1","addr":"172.21.15.8:6834","nonce":463162567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2479192780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":2479192780},{"type":"v1","addr":"172.21.15.8:6835","nonce":2479192780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:41:13.704888+0000","modified":"2024-05-26T15:41:24.494752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5122":{"gid":5122,"name":"b","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.47:6835/1710654961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1710654961},{"type":"v1","addr":"172.21.15.47:6835","nonce":1710654961}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-26T15:41:24.675 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 22 2024-05-26T15:41:24.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.677+0000 7fbdd2800640 1 -- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbdac06ac00 msgr2=0x7fbdac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.677+0000 7fbdd2800640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbdac06ac00 0x7fbdac06d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc067110 tx=0x7fbdb8006c90 comp rx=0 tx=0).stop 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.678+0000 7fbdd2800640 1 -- 172.21.15.8:0/2682777153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 msgr2=0x7fbdcc136ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.678+0000 7fbdd2800640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 0x7fbdcc136ed0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000c390 tx=0x7fbdc000c850 comp rx=0 tx=0).stop 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.678+0000 7fbdd2800640 1 -- 172.21.15.8:0/2682777153 shutdown_connections 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.678+0000 7fbdd2800640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbdac06ac00 0x7fbdac06d0c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.678+0000 7fbdd2800640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdcc144180 0x7fbdcc15d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.678+0000 7fbdd2800640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbdcc0cb160 0x7fbdcc0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.678+0000 7fbdd2800640 1 --2- 172.21.15.8:0/2682777153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbdcc070ab0 0x7fbdcc136ed0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.678+0000 7fbdd2800640 1 -- 172.21.15.8:0/2682777153 >> 172.21.15.8:0/2682777153 conn(0x7fbdcc069ed0 msgr2=0x7fbdcc15e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.678+0000 7fbdd2800640 1 -- 172.21.15.8:0/2682777153 shutdown_connections 2024-05-26T15:41:24.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:24.678+0000 7fbdd2800640 1 -- 172.21.15.8:0/2682777153 wait complete. 2024-05-26T15:41:25.099 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-26T15:41:13.704888+0000', 'modified': '2024-05-26T15:41:24.494752+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5122}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5122': {'gid': 5122, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.47:6835/1710654961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 1710654961}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 1710654961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-26T15:41:25.099 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5122:up:rejoin 2024-05-26T15:41:26.100 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:41:26.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.322+0000 7f5f9e800640 1 Processor -- start 2024-05-26T15:41:26.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.322+0000 7f5f9e800640 1 -- start start 2024-05-26T15:41:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.323+0000 7f5f9e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f9815f230 0x7f5f9806e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.323+0000 7f5f9e800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5f9815ed30 0x7f5f9815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.323+0000 7f5f9e800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9806d380 con 0x7f5f981445d0 2024-05-26T15:41:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.323+0000 7f5f9e800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9806d660 con 0x7f5f9815ed30 2024-05-26T15:41:26.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.323+0000 7f5f9e800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9806d940 con 0x7f5f9815f230 2024-05-26T15:41:26.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.324+0000 7f5f97e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5f9815ed30 0x7f5f9815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:26.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.324+0000 7f5f97400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f5f981445d0 0x7f5f9815e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:37902/0 (socket says 172.21.15.8:37902) 2024-05-26T15:41:26.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.324+0000 7f5f97400640 1 -- 172.21.15.8:0/2218087585 learned_addr learned my addr 172.21.15.8:0/2218087585 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:26.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.324+0000 7f5f96a00640 1 --2- 172.21.15.8:0/2218087585 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f9815f230 0x7f5f9806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:26.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.325+0000 7f5f97e00640 1 -- 172.21.15.8:0/2218087585 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f9815f230 msgr2=0x7f5f9806e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:26.323 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.325+0000 7f5f97e00640 1 --2- 172.21.15.8:0/2218087585 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f9815f230 0x7f5f9806e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.325+0000 7f5f97e00640 1 -- 172.21.15.8:0/2218087585 >> v1:172.21.15.8:6789/0 conn(0x7f5f981445d0 legacy=0x7f5f9815e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:26.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.325+0000 7f5f97e00640 1 -- 172.21.15.8:0/2218087585 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9806dc20 con 0x7f5f9815ed30 2024-05-26T15:41:26.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.326+0000 7f5f97e00640 1 --2- 172.21.15.8:0/2218087585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 0x7f5f9815c400 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009d90 tx=0x7f5f9002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de663a429966bc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:26.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.326+0000 7f5f96000640 1 -- 172.21.15.8:0/2218087585 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90031600 con 0x7f5f9815ed30 2024-05-26T15:41:26.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.326+0000 7f5f96000640 1 -- 172.21.15.8:0/2218087585 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9002d050 con 0x7f5f9815ed30 2024-05-26T15:41:26.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.326+0000 7f5f96000640 1 -- 172.21.15.8:0/2218087585 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f90031980 con 0x7f5f9815ed30 2024-05-26T15:41:26.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.327+0000 7f5f9e800640 1 -- 172.21.15.8:0/2218087585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 msgr2=0x7f5f9815c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:26.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.327+0000 7f5f9e800640 1 --2- 172.21.15.8:0/2218087585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 0x7f5f9815c400 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009d90 tx=0x7f5f9002a5d0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.327+0000 7f5f9e800640 1 -- 172.21.15.8:0/2218087585 shutdown_connections 2024-05-26T15:41:26.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.327+0000 7f5f9e800640 1 --2- 172.21.15.8:0/2218087585 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 0x7f5f9815c400 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.327+0000 7f5f9e800640 1 --2- 172.21.15.8:0/2218087585 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f9815f230 0x7f5f9806e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.327+0000 7f5f9e800640 1 -- 172.21.15.8:0/2218087585 >> 172.21.15.8:0/2218087585 conn(0x7f5f980b0720 msgr2=0x7f5f980b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:26.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.327+0000 7f5f9e800640 1 -- 172.21.15.8:0/2218087585 shutdown_connections 2024-05-26T15:41:26.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.327+0000 7f5f9e800640 1 -- 172.21.15.8:0/2218087585 wait complete. 2024-05-26T15:41:26.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.329+0000 7f5f9e800640 1 Processor -- start 2024-05-26T15:41:26.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.329+0000 7f5f9e800640 1 -- start start 2024-05-26T15:41:26.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.330+0000 7f5f9e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f981445d0 0x7f5f980ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:26.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.330+0000 7f5f9e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 0x7f5f981f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:26.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.330+0000 7f5f9e800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f9815f230 0x7f5f980abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:26.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.330+0000 7f5f9e800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980ad040 con 0x7f5f9815ed30 2024-05-26T15:41:26.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.330+0000 7f5f9e800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98140d50 con 0x7f5f981445d0 2024-05-26T15:41:26.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.330+0000 7f5f9e800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980ac1d0 con 0x7f5f9815f230 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.331+0000 7f5f96a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 0x7f5f981f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.331+0000 7f5f96a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 0x7f5f981f6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45464/0 (socket says 172.21.15.8:45464) 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.331+0000 7f5f96a00640 1 -- 172.21.15.8:0/115775541 learned_addr learned my addr 172.21.15.8:0/115775541 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.331+0000 7f5f97e00640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f9815f230 0x7f5f980abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.331+0000 7f5f97400640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f981445d0 0x7f5f980ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.331+0000 7f5f96a00640 1 -- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f9815f230 msgr2=0x7f5f980abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.331+0000 7f5f96a00640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f9815f230 0x7f5f980abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.331+0000 7f5f96a00640 1 -- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f981445d0 msgr2=0x7f5f980ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.331+0000 7f5f96a00640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f981445d0 0x7f5f980ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.331+0000 7f5f96a00640 1 -- 172.21.15.8:0/115775541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f90009a70 con 0x7f5f9815ed30 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.332+0000 7f5f96a00640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 0x7f5f981f6c40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400d5f0 tx=0x7f5f8400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.332+0000 7f5f8f400640 1 -- 172.21.15.8:0/115775541 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f840125f0 con 0x7f5f9815ed30 2024-05-26T15:41:26.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.332+0000 7f5f8f400640 1 -- 172.21.15.8:0/115775541 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f84012750 con 0x7f5f9815ed30 2024-05-26T15:41:26.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.332+0000 7f5f8f400640 1 -- 172.21.15.8:0/115775541 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84012b00 con 0x7f5f9815ed30 2024-05-26T15:41:26.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.332+0000 7f5f9e800640 1 -- 172.21.15.8:0/115775541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f980ac430 con 0x7f5f9815ed30 2024-05-26T15:41:26.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.332+0000 7f5f9e800640 1 -- 172.21.15.8:0/115775541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f980ac9f0 con 0x7f5f9815ed30 2024-05-26T15:41:26.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.334+0000 7f5f9e800640 1 -- 172.21.15.8:0/115775541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f98071730 con 0x7f5f9815ed30 2024-05-26T15:41:26.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.335+0000 7f5f8f400640 1 -- 172.21.15.8:0/115775541 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f84012c60 con 0x7f5f9815ed30 2024-05-26T15:41:26.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.335+0000 7f5f8f400640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f7806ac00 0x7f5f7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:26.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.336+0000 7f5f8f400640 1 -- 172.21.15.8:0/115775541 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f5f84089a70 con 0x7f5f9815ed30 2024-05-26T15:41:26.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.336+0000 7f5f97400640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f7806ac00 0x7f5f7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:26.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.337+0000 7f5f97400640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f7806ac00 0x7f5f7806d0c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5f88005880 tx=0x7f5f88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:26.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.340+0000 7f5f8f400640 1 -- 172.21.15.8:0/115775541 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5f840549c0 con 0x7f5f9815ed30 2024-05-26T15:41:26.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.577+0000 7f5f9e800640 1 -- 172.21.15.8:0/115775541 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f9804e210 con 0x7f5f9815ed30 2024-05-26T15:41:26.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.578+0000 7f5f8f400640 1 -- 172.21.15.8:0/115775541 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f5f84057fe0 con 0x7f5f9815ed30 2024-05-26T15:41:26.576 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:26.576 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/481709676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":481709676},{"type":"v1","addr":"172.21.15.47:6837","nonce":481709676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/463162567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":463162567},{"type":"v1","addr":"172.21.15.8:6834","nonce":463162567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2479192780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":2479192780},{"type":"v1","addr":"172.21.15.8:6835","nonce":2479192780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:41:13.704888+0000","modified":"2024-05-26T15:41:26.509872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5122":{"gid":5122,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6835/1710654961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1710654961},{"type":"v1","addr":"172.21.15.47:6835","nonce":1710654961}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-26T15:41:26.577 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 24 2024-05-26T15:41:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.580+0000 7f5f9e800640 1 -- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f7806ac00 msgr2=0x7f5f7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.580+0000 7f5f9e800640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f7806ac00 0x7f5f7806d0c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5f88005880 tx=0x7f5f88009040 comp rx=0 tx=0).stop 2024-05-26T15:41:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.580+0000 7f5f9e800640 1 -- 172.21.15.8:0/115775541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 msgr2=0x7f5f981f6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.580+0000 7f5f9e800640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 0x7f5f981f6c40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400d5f0 tx=0x7f5f8400dab0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.580+0000 7f5f9e800640 1 -- 172.21.15.8:0/115775541 shutdown_connections 2024-05-26T15:41:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.580+0000 7f5f9e800640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f9815f230 0x7f5f980abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.580+0000 7f5f9e800640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f9815ed30 0x7f5f981f6c40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.580+0000 7f5f9e800640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f7806ac00 0x7f5f7806d0c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.580+0000 7f5f9e800640 1 --2- 172.21.15.8:0/115775541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f981445d0 0x7f5f980ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.580+0000 7f5f9e800640 1 -- 172.21.15.8:0/115775541 >> 172.21.15.8:0/115775541 conn(0x7f5f980b0720 msgr2=0x7f5f980cbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.581+0000 7f5f9e800640 1 -- 172.21.15.8:0/115775541 shutdown_connections 2024-05-26T15:41:26.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:26.581+0000 7f5f9e800640 1 -- 172.21.15.8:0/115775541 wait complete. 2024-05-26T15:41:27.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-26T15:41:13.704888+0000', 'modified': '2024-05-26T15:41:26.509872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5122}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5122': {'gid': 5122, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.47:6835/1710654961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 1710654961}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 1710654961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-26T15:41:27.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-26T15:41:27.001 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-26T15:41:27.222 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.224+0000 7ff805400640 1 Processor -- start 2024-05-26T15:41:27.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.224+0000 7ff805400640 1 -- start start 2024-05-26T15:41:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.226+0000 7ff805400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff800070850 0x7ff80006c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.226+0000 7ff805400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 0x7ff80015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.226+0000 7ff805400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8000a76b0 con 0x7ff800070c30 2024-05-26T15:41:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.226+0000 7ff805400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80015b320 con 0x7ff800070850 2024-05-26T15:41:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.226+0000 7ff805400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80006d500 con 0x7ff8000cc610 2024-05-26T15:41:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.226+0000 7ff7ffe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff800070850 0x7ff80006c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.226+0000 7ff7ffe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff800070850 0x7ff80006c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45476/0 (socket says 172.21.15.8:45476) 2024-05-26T15:41:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.226+0000 7ff7ffe00640 1 -- 172.21.15.8:0/3233346809 learned_addr learned my addr 172.21.15.8:0/3233346809 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:27.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.227+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/3233346809 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 0x7ff80015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.227+0000 7ff7ffe00640 1 -- 172.21.15.8:0/3233346809 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 msgr2=0x7ff80015eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:27.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.227+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/3233346809 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 0x7ff80015eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.227+0000 7ff7ffe00640 1 -- 172.21.15.8:0/3233346809 >> v1:172.21.15.47:6789/0 conn(0x7ff800070c30 legacy=0x7ff80015f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:27.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.227+0000 7ff7ffe00640 1 -- 172.21.15.8:0/3233346809 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80006cf40 con 0x7ff800070850 2024-05-26T15:41:27.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.227+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/3233346809 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 0x7ff80015eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:41:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.228+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/3233346809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 0x7ff80006c640 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009870 tx=0x7ff7f002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539bc6136164987f server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.229+0000 7ff7ff400640 1 -- 172.21.15.8:0/3233346809 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0032640 con 0x7ff800070850 2024-05-26T15:41:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.229+0000 7ff7ff400640 1 -- 172.21.15.8:0/3233346809 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f00327a0 con 0x7ff800070850 2024-05-26T15:41:27.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.229+0000 7ff7ff400640 1 -- 172.21.15.8:0/3233346809 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0032b30 con 0x7ff800070850 2024-05-26T15:41:27.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.230+0000 7ff805400640 1 -- 172.21.15.8:0/3233346809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 msgr2=0x7ff80006c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.230+0000 7ff805400640 1 --2- 172.21.15.8:0/3233346809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 0x7ff80006c640 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009870 tx=0x7ff7f002a300 comp rx=0 tx=0).stop 2024-05-26T15:41:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.230+0000 7ff805400640 1 -- 172.21.15.8:0/3233346809 shutdown_connections 2024-05-26T15:41:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.230+0000 7ff805400640 1 --2- 172.21.15.8:0/3233346809 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 0x7ff80015eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.230+0000 7ff805400640 1 --2- 172.21.15.8:0/3233346809 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 0x7ff80006c640 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.230+0000 7ff805400640 1 -- 172.21.15.8:0/3233346809 >> 172.21.15.8:0/3233346809 conn(0x7ff800069ed0 msgr2=0x7ff80006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.230+0000 7ff805400640 1 -- 172.21.15.8:0/3233346809 shutdown_connections 2024-05-26T15:41:27.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.230+0000 7ff805400640 1 -- 172.21.15.8:0/3233346809 wait complete. 2024-05-26T15:41:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.232+0000 7ff805400640 1 Processor -- start 2024-05-26T15:41:27.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.232+0000 7ff805400640 1 -- start start 2024-05-26T15:41:27.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.233+0000 7ff805400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 0x7ff800132250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.233+0000 7ff805400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff800070c30 0x7ff8001e2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.233+0000 7ff805400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 0x7ff8000ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.233+0000 7ff805400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8001e3710 con 0x7ff800070850 2024-05-26T15:41:27.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.233+0000 7ff805400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8001e2a90 con 0x7ff800070c30 2024-05-26T15:41:27.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.233+0000 7ff805400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8001e2d70 con 0x7ff8000cc610 2024-05-26T15:41:27.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.233+0000 7ff7ffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 0x7ff800132250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.233+0000 7ff7ffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 0x7ff800132250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45490/0 (socket says 172.21.15.8:45490) 2024-05-26T15:41:27.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.233+0000 7ff7ffe00640 1 -- 172.21.15.8:0/2300103213 learned_addr learned my addr 172.21.15.8:0/2300103213 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.234+0000 7ff804a00640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 0x7ff8000ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.234+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff800070c30 0x7ff8001e2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.234+0000 7ff7ffe00640 1 -- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 msgr2=0x7ff8000ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.234+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 0x7ff8000ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.234+0000 7ff7ffe00640 1 -- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff800070c30 msgr2=0x7ff8001e2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.234+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff800070c30 0x7ff8001e2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.234+0000 7ff7ffe00640 1 -- 172.21.15.8:0/2300103213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00094d0 con 0x7ff800070850 2024-05-26T15:41:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.234+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff800070c30 0x7ff8001e2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.234+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 0x7ff800132250 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009870 tx=0x7ff7f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:27.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.234+0000 7ff7fcc00640 1 -- 172.21.15.8:0/2300103213 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0030850 con 0x7ff800070850 2024-05-26T15:41:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.235+0000 7ff7fcc00640 1 -- 172.21.15.8:0/2300103213 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f00309b0 con 0x7ff800070850 2024-05-26T15:41:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.235+0000 7ff7fcc00640 1 -- 172.21.15.8:0/2300103213 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0030d60 con 0x7ff800070850 2024-05-26T15:41:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.235+0000 7ff805400640 1 -- 172.21.15.8:0/2300103213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8001e3050 con 0x7ff800070850 2024-05-26T15:41:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.235+0000 7ff805400640 1 -- 172.21.15.8:0/2300103213 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8001e40f0 con 0x7ff800070850 2024-05-26T15:41:27.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.237+0000 7ff7fcc00640 1 -- 172.21.15.8:0/2300103213 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff7f0039040 con 0x7ff800070850 2024-05-26T15:41:27.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.238+0000 7ff7fcc00640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff7dc06ac00 0x7ff7dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.238+0000 7ff7fcc00640 1 -- 172.21.15.8:0/2300103213 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7ff7f00a9d00 con 0x7ff800070850 2024-05-26T15:41:27.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.239+0000 7ff809870740 1 Processor -- start 2024-05-26T15:41:27.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.239+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff7dc06ac00 0x7ff7dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.239+0000 7ff809870740 1 -- start start 2024-05-26T15:41:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff809870740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f40d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff809870740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f175a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff809870740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f17ae0 0x55e473f18bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff809870740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e473e82a70 con 0x55e473f61300 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff809870740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e473e80200 con 0x55e473f17ae0 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff809870740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e473e7baf0 con 0x55e473f61910 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff7ffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f40d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff7ffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f40d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45492/0 (socket says 172.21.15.8:45492) 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff7ffe00640 1 -- 172.21.15.8:0/3469161717 learned_addr learned my addr 172.21.15.8:0/3469161717 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff7dc06ac00 0x7ff7dc06d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8006fd0 tx=0x7ff7e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff804a00640 1 --2- 172.21.15.8:0/3469161717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f17ae0 0x55e473f18bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/3469161717 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f175a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff7ffe00640 1 -- 172.21.15.8:0/3469161717 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 msgr2=0x55e473f175a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/3469161717 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f175a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff7ffe00640 1 -- 172.21.15.8:0/3469161717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f17ae0 msgr2=0x55e473f18bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/3469161717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f17ae0 0x55e473f18bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.240+0000 7ff7ffe00640 1 -- 172.21.15.8:0/3469161717 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e473e46b90 con 0x55e473f61300 2024-05-26T15:41:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.241+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/3469161717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f40d70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00785e0 tx=0x7ff7f0078610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2583c509c5eb7b06 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.241+0000 7ff7f4c00640 1 -- 172.21.15.8:0/3469161717 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f007c7d0 con 0x55e473f61300 2024-05-26T15:41:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.241+0000 7ff7f4c00640 1 -- 172.21.15.8:0/3469161717 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0080d90 con 0x55e473f61300 2024-05-26T15:41:27.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.241+0000 7ff7f4c00640 1 -- 172.21.15.8:0/3469161717 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00750b0 con 0x55e473f61300 2024-05-26T15:41:27.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.242+0000 7ff809870740 1 -- 172.21.15.8:0/3469161717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 msgr2=0x55e473f40d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:27.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.242+0000 7ff809870740 1 --2- 172.21.15.8:0/3469161717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f40d70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00785e0 tx=0x7ff7f0078610 comp rx=0 tx=0).stop 2024-05-26T15:41:27.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.242+0000 7ff809870740 1 -- 172.21.15.8:0/3469161717 shutdown_connections 2024-05-26T15:41:27.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.242+0000 7ff809870740 1 --2- 172.21.15.8:0/3469161717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f17ae0 0x55e473f18bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.242+0000 7ff809870740 1 --2- 172.21.15.8:0/3469161717 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f175a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.242+0000 7ff809870740 1 --2- 172.21.15.8:0/3469161717 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f40d70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.242+0000 7ff809870740 1 -- 172.21.15.8:0/3469161717 >> 172.21.15.8:0/3469161717 conn(0x55e473f16000 msgr2=0x55e473f5e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.242+0000 7ff809870740 1 -- 172.21.15.8:0/3469161717 shutdown_connections 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.242+0000 7ff809870740 1 -- 172.21.15.8:0/3469161717 wait complete. 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.243+0000 7ff809870740 1 -- start start 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.243+0000 7ff809870740 1 Processor -- start 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.244+0000 7ff809870740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61300 0x55e473f3e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.244+0000 7ff809870740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61910 0x55e473f6f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.244+0000 7ff809870740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f6fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.244+0000 7ff809870740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e473e1d220 con 0x55e473f61910 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.244+0000 7ff809870740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e473e1cec0 con 0x55e473f397e0 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.244+0000 7ff809870740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e473be2f20 con 0x55e473f61300 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.244+0000 7ff809870740 10 client.0 _ll_register_callbacks cb 0x55e473e75160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.244+0000 7ff7f7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61910 0x55e473f6f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.244+0000 7ff7f7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61910 0x55e473f6f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45496/0 (socket says 172.21.15.8:45496) 2024-05-26T15:41:27.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.244+0000 7ff7f7e00640 1 -- 172.21.15.8:0/3503023495 learned_addr learned my addr 172.21.15.8:0/3503023495 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:27.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff804a00640 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f6fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61300 0x55e473f3e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff7f7e00640 1 -- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61300 msgr2=0x55e473f3e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:27.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61300 0x55e473f3e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff7f7e00640 1 -- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 msgr2=0x55e473f6fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:27.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f6fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff7f7e00640 1 -- 172.21.15.8:0/3503023495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8001e40f0 con 0x55e473f61910 2024-05-26T15:41:27.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff804a00640 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f6fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61910 0x55e473f6f6a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800efb0 tx=0x7ff7e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da32cb3110ac3f78 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff7ed600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff7ed600640 1 -- 172.21.15.8:0/3503023495 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8015dd0 con 0x55e473f61910 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff809870740 1 -- 172.21.15.8:0/3503023495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e473ea5c90 con 0x55e473f61910 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.245+0000 7ff7ed600640 1 -- 172.21.15.8:0/3503023495 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7ff7e8004030 con 0x55e473f61910 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff7ed600640 1 -- 172.21.15.8:0/3503023495 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7e80041f0 con 0x55e473f61910 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff809870740 10 client.5565 fetch_fsmap learned FSMap version 24 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff809870740 1 -- 172.21.15.8:0/3503023495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55e473e7a170 con 0x55e473f61910 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff7ed600640 1 -- 172.21.15.8:0/3503023495 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e473ea5c90 con 0x55e473f61910 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff7ed600640 1 -- 172.21.15.8:0/3503023495 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff7e8004350 con 0x55e473f61910 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff809870740 10 client.5565 fetch_fsmap finished waiting for FSMap version 24 2024-05-26T15:41:27.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff809870740 10 client.5565 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-26T15:41:27.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff809870740 20 client.5565 populate_metadata read hostname 'smithi008' 2024-05-26T15:41:27.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff809870740 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:6834/1710654961,v1:172.21.15.47:6835/1710654961] conn(0x55e473f3f970 0x55e473f3fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff809870740 4 client.5565 mds_command: new command op to 5122 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-26T15:41:27.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.246+0000 7ff809870740 1 -- 172.21.15.8:0/3503023495 --> [v2:172.21.15.47:6834/1710654961,v1:172.21.15.47:6835/1710654961] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e473b6f3c0 con 0x55e473f3f970 2024-05-26T15:41:27.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.247+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:6834/1710654961,v1:172.21.15.47:6835/1710654961] conn(0x55e473f3f970 0x55e473f3fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.248+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:6834/1710654961,v1:172.21.15.47:6835/1710654961] conn(0x55e473f3f970 0x55e473f3fd50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bef3cb73f3b3aea server_cookie=fdb313a9f8d78382 in_seq=0 out_seq=0 2024-05-26T15:41:27.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.248+0000 7ff7ed600640 10 client.5565 ms_handle_connect on v2:172.21.15.47:6834/1710654961 2024-05-26T15:41:27.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.250+0000 7ff7ed600640 1 -- 172.21.15.8:0/3503023495 <== mds.0 v2:172.21.15.47:6834/1710654961 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e473b6f3c0 con 0x55e473f3f970 2024-05-26T15:41:27.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.250+0000 7ff7ed600640 10 client.5565 handle_command_reply: tid=0 2024-05-26T15:41:27.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.250+0000 7ff809870740 1 client.5565 shutdown 2024-05-26T15:41:27.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 1 -- 172.21.15.8:0/3503023495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61910 msgr2=0x55e473f6f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:27.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61910 0x55e473f6f6a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800efb0 tx=0x7ff7e8004730 comp rx=0 tx=0).stop 2024-05-26T15:41:27.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 1 -- 172.21.15.8:0/3503023495 shutdown_connections 2024-05-26T15:41:27.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:6834/1710654961,v1:172.21.15.47:6835/1710654961] conn(0x55e473f3f970 0x55e473f3fd50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f6fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61910 0x55e473f6f6a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 1 --2- 172.21.15.8:0/3503023495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61300 0x55e473f3e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff7ed600640 0 client.5565 ms_handle_reset on v2:172.21.15.47:6834/1710654961 2024-05-26T15:41:27.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 1 -- 172.21.15.8:0/3503023495 >> 172.21.15.8:0/3503023495 conn(0x55e473f17ae0 msgr2=0x55e473f5e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:27.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 1 -- 172.21.15.8:0/3503023495 shutdown_connections 2024-05-26T15:41:27.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 1 -- 172.21.15.8:0/3503023495 wait complete. 2024-05-26T15:41:27.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.251+0000 7ff809870740 20 client.5565 trim_cache size 0 max 16384 2024-05-26T15:41:27.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.269+0000 7ff809870740 1 Processor -- start 2024-05-26T15:41:27.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.269+0000 7ff809870740 1 -- start start 2024-05-26T15:41:27.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.270+0000 7ff809870740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f60c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.270+0000 7ff809870740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.270+0000 7ff809870740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f47900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.270+0000 7ff809870740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e473f388c0 con 0x55e473f61300 2024-05-26T15:41:27.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.270+0000 7ff809870740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e473f13b50 con 0x55e473f397e0 2024-05-26T15:41:27.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.270+0000 7ff809870740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e473f61160 con 0x55e473f61910 2024-05-26T15:41:27.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.270+0000 7ff7f7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.270+0000 7ff7f7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45508/0 (socket says 172.21.15.8:45508) 2024-05-26T15:41:27.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.270+0000 7ff7f7e00640 1 -- 172.21.15.8:0/2710482000 learned_addr learned my addr 172.21.15.8:0/2710482000 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:27.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f60c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7f7e00640 1 -- 172.21.15.8:0/2710482000 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 msgr2=0x55e473f47900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff804a00640 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f47900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f47900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7f7e00640 1 -- 172.21.15.8:0/2710482000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 msgr2=0x55e473f60c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f60c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7f7e00640 1 -- 172.21.15.8:0/2710482000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e473eaf130 con 0x55e473f61300 2024-05-26T15:41:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f60c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:27.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff804a00640 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f47900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f473c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009200 tx=0x7ff7e801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c589f64cb46148 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7f5600640 1 -- 172.21.15.8:0/2710482000 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8015dd0 con 0x55e473f61300 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7f5600640 1 -- 172.21.15.8:0/2710482000 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e801b050 con 0x55e473f61300 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.271+0000 7ff7f5600640 1 -- 172.21.15.8:0/2710482000 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8003a90 con 0x55e473f61300 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.272+0000 7ff809870740 1 -- 172.21.15.8:0/2710482000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 msgr2=0x55e473f473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.272+0000 7ff809870740 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f473c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009200 tx=0x7ff7e801e000 comp rx=0 tx=0).stop 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.272+0000 7ff809870740 1 -- 172.21.15.8:0/2710482000 shutdown_connections 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.272+0000 7ff809870740 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f47900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.272+0000 7ff809870740 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473f473c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.272+0000 7ff809870740 1 --2- 172.21.15.8:0/2710482000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f60c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.272+0000 7ff809870740 1 -- 172.21.15.8:0/2710482000 >> 172.21.15.8:0/2710482000 conn(0x55e473f17ae0 msgr2=0x55e473f1aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.272+0000 7ff809870740 1 -- 172.21.15.8:0/2710482000 shutdown_connections 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.272+0000 7ff809870740 1 -- 172.21.15.8:0/2710482000 wait complete. 2024-05-26T15:41:27.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.273+0000 7ff809870740 1 -- start start 2024-05-26T15:41:27.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.273+0000 7ff809870740 1 Processor -- start 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.274+0000 7ff809870740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f5f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.274+0000 7ff809870740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473fd1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.274+0000 7ff809870740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.274+0000 7ff809870740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e473f137c0 con 0x55e473f61300 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.274+0000 7ff809870740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e473f5dc60 con 0x55e473f397e0 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.274+0000 7ff809870740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e473f40a90 con 0x55e473f61910 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.274+0000 7ff809870740 10 client.0 _ll_register_callbacks cb 0x55e473f17a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7f7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473fd1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7f7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473fd1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45524/0 (socket says 172.21.15.8:45524) 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7f7e00640 1 -- 172.21.15.8:0/1866153579 learned_addr learned my addr 172.21.15.8:0/1866153579 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f5f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7f7e00640 1 -- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 msgr2=0x55e473f473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7f7e00640 1 -- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 msgr2=0x55e473f5f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f5f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7f7e00640 1 -- 172.21.15.8:0/1866153579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e473e7a170 con 0x55e473f61300 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7f7e00640 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473fd1130 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009360 tx=0x7ff7e8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fc19c0fc0ee5a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.275+0000 7ff7ed600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.276+0000 7ff7ed600640 1 -- 172.21.15.8:0/1866153579 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8006240 con 0x55e473f61300 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.276+0000 7ff7ed600640 1 -- 172.21.15.8:0/1866153579 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7ff7e80063a0 con 0x55e473f61300 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.276+0000 7ff809870740 1 -- 172.21.15.8:0/1866153579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7f0080d90 con 0x55e473f61300 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.276+0000 7ff7ed600640 1 -- 172.21.15.8:0/1866153579 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7e8015810 con 0x55e473f61300 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.276+0000 7ff809870740 10 client.5571 fetch_fsmap learned FSMap version 24 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.276+0000 7ff809870740 1 -- 172.21.15.8:0/1866153579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55e473e1c430 con 0x55e473f61300 2024-05-26T15:41:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.276+0000 7ff7ed600640 1 -- 172.21.15.8:0/1866153579 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0080d90 con 0x55e473f61300 2024-05-26T15:41:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.276+0000 7ff7ed600640 1 -- 172.21.15.8:0/1866153579 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff7e8006560 con 0x55e473f61300 2024-05-26T15:41:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.277+0000 7ff809870740 10 client.5571 fetch_fsmap finished waiting for FSMap version 24 2024-05-26T15:41:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.277+0000 7ff809870740 10 client.5571 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-26T15:41:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.277+0000 7ff809870740 20 client.5571 populate_metadata read hostname 'smithi008' 2024-05-26T15:41:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.277+0000 7ff809870740 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:6834/1710654961,v1:172.21.15.47:6835/1710654961] conn(0x55e473f479d0 0x55e473f37ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.277+0000 7ff809870740 4 client.5571 mds_command: new command op to 5122 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-26T15:41:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.277+0000 7ff809870740 1 -- 172.21.15.8:0/1866153579 --> [v2:172.21.15.47:6834/1710654961,v1:172.21.15.47:6835/1710654961] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e473b806c0 con 0x55e473f479d0 2024-05-26T15:41:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.277+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:6834/1710654961,v1:172.21.15.47:6835/1710654961] conn(0x55e473f479d0 0x55e473f37ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.278+0000 7ff7ffe00640 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:6834/1710654961,v1:172.21.15.47:6835/1710654961] conn(0x55e473f479d0 0x55e473f37ca0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5132b697ec19e9d3 server_cookie=c1c3a0541d9aab86 in_seq=0 out_seq=0 2024-05-26T15:41:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.278+0000 7ff7ed600640 10 client.5571 ms_handle_connect on v2:172.21.15.47:6834/1710654961 2024-05-26T15:41:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff7ed600640 1 -- 172.21.15.8:0/1866153579 <== mds.0 v2:172.21.15.47:6834/1710654961 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e473b806c0 con 0x55e473f479d0 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff7ed600640 10 client.5571 handle_command_reply: tid=0 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 client.5571 shutdown 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 -- 172.21.15.8:0/1866153579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 msgr2=0x55e473fd1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473fd1130 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009360 tx=0x7ff7e8013000 comp rx=0 tx=0).stop 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 -- 172.21.15.8:0/1866153579 shutdown_connections 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:6834/1710654961,v1:172.21.15.47:6835/1710654961] conn(0x55e473f479d0 0x55e473f37ca0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55e473f61910 0x55e473f473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55e473f61300 0x55e473fd1130 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 --2- 172.21.15.8:0/1866153579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55e473f397e0 0x55e473f5f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff7ed600640 0 client.5571 ms_handle_reset on v2:172.21.15.47:6834/1710654961 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 -- 172.21.15.8:0/1866153579 >> 172.21.15.8:0/1866153579 conn(0x55e473f17ae0 msgr2=0x55e473f6fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 -- 172.21.15.8:0/1866153579 shutdown_connections 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.279+0000 7ff809870740 1 -- 172.21.15.8:0/1866153579 wait complete. 2024-05-26T15:41:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff809870740 20 client.5571 trim_cache size 0 max 16384 2024-05-26T15:41:27.281 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:41:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "03132396-4584-4cf0-b2e0-b5ae6040045e", 2024-05-26T15:41:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2024-05-26T15:41:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5122, 2024-05-26T15:41:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-05-26T15:41:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-05-26T15:41:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-05-26T15:41:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 4.7870207889999996, 2024-05-26T15:41:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 24, 2024-05-26T15:41:27.281 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 43, 2024-05-26T15:41:27.282 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 43, 2024-05-26T15:41:27.282 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 4.8295044909999998 2024-05-26T15:41:27.282 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:41:27.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 -- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff7dc06ac00 msgr2=0x7ff7dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:27.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff7dc06ac00 0x7ff7dc06d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8006fd0 tx=0x7ff7e8008040 comp rx=0 tx=0).stop 2024-05-26T15:41:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 -- 172.21.15.8:0/2300103213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 msgr2=0x7ff800132250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 0x7ff800132250 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009870 tx=0x7ff7f00046c0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 -- 172.21.15.8:0/2300103213 shutdown_connections 2024-05-26T15:41:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff8000cc610 0x7ff8000ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff7dc06ac00 0x7ff7dc06d0c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff800070c30 0x7ff8001e2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 --2- 172.21.15.8:0/2300103213 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff800070850 0x7ff800132250 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 -- 172.21.15.8:0/2300103213 >> 172.21.15.8:0/2300103213 conn(0x7ff800069ed0 msgr2=0x7ff800140140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 -- 172.21.15.8:0/2300103213 shutdown_connections 2024-05-26T15:41:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:27.280+0000 7ff805400640 1 -- 172.21.15.8:0/2300103213 wait complete. 2024-05-26T15:41:27.298 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:27.298 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:27.350 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2024-05-26T15:41:27.350 DEBUG:teuthology.orchestra.run.smithi008:> import time 2024-05-26T15:41:27.350 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:41:27.350 DEBUG:teuthology.orchestra.run.smithi008:> with open("/home/ubuntu/cephtest/mnt.0/open_file0", '"'"'w'"'"') as f: 2024-05-26T15:41:27.350 DEBUG:teuthology.orchestra.run.smithi008:> f.write("content") 2024-05-26T15:41:27.351 DEBUG:teuthology.orchestra.run.smithi008:> f.flush() 2024-05-26T15:41:27.351 DEBUG:teuthology.orchestra.run.smithi008:> while True: 2024-05-26T15:41:27.351 DEBUG:teuthology.orchestra.run.smithi008:> time.sleep(1) 2024-05-26T15:41:27.351 DEBUG:teuthology.orchestra.run.smithi008:> ' 2024-05-26T15:41:27.355 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file0 2024-05-26T15:41:27.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:41:27.400 INFO:teuthology.orchestra.run.smithi008.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file0': No such file or directory 2024-05-26T15:41:27.467 INFO:tasks.ceph.mds.b.smithi047.stderr:2024-05-26T15:41:27.468+0000 7fb9ace00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-26T15:41:28.401 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file0 2024-05-26T15:41:28.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:41:28.455 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:41:28.462 INFO:teuthology.orchestra.run.smithi008.stdout:7 2024-05-26T15:41:28.462 INFO:tasks.cephfs.mount:File open_file0 became visible with size 7 from 0 after 1s 2024-05-26T15:41:28.462 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:28.462 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:28.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:28.553 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file0 bs=1M conv=fdatasync count=1 seek=0) 2024-05-26T15:41:28.659 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:41:28.659 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:41:28.659 INFO:teuthology.orchestra.run.smithi008.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0425197 s, 24.7 MB/s 2024-05-26T15:41:28.661 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:28.661 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:28.713 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2024-05-26T15:41:28.713 DEBUG:teuthology.orchestra.run.smithi008:> import time 2024-05-26T15:41:28.713 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:41:28.713 DEBUG:teuthology.orchestra.run.smithi008:> with open("/home/ubuntu/cephtest/mnt.0/open_file1", '"'"'w'"'"') as f: 2024-05-26T15:41:28.713 DEBUG:teuthology.orchestra.run.smithi008:> f.write("content") 2024-05-26T15:41:28.713 DEBUG:teuthology.orchestra.run.smithi008:> f.flush() 2024-05-26T15:41:28.713 DEBUG:teuthology.orchestra.run.smithi008:> while True: 2024-05-26T15:41:28.713 DEBUG:teuthology.orchestra.run.smithi008:> time.sleep(1) 2024-05-26T15:41:28.713 DEBUG:teuthology.orchestra.run.smithi008:> ' 2024-05-26T15:41:28.718 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file1 2024-05-26T15:41:28.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:41:28.768 INFO:teuthology.orchestra.run.smithi008.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file1': No such file or directory 2024-05-26T15:41:29.769 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file1 2024-05-26T15:41:29.827 INFO:teuthology.orchestra.run.smithi008.stdout:7 2024-05-26T15:41:29.828 INFO:tasks.cephfs.mount:File open_file1 became visible with size 7 from 0 after 1s 2024-05-26T15:41:29.828 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:29.828 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:29.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:29.880 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file1 bs=1M conv=fdatasync count=1 seek=0) 2024-05-26T15:41:29.989 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:41:29.989 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:41:29.989 INFO:teuthology.orchestra.run.smithi008.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0390371 s, 26.9 MB/s 2024-05-26T15:41:29.991 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:29.991 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:30.048 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2024-05-26T15:41:30.048 DEBUG:teuthology.orchestra.run.smithi008:> import time 2024-05-26T15:41:30.048 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:41:30.048 DEBUG:teuthology.orchestra.run.smithi008:> with open("/home/ubuntu/cephtest/mnt.0/open_file2", '"'"'w'"'"') as f: 2024-05-26T15:41:30.048 DEBUG:teuthology.orchestra.run.smithi008:> f.write("content") 2024-05-26T15:41:30.048 DEBUG:teuthology.orchestra.run.smithi008:> f.flush() 2024-05-26T15:41:30.048 DEBUG:teuthology.orchestra.run.smithi008:> while True: 2024-05-26T15:41:30.048 DEBUG:teuthology.orchestra.run.smithi008:> time.sleep(1) 2024-05-26T15:41:30.048 DEBUG:teuthology.orchestra.run.smithi008:> ' 2024-05-26T15:41:30.053 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file2 2024-05-26T15:41:30.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:41:30.098 INFO:teuthology.orchestra.run.smithi008.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file2': No such file or directory 2024-05-26T15:41:31.099 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file2 2024-05-26T15:41:31.160 INFO:teuthology.orchestra.run.smithi008.stdout:7 2024-05-26T15:41:31.160 INFO:tasks.cephfs.mount:File open_file2 became visible with size 7 from 0 after 1s 2024-05-26T15:41:31.160 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:31.160 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:31.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:31.218 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file2 bs=1M conv=fdatasync count=1 seek=0) 2024-05-26T15:41:31.321 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:41:31.321 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:41:31.321 INFO:teuthology.orchestra.run.smithi008.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341337 s, 30.7 MB/s 2024-05-26T15:41:31.323 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:31.323 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:31.381 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2024-05-26T15:41:31.381 DEBUG:teuthology.orchestra.run.smithi008:> import time 2024-05-26T15:41:31.382 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:41:31.382 DEBUG:teuthology.orchestra.run.smithi008:> with open("/home/ubuntu/cephtest/mnt.0/open_file3", '"'"'w'"'"') as f: 2024-05-26T15:41:31.382 DEBUG:teuthology.orchestra.run.smithi008:> f.write("content") 2024-05-26T15:41:31.382 DEBUG:teuthology.orchestra.run.smithi008:> f.flush() 2024-05-26T15:41:31.382 DEBUG:teuthology.orchestra.run.smithi008:> while True: 2024-05-26T15:41:31.382 DEBUG:teuthology.orchestra.run.smithi008:> time.sleep(1) 2024-05-26T15:41:31.382 DEBUG:teuthology.orchestra.run.smithi008:> ' 2024-05-26T15:41:31.387 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file3 2024-05-26T15:41:31.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:41:31.438 INFO:teuthology.orchestra.run.smithi008.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file3': No such file or directory 2024-05-26T15:41:32.439 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file3 2024-05-26T15:41:32.499 INFO:teuthology.orchestra.run.smithi008.stdout:7 2024-05-26T15:41:32.500 INFO:tasks.cephfs.mount:File open_file3 became visible with size 7 from 0 after 1s 2024-05-26T15:41:32.500 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:32.500 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:32.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:32.553 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file3 bs=1M conv=fdatasync count=1 seek=0) 2024-05-26T15:41:32.650 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:41:32.651 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:41:32.651 INFO:teuthology.orchestra.run.smithi008.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030377 s, 34.5 MB/s 2024-05-26T15:41:32.652 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:32.652 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:32.711 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2024-05-26T15:41:32.711 DEBUG:teuthology.orchestra.run.smithi008:> import time 2024-05-26T15:41:32.711 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:41:32.711 DEBUG:teuthology.orchestra.run.smithi008:> with open("/home/ubuntu/cephtest/mnt.0/open_file4", '"'"'w'"'"') as f: 2024-05-26T15:41:32.711 DEBUG:teuthology.orchestra.run.smithi008:> f.write("content") 2024-05-26T15:41:32.711 DEBUG:teuthology.orchestra.run.smithi008:> f.flush() 2024-05-26T15:41:32.711 DEBUG:teuthology.orchestra.run.smithi008:> while True: 2024-05-26T15:41:32.711 DEBUG:teuthology.orchestra.run.smithi008:> time.sleep(1) 2024-05-26T15:41:32.711 DEBUG:teuthology.orchestra.run.smithi008:> ' 2024-05-26T15:41:32.717 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file4 2024-05-26T15:41:32.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:41:32.762 INFO:teuthology.orchestra.run.smithi008.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file4': No such file or directory 2024-05-26T15:41:33.763 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file4 2024-05-26T15:41:33.819 INFO:teuthology.orchestra.run.smithi008.stdout:7 2024-05-26T15:41:33.819 INFO:tasks.cephfs.mount:File open_file4 became visible with size 7 from 0 after 1s 2024-05-26T15:41:33.820 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:33.820 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:33.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:33.877 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file4 bs=1M conv=fdatasync count=1 seek=0) 2024-05-26T15:41:33.979 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:41:33.979 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:41:33.979 INFO:teuthology.orchestra.run.smithi008.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326436 s, 32.1 MB/s 2024-05-26T15:41:33.981 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:33.981 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:34.042 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2024-05-26T15:41:34.042 DEBUG:teuthology.orchestra.run.smithi008:> import time 2024-05-26T15:41:34.042 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:41:34.042 DEBUG:teuthology.orchestra.run.smithi008:> with open("/home/ubuntu/cephtest/mnt.0/open_file5", '"'"'w'"'"') as f: 2024-05-26T15:41:34.042 DEBUG:teuthology.orchestra.run.smithi008:> f.write("content") 2024-05-26T15:41:34.042 DEBUG:teuthology.orchestra.run.smithi008:> f.flush() 2024-05-26T15:41:34.042 DEBUG:teuthology.orchestra.run.smithi008:> while True: 2024-05-26T15:41:34.042 DEBUG:teuthology.orchestra.run.smithi008:> time.sleep(1) 2024-05-26T15:41:34.042 DEBUG:teuthology.orchestra.run.smithi008:> ' 2024-05-26T15:41:34.047 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file5 2024-05-26T15:41:34.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:41:34.096 INFO:teuthology.orchestra.run.smithi008.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file5': No such file or directory 2024-05-26T15:41:35.097 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file5 2024-05-26T15:41:35.159 INFO:teuthology.orchestra.run.smithi008.stdout:7 2024-05-26T15:41:35.159 INFO:tasks.cephfs.mount:File open_file5 became visible with size 7 from 0 after 1s 2024-05-26T15:41:35.159 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:35.160 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:35.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:35.214 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file5 bs=1M conv=fdatasync count=1 seek=0) 2024-05-26T15:41:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:41:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:41:35.318 INFO:teuthology.orchestra.run.smithi008.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286292 s, 36.6 MB/s 2024-05-26T15:41:35.320 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:35.320 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:35.381 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2024-05-26T15:41:35.381 DEBUG:teuthology.orchestra.run.smithi008:> import time 2024-05-26T15:41:35.381 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:41:35.381 DEBUG:teuthology.orchestra.run.smithi008:> with open("/home/ubuntu/cephtest/mnt.0/open_file6", '"'"'w'"'"') as f: 2024-05-26T15:41:35.381 DEBUG:teuthology.orchestra.run.smithi008:> f.write("content") 2024-05-26T15:41:35.381 DEBUG:teuthology.orchestra.run.smithi008:> f.flush() 2024-05-26T15:41:35.381 DEBUG:teuthology.orchestra.run.smithi008:> while True: 2024-05-26T15:41:35.381 DEBUG:teuthology.orchestra.run.smithi008:> time.sleep(1) 2024-05-26T15:41:35.381 DEBUG:teuthology.orchestra.run.smithi008:> ' 2024-05-26T15:41:35.387 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file6 2024-05-26T15:41:35.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:41:35.435 INFO:teuthology.orchestra.run.smithi008.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file6': No such file or directory 2024-05-26T15:41:36.437 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file6 2024-05-26T15:41:36.498 INFO:teuthology.orchestra.run.smithi008.stdout:7 2024-05-26T15:41:36.498 INFO:tasks.cephfs.mount:File open_file6 became visible with size 7 from 0 after 1s 2024-05-26T15:41:36.498 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:36.499 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:36.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:36.553 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file6 bs=1M conv=fdatasync count=1 seek=0) 2024-05-26T15:41:36.676 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:41:36.676 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:41:36.676 INFO:teuthology.orchestra.run.smithi008.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.052466 s, 20.0 MB/s 2024-05-26T15:41:36.678 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:36.678 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:36.735 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2024-05-26T15:41:36.735 DEBUG:teuthology.orchestra.run.smithi008:> import time 2024-05-26T15:41:36.735 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:41:36.735 DEBUG:teuthology.orchestra.run.smithi008:> with open("/home/ubuntu/cephtest/mnt.0/open_file7", '"'"'w'"'"') as f: 2024-05-26T15:41:36.735 DEBUG:teuthology.orchestra.run.smithi008:> f.write("content") 2024-05-26T15:41:36.735 DEBUG:teuthology.orchestra.run.smithi008:> f.flush() 2024-05-26T15:41:36.735 DEBUG:teuthology.orchestra.run.smithi008:> while True: 2024-05-26T15:41:36.735 DEBUG:teuthology.orchestra.run.smithi008:> time.sleep(1) 2024-05-26T15:41:36.736 DEBUG:teuthology.orchestra.run.smithi008:> ' 2024-05-26T15:41:36.740 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file7 2024-05-26T15:41:36.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:41:36.788 INFO:teuthology.orchestra.run.smithi008.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file7': No such file or directory 2024-05-26T15:41:37.789 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file7 2024-05-26T15:41:37.848 INFO:teuthology.orchestra.run.smithi008.stdout:7 2024-05-26T15:41:37.848 INFO:tasks.cephfs.mount:File open_file7 became visible with size 7 from 0 after 1s 2024-05-26T15:41:37.848 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:37.848 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:37.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:37.903 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file7 bs=1M conv=fdatasync count=1 seek=0) 2024-05-26T15:41:38.017 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2024-05-26T15:41:38.017 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2024-05-26T15:41:38.017 INFO:teuthology.orchestra.run.smithi008.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0435175 s, 24.1 MB/s 2024-05-26T15:41:48.020 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_openfiles.1 2024-05-26T15:41:48.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.142+0000 7fd20dde0f40 1 Processor -- start 2024-05-26T15:41:48.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.143+0000 7fd20dde0f40 1 -- start start 2024-05-26T15:41:48.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.143+0000 7fd20dde0f40 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1f00035f0 0x559da97e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:48.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.143+0000 7fd20dde0f40 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x559da97e8c00 0x559da976e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:48.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.143+0000 7fd20dde0f40 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da976e680 0x559da9800a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:48.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.143+0000 7fd20dde0f40 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da96d7400 con 0x559da976e680 2024-05-26T15:41:48.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.143+0000 7fd20dde0f40 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da9672fe0 con 0x7fd1f00035f0 2024-05-26T15:41:48.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.143+0000 7fd20dde0f40 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x559da9672c80 con 0x559da97e8c00 2024-05-26T15:41:48.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.144+0000 7fd20ba00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da976e680 0x559da9800a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:48.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.144+0000 7fd20ba00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da976e680 0x559da9800a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33114/0 (socket says 172.21.15.8:33114) 2024-05-26T15:41:48.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.144+0000 7fd20ba00640 1 -- 172.21.15.8:0/689498594 learned_addr learned my addr 172.21.15.8:0/689498594 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:48.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.144+0000 7fd20ba00640 1 -- 172.21.15.8:0/689498594 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x559da97e8c00 msgr2=0x559da976e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:48.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.144+0000 7fd20ba00640 1 --2- 172.21.15.8:0/689498594 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x559da97e8c00 0x559da976e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:48.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.144+0000 7fd20ba00640 1 -- 172.21.15.8:0/689498594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1f00035f0 msgr2=0x559da97e7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:48.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.144+0000 7fd20ba00640 1 --2- 172.21.15.8:0/689498594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1f00035f0 0x559da97e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:48.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.144+0000 7fd20ba00640 1 -- 172.21.15.8:0/689498594 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559da9681b20 con 0x559da976e680 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.145+0000 7fd20ba00640 1 --2- 172.21.15.8:0/689498594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da976e680 0x559da9800a10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd20400a780 tx=0x7fd20404f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4db412779bad29f server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.145+0000 7fd209c00640 1 -- 172.21.15.8:0/689498594 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204057e40 con 0x559da976e680 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.145+0000 7fd209c00640 1 -- 172.21.15.8:0/689498594 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20401a6a0 con 0x559da976e680 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.145+0000 7fd209c00640 1 -- 172.21.15.8:0/689498594 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204057640 con 0x559da976e680 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.146+0000 7fd20dde0f40 1 -- 172.21.15.8:0/689498594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da976e680 msgr2=0x559da9800a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.146+0000 7fd20dde0f40 1 --2- 172.21.15.8:0/689498594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da976e680 0x559da9800a10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd20400a780 tx=0x7fd20404f000 comp rx=0 tx=0).stop 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.146+0000 7fd20dde0f40 1 -- 172.21.15.8:0/689498594 shutdown_connections 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.146+0000 7fd20dde0f40 1 --2- 172.21.15.8:0/689498594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da976e680 0x559da9800a10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.146+0000 7fd20dde0f40 1 --2- 172.21.15.8:0/689498594 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x559da97e8c00 0x559da976e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.146+0000 7fd20dde0f40 1 --2- 172.21.15.8:0/689498594 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1f00035f0 0x559da97e7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.146+0000 7fd20dde0f40 1 -- 172.21.15.8:0/689498594 >> 172.21.15.8:0/689498594 conn(0x559da97281b0 msgr2=0x559da9802650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.146+0000 7fd20dde0f40 1 -- 172.21.15.8:0/689498594 shutdown_connections 2024-05-26T15:41:48.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.146+0000 7fd20dde0f40 1 -- 172.21.15.8:0/689498594 wait complete. 2024-05-26T15:41:48.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.147+0000 7fd20dde0f40 1 Processor -- start 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.147+0000 7fd20dde0f40 1 -- start start 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd20dde0f40 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x559da976e680 0x559da9777d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd20dde0f40 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da97e8c00 0x559da97e4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd20dde0f40 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1f00035f0 0x559da97fca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd20dde0f40 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da96698f0 con 0x559da97e8c00 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd20dde0f40 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da97ffbd0 con 0x7fd1f00035f0 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd20dde0f40 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x559da97ff8f0 con 0x559da976e680 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd202600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da97e8c00 0x559da97e4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd202600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da97e8c00 0x559da97e4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33126/0 (socket says 172.21.15.8:33126) 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd202600640 1 -- 172.21.15.8:0/965343764 learned_addr learned my addr 172.21.15.8:0/965343764 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd20b000640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x559da976e680 0x559da9777d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.148+0000 7fd20ba00640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1f00035f0 0x559da97fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:48.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd202600640 1 -- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x559da976e680 msgr2=0x559da9777d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:48.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd202600640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x559da976e680 0x559da9777d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:48.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd202600640 1 -- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1f00035f0 msgr2=0x559da97fca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:48.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd202600640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1f00035f0 0x559da97fca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd202600640 1 -- 172.21.15.8:0/965343764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0001e10 con 0x559da97e8c00 2024-05-26T15:41:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd20ba00640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1f00035f0 0x559da97fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd202600640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da97e8c00 0x559da97e4a70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4002f40 tx=0x7fd1f4009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd203e00640 1 -- 172.21.15.8:0/965343764 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f400f050 con 0x559da97e8c00 2024-05-26T15:41:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd203e00640 1 -- 172.21.15.8:0/965343764 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4010040 con 0x559da97e8c00 2024-05-26T15:41:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd20dde0f40 1 -- 172.21.15.8:0/965343764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559da9674f60 con 0x559da97e8c00 2024-05-26T15:41:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd203e00640 1 -- 172.21.15.8:0/965343764 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40156a0 con 0x559da97e8c00 2024-05-26T15:41:48.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.149+0000 7fd20dde0f40 1 -- 172.21.15.8:0/965343764 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559da96749c0 con 0x559da97e8c00 2024-05-26T15:41:48.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.151+0000 7fd203e00640 1 -- 172.21.15.8:0/965343764 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd1f4005020 con 0x559da97e8c00 2024-05-26T15:41:48.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.152+0000 7fd203e00640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd1e8069610 0x7fd1e806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:48.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.152+0000 7fd203e00640 1 -- 172.21.15.8:0/965343764 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fd1f4087e70 con 0x559da97e8c00 2024-05-26T15:41:48.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.153+0000 7fd20dde0f40 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x559da97ff380 0x559da9899260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:48.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.153+0000 7fd20dde0f40 1 -- 172.21.15.8:0/965343764 --> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] -- osd_op(unknown.0.0:1 5.13 5:c9647462:::mds0_openfiles.1:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) v8 -- 0x559da98997a0 con 0x559da97ff380 2024-05-26T15:41:48.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.153+0000 7fd20b000640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd1e8069610 0x7fd1e806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:48.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.153+0000 7fd20ba00640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x559da97ff380 0x559da9899260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:48.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20ba00640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x559da97ff380 0x559da9899260 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:48.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20ba00640 1 -- 172.21.15.8:0/965343764 <== osd.3 v2:172.21.15.8:6813/36924 1 ==== osd_op_reply(1 mds0_openfiles.1 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x7fd204057560 con 0x559da97ff380 2024-05-26T15:41:48.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20b000640 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd1e8069610 0x7fd1e806bad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0013d0 tx=0x7fd1fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:48.153 INFO:teuthology.orchestra.run.smithi008.stdout:cephfs_metadata/mds0_openfiles.1 mtime 2024-05-26T15:41:42.000000+0000, size 0 2024-05-26T15:41:48.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20dde0f40 1 -- 172.21.15.8:0/965343764 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x559da97ff380 msgr2=0x559da9899260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:48.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20dde0f40 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x559da97ff380 0x559da9899260 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20dde0f40 1 -- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd1e8069610 msgr2=0x7fd1e806bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20dde0f40 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd1e8069610 0x7fd1e806bad0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0013d0 tx=0x7fd1fc008040 comp rx=0 tx=0).stop 2024-05-26T15:41:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20dde0f40 1 -- 172.21.15.8:0/965343764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da97e8c00 msgr2=0x559da97e4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20dde0f40 1 --2- 172.21.15.8:0/965343764 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x559da97e8c00 0x559da97e4a70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4002f40 tx=0x7fd1f4009e10 comp rx=0 tx=0).stop 2024-05-26T15:41:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20ba00640 1 -- 172.21.15.8:0/965343764 reap_dead start 2024-05-26T15:41:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20dde0f40 1 -- 172.21.15.8:0/965343764 shutdown_connections 2024-05-26T15:41:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.154+0000 7fd20dde0f40 1 -- 172.21.15.8:0/965343764 >> 172.21.15.8:0/965343764 conn(0x559da97281b0 msgr2=0x559da9802650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.155+0000 7fd20dde0f40 1 -- 172.21.15.8:0/965343764 shutdown_connections 2024-05-26T15:41:48.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:48.155+0000 7fd20dde0f40 1 -- 172.21.15.8:0/965343764 wait complete. 2024-05-26T15:41:48.169 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-26T15:41:48.169 DEBUG:teuthology.orchestra.run.smithi008:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-26T15:41:48.334 DEBUG:teuthology.orchestra.run.smithi047:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-26T15:41:48.449 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-26T15:41:48.450 INFO:tasks.cephfs.mount:Terminating background process 2024-05-26T15:41:48.473 INFO:tasks.cephfs.mount:Terminating background process 2024-05-26T15:41:48.536 INFO:tasks.cephfs.mount:Terminating background process 2024-05-26T15:41:48.600 INFO:tasks.cephfs.mount:Terminating background process 2024-05-26T15:41:48.664 INFO:tasks.cephfs.mount:Terminating background process 2024-05-26T15:41:48.728 INFO:tasks.cephfs.mount:Terminating background process 2024-05-26T15:41:48.793 INFO:tasks.cephfs.mount:Terminating background process 2024-05-26T15:41:48.858 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:48.858 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:48.959 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:48.959 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:49.014 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:41:49.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.227+0000 7f8725600640 1 Processor -- start 2024-05-26T15:41:49.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.227+0000 7f8725600640 1 -- start start 2024-05-26T15:41:49.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.229+0000 7f8725600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8720144180 0x7f87200cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.229+0000 7f8725600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8720144560 con 0x7f872006db60 2024-05-26T15:41:49.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.229+0000 7f8725600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872015b190 con 0x7f8720070c80 2024-05-26T15:41:49.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.229+0000 7f8725600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872015b470 con 0x7f8720144180 2024-05-26T15:41:49.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.229+0000 7f871fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8720144180 0x7f87200cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.229+0000 7f871f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f872006db60 0x7f8720070570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41780/0 (socket says 172.21.15.8:41780) 2024-05-26T15:41:49.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.229+0000 7f871f400640 1 -- 172.21.15.8:0/2052403584 learned_addr learned my addr 172.21.15.8:0/2052403584 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:49.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.230+0000 7f871fe00640 1 -- 172.21.15.8:0/2052403584 >> v1:172.21.15.47:6789/0 conn(0x7f8720070c80 legacy=0x7f872006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:49.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.230+0000 7f871fe00640 1 -- 172.21.15.8:0/2052403584 >> v1:172.21.15.8:6789/0 conn(0x7f872006db60 legacy=0x7f8720070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.230+0000 7f871fe00640 1 -- 172.21.15.8:0/2052403584 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872015b750 con 0x7f8720144180 2024-05-26T15:41:49.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.230+0000 7f871ea00640 1 -- 172.21.15.8:0/2052403584 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543409032 0 0) 0x7f8720144560 con 0x7f872006db60 2024-05-26T15:41:49.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.231+0000 7f871fe00640 1 --2- 172.21.15.8:0/2052403584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8720144180 0x7f87200cb160 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f87100097a0 tx=0x7f871002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccf6873b66a5c65 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:49.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.231+0000 7f871ea00640 1 -- 172.21.15.8:0/2052403584 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871002ae50 con 0x7f8720144180 2024-05-26T15:41:49.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.232+0000 7f871ea00640 1 -- 172.21.15.8:0/2052403584 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710032440 con 0x7f8720144180 2024-05-26T15:41:49.230 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.232+0000 7f871ea00640 1 -- 172.21.15.8:0/2052403584 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100327d0 con 0x7f8720144180 2024-05-26T15:41:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.232+0000 7f8725600640 1 -- 172.21.15.8:0/2052403584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8720144180 msgr2=0x7f87200cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.232+0000 7f8725600640 1 --2- 172.21.15.8:0/2052403584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8720144180 0x7f87200cb160 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f87100097a0 tx=0x7f871002a140 comp rx=0 tx=0).stop 2024-05-26T15:41:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.232+0000 7f8725600640 1 -- 172.21.15.8:0/2052403584 shutdown_connections 2024-05-26T15:41:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.232+0000 7f8725600640 1 --2- 172.21.15.8:0/2052403584 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8720144180 0x7f87200cb160 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.232+0000 7f8725600640 1 -- 172.21.15.8:0/2052403584 >> 172.21.15.8:0/2052403584 conn(0x7f8720069ed0 msgr2=0x7f872006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.232+0000 7f8725600640 1 -- 172.21.15.8:0/2052403584 shutdown_connections 2024-05-26T15:41:49.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.232+0000 7f8725600640 1 -- 172.21.15.8:0/2052403584 wait complete. 2024-05-26T15:41:49.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.234+0000 7f8725600640 1 Processor -- start 2024-05-26T15:41:49.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.234+0000 7f8725600640 1 -- start start 2024-05-26T15:41:49.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.235+0000 7f8725600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f872006db60 0x7f8720139ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.235+0000 7f8725600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8720070c80 0x7f87200b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.235+0000 7f8725600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8720144180 0x7f87200b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.235+0000 7f8725600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8720140630 con 0x7f872006db60 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.235+0000 7f8725600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87200b2800 con 0x7f8720070c80 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.235+0000 7f8725600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f872013ff70 con 0x7f8720144180 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.236+0000 7f871fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f872006db60 0x7f8720139ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.236+0000 7f871fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f872006db60 0x7f8720139ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33134/0 (socket says 172.21.15.8:33134) 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.236+0000 7f871fe00640 1 -- 172.21.15.8:0/2804423751 learned_addr learned my addr 172.21.15.8:0/2804423751 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.236+0000 7f871f400640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8720070c80 0x7f87200b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.236+0000 7f8724c00640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8720144180 0x7f87200b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.236+0000 7f871fe00640 1 -- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8720144180 msgr2=0x7f87200b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.236+0000 7f871fe00640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8720144180 0x7f87200b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.236+0000 7f871fe00640 1 -- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8720070c80 msgr2=0x7f87200b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.235 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.236+0000 7f871fe00640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8720070c80 0x7f87200b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.236+0000 7f871fe00640 1 -- 172.21.15.8:0/2804423751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710009400 con 0x7f872006db60 2024-05-26T15:41:49.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.237+0000 7f871fe00640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f872006db60 0x7f8720139ee0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8710000c00 tx=0x7f87100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:49.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.237+0000 7f8717e00640 1 -- 172.21.15.8:0/2804423751 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871003d910 con 0x7f872006db60 2024-05-26T15:41:49.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.237+0000 7f8717e00640 1 -- 172.21.15.8:0/2804423751 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871003da70 con 0x7f872006db60 2024-05-26T15:41:49.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.237+0000 7f8725600640 1 -- 172.21.15.8:0/2804423751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872015af60 con 0x7f872006db60 2024-05-26T15:41:49.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.237+0000 7f8717e00640 1 -- 172.21.15.8:0/2804423751 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871003de20 con 0x7f872006db60 2024-05-26T15:41:49.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.237+0000 7f8725600640 1 -- 172.21.15.8:0/2804423751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87200b2ae0 con 0x7f872006db60 2024-05-26T15:41:49.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.239+0000 7f8725600640 1 -- 172.21.15.8:0/2804423751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872004e210 con 0x7f872006db60 2024-05-26T15:41:49.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.240+0000 7f8717e00640 1 -- 172.21.15.8:0/2804423751 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8710039040 con 0x7f872006db60 2024-05-26T15:41:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.241+0000 7f8717e00640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f870006ac00 0x7f870006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.241+0000 7f8717e00640 1 -- 172.21.15.8:0/2804423751 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f8710032e40 con 0x7f872006db60 2024-05-26T15:41:49.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.241+0000 7f871f400640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f870006ac00 0x7f870006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.243+0000 7f871f400640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f870006ac00 0x7f870006d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f87200cb610 tx=0x7f870c007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:49.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.246+0000 7f8717e00640 1 -- 172.21.15.8:0/2804423751 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8710074ef0 con 0x7f872006db60 2024-05-26T15:41:49.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.445+0000 7f8725600640 1 -- 172.21.15.8:0/2804423751 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f872006a5f0 con 0x7f872006db60 2024-05-26T15:41:49.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.448+0000 7f8717e00640 1 -- 172.21.15.8:0/2804423751 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16467 (secure 0 0 0) 0x7f8710041090 con 0x7f872006db60 2024-05-26T15:41:49.447 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:49.447 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":43,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:41:22.482852+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:41:11.994768+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-26T15:41:12.729228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3972699618":"2024-05-27T15:41:22.474515+0000","172.21.15.47:6837/2181130163":"2024-05-27T15:41:22.454549+0000","172.21.15.8:6834/3972699618":"2024-05-27T15:41:22.474515+0000","172.21.15.47:6834/2181130163":"2024-05-27T15:41:22.454549+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:41:49.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 -- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f870006ac00 msgr2=0x7f870006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f870006ac00 0x7f870006d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f87200cb610 tx=0x7f870c007b50 comp rx=0 tx=0).stop 2024-05-26T15:41:49.449 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 -- 172.21.15.8:0/2804423751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f872006db60 msgr2=0x7f8720139ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f872006db60 0x7f8720139ee0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8710000c00 tx=0x7f87100046c0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 -- 172.21.15.8:0/2804423751 shutdown_connections 2024-05-26T15:41:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8720144180 0x7f87200b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f870006ac00 0x7f870006d0c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8720070c80 0x7f87200b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 --2- 172.21.15.8:0/2804423751 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f872006db60 0x7f8720139ee0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 -- 172.21.15.8:0/2804423751 >> 172.21.15.8:0/2804423751 conn(0x7f8720069ed0 msgr2=0x7f8720159160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 -- 172.21.15.8:0/2804423751 shutdown_connections 2024-05-26T15:41:49.450 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.451+0000 7f8725600640 1 -- 172.21.15.8:0/2804423751 wait complete. 2024-05-26T15:41:49.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:41:11.994768+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:41:12.729228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-26T15:41:49.470 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:41:49.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.685+0000 7fd87d400640 1 Processor -- start 2024-05-26T15:41:49.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.686+0000 7fd87d400640 1 -- start start 2024-05-26T15:41:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.687+0000 7fd87d400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd87806dfe0 0x7fd8780cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.687+0000 7fd87d400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8780cc050 0x7fd8780b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.687+0000 7fd87d400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87815e5b0 con 0x7fd878143230 2024-05-26T15:41:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.687+0000 7fd87d400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87815e190 con 0x7fd87806dfe0 2024-05-26T15:41:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.687+0000 7fd87d400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780cc820 con 0x7fd8780cc050 2024-05-26T15:41:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.688+0000 7fd876800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd878143230 0x7fd87806d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41782/0 (socket says 172.21.15.8:41782) 2024-05-26T15:41:49.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.688+0000 7fd876800640 1 -- 172.21.15.8:0/2399621617 learned_addr learned my addr 172.21.15.8:0/2399621617 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:49.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.688+0000 7fd877200640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8780cc050 0x7fd8780b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.688+0000 7fd875e00640 1 --2- 172.21.15.8:0/2399621617 >> v2:172.21.15.47:3300/0 conn(0x7fd87806dfe0 0x7fd8780cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.688+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717350140 0 0) 0x7fd87815e5b0 con 0x7fd878143230 2024-05-26T15:41:49.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.688+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd85c003520 con 0x7fd878143230 2024-05-26T15:41:49.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3217129961 0 0) 0x7fd85c003520 con 0x7fd878143230 2024-05-26T15:41:49.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8780cc050 msgr2=0x7fd8780b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:49.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8780cc050 0x7fd8780b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 >> v2:172.21.15.47:3300/0 conn(0x7fd87806dfe0 msgr2=0x7fd8780cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 --2- 172.21.15.8:0/2399621617 >> v2:172.21.15.47:3300/0 conn(0x7fd87806dfe0 0x7fd8780cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87815d7f0 con 0x7fd878143230 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fd868001690 con 0x7fd878143230 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 >> v1:172.21.15.8:6789/0 conn(0x7fd878143230 legacy=0x7fd87806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd85c003970 0x7fd85c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 0x7fd85c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8780cc050 0x7fd85c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87815e190 con 0x7fd85c0047c0 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780cc820 con 0x7fd85c003970 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c00bab0 con 0x7fd8780cc050 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd875e00640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 0x7fd85c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.689+0000 7fd876800640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd85c003970 0x7fd85c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.690+0000 7fd875e00640 1 -- 172.21.15.8:0/2399621617 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8780cc050 msgr2=0x7fd85c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:49.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.690+0000 7fd875e00640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd8780cc050 0x7fd85c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.690+0000 7fd875e00640 1 -- 172.21.15.8:0/2399621617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd85c003970 msgr2=0x7fd85c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:49.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.690+0000 7fd875e00640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd85c003970 0x7fd85c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.690+0000 7fd875e00640 1 -- 172.21.15.8:0/2399621617 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c003520 con 0x7fd85c0047c0 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.691+0000 7fd875e00640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 0x7fd85c004c40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd864009a90 tx=0x7fd85c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925e8af2307061a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.691+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864031400 con 0x7fd85c0047c0 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.691+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86402d050 con 0x7fd85c0047c0 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.691+0000 7fd875400640 1 -- 172.21.15.8:0/2399621617 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864031780 con 0x7fd85c0047c0 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.691+0000 7fd87d400640 1 -- 172.21.15.8:0/2399621617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 msgr2=0x7fd85c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.691+0000 7fd87d400640 1 --2- 172.21.15.8:0/2399621617 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 0x7fd85c004c40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd864009a90 tx=0x7fd85c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.692+0000 7fd877200640 1 -- 172.21.15.8:0/2399621617 reap_dead start 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.692+0000 7fd87d400640 1 -- 172.21.15.8:0/2399621617 shutdown_connections 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.692+0000 7fd87d400640 1 -- 172.21.15.8:0/2399621617 >> 172.21.15.8:0/2399621617 conn(0x7fd8780b0820 msgr2=0x7fd8780b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.692+0000 7fd87d400640 1 -- 172.21.15.8:0/2399621617 shutdown_connections 2024-05-26T15:41:49.691 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.692+0000 7fd87d400640 1 -- 172.21.15.8:0/2399621617 wait complete. 2024-05-26T15:41:49.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.693+0000 7fd87d400640 1 Processor -- start 2024-05-26T15:41:49.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.694+0000 7fd87d400640 1 -- start start 2024-05-26T15:41:49.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.694+0000 7fd87d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 0x7fd8781558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd87d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd87806cf80 0x7fd8780aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd87d400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd878139620 0x7fd878139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd87d400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780ab040 con 0x7fd85c0047c0 2024-05-26T15:41:49.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd87d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd878142a90 con 0x7fd87806cf80 2024-05-26T15:41:49.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd87d400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8781427b0 con 0x7fd878139620 2024-05-26T15:41:49.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd876800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 0x7fd8781558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd876800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 0x7fd8781558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33150/0 (socket says 172.21.15.8:33150) 2024-05-26T15:41:49.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd876800640 1 -- 172.21.15.8:0/1032890495 learned_addr learned my addr 172.21.15.8:0/1032890495 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:49.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd877200640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd878139620 0x7fd878139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd875e00640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd87806cf80 0x7fd8780aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd876800640 1 -- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd878139620 msgr2=0x7fd878139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd876800640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd878139620 0x7fd878139ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd876800640 1 -- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd87806cf80 msgr2=0x7fd8780aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd876800640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd87806cf80 0x7fd8780aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.695+0000 7fd876800640 1 -- 172.21.15.8:0/1032890495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878138b40 con 0x7fd85c0047c0 2024-05-26T15:41:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.696+0000 7fd876800640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 0x7fd8781558a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd86800d770 tx=0x7fd86800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.696+0000 7fd86ea00640 1 -- 172.21.15.8:0/1032890495 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8680072d0 con 0x7fd85c0047c0 2024-05-26T15:41:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.696+0000 7fd86ea00640 1 -- 172.21.15.8:0/1032890495 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd868007430 con 0x7fd85c0047c0 2024-05-26T15:41:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.696+0000 7fd87d400640 1 -- 172.21.15.8:0/1032890495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd878138e20 con 0x7fd85c0047c0 2024-05-26T15:41:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.696+0000 7fd86ea00640 1 -- 172.21.15.8:0/1032890495 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8680047e0 con 0x7fd85c0047c0 2024-05-26T15:41:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.696+0000 7fd87d400640 1 -- 172.21.15.8:0/1032890495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd878142440 con 0x7fd85c0047c0 2024-05-26T15:41:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.697+0000 7fd87d400640 1 -- 172.21.15.8:0/1032890495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87804e210 con 0x7fd85c0047c0 2024-05-26T15:41:49.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.698+0000 7fd86ea00640 1 -- 172.21.15.8:0/1032890495 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd868004940 con 0x7fd85c0047c0 2024-05-26T15:41:49.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.699+0000 7fd86ea00640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd85806ac30 0x7fd85806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:49.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.699+0000 7fd86ea00640 1 -- 172.21.15.8:0/1032890495 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fd868089140 con 0x7fd85c0047c0 2024-05-26T15:41:49.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.700+0000 7fd875e00640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd85806ac30 0x7fd85806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:49.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.701+0000 7fd875e00640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd85806ac30 0x7fd85806d0f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd864033000 tx=0x7fd864008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:49.702 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.704+0000 7fd86ea00640 1 -- 172.21.15.8:0/1032890495 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd868054120 con 0x7fd85c0047c0 2024-05-26T15:41:49.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.905+0000 7fd87d400640 1 -- 172.21.15.8:0/1032890495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8780b2020 con 0x7fd85c0047c0 2024-05-26T15:41:49.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.906+0000 7fd86ea00640 1 -- 172.21.15.8:0/1032890495 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd868057740 con 0x7fd85c0047c0 2024-05-26T15:41:49.905 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:41:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.909+0000 7fd87d400640 1 -- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd85806ac30 msgr2=0x7fd85806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.909+0000 7fd87d400640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd85806ac30 0x7fd85806d0f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd864033000 tx=0x7fd864008030 comp rx=0 tx=0).stop 2024-05-26T15:41:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.909+0000 7fd87d400640 1 -- 172.21.15.8:0/1032890495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 msgr2=0x7fd8781558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.909+0000 7fd87d400640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 0x7fd8781558a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd86800d770 tx=0x7fd86800dc30 comp rx=0 tx=0).stop 2024-05-26T15:41:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.909+0000 7fd87d400640 1 -- 172.21.15.8:0/1032890495 shutdown_connections 2024-05-26T15:41:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.909+0000 7fd87d400640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fd878139620 0x7fd878139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.909+0000 7fd87d400640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fd85806ac30 0x7fd85806d0f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.909+0000 7fd87d400640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd87806cf80 0x7fd8780aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.909+0000 7fd87d400640 1 --2- 172.21.15.8:0/1032890495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd85c0047c0 0x7fd8781558a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.909+0000 7fd87d400640 1 -- 172.21.15.8:0/1032890495 >> 172.21.15.8:0/1032890495 conn(0x7fd8780b0820 msgr2=0x7fd87806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.910+0000 7fd87d400640 1 -- 172.21.15.8:0/1032890495 shutdown_connections 2024-05-26T15:41:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:49.910+0000 7fd87d400640 1 -- 172.21.15.8:0/1032890495 wait complete. 2024-05-26T15:41:49.928 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:41:50.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.138+0000 7f73c1a00640 1 Processor -- start 2024-05-26T15:41:50.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.139+0000 7f73c1a00640 1 -- start start 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.140+0000 7f73c1a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73bc142c20 0x7f73bc0cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.140+0000 7f73c1a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f73bc06de20 0x7f73bc0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.140+0000 7f73c1a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73bc0ae2c0 con 0x7f73bc0b3ad0 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.140+0000 7f73c1a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73bc143000 con 0x7f73bc06de20 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.140+0000 7f73c1a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc070720 con 0x7f73bc142c20 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.141+0000 7f73bb400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f73bc0b3ad0 0x7f73bc06d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41798/0 (socket says 172.21.15.8:41798) 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.141+0000 7f73bb400640 1 -- 172.21.15.8:0/437707623 learned_addr learned my addr 172.21.15.8:0/437707623 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.141+0000 7f73c1000640 1 --2- 172.21.15.8:0/437707623 >> v2:172.21.15.47:3300/0 conn(0x7f73bc06de20 0x7f73bc0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.141+0000 7f73bbe00640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73bc142c20 0x7f73bc0cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.141+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129591027 0 0) 0x7f73a8001110 con 0x7f73bc0b3ad0 2024-05-26T15:41:50.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.141+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a0003520 con 0x7f73bc0b3ad0 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1522672434 0 0) 0x7f73a0003520 con 0x7f73bc0b3ad0 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73bc142c20 msgr2=0x7f73bc0cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73bc142c20 0x7f73bc0cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 >> v2:172.21.15.47:3300/0 conn(0x7f73bc06de20 msgr2=0x7f73bc0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 --2- 172.21.15.8:0/437707623 >> v2:172.21.15.47:3300/0 conn(0x7f73bc06de20 0x7f73bc0b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc0ce2a0 con 0x7f73bc0b3ad0 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f73a8001800 con 0x7f73bc0b3ad0 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 >> v1:172.21.15.8:6789/0 conn(0x7f73bc0b3ad0 legacy=0x7f73bc06d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73a00039e0 0x7f73a0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73bc142c20 0x7f73a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a0004d00 0x7f73a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc143000 con 0x7f73a0004d00 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc070720 con 0x7f73a00039e0 2024-05-26T15:41:50.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a000ba00 con 0x7f73bc142c20 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73c1000640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a0004d00 0x7f73a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.142+0000 7f73bb400640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73bc142c20 0x7f73a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.143+0000 7f73c1000640 1 -- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73bc142c20 msgr2=0x7f73a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.143+0000 7f73c1000640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73bc142c20 0x7f73a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.143+0000 7f73bbe00640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73a00039e0 0x7f73a0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.143+0000 7f73c1000640 1 -- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73a00039e0 msgr2=0x7f73a0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.143+0000 7f73c1000640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73a00039e0 0x7f73a0003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.143+0000 7f73c1000640 1 -- 172.21.15.8:0/437707623 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a0003520 con 0x7f73a0004d00 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.143+0000 7f73bb400640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73bc142c20 0x7f73a00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.144+0000 7f73c1000640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a0004d00 0x7f73a0005180 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009fc0 tx=0x7f73a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dd7a28858b7825 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:50.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.144+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4031670 con 0x7f73a0004d00 2024-05-26T15:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.144+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b400f040 con 0x7f73a0004d00 2024-05-26T15:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.144+0000 7f73baa00640 1 -- 172.21.15.8:0/437707623 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4031a10 con 0x7f73a0004d00 2024-05-26T15:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.145+0000 7f73c1a00640 1 -- 172.21.15.8:0/437707623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a0004d00 msgr2=0x7f73a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.145+0000 7f73c1a00640 1 --2- 172.21.15.8:0/437707623 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73a0004d00 0x7f73a0005180 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009fc0 tx=0x7f73a00057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.145+0000 7f73c1000640 1 -- 172.21.15.8:0/437707623 reap_dead start 2024-05-26T15:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.145+0000 7f73c1a00640 1 -- 172.21.15.8:0/437707623 shutdown_connections 2024-05-26T15:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.145+0000 7f73c1a00640 1 -- 172.21.15.8:0/437707623 >> 172.21.15.8:0/437707623 conn(0x7f73bc069ed0 msgr2=0x7f73bc06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.145+0000 7f73c1a00640 1 -- 172.21.15.8:0/437707623 shutdown_connections 2024-05-26T15:41:50.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.145+0000 7f73c1a00640 1 -- 172.21.15.8:0/437707623 wait complete. 2024-05-26T15:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.147+0000 7f73c1a00640 1 Processor -- start 2024-05-26T15:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.147+0000 7f73c1a00640 1 -- start start 2024-05-26T15:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.148+0000 7f73c1a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73a0004d00 0x7f73bc13cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.148+0000 7f73c1a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73bc15a890 0x7f73bc15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.148+0000 7f73c1a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73bc158ca0 0x7f73bc159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.148+0000 7f73c1a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc159640 con 0x7f73bc158ca0 2024-05-26T15:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.148+0000 7f73c1a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc15b930 con 0x7f73bc15a890 2024-05-26T15:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.148+0000 7f73c1a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73bc15b370 con 0x7f73a0004d00 2024-05-26T15:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.148+0000 7f73c1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73bc158ca0 0x7f73bc159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.148+0000 7f73c1000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73bc158ca0 0x7f73bc159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33164/0 (socket says 172.21.15.8:33164) 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.148+0000 7f73c1000640 1 -- 172.21.15.8:0/4135329013 learned_addr learned my addr 172.21.15.8:0/4135329013 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73bb400640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73bc15a890 0x7f73bc15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73bbe00640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73a0004d00 0x7f73bc13cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73c1000640 1 -- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73a0004d00 msgr2=0x7f73bc13cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73c1000640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73a0004d00 0x7f73bc13cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73c1000640 1 -- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73bc15a890 msgr2=0x7f73bc15acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73c1000640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73bc15a890 0x7f73bc15acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73c1000640 1 -- 172.21.15.8:0/4135329013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc15b650 con 0x7f73bc158ca0 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73c1000640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73bc158ca0 0x7f73bc159100 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f73b4033040 tx=0x7f73b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73b3e00640 1 -- 172.21.15.8:0/4135329013 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4003b90 con 0x7f73bc158ca0 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73b3e00640 1 -- 172.21.15.8:0/4135329013 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b4040070 con 0x7f73bc158ca0 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.149+0000 7f73c1a00640 1 -- 172.21.15.8:0/4135329013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc136f60 con 0x7f73bc158ca0 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.150+0000 7f73b3e00640 1 -- 172.21.15.8:0/4135329013 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4031e10 con 0x7f73bc158ca0 2024-05-26T15:41:50.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.150+0000 7f73c1a00640 1 -- 172.21.15.8:0/4135329013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73bc15bdc0 con 0x7f73bc158ca0 2024-05-26T15:41:50.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.151+0000 7f73c1a00640 1 -- 172.21.15.8:0/4135329013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73bc137480 con 0x7f73bc158ca0 2024-05-26T15:41:50.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.152+0000 7f73b3e00640 1 -- 172.21.15.8:0/4135329013 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f73b4042030 con 0x7f73bc158ca0 2024-05-26T15:41:50.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.153+0000 7f73b3e00640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f739c06ac00 0x7f739c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.153+0000 7f73b3e00640 1 -- 172.21.15.8:0/4135329013 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f73b40aadf0 con 0x7f73bc158ca0 2024-05-26T15:41:50.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.153+0000 7f73bbe00640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f739c06ac00 0x7f739c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.155+0000 7f73bbe00640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f739c06ac00 0x7f739c06d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009910 tx=0x7f73ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:50.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.157+0000 7f73b3e00640 1 -- 172.21.15.8:0/4135329013 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f73bc137480 con 0x7f73bc158ca0 2024-05-26T15:41:50.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.354+0000 7f73c1a00640 1 -- 172.21.15.8:0/4135329013 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73bc137480 con 0x7f73bc158ca0 2024-05-26T15:41:50.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.355+0000 7f73b3e00640 1 -- 172.21.15.8:0/4135329013 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f73bc137480 con 0x7f73bc158ca0 2024-05-26T15:41:50.353 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:41:50.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.357+0000 7f73c1a00640 1 -- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f739c06ac00 msgr2=0x7f739c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.357+0000 7f73c1a00640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f739c06ac00 0x7f739c06d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009910 tx=0x7f73ac008040 comp rx=0 tx=0).stop 2024-05-26T15:41:50.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.357+0000 7f73c1a00640 1 -- 172.21.15.8:0/4135329013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73bc158ca0 msgr2=0x7f73bc159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.357+0000 7f73c1a00640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73bc158ca0 0x7f73bc159100 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f73b4033040 tx=0x7f73b4009750 comp rx=0 tx=0).stop 2024-05-26T15:41:50.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.358+0000 7f73c1a00640 1 -- 172.21.15.8:0/4135329013 shutdown_connections 2024-05-26T15:41:50.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.358+0000 7f73c1a00640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73bc158ca0 0x7f73bc159100 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.358+0000 7f73c1a00640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f739c06ac00 0x7f739c06d0c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.358+0000 7f73c1a00640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f73bc15a890 0x7f73bc15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.358+0000 7f73c1a00640 1 --2- 172.21.15.8:0/4135329013 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f73a0004d00 0x7f73bc13cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.358+0000 7f73c1a00640 1 -- 172.21.15.8:0/4135329013 >> 172.21.15.8:0/4135329013 conn(0x7f73bc069ed0 msgr2=0x7f73bc06c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:50.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.358+0000 7f73c1a00640 1 -- 172.21.15.8:0/4135329013 shutdown_connections 2024-05-26T15:41:50.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.358+0000 7f73c1a00640 1 -- 172.21.15.8:0/4135329013 wait complete. 2024-05-26T15:41:50.376 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:41:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.593+0000 7f4b27200640 1 Processor -- start 2024-05-26T15:41:50.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.593+0000 7f4b27200640 1 -- start start 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.595+0000 7f4b27200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4b280b00c0 0x7f4b2806a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.595+0000 7f4b27200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b4960 0x7f4b28145880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.595+0000 7f4b27200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b280b04a0 con 0x7f4b280b0b10 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.595+0000 7f4b27200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b280b1290 con 0x7f4b280b00c0 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.595+0000 7f4b27200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28161570 con 0x7f4b280b4960 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.596+0000 7f4b25e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4b280b00c0 0x7f4b2806a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.596+0000 7f4b25e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4b280b00c0 0x7f4b2806a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33168/0 (socket says 172.21.15.8:33168) 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.596+0000 7f4b25e00640 1 -- 172.21.15.8:0/2586915322 learned_addr learned my addr 172.21.15.8:0/2586915322 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.596+0000 7f4b26800640 1 --2- 172.21.15.8:0/2586915322 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b4960 0x7f4b28145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.596+0000 7f4b25e00640 1 -- 172.21.15.8:0/2586915322 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b4960 msgr2=0x7f4b28145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.596+0000 7f4b25e00640 1 --2- 172.21.15.8:0/2586915322 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b4960 0x7f4b28145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.596+0000 7f4b25e00640 1 -- 172.21.15.8:0/2586915322 >> v1:172.21.15.47:6789/0 conn(0x7f4b280b0b10 legacy=0x7f4b280b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:50.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.596+0000 7f4b25e00640 1 -- 172.21.15.8:0/2586915322 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b281607b0 con 0x7f4b280b00c0 2024-05-26T15:41:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.597+0000 7f4b25e00640 1 --2- 172.21.15.8:0/2586915322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 0x7f4b2806a8e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009870 tx=0x7f4b1802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ea032a8d465d0f server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.598+0000 7f4b24a00640 1 -- 172.21.15.8:0/2586915322 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1802ae10 con 0x7f4b280b00c0 2024-05-26T15:41:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.598+0000 7f4b24a00640 1 -- 172.21.15.8:0/2586915322 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18032440 con 0x7f4b280b00c0 2024-05-26T15:41:50.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.598+0000 7f4b24a00640 1 -- 172.21.15.8:0/2586915322 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180327d0 con 0x7f4b280b00c0 2024-05-26T15:41:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.598+0000 7f4b27200640 1 -- 172.21.15.8:0/2586915322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 msgr2=0x7f4b2806a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.598+0000 7f4b27200640 1 --2- 172.21.15.8:0/2586915322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 0x7f4b2806a8e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009870 tx=0x7f4b1802a100 comp rx=0 tx=0).stop 2024-05-26T15:41:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.599+0000 7f4b27200640 1 -- 172.21.15.8:0/2586915322 shutdown_connections 2024-05-26T15:41:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.599+0000 7f4b27200640 1 --2- 172.21.15.8:0/2586915322 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b4960 0x7f4b28145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.599+0000 7f4b27200640 1 --2- 172.21.15.8:0/2586915322 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 0x7f4b2806a8e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.599+0000 7f4b27200640 1 -- 172.21.15.8:0/2586915322 >> 172.21.15.8:0/2586915322 conn(0x7f4b280b4ee0 msgr2=0x7f4b28098a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.599+0000 7f4b27200640 1 -- 172.21.15.8:0/2586915322 shutdown_connections 2024-05-26T15:41:50.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.599+0000 7f4b27200640 1 -- 172.21.15.8:0/2586915322 wait complete. 2024-05-26T15:41:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.601+0000 7f4b27200640 1 Processor -- start 2024-05-26T15:41:50.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.601+0000 7f4b27200640 1 -- start start 2024-05-26T15:41:50.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.602+0000 7f4b27200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 0x7f4b281576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.602+0000 7f4b27200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b0b10 0x7f4b280accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.602+0000 7f4b27200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b280b4960 0x7f4b281f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.602+0000 7f4b27200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28157c20 con 0x7f4b280b00c0 2024-05-26T15:41:50.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.602+0000 7f4b27200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b281e6a00 con 0x7f4b280b4960 2024-05-26T15:41:50.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.602+0000 7f4b27200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b281e6ce0 con 0x7f4b280b0b10 2024-05-26T15:41:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.602+0000 7f4b25e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 0x7f4b281576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.602+0000 7f4b25e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 0x7f4b281576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33178/0 (socket says 172.21.15.8:33178) 2024-05-26T15:41:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.602+0000 7f4b25e00640 1 -- 172.21.15.8:0/1798402019 learned_addr learned my addr 172.21.15.8:0/1798402019 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.603+0000 7f4b25400640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b0b10 0x7f4b280accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.603+0000 7f4b26800640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b280b4960 0x7f4b281f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.603+0000 7f4b25e00640 1 -- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b0b10 msgr2=0x7f4b280accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.603+0000 7f4b25e00640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b0b10 0x7f4b280accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.603+0000 7f4b25e00640 1 -- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b280b4960 msgr2=0x7f4b281f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.603+0000 7f4b25e00640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b280b4960 0x7f4b281f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.603+0000 7f4b25e00640 1 -- 172.21.15.8:0/1798402019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180094d0 con 0x7f4b280b00c0 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.603+0000 7f4b25400640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b0b10 0x7f4b280accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.603+0000 7f4b25e00640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 0x7f4b281576e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009870 tx=0x7f4b180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.604+0000 7f4b1e000640 1 -- 172.21.15.8:0/1798402019 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180308d0 con 0x7f4b280b00c0 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.604+0000 7f4b1e000640 1 -- 172.21.15.8:0/1798402019 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18030a30 con 0x7f4b280b00c0 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.604+0000 7f4b1e000640 1 -- 172.21.15.8:0/1798402019 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18030de0 con 0x7f4b280b00c0 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.604+0000 7f4b27200640 1 -- 172.21.15.8:0/1798402019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b281e6fc0 con 0x7f4b280b00c0 2024-05-26T15:41:50.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.604+0000 7f4b27200640 1 -- 172.21.15.8:0/1798402019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b281e7580 con 0x7f4b280b00c0 2024-05-26T15:41:50.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.605+0000 7f4b27200640 1 -- 172.21.15.8:0/1798402019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b280b0f30 con 0x7f4b280b00c0 2024-05-26T15:41:50.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.606+0000 7f4b1e000640 1 -- 172.21.15.8:0/1798402019 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4b18039040 con 0x7f4b280b00c0 2024-05-26T15:41:50.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.607+0000 7f4b1e000640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4b0806ac00 0x7f4b0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:50.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.607+0000 7f4b1e000640 1 -- 172.21.15.8:0/1798402019 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f4b180aa1d0 con 0x7f4b280b00c0 2024-05-26T15:41:50.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.607+0000 7f4b25400640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4b0806ac00 0x7f4b0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:50.607 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.609+0000 7f4b25400640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4b0806ac00 0x7f4b0806d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4b280afab0 tx=0x7f4b14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:50.610 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.611+0000 7f4b1e000640 1 -- 172.21.15.8:0/1798402019 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4b280b0f30 con 0x7f4b280b00c0 2024-05-26T15:41:50.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.812+0000 7f4b27200640 1 -- 172.21.15.8:0/1798402019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b280b0f30 con 0x7f4b280b00c0 2024-05-26T15:41:50.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.813+0000 7f4b1e000640 1 -- 172.21.15.8:0/1798402019 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b280b0f30 con 0x7f4b280b00c0 2024-05-26T15:41:50.812 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:41:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 -- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4b0806ac00 msgr2=0x7f4b0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.814 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4b0806ac00 0x7f4b0806d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4b280afab0 tx=0x7f4b14009040 comp rx=0 tx=0).stop 2024-05-26T15:41:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 -- 172.21.15.8:0/1798402019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 msgr2=0x7f4b281576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 0x7f4b281576e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009870 tx=0x7f4b180046c0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 -- 172.21.15.8:0/1798402019 shutdown_connections 2024-05-26T15:41:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4b0806ac00 0x7f4b0806d0c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b280b4960 0x7f4b281f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4b280b0b10 0x7f4b280accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 --2- 172.21.15.8:0/1798402019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b280b00c0 0x7f4b281576e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 -- 172.21.15.8:0/1798402019 >> 172.21.15.8:0/1798402019 conn(0x7f4b280b4ee0 msgr2=0x7f4b2815d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 -- 172.21.15.8:0/1798402019 shutdown_connections 2024-05-26T15:41:50.815 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:50.816+0000 7f4b27200640 1 -- 172.21.15.8:0/1798402019 wait complete. 2024-05-26T15:41:50.834 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-26T15:41:51.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.046+0000 7f7c99400640 1 Processor -- start 2024-05-26T15:41:51.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.047+0000 7f7c99400640 1 -- start start 2024-05-26T15:41:51.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.048+0000 7f7c99400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c94070850 0x7f7c9406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.048+0000 7f7c99400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7c940cc610 0x7f7c9415eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.048+0000 7f7c99400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940a76b0 con 0x7f7c94070c30 2024-05-26T15:41:51.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.048+0000 7f7c99400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9415b320 con 0x7f7c940cc610 2024-05-26T15:41:51.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.048+0000 7f7c99400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9406d500 con 0x7f7c94070850 2024-05-26T15:41:51.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.049+0000 7f7c98a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7c94070c30 0x7f7c9415f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34508/0 (socket says 172.21.15.8:34508) 2024-05-26T15:41:51.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.049+0000 7f7c98a00640 1 -- 172.21.15.8:0/3974834938 learned_addr learned my addr 172.21.15.8:0/3974834938 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.049+0000 7f7c93400640 1 --2- 172.21.15.8:0/3974834938 >> v2:172.21.15.47:3300/0 conn(0x7f7c940cc610 0x7f7c9415eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.049+0000 7f7c93e00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c94070850 0x7f7c9406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.049+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567591182 0 0) 0x7f7c940a76b0 con 0x7f7c94070c30 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.049+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c78003520 con 0x7f7c94070c30 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2941664828 0 0) 0x7f7c78003520 con 0x7f7c94070c30 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c94070850 msgr2=0x7f7c9406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c94070850 0x7f7c9406c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 >> v2:172.21.15.47:3300/0 conn(0x7f7c940cc610 msgr2=0x7f7c9415eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 --2- 172.21.15.8:0/3974834938 >> v2:172.21.15.47:3300/0 conn(0x7f7c940cc610 0x7f7c9415eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9406cf40 con 0x7f7c94070c30 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f7c8c0019f0 con 0x7f7c94070c30 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 >> v1:172.21.15.8:6789/0 conn(0x7f7c94070c30 legacy=0x7f7c9415f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c78003970 0x7f7c78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c94070850 0x7f7c780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c78004d00 0x7f7c78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9415b320 con 0x7f7c78004d00 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9406d500 con 0x7f7c78003970 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7800b980 con 0x7f7c94070850 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.050+0000 7f7c98a00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c78004d00 0x7f7c78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.051+0000 7f7c93400640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c94070850 0x7f7c780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.051+0000 7f7c93e00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c78003970 0x7f7c78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.051+0000 7f7c98a00640 1 -- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c94070850 msgr2=0x7f7c780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.051+0000 7f7c98a00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c94070850 0x7f7c780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.051+0000 7f7c98a00640 1 -- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c78003970 msgr2=0x7f7c78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.051+0000 7f7c98a00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c78003970 0x7f7c78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.051+0000 7f7c98a00640 1 -- 172.21.15.8:0/3974834938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c78003520 con 0x7f7c78004d00 2024-05-26T15:41:51.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.051+0000 7f7c93e00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c78003970 0x7f7c78003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.052+0000 7f7c98a00640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c78004d00 0x7f7c78005180 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00a860 tx=0x7f7c780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c929ee3a1b09e999 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.052+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c02ba80 con 0x7f7c78004d00 2024-05-26T15:41:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.052+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c02bbe0 con 0x7f7c78004d00 2024-05-26T15:41:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.052+0000 7f7c92a00640 1 -- 172.21.15.8:0/3974834938 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c034470 con 0x7f7c78004d00 2024-05-26T15:41:51.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.053+0000 7f7c99400640 1 -- 172.21.15.8:0/3974834938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c78004d00 msgr2=0x7f7c78005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.053+0000 7f7c99400640 1 --2- 172.21.15.8:0/3974834938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c78004d00 0x7f7c78005180 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00a860 tx=0x7f7c780057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.053+0000 7f7c98a00640 1 -- 172.21.15.8:0/3974834938 reap_dead start 2024-05-26T15:41:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.053+0000 7f7c99400640 1 -- 172.21.15.8:0/3974834938 shutdown_connections 2024-05-26T15:41:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.053+0000 7f7c99400640 1 -- 172.21.15.8:0/3974834938 >> 172.21.15.8:0/3974834938 conn(0x7f7c94069ed0 msgr2=0x7f7c9406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.053+0000 7f7c99400640 1 -- 172.21.15.8:0/3974834938 shutdown_connections 2024-05-26T15:41:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.053+0000 7f7c99400640 1 -- 172.21.15.8:0/3974834938 wait complete. 2024-05-26T15:41:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.055+0000 7f7c99400640 1 Processor -- start 2024-05-26T15:41:51.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.055+0000 7f7c99400640 1 -- start start 2024-05-26T15:41:51.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.056+0000 7f7c99400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c78004d00 0x7f7c94138d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.056+0000 7f7c99400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c9413a440 0x7f7c9413e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.056+0000 7f7c99400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94159f20 0x7f7c9413b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.056+0000 7f7c99400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9413ebe0 con 0x7f7c94159f20 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.056+0000 7f7c99400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c941393a0 con 0x7f7c78004d00 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.056+0000 7f7c99400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94139680 con 0x7f7c9413a440 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.057+0000 7f7c98a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94159f20 0x7f7c9413b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.057+0000 7f7c98a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94159f20 0x7f7c9413b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43984/0 (socket says 172.21.15.8:43984) 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.057+0000 7f7c98a00640 1 -- 172.21.15.8:0/2002101272 learned_addr learned my addr 172.21.15.8:0/2002101272 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.057+0000 7f7c93400640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c9413a440 0x7f7c9413e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.057+0000 7f7c93e00640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c78004d00 0x7f7c94138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.057+0000 7f7c98a00640 1 -- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c9413a440 msgr2=0x7f7c9413e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.057+0000 7f7c98a00640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c9413a440 0x7f7c9413e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.057+0000 7f7c98a00640 1 -- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c78004d00 msgr2=0x7f7c94138d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:51.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.057+0000 7f7c98a00640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c78004d00 0x7f7c94138d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.057+0000 7f7c98a00640 1 -- 172.21.15.8:0/2002101272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94139960 con 0x7f7c94159f20 2024-05-26T15:41:51.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.058+0000 7f7c98a00640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94159f20 0x7f7c9413b1f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00a980 tx=0x7f7c8c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.058+0000 7f7c8be00640 1 -- 172.21.15.8:0/2002101272 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c038070 con 0x7f7c94159f20 2024-05-26T15:41:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.058+0000 7f7c8be00640 1 -- 172.21.15.8:0/2002101272 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c001fd0 con 0x7f7c94159f20 2024-05-26T15:41:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.058+0000 7f7c99400640 1 -- 172.21.15.8:0/2002101272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c94139c40 con 0x7f7c94159f20 2024-05-26T15:41:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.058+0000 7f7c8be00640 1 -- 172.21.15.8:0/2002101272 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c034690 con 0x7f7c94159f20 2024-05-26T15:41:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.058+0000 7f7c99400640 1 -- 172.21.15.8:0/2002101272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9415a3a0 con 0x7f7c94159f20 2024-05-26T15:41:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.059+0000 7f7c99400640 1 -- 172.21.15.8:0/2002101272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9413a160 con 0x7f7c94159f20 2024-05-26T15:41:51.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.060+0000 7f7c8be00640 1 -- 172.21.15.8:0/2002101272 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c8c031070 con 0x7f7c94159f20 2024-05-26T15:41:51.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.061+0000 7f7c8be00640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c7406ac30 0x7f7c7406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.061+0000 7f7c8be00640 1 -- 172.21.15.8:0/2002101272 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f7c8c03b040 con 0x7f7c94159f20 2024-05-26T15:41:51.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.062+0000 7f7c93e00640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c7406ac30 0x7f7c7406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.063+0000 7f7c93e00640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c7406ac30 0x7f7c7406d0f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009aa0 tx=0x7f7c84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:51.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.065+0000 7f7c8be00640 1 -- 172.21.15.8:0/2002101272 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7c9413a160 con 0x7f7c94159f20 2024-05-26T15:41:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.277+0000 7f7c99400640 1 -- 172.21.15.8:0/2002101272 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7c9413a160 con 0x7f7c94159f20 2024-05-26T15:41:51.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.278+0000 7f7c8be00640 1 -- 172.21.15.8:0/2002101272 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v43) v1 ==== 80+0+242 (secure 0 0 0) 0x7f7c8c044110 con 0x7f7c94159f20 2024-05-26T15:41:51.276 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6835/3972699618 2024-05-27T15:41:22.474515+0000 2024-05-26T15:41:51.277 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.47:6837/2181130163 2024-05-27T15:41:22.454549+0000 2024-05-26T15:41:51.277 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8:6834/3972699618 2024-05-27T15:41:22.474515+0000 2024-05-26T15:41:51.277 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.47:6834/2181130163 2024-05-27T15:41:22.454549+0000 2024-05-26T15:41:51.277 INFO:teuthology.orchestra.run.smithi008.stderr:listed 4 entries 2024-05-26T15:41:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.280+0000 7f7c99400640 1 -- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c7406ac30 msgr2=0x7f7c7406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c7406ac30 0x7f7c7406d0f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009aa0 tx=0x7f7c84008040 comp rx=0 tx=0).stop 2024-05-26T15:41:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 -- 172.21.15.8:0/2002101272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94159f20 msgr2=0x7f7c9413b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94159f20 0x7f7c9413b1f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00a980 tx=0x7f7c8c001d80 comp rx=0 tx=0).stop 2024-05-26T15:41:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 -- 172.21.15.8:0/2002101272 shutdown_connections 2024-05-26T15:41:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7c94159f20 0x7f7c9413b1f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7c9413a440 0x7f7c9413e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7c7406ac30 0x7f7c7406d0f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 --2- 172.21.15.8:0/2002101272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7c78004d00 0x7f7c94138d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 -- 172.21.15.8:0/2002101272 >> 172.21.15.8:0/2002101272 conn(0x7f7c94069ed0 msgr2=0x7f7c940b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 -- 172.21.15.8:0/2002101272 shutdown_connections 2024-05-26T15:41:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.281+0000 7f7c99400640 1 -- 172.21.15.8:0/2002101272 wait complete. 2024-05-26T15:41:51.298 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-26T15:41:51.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:51.298 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-26T15:41:51.458 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:41:51.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:41:51.458 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-26T15:41:51.506 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:41:51.506 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:51.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-26T15:41:51.547 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:41:51.547 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:51.588 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-26T15:41:51.588 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:41:51.588 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:41:51.635 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-26T15:41:51.635 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:41:51.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.849+0000 7fe53dc00640 1 Processor -- start 2024-05-26T15:41:51.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.850+0000 7fe53dc00640 1 -- start start 2024-05-26T15:41:51.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.851+0000 7fe53dc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe53815ed30 0x7fe53806e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.851+0000 7fe53dc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53806d380 con 0x7fe5381445d0 2024-05-26T15:41:51.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.851+0000 7fe53dc00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53806d660 con 0x7fe53815f230 2024-05-26T15:41:51.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.851+0000 7fe53dc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53806d940 con 0x7fe53815ed30 2024-05-26T15:41:51.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.851+0000 7fe536a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe5381445d0 0x7fe53815e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34524/0 (socket says 172.21.15.8:34524) 2024-05-26T15:41:51.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.852+0000 7fe536a00640 1 -- 172.21.15.8:0/2562046161 learned_addr learned my addr 172.21.15.8:0/2562046161 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:51.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.852+0000 7fe537400640 1 --2- 172.21.15.8:0/2562046161 >> v2:172.21.15.8:3300/0 conn(0x7fe53815ed30 0x7fe53806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.852+0000 7fe536000640 1 -- 172.21.15.8:0/2562046161 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281925247 0 0) 0x7fe53806d380 con 0x7fe5381445d0 2024-05-26T15:41:51.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.852+0000 7fe536000640 1 -- 172.21.15.8:0/2562046161 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe51c003520 con 0x7fe5381445d0 2024-05-26T15:41:51.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.852+0000 7fe537400640 1 -- 172.21.15.8:0/2562046161 >> v1:172.21.15.47:6789/0 conn(0x7fe53815f230 legacy=0x7fe53815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:51.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.852+0000 7fe537400640 1 -- 172.21.15.8:0/2562046161 >> v1:172.21.15.8:6789/0 conn(0x7fe5381445d0 legacy=0x7fe53815e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:51.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.852+0000 7fe537400640 1 -- 172.21.15.8:0/2562046161 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53806dc20 con 0x7fe53815ed30 2024-05-26T15:41:51.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.853+0000 7fe537400640 1 --2- 172.21.15.8:0/2562046161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815ed30 0x7fe53806e630 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe530009d90 tx=0x7fe53002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1245ddb50bef6b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:51.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.853+0000 7fe536000640 1 -- 172.21.15.8:0/2562046161 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530031600 con 0x7fe53815ed30 2024-05-26T15:41:51.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.854+0000 7fe536000640 1 -- 172.21.15.8:0/2562046161 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53002d050 con 0x7fe53815ed30 2024-05-26T15:41:51.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.854+0000 7fe536000640 1 -- 172.21.15.8:0/2562046161 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530031980 con 0x7fe53815ed30 2024-05-26T15:41:51.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.854+0000 7fe53dc00640 1 -- 172.21.15.8:0/2562046161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815ed30 msgr2=0x7fe53806e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:51.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.854+0000 7fe53dc00640 1 --2- 172.21.15.8:0/2562046161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815ed30 0x7fe53806e630 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe530009d90 tx=0x7fe53002a610 comp rx=0 tx=0).stop 2024-05-26T15:41:51.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.854+0000 7fe53dc00640 1 -- 172.21.15.8:0/2562046161 shutdown_connections 2024-05-26T15:41:51.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.854+0000 7fe53dc00640 1 --2- 172.21.15.8:0/2562046161 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815ed30 0x7fe53806e630 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.854+0000 7fe53dc00640 1 -- 172.21.15.8:0/2562046161 >> 172.21.15.8:0/2562046161 conn(0x7fe5380b0720 msgr2=0x7fe5380b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:51.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.854+0000 7fe53dc00640 1 -- 172.21.15.8:0/2562046161 shutdown_connections 2024-05-26T15:41:51.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.855+0000 7fe53dc00640 1 -- 172.21.15.8:0/2562046161 wait complete. 2024-05-26T15:41:51.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.856+0000 7fe53dc00640 1 Processor -- start 2024-05-26T15:41:51.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.856+0000 7fe53dc00640 1 -- start start 2024-05-26T15:41:51.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.857+0000 7fe53dc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5381445d0 0x7fe5380b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.857+0000 7fe53dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe53815ed30 0x7fe5381f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.857+0000 7fe53dc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815f230 0x7fe5381e4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.857+0000 7fe53dc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5381e75c0 con 0x7fe53815f230 2024-05-26T15:41:51.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.857+0000 7fe53dc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53815bcd0 con 0x7fe53815ed30 2024-05-26T15:41:51.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.857+0000 7fe53dc00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5381e6940 con 0x7fe5381445d0 2024-05-26T15:41:51.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe537400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815f230 0x7fe5381e4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe537400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815f230 0x7fe5381e4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44000/0 (socket says 172.21.15.8:44000) 2024-05-26T15:41:51.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe537400640 1 -- 172.21.15.8:0/4275105990 learned_addr learned my addr 172.21.15.8:0/4275105990 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe536a00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5381445d0 0x7fe5380b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe52fe00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe53815ed30 0x7fe5381f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe537400640 1 -- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5381445d0 msgr2=0x7fe5380b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe537400640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5381445d0 0x7fe5380b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe537400640 1 -- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe53815ed30 msgr2=0x7fe5381f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe537400640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe53815ed30 0x7fe5381f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe537400640 1 -- 172.21.15.8:0/4275105990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009a70 con 0x7fe53815f230 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe536a00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5381445d0 0x7fe5380b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.858+0000 7fe52fe00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe53815ed30 0x7fe5381f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.859+0000 7fe537400640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815f230 0x7fe5381e4d50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe530009d90 tx=0x7fe530004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:51.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.859+0000 7fe52ea00640 1 -- 172.21.15.8:0/4275105990 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53003c830 con 0x7fe53815f230 2024-05-26T15:41:51.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.859+0000 7fe52ea00640 1 -- 172.21.15.8:0/4275105990 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53003c990 con 0x7fe53815f230 2024-05-26T15:41:51.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.859+0000 7fe52ea00640 1 -- 172.21.15.8:0/4275105990 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53003cd00 con 0x7fe53815f230 2024-05-26T15:41:51.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.859+0000 7fe53dc00640 1 -- 172.21.15.8:0/4275105990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5381e6c20 con 0x7fe53815f230 2024-05-26T15:41:51.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.859+0000 7fe53dc00640 1 -- 172.21.15.8:0/4275105990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5381e71e0 con 0x7fe53815f230 2024-05-26T15:41:51.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.860+0000 7fe53dc00640 1 -- 172.21.15.8:0/4275105990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5381e7370 con 0x7fe53815f230 2024-05-26T15:41:51.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.861+0000 7fe52ea00640 1 -- 172.21.15.8:0/4275105990 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe53003a3b0 con 0x7fe53815f230 2024-05-26T15:41:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.862+0000 7fe52ea00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe51406ac00 0x7fe51406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:51.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.862+0000 7fe52ea00640 1 -- 172.21.15.8:0/4275105990 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fe5300aacb0 con 0x7fe53815f230 2024-05-26T15:41:51.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.863+0000 7fe536a00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe51406ac00 0x7fe51406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:51.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.864+0000 7fe536a00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe51406ac00 0x7fe51406d0c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe528007fd0 tx=0x7fe528009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:51.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:51.867+0000 7fe52ea00640 1 -- 172.21.15.8:0/4275105990 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe530079690 con 0x7fe53815f230 2024-05-26T15:41:52.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.111+0000 7fe53dc00640 1 -- 172.21.15.8:0/4275105990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe53804e210 con 0x7fe53815f230 2024-05-26T15:41:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.112+0000 7fe52ea00640 1 -- 172.21.15.8:0/4275105990 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4723 (secure 0 0 0) 0x7fe53003ce60 con 0x7fe53815f230 2024-05-26T15:41:52.111 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:52.111 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/481709676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":481709676},{"type":"v1","addr":"172.21.15.47:6837","nonce":481709676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/463162567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":463162567},{"type":"v1","addr":"172.21.15.8:6834","nonce":463162567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2479192780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":2479192780},{"type":"v1","addr":"172.21.15.8:6835","nonce":2479192780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:41:13.704888+0000","modified":"2024-05-26T15:41:26.509872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5122":{"gid":5122,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6835/1710654961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1710654961},{"type":"v1","addr":"172.21.15.47:6835","nonce":1710654961}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-26T15:41:52.111 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 24 2024-05-26T15:41:52.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 -- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe51406ac00 msgr2=0x7fe51406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe51406ac00 0x7fe51406d0c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe528007fd0 tx=0x7fe528009040 comp rx=0 tx=0).stop 2024-05-26T15:41:52.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 -- 172.21.15.8:0/4275105990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815f230 msgr2=0x7fe5381e4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815f230 0x7fe5381e4d50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe530009d90 tx=0x7fe530004a40 comp rx=0 tx=0).stop 2024-05-26T15:41:52.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 -- 172.21.15.8:0/4275105990 shutdown_connections 2024-05-26T15:41:52.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe53815f230 0x7fe5381e4d50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe51406ac00 0x7fe51406d0c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe53815ed30 0x7fe5381f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 --2- 172.21.15.8:0/4275105990 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe5381445d0 0x7fe5380b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 -- 172.21.15.8:0/4275105990 >> 172.21.15.8:0/4275105990 conn(0x7fe5380b0720 msgr2=0x7fe5380adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:52.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.115+0000 7fe53dc00640 1 -- 172.21.15.8:0/4275105990 shutdown_connections 2024-05-26T15:41:52.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.116+0000 7fe53dc00640 1 -- 172.21.15.8:0/4275105990 wait complete. 2024-05-26T15:41:52.134 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.353+0000 7f04faa00640 1 Processor -- start 2024-05-26T15:41:52.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.353+0000 7f04faa00640 1 -- start start 2024-05-26T15:41:52.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.355+0000 7f04faa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f04f4144180 0x7f04f40cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.355+0000 7f04faa00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04f4070c80 0x7f04f406dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.355+0000 7f04faa00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f4144560 con 0x7f04f406db60 2024-05-26T15:41:52.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.355+0000 7f04faa00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f415b190 con 0x7f04f4144180 2024-05-26T15:41:52.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.355+0000 7f04faa00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f415b470 con 0x7f04f4070c80 2024-05-26T15:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.356+0000 7f04f8c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f04f406db60 0x7f04f4070570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34540/0 (socket says 172.21.15.8:34540) 2024-05-26T15:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.356+0000 7f04f8c00640 1 -- 172.21.15.8:0/939515001 learned_addr learned my addr 172.21.15.8:0/939515001 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:52.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.356+0000 7f04f9600640 1 --2- 172.21.15.8:0/939515001 >> v2:172.21.15.47:3300/0 conn(0x7f04f4144180 0x7f04f40cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.356+0000 7f04fa000640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04f4070c80 0x7f04f406dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.356+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119827672 0 0) 0x7f04f4144560 con 0x7f04f406db60 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.356+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04dc003520 con 0x7f04f406db60 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2492768109 0 0) 0x7f04dc003520 con 0x7f04f406db60 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04f4070c80 msgr2=0x7f04f406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04f4070c80 0x7f04f406dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 >> v2:172.21.15.47:3300/0 conn(0x7f04f4144180 msgr2=0x7f04f40cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 --2- 172.21.15.8:0/939515001 >> v2:172.21.15.47:3300/0 conn(0x7f04f4144180 0x7f04f40cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f415b750 con 0x7f04f406db60 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f04e0001670 con 0x7f04f406db60 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 >> v1:172.21.15.8:6789/0 conn(0x7f04f406db60 legacy=0x7f04f4070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04dc003970 0x7f04dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04f4070c80 0x7f04dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04dc004d00 0x7f04dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f415b190 con 0x7f04dc003970 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f415b470 con 0x7f04dc004d00 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc00b9b0 con 0x7f04f4070c80 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.357+0000 7f04f9600640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04dc003970 0x7f04dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.358+0000 7f04fa000640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04dc004d00 0x7f04dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.358+0000 7f04f9600640 1 -- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04f4070c80 msgr2=0x7f04dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.358+0000 7f04f8c00640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04f4070c80 0x7f04dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.358+0000 7f04f9600640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04f4070c80 0x7f04dc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.358+0000 7f04f9600640 1 -- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04dc004d00 msgr2=0x7f04dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.358+0000 7f04f9600640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04dc004d00 0x7f04dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.358+0000 7f04f9600640 1 -- 172.21.15.8:0/939515001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc003520 con 0x7f04dc003970 2024-05-26T15:41:52.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.358+0000 7f04f8c00640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04f4070c80 0x7f04dc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:52.359 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.358+0000 7f04fa000640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04dc004d00 0x7f04dc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.359+0000 7f04f9600640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04dc003970 0x7f04dc003d90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009fc0 tx=0x7f04dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea821c605e255814 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.360+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8031670 con 0x7f04dc003970 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.360+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e800f040 con 0x7f04dc003970 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.360+0000 7f04f3e00640 1 -- 172.21.15.8:0/939515001 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8031a10 con 0x7f04dc003970 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.361+0000 7f04faa00640 1 -- 172.21.15.8:0/939515001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04dc003970 msgr2=0x7f04dc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.361+0000 7f04faa00640 1 --2- 172.21.15.8:0/939515001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04dc003970 0x7f04dc003d90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009fc0 tx=0x7f04dc0057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.361+0000 7f04fa000640 1 -- 172.21.15.8:0/939515001 reap_dead start 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.361+0000 7f04faa00640 1 -- 172.21.15.8:0/939515001 shutdown_connections 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.361+0000 7f04faa00640 1 -- 172.21.15.8:0/939515001 >> 172.21.15.8:0/939515001 conn(0x7f04f4069ed0 msgr2=0x7f04f406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.361+0000 7f04faa00640 1 -- 172.21.15.8:0/939515001 shutdown_connections 2024-05-26T15:41:52.360 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.361+0000 7f04faa00640 1 -- 172.21.15.8:0/939515001 wait complete. 2024-05-26T15:41:52.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.363+0000 7f04faa00640 1 Processor -- start 2024-05-26T15:41:52.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.363+0000 7f04faa00640 1 -- start start 2024-05-26T15:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.364+0000 7f04faa00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04dc003970 0x7f04f41582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.364+0000 7f04faa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04f4140dd0 0x7f04f40a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.364+0000 7f04faa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04f41f03a0 0x7f04f415e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.364+0000 7f04faa00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f4158800 con 0x7f04f41f03a0 2024-05-26T15:41:52.363 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.364+0000 7f04faa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f4141320 con 0x7f04f4140dd0 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.364+0000 7f04faa00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f4141600 con 0x7f04dc003970 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.364+0000 7f04fa000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04f41f03a0 0x7f04f415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.364+0000 7f04fa000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04f41f03a0 0x7f04f415e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44024/0 (socket says 172.21.15.8:44024) 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.364+0000 7f04fa000640 1 -- 172.21.15.8:0/3181752025 learned_addr learned my addr 172.21.15.8:0/3181752025 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04f8c00640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04f4140dd0 0x7f04f40a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04f9600640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04dc003970 0x7f04f41582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04fa000640 1 -- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04dc003970 msgr2=0x7f04f41582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04fa000640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04dc003970 0x7f04f41582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04fa000640 1 -- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04f4140dd0 msgr2=0x7f04f40a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04fa000640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04f4140dd0 0x7f04f40a85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04fa000640 1 -- 172.21.15.8:0/3181752025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f415af60 con 0x7f04f41f03a0 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04f9600640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04dc003970 0x7f04f41582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04f8c00640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04f4140dd0 0x7f04f40a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:52.364 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04fa000640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04f41f03a0 0x7f04f415e250 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f04f406ad60 tx=0x7f04ec010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04f1600640 1 -- 172.21.15.8:0/3181752025 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00e8a0 con 0x7f04f41f03a0 2024-05-26T15:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04f1600640 1 -- 172.21.15.8:0/3181752025 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec00ea20 con 0x7f04f41f03a0 2024-05-26T15:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04f1600640 1 -- 172.21.15.8:0/3181752025 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00edd0 con 0x7f04f41f03a0 2024-05-26T15:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.365+0000 7f04faa00640 1 -- 172.21.15.8:0/3181752025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f41418e0 con 0x7f04f41f03a0 2024-05-26T15:41:52.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.366+0000 7f04faa00640 1 -- 172.21.15.8:0/3181752025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f4141ea0 con 0x7f04f41f03a0 2024-05-26T15:41:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.367+0000 7f04faa00640 1 -- 172.21.15.8:0/3181752025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f404e210 con 0x7f04f41f03a0 2024-05-26T15:41:52.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.368+0000 7f04f1600640 1 -- 172.21.15.8:0/3181752025 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f04ec020410 con 0x7f04f41f03a0 2024-05-26T15:41:52.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.369+0000 7f04f1600640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f04d406ac30 0x7f04d406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.367 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.369+0000 7f04f1600640 1 -- 172.21.15.8:0/3181752025 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f04ec088e30 con 0x7f04f41f03a0 2024-05-26T15:41:52.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.370+0000 7f04f9600640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f04d406ac30 0x7f04d406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.371+0000 7f04f9600640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f04d406ac30 0x7f04d406d0f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f04e8035000 tx=0x7f04e802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:52.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.375+0000 7f04f1600640 1 -- 172.21.15.8:0/3181752025 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f04ec053e30 con 0x7f04f41f03a0 2024-05-26T15:41:52.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.587+0000 7f04faa00640 1 -- 172.21.15.8:0/3181752025 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04f4143930 con 0x7f04f41f03a0 2024-05-26T15:41:52.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.590+0000 7f04f1600640 1 -- 172.21.15.8:0/3181752025 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16467 (secure 0 0 0) 0x7f04ec057450 con 0x7f04f41f03a0 2024-05-26T15:41:52.589 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:52.589 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":43,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:41:22.482852+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:41:11.994768+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-26T15:41:12.729228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3972699618":"2024-05-27T15:41:22.474515+0000","172.21.15.47:6837/2181130163":"2024-05-27T15:41:22.454549+0000","172.21.15.8:6834/3972699618":"2024-05-27T15:41:22.474515+0000","172.21.15.47:6834/2181130163":"2024-05-27T15:41:22.454549+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:41:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 -- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f04d406ac30 msgr2=0x7f04d406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f04d406ac30 0x7f04d406d0f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f04e8035000 tx=0x7f04e802f000 comp rx=0 tx=0).stop 2024-05-26T15:41:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 -- 172.21.15.8:0/3181752025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04f41f03a0 msgr2=0x7f04f415e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04f41f03a0 0x7f04f415e250 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f04f406ad60 tx=0x7f04ec010c20 comp rx=0 tx=0).stop 2024-05-26T15:41:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 -- 172.21.15.8:0/3181752025 shutdown_connections 2024-05-26T15:41:52.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f04f41f03a0 0x7f04f415e250 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f04d406ac30 0x7f04d406d0f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04f4140dd0 0x7f04f40a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 --2- 172.21.15.8:0/3181752025 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f04dc003970 0x7f04f41582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 -- 172.21.15.8:0/3181752025 >> 172.21.15.8:0/3181752025 conn(0x7f04f4069ed0 msgr2=0x7f04f4158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 -- 172.21.15.8:0/3181752025 shutdown_connections 2024-05-26T15:41:52.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.593+0000 7f04faa00640 1 -- 172.21.15.8:0/3181752025 wait complete. 2024-05-26T15:41:52.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:41:11.994768+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:41:12.729228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-26T15:41:52.614 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:41:52.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.822+0000 7f0f9c800640 1 Processor -- start 2024-05-26T15:41:52.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.823+0000 7f0f9c800640 1 -- start start 2024-05-26T15:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.824+0000 7f0f9c800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f94161170 0x7f0f94070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.824+0000 7f0f9c800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0f940ce060 0x7f0f94070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.825+0000 7f0f9c800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f940b3690 con 0x7f0f940b2350 2024-05-26T15:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.825+0000 7f0f9c800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f940b3ea0 con 0x7f0f940ce060 2024-05-26T15:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.825+0000 7f0f9c800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f94161550 con 0x7f0f94161170 2024-05-26T15:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.825+0000 7f0f99400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0f940b2350 0x7f0f9406c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34542/0 (socket says 172.21.15.8:34542) 2024-05-26T15:41:52.823 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.825+0000 7f0f99400640 1 -- 172.21.15.8:0/1094877417 learned_addr learned my addr 172.21.15.8:0/1094877417 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:52.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.825+0000 7f0f99e00640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f94161170 0x7f0f94070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.825+0000 7f0f9a800640 1 --2- 172.21.15.8:0/1094877417 >> v2:172.21.15.47:3300/0 conn(0x7f0f940ce060 0x7f0f94070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.825+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175064230 0 0) 0x7f0f940b3690 con 0x7f0f940b2350 2024-05-26T15:41:52.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.825+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f7c003520 con 0x7f0f940b2350 2024-05-26T15:41:52.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2042064849 0 0) 0x7f0f7c003520 con 0x7f0f940b2350 2024-05-26T15:41:52.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f94161170 msgr2=0x7f0f94070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:52.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f94161170 0x7f0f94070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 >> v2:172.21.15.47:3300/0 conn(0x7f0f940ce060 msgr2=0x7f0f94070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 --2- 172.21.15.8:0/1094877417 >> v2:172.21.15.47:3300/0 conn(0x7f0f940ce060 0x7f0f94070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f940cb5b0 con 0x7f0f940b2350 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f0f84001670 con 0x7f0f940b2350 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 >> v1:172.21.15.8:6789/0 conn(0x7f0f940b2350 legacy=0x7f0f9406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f7c003970 0x7f0f7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f7c0047c0 0x7f0f7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f94161170 0x7f0f7c0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f940b3ea0 con 0x7f0f7c003970 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f94161550 con 0x7f0f7c0047c0 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c00bb10 con 0x7f0f94161170 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.826+0000 7f0f99e00640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f7c003970 0x7f0f7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.827+0000 7f0f99400640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f7c0047c0 0x7f0f7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.827+0000 7f0f99e00640 1 -- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f94161170 msgr2=0x7f0f7c0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:52.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.827+0000 7f0f99e00640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f94161170 0x7f0f7c0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.827+0000 7f0f99e00640 1 -- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f7c0047c0 msgr2=0x7f0f7c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:52.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.827+0000 7f0f99e00640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f7c0047c0 0x7f0f7c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.827+0000 7f0f99e00640 1 -- 172.21.15.8:0/1094877417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c003520 con 0x7f0f7c003970 2024-05-26T15:41:52.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.827+0000 7f0f99400640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f7c0047c0 0x7f0f7c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.828+0000 7f0f99e00640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f7c003970 0x7f0f7c003d90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009ac0 tx=0x7f0f7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7851a33890add server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.828+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88031400 con 0x7f0f7c003970 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.828+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8802d050 con 0x7f0f7c003970 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.828+0000 7f0f98a00640 1 -- 172.21.15.8:0/1094877417 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88031780 con 0x7f0f7c003970 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.829+0000 7f0f9c800640 1 -- 172.21.15.8:0/1094877417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f7c003970 msgr2=0x7f0f7c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.829+0000 7f0f9c800640 1 --2- 172.21.15.8:0/1094877417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f7c003970 0x7f0f7c003d90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009ac0 tx=0x7f0f7c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.829+0000 7f0f9a800640 1 -- 172.21.15.8:0/1094877417 reap_dead start 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.829+0000 7f0f9c800640 1 -- 172.21.15.8:0/1094877417 shutdown_connections 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.829+0000 7f0f9c800640 1 -- 172.21.15.8:0/1094877417 >> 172.21.15.8:0/1094877417 conn(0x7f0f940b0820 msgr2=0x7f0f940b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.829+0000 7f0f9c800640 1 -- 172.21.15.8:0/1094877417 shutdown_connections 2024-05-26T15:41:52.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.829+0000 7f0f9c800640 1 -- 172.21.15.8:0/1094877417 wait complete. 2024-05-26T15:41:52.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.831+0000 7f0f9c800640 1 Processor -- start 2024-05-26T15:41:52.829 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.831+0000 7f0f9c800640 1 -- start start 2024-05-26T15:41:52.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.832+0000 7f0f9c800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f7c003970 0x7f0f940ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.832+0000 7f0f9c800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f941fa560 0x7f0f9415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.832+0000 7f0f9c800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f9414f5e0 0x7f0f9414fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.832+0000 7f0f9c800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9414ffa0 con 0x7f0f941fa560 2024-05-26T15:41:52.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.832+0000 7f0f9c800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941fa9e0 con 0x7f0f9414f5e0 2024-05-26T15:41:52.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.832+0000 7f0f9c800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941facb0 con 0x7f0f7c003970 2024-05-26T15:41:52.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.832+0000 7f0f99400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f941fa560 0x7f0f9415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.832+0000 7f0f99400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f941fa560 0x7f0f9415eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44036/0 (socket says 172.21.15.8:44036) 2024-05-26T15:41:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.832+0000 7f0f99400640 1 -- 172.21.15.8:0/2354126155 learned_addr learned my addr 172.21.15.8:0/2354126155 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f99400640 1 -- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f7c003970 msgr2=0x7f0f940ad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f99e00640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f7c003970 0x7f0f940ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f9a800640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f9414f5e0 0x7f0f9414fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f99400640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f7c003970 0x7f0f940ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f99400640 1 -- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f9414f5e0 msgr2=0x7f0f9414fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f99400640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f9414f5e0 0x7f0f9414fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f99400640 1 -- 172.21.15.8:0/2354126155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f941faf90 con 0x7f0f941fa560 2024-05-26T15:41:52.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f99400640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f941fa560 0x7f0f9415eb20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0f84001eb0 tx=0x7f0f8400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f8e000640 1 -- 172.21.15.8:0/2354126155 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840074e0 con 0x7f0f941fa560 2024-05-26T15:41:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f8e000640 1 -- 172.21.15.8:0/2354126155 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f84007640 con 0x7f0f941fa560 2024-05-26T15:41:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f8e000640 1 -- 172.21.15.8:0/2354126155 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84004a00 con 0x7f0f941fa560 2024-05-26T15:41:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f9c800640 1 -- 172.21.15.8:0/2354126155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f941fb270 con 0x7f0f941fa560 2024-05-26T15:41:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.833+0000 7f0f9c800640 1 -- 172.21.15.8:0/2354126155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9415f060 con 0x7f0f941fa560 2024-05-26T15:41:52.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.834+0000 7f0f9c800640 1 -- 172.21.15.8:0/2354126155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f941fb4b0 con 0x7f0f941fa560 2024-05-26T15:41:52.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.836+0000 7f0f8e000640 1 -- 172.21.15.8:0/2354126155 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f84004b60 con 0x7f0f941fa560 2024-05-26T15:41:52.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.836+0000 7f0f8e000640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f7806ac00 0x7f0f7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:52.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.837+0000 7f0f8e000640 1 -- 172.21.15.8:0/2354126155 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f0f84088fe0 con 0x7f0f941fa560 2024-05-26T15:41:52.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.837+0000 7f0f99e00640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f7806ac00 0x7f0f7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:52.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.839+0000 7f0f99e00640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f7806ac00 0x7f0f7806d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f88033000 tx=0x7f0f88008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:52.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:52.842+0000 7f0f8e000640 1 -- 172.21.15.8:0/2354126155 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0f941fb4b0 con 0x7f0f941fa560 2024-05-26T15:41:53.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.042+0000 7f0f9c800640 1 -- 172.21.15.8:0/2354126155 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f940a89c0 con 0x7f0f941fa560 2024-05-26T15:41:53.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.043+0000 7f0f8e000640 1 -- 172.21.15.8:0/2354126155 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f940a89c0 con 0x7f0f941fa560 2024-05-26T15:41:53.041 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:41:53.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 -- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f7806ac00 msgr2=0x7f0f7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f7806ac00 0x7f0f7806d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f88033000 tx=0x7f0f88008030 comp rx=0 tx=0).stop 2024-05-26T15:41:53.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 -- 172.21.15.8:0/2354126155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f941fa560 msgr2=0x7f0f9415eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f941fa560 0x7f0f9415eb20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0f84001eb0 tx=0x7f0f8400dd40 comp rx=0 tx=0).stop 2024-05-26T15:41:53.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 -- 172.21.15.8:0/2354126155 shutdown_connections 2024-05-26T15:41:53.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f7806ac00 0x7f0f7806d0c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f9414f5e0 0x7f0f9414fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f941fa560 0x7f0f9415eb20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 --2- 172.21.15.8:0/2354126155 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f7c003970 0x7f0f940ad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 -- 172.21.15.8:0/2354126155 >> 172.21.15.8:0/2354126155 conn(0x7f0f940b0820 msgr2=0x7f0f94070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:53.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 -- 172.21.15.8:0/2354126155 shutdown_connections 2024-05-26T15:41:53.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.046+0000 7f0f9c800640 1 -- 172.21.15.8:0/2354126155 wait complete. 2024-05-26T15:41:53.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:41:53.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.285+0000 7f7035200640 1 Processor -- start 2024-05-26T15:41:53.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.285+0000 7f7035200640 1 -- start start 2024-05-26T15:41:53.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.287+0000 7f7035200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7030143230 0x7f703006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.287+0000 7f7035200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f703006de10 0x7f70300cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.287+0000 7f7035200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703006e270 con 0x7f70300cc050 2024-05-26T15:41:53.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.287+0000 7f7035200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703015e190 con 0x7f703006de10 2024-05-26T15:41:53.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.287+0000 7f7035200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703015e5b0 con 0x7f7030143230 2024-05-26T15:41:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.288+0000 7f702d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f703006de10 0x7f70300cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.288+0000 7f702d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f703006de10 0x7f70300cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44044/0 (socket says 172.21.15.8:44044) 2024-05-26T15:41:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.288+0000 7f702d400640 1 -- 172.21.15.8:0/2995150303 learned_addr learned my addr 172.21.15.8:0/2995150303 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.288+0000 7f702de00640 1 --2- 172.21.15.8:0/2995150303 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7030143230 0x7f703006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.288+0000 7f702d400640 1 -- 172.21.15.8:0/2995150303 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7030143230 msgr2=0x7f703006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.288+0000 7f702d400640 1 --2- 172.21.15.8:0/2995150303 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7030143230 0x7f703006d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.288+0000 7f702d400640 1 -- 172.21.15.8:0/2995150303 >> v1:172.21.15.47:6789/0 conn(0x7f70300cc050 legacy=0x7f7030070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.288+0000 7f702d400640 1 -- 172.21.15.8:0/2995150303 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70300cc820 con 0x7f703006de10 2024-05-26T15:41:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.289+0000 7f702d400640 1 --2- 172.21.15.8:0/2995150303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703006de10 0x7f70300cbb10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7018009e50 tx=0x7f701802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cd0e7289ac808c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:53.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.290+0000 7f702ca00640 1 -- 172.21.15.8:0/2995150303 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018031600 con 0x7f703006de10 2024-05-26T15:41:53.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.290+0000 7f702ca00640 1 -- 172.21.15.8:0/2995150303 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701802d050 con 0x7f703006de10 2024-05-26T15:41:53.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.290+0000 7f702ca00640 1 -- 172.21.15.8:0/2995150303 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018031980 con 0x7f703006de10 2024-05-26T15:41:53.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.290+0000 7f7035200640 1 -- 172.21.15.8:0/2995150303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703006de10 msgr2=0x7f70300cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.290+0000 7f7035200640 1 --2- 172.21.15.8:0/2995150303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703006de10 0x7f70300cbb10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7018009e50 tx=0x7f701802a5b0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.290+0000 7f7035200640 1 -- 172.21.15.8:0/2995150303 shutdown_connections 2024-05-26T15:41:53.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.290+0000 7f7035200640 1 --2- 172.21.15.8:0/2995150303 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f703006de10 0x7f70300cbb10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.290+0000 7f7035200640 1 --2- 172.21.15.8:0/2995150303 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7030143230 0x7f703006d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.290+0000 7f7035200640 1 -- 172.21.15.8:0/2995150303 >> 172.21.15.8:0/2995150303 conn(0x7f70300b0820 msgr2=0x7f70300b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:53.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.291+0000 7f7035200640 1 -- 172.21.15.8:0/2995150303 shutdown_connections 2024-05-26T15:41:53.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.291+0000 7f7035200640 1 -- 172.21.15.8:0/2995150303 wait complete. 2024-05-26T15:41:53.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.292+0000 7f7035200640 1 Processor -- start 2024-05-26T15:41:53.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.293+0000 7f7035200640 1 -- start start 2024-05-26T15:41:53.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.293+0000 7f7035200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f703006de10 0x7f7030159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f7035200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70300cc050 0x7f70300ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f7035200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7030143230 0x7f70300aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f7035200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703015a9f0 con 0x7f70300cc050 2024-05-26T15:41:53.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f7035200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7030159670 con 0x7f703006de10 2024-05-26T15:41:53.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f7035200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70300ac8c0 con 0x7f7030143230 2024-05-26T15:41:53.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f702d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70300cc050 0x7f70300ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f702d400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70300cc050 0x7f70300ab8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44060/0 (socket says 172.21.15.8:44060) 2024-05-26T15:41:53.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f702d400640 1 -- 172.21.15.8:0/3122549524 learned_addr learned my addr 172.21.15.8:0/3122549524 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:53.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f702e800640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7030143230 0x7f70300aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f702de00640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f703006de10 0x7f7030159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f702d400640 1 -- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7030143230 msgr2=0x7f70300aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f702d400640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7030143230 0x7f70300aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f702d400640 1 -- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f703006de10 msgr2=0x7f7030159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f702d400640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f703006de10 0x7f7030159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.294+0000 7f702d400640 1 -- 172.21.15.8:0/3122549524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018009b30 con 0x7f70300cc050 2024-05-26T15:41:53.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.295+0000 7f702d400640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70300cc050 0x7f70300ab8b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7018009e50 tx=0x7f7018004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:53.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.295+0000 7f7026000640 1 -- 172.21.15.8:0/3122549524 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701803d860 con 0x7f70300cc050 2024-05-26T15:41:53.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.295+0000 7f7026000640 1 -- 172.21.15.8:0/3122549524 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701803d9c0 con 0x7f70300cc050 2024-05-26T15:41:53.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.295+0000 7f7026000640 1 -- 172.21.15.8:0/3122549524 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701803dd70 con 0x7f70300cc050 2024-05-26T15:41:53.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.295+0000 7f7035200640 1 -- 172.21.15.8:0/3122549524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70300ac300 con 0x7f70300cc050 2024-05-26T15:41:53.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.295+0000 7f7035200640 1 -- 172.21.15.8:0/3122549524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703015a610 con 0x7f70300cc050 2024-05-26T15:41:53.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.296+0000 7f7035200640 1 -- 172.21.15.8:0/3122549524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703015ab30 con 0x7f70300cc050 2024-05-26T15:41:53.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.297+0000 7f7026000640 1 -- 172.21.15.8:0/3122549524 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f701803b400 con 0x7f70300cc050 2024-05-26T15:41:53.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.298+0000 7f7026000640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f700c06ac00 0x7f700c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.298+0000 7f7026000640 1 -- 172.21.15.8:0/3122549524 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f70180aa680 con 0x7f70300cc050 2024-05-26T15:41:53.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.299+0000 7f702de00640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f700c06ac00 0x7f700c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.300+0000 7f702de00640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f700c06ac00 0x7f700c06d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7020006fd0 tx=0x7f7020008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:53.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.303+0000 7f7026000640 1 -- 172.21.15.8:0/3122549524 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f70180755d0 con 0x7f70300cc050 2024-05-26T15:41:53.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.503+0000 7f7035200640 1 -- 172.21.15.8:0/3122549524 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f703004e210 con 0x7f70300cc050 2024-05-26T15:41:53.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.504+0000 7f7026000640 1 -- 172.21.15.8:0/3122549524 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7018078bf0 con 0x7f70300cc050 2024-05-26T15:41:53.503 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 -- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f700c06ac00 msgr2=0x7f700c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f700c06ac00 0x7f700c06d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7020006fd0 tx=0x7f7020008040 comp rx=0 tx=0).stop 2024-05-26T15:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 -- 172.21.15.8:0/3122549524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70300cc050 msgr2=0x7f70300ab8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70300cc050 0x7f70300ab8b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7018009e50 tx=0x7f7018004a40 comp rx=0 tx=0).stop 2024-05-26T15:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 -- 172.21.15.8:0/3122549524 shutdown_connections 2024-05-26T15:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7030143230 0x7f70300aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70300cc050 0x7f70300ab8b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f700c06ac00 0x7f700c06d0c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 --2- 172.21.15.8:0/3122549524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f703006de10 0x7f7030159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 -- 172.21.15.8:0/3122549524 >> 172.21.15.8:0/3122549524 conn(0x7f70300b0820 msgr2=0x7f7030142510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:53.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 -- 172.21.15.8:0/3122549524 shutdown_connections 2024-05-26T15:41:53.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.507+0000 7f7035200640 1 -- 172.21.15.8:0/3122549524 wait complete. 2024-05-26T15:41:53.524 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:41:53.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.740+0000 7fb45cc00640 1 Processor -- start 2024-05-26T15:41:53.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.740+0000 7fb45cc00640 1 -- start start 2024-05-26T15:41:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.741+0000 7fb45cc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb4580b0f40 0x7fb45806aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.741+0000 7fb45cc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb45815eb30 0x7fb45815ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.741+0000 7fb45cc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45815b660 con 0x7fb4580b0b60 2024-05-26T15:41:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.741+0000 7fb45cc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45815e710 con 0x7fb45815eb30 2024-05-26T15:41:53.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.741+0000 7fb45cc00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45815e400 con 0x7fb4580b0f40 2024-05-26T15:41:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.742+0000 7fb457e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb45815eb30 0x7fb45815ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.742+0000 7fb457400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb4580b0b60 0x7fb45815ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34550/0 (socket says 172.21.15.8:34550) 2024-05-26T15:41:53.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.742+0000 7fb457400640 1 -- 172.21.15.8:0/1920455972 learned_addr learned my addr 172.21.15.8:0/1920455972 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.742+0000 7fb456a00640 1 --2- 172.21.15.8:0/1920455972 >> v2:172.21.15.47:3300/0 conn(0x7fb4580b0f40 0x7fb45806aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.742+0000 7fb457e00640 1 -- 172.21.15.8:0/1920455972 >> v2:172.21.15.47:3300/0 conn(0x7fb4580b0f40 msgr2=0x7fb45806aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.742+0000 7fb457e00640 1 --2- 172.21.15.8:0/1920455972 >> v2:172.21.15.47:3300/0 conn(0x7fb4580b0f40 0x7fb45806aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.742+0000 7fb457e00640 1 -- 172.21.15.8:0/1920455972 >> v1:172.21.15.8:6789/0 conn(0x7fb4580b0b60 legacy=0x7fb45815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.742+0000 7fb456000640 1 -- 172.21.15.8:0/1920455972 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033243674 0 0) 0x7fb45815b660 con 0x7fb4580b0b60 2024-05-26T15:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.742+0000 7fb457e00640 1 -- 172.21.15.8:0/1920455972 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45815b940 con 0x7fb45815eb30 2024-05-26T15:41:53.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.743+0000 7fb457e00640 1 --2- 172.21.15.8:0/1920455972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 0x7fb45815ef60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb4580d0790 tx=0x7fb45002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e4d6a5c3ff72ab server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.744+0000 7fb456000640 1 -- 172.21.15.8:0/1920455972 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45002aea0 con 0x7fb45815eb30 2024-05-26T15:41:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.744+0000 7fb456000640 1 -- 172.21.15.8:0/1920455972 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45002d050 con 0x7fb45815eb30 2024-05-26T15:41:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.744+0000 7fb456000640 1 -- 172.21.15.8:0/1920455972 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb450007960 con 0x7fb45815eb30 2024-05-26T15:41:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.744+0000 7fb45cc00640 1 -- 172.21.15.8:0/1920455972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 msgr2=0x7fb45815ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.744+0000 7fb45cc00640 1 --2- 172.21.15.8:0/1920455972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 0x7fb45815ef60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb4580d0790 tx=0x7fb45002a680 comp rx=0 tx=0).stop 2024-05-26T15:41:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.745+0000 7fb45cc00640 1 -- 172.21.15.8:0/1920455972 shutdown_connections 2024-05-26T15:41:53.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.745+0000 7fb45cc00640 1 --2- 172.21.15.8:0/1920455972 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 0x7fb45815ef60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.745+0000 7fb45cc00640 1 --2- 172.21.15.8:0/1920455972 >> v2:172.21.15.47:3300/0 conn(0x7fb4580b0f40 0x7fb45806aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.745+0000 7fb45cc00640 1 -- 172.21.15.8:0/1920455972 >> 172.21.15.8:0/1920455972 conn(0x7fb4580b4ee0 msgr2=0x7fb458098a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:53.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.745+0000 7fb45cc00640 1 -- 172.21.15.8:0/1920455972 shutdown_connections 2024-05-26T15:41:53.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.745+0000 7fb45cc00640 1 -- 172.21.15.8:0/1920455972 wait complete. 2024-05-26T15:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.746+0000 7fb45cc00640 1 Processor -- start 2024-05-26T15:41:53.745 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.747+0000 7fb45cc00640 1 -- start start 2024-05-26T15:41:53.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.748+0000 7fb45cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4580b0b60 0x7fb4580c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.748+0000 7fb45cc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4580b0f40 0x7fb458154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.748+0000 7fb45cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 0x7fb4581e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.748+0000 7fb45cc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580b4860 con 0x7fb45815eb30 2024-05-26T15:41:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.748+0000 7fb45cc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580b3ce0 con 0x7fb4580b0b60 2024-05-26T15:41:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.748+0000 7fb45cc00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580b3fc0 con 0x7fb4580b0f40 2024-05-26T15:41:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.748+0000 7fb457e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 0x7fb4581e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.748+0000 7fb457e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 0x7fb4581e6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44074/0 (socket says 172.21.15.8:44074) 2024-05-26T15:41:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.748+0000 7fb457e00640 1 -- 172.21.15.8:0/467334854 learned_addr learned my addr 172.21.15.8:0/467334854 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:53.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.748+0000 7fb457400640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4580b0b60 0x7fb4580c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb457e00640 1 -- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4580b0f40 msgr2=0x7fb458154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb456a00640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4580b0f40 0x7fb458154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb457e00640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4580b0f40 0x7fb458154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb457e00640 1 -- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4580b0b60 msgr2=0x7fb4580c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb457e00640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4580b0b60 0x7fb4580c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb457e00640 1 -- 172.21.15.8:0/467334854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450009a70 con 0x7fb45815eb30 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb457400640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4580b0b60 0x7fb4580c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb457e00640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 0x7fb4581e6940 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb45002ac70 tx=0x7fb450004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb44f400640 1 -- 172.21.15.8:0/467334854 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45003b820 con 0x7fb45815eb30 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb44f400640 1 -- 172.21.15.8:0/467334854 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45003b980 con 0x7fb45815eb30 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb45cc00640 1 -- 172.21.15.8:0/467334854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4580b42a0 con 0x7fb45815eb30 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.749+0000 7fb44f400640 1 -- 172.21.15.8:0/467334854 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45003bcf0 con 0x7fb45815eb30 2024-05-26T15:41:53.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.750+0000 7fb45cc00640 1 -- 172.21.15.8:0/467334854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4580c99f0 con 0x7fb45815eb30 2024-05-26T15:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.751+0000 7fb45cc00640 1 -- 172.21.15.8:0/467334854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb458073fa0 con 0x7fb45815eb30 2024-05-26T15:41:53.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.752+0000 7fb44f400640 1 -- 172.21.15.8:0/467334854 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb450031400 con 0x7fb45815eb30 2024-05-26T15:41:53.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.753+0000 7fb44f400640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb43806ac00 0x7fb43806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:53.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.753+0000 7fb44f400640 1 -- 172.21.15.8:0/467334854 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fb4500aaf50 con 0x7fb45815eb30 2024-05-26T15:41:53.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.754+0000 7fb457400640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb43806ac00 0x7fb43806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:53.754 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.756+0000 7fb457400640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb43806ac00 0x7fb43806d0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb448000f60 tx=0x7fb448009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:53.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.758+0000 7fb44f400640 1 -- 172.21.15.8:0/467334854 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb450075e10 con 0x7fb45815eb30 2024-05-26T15:41:53.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.959+0000 7fb45cc00640 1 -- 172.21.15.8:0/467334854 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4580cf460 con 0x7fb45815eb30 2024-05-26T15:41:53.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.960+0000 7fb44f400640 1 -- 172.21.15.8:0/467334854 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb450079430 con 0x7fb45815eb30 2024-05-26T15:41:53.959 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:41:53.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.962+0000 7fb45cc00640 1 -- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb43806ac00 msgr2=0x7fb43806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.962+0000 7fb45cc00640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb43806ac00 0x7fb43806d0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb448000f60 tx=0x7fb448009040 comp rx=0 tx=0).stop 2024-05-26T15:41:53.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.963+0000 7fb45cc00640 1 -- 172.21.15.8:0/467334854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 msgr2=0x7fb4581e6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:53.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.963+0000 7fb45cc00640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 0x7fb4581e6940 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb45002ac70 tx=0x7fb450004a40 comp rx=0 tx=0).stop 2024-05-26T15:41:53.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.963+0000 7fb45cc00640 1 -- 172.21.15.8:0/467334854 shutdown_connections 2024-05-26T15:41:53.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.963+0000 7fb45cc00640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb45815eb30 0x7fb4581e6940 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.963+0000 7fb45cc00640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb4580b0f40 0x7fb458154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.963+0000 7fb45cc00640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb43806ac00 0x7fb43806d0c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.963+0000 7fb45cc00640 1 --2- 172.21.15.8:0/467334854 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb4580b0b60 0x7fb4580c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:53.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.963+0000 7fb45cc00640 1 -- 172.21.15.8:0/467334854 >> 172.21.15.8:0/467334854 conn(0x7fb4580b4ee0 msgr2=0x7fb458158f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:53.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.963+0000 7fb45cc00640 1 -- 172.21.15.8:0/467334854 shutdown_connections 2024-05-26T15:41:53.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:53.963+0000 7fb45cc00640 1 -- 172.21.15.8:0/467334854 wait complete. 2024-05-26T15:41:53.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:41:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.188+0000 7f5fb2000640 1 Processor -- start 2024-05-26T15:41:54.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.188+0000 7f5fb2000640 1 -- start start 2024-05-26T15:41:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.190+0000 7f5fb2000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5fac142410 0x7f5fac0cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.190+0000 7f5fb2000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5fac06d6e0 0x7f5fac06db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.190+0000 7f5fb2000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fac0cdd90 con 0x7f5fac142b30 2024-05-26T15:41:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.190+0000 7f5fb2000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fac06e090 con 0x7f5fac06d6e0 2024-05-26T15:41:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.190+0000 7f5fb2000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fac143340 con 0x7f5fac142410 2024-05-26T15:41:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.190+0000 7f5fb1600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5fac06d6e0 0x7f5fac06db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.190+0000 7f5fb1600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f5fac06d6e0 0x7f5fac06db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44088/0 (socket says 172.21.15.8:44088) 2024-05-26T15:41:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.190+0000 7f5fb1600640 1 -- 172.21.15.8:0/475917911 learned_addr learned my addr 172.21.15.8:0/475917911 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:54.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.190+0000 7f5fb0c00640 1 --2- 172.21.15.8:0/475917911 >> v2:172.21.15.47:3300/0 conn(0x7f5fac142410 0x7f5fac0cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.191+0000 7f5fb1600640 1 -- 172.21.15.8:0/475917911 >> v2:172.21.15.47:3300/0 conn(0x7f5fac142410 msgr2=0x7f5fac0cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.191+0000 7f5fb1600640 1 --2- 172.21.15.8:0/475917911 >> v2:172.21.15.47:3300/0 conn(0x7f5fac142410 0x7f5fac0cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.191+0000 7f5fb1600640 1 -- 172.21.15.8:0/475917911 >> v1:172.21.15.47:6789/0 conn(0x7f5fac142b30 legacy=0x7f5fac070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.191+0000 7f5fb1600640 1 -- 172.21.15.8:0/475917911 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac0cdfe0 con 0x7f5fac06d6e0 2024-05-26T15:41:54.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.192+0000 7f5fb1600640 1 --2- 172.21.15.8:0/475917911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 0x7f5fac06db50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5fac06ace0 tx=0x7f5fa402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bd0bc3ddab0681 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.192+0000 7f5fab400640 1 -- 172.21.15.8:0/475917911 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4031600 con 0x7f5fac06d6e0 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.192+0000 7f5fab400640 1 -- 172.21.15.8:0/475917911 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa402d050 con 0x7f5fac06d6e0 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.192+0000 7f5fab400640 1 -- 172.21.15.8:0/475917911 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4031980 con 0x7f5fac06d6e0 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.193+0000 7f5fb2000640 1 -- 172.21.15.8:0/475917911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 msgr2=0x7f5fac06db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.193+0000 7f5fb2000640 1 --2- 172.21.15.8:0/475917911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 0x7f5fac06db50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5fac06ace0 tx=0x7f5fa402a6f0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.193+0000 7f5fb2000640 1 -- 172.21.15.8:0/475917911 shutdown_connections 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.193+0000 7f5fb2000640 1 --2- 172.21.15.8:0/475917911 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 0x7f5fac06db50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.193+0000 7f5fb2000640 1 --2- 172.21.15.8:0/475917911 >> v2:172.21.15.47:3300/0 conn(0x7f5fac142410 0x7f5fac0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.193+0000 7f5fb2000640 1 -- 172.21.15.8:0/475917911 >> 172.21.15.8:0/475917911 conn(0x7f5fac069ed0 msgr2=0x7f5fac06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.193+0000 7f5fb2000640 1 -- 172.21.15.8:0/475917911 shutdown_connections 2024-05-26T15:41:54.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.193+0000 7f5fb2000640 1 -- 172.21.15.8:0/475917911 wait complete. 2024-05-26T15:41:54.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.195+0000 7f5fb2000640 1 Processor -- start 2024-05-26T15:41:54.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.195+0000 7f5fb2000640 1 -- start start 2024-05-26T15:41:54.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.196+0000 7f5fb2000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 0x7f5fac13da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.196+0000 7f5fb2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fac142410 0x7f5fac15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.196+0000 7f5fb2000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5fac142b30 0x7f5fac1e47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.196+0000 7f5fb2000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1e3730 con 0x7f5fac06d6e0 2024-05-26T15:41:54.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.196+0000 7f5fb2000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1e3a10 con 0x7f5fac142410 2024-05-26T15:41:54.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.196+0000 7f5fb2000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1e3cf0 con 0x7f5fac142b30 2024-05-26T15:41:54.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fb0c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 0x7f5fac13da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fb0c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 0x7f5fac13da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44096/0 (socket says 172.21.15.8:44096) 2024-05-26T15:41:54.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fb0c00640 1 -- 172.21.15.8:0/1983177377 learned_addr learned my addr 172.21.15.8:0/1983177377 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:54.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fb1600640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5fac142b30 0x7f5fac1e47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fabe00640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fac142410 0x7f5fac15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fb0c00640 1 -- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5fac142b30 msgr2=0x7f5fac1e47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:54.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fb0c00640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5fac142b30 0x7f5fac1e47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fb0c00640 1 -- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fac142410 msgr2=0x7f5fac15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:54.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fb0c00640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fac142410 0x7f5fac15a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fb0c00640 1 -- 172.21.15.8:0/1983177377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4009b30 con 0x7f5fac06d6e0 2024-05-26T15:41:54.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.197+0000 7f5fabe00640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fac142410 0x7f5fac15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:41:54.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.198+0000 7f5fb0c00640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 0x7f5fac13da50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000d5f0 tx=0x7f5fa000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:54.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.198+0000 7f5fa8c00640 1 -- 172.21.15.8:0/1983177377 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00125f0 con 0x7f5fac06d6e0 2024-05-26T15:41:54.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.198+0000 7f5fa8c00640 1 -- 172.21.15.8:0/1983177377 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa0012750 con 0x7f5fac06d6e0 2024-05-26T15:41:54.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.198+0000 7f5fb2000640 1 -- 172.21.15.8:0/1983177377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fac1e3fd0 con 0x7f5fac06d6e0 2024-05-26T15:41:54.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.198+0000 7f5fa8c00640 1 -- 172.21.15.8:0/1983177377 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0012b00 con 0x7f5fac06d6e0 2024-05-26T15:41:54.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.198+0000 7f5fb2000640 1 -- 172.21.15.8:0/1983177377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac15aab0 con 0x7f5fac06d6e0 2024-05-26T15:41:54.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.200+0000 7f5fb2000640 1 -- 172.21.15.8:0/1983177377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fac04e210 con 0x7f5fac06d6e0 2024-05-26T15:41:54.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.200+0000 7f5fa8c00640 1 -- 172.21.15.8:0/1983177377 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5fa0012c60 con 0x7f5fac06d6e0 2024-05-26T15:41:54.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.201+0000 7f5fa8c00640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.202+0000 7f5fa8c00640 1 -- 172.21.15.8:0/1983177377 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f5fa00899a0 con 0x7f5fac06d6e0 2024-05-26T15:41:54.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.202+0000 7f5fabe00640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.203+0000 7f5fabe00640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5fac15c520 tx=0x7f5f98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:54.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.206+0000 7f5fa8c00640 1 -- 172.21.15.8:0/1983177377 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5fa0054a20 con 0x7f5fac06d6e0 2024-05-26T15:41:54.443 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.445+0000 7f5fb2000640 1 -- 172.21.15.8:0/1983177377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fac0b1c00 con 0x7f5fac06d6e0 2024-05-26T15:41:54.444 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.445+0000 7f5fa8c00640 1 -- 172.21.15.8:0/1983177377 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f5fa0058040 con 0x7f5fac06d6e0 2024-05-26T15:41:54.444 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:54.444 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/481709676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":481709676},{"type":"v1","addr":"172.21.15.47:6837","nonce":481709676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/463162567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":463162567},{"type":"v1","addr":"172.21.15.8:6834","nonce":463162567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2479192780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":2479192780},{"type":"v1","addr":"172.21.15.8:6835","nonce":2479192780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:41:13.704888+0000","modified":"2024-05-26T15:41:26.509872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5122":{"gid":5122,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6835/1710654961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1710654961},{"type":"v1","addr":"172.21.15.47:6835","nonce":1710654961}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-26T15:41:54.444 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 24 2024-05-26T15:41:54.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 -- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f8c06ac00 msgr2=0x7f5f8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:54.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5fac15c520 tx=0x7f5f98009040 comp rx=0 tx=0).stop 2024-05-26T15:41:54.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 -- 172.21.15.8:0/1983177377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 msgr2=0x7f5fac13da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:54.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 0x7f5fac13da50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000d5f0 tx=0x7f5fa000dab0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 -- 172.21.15.8:0/1983177377 shutdown_connections 2024-05-26T15:41:54.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5fac142b30 0x7f5fac1e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fac142410 0x7f5fac15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 --2- 172.21.15.8:0/1983177377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5fac06d6e0 0x7f5fac13da50 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.447 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 -- 172.21.15.8:0/1983177377 >> 172.21.15.8:0/1983177377 conn(0x7f5fac069ed0 msgr2=0x7f5fac0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 -- 172.21.15.8:0/1983177377 shutdown_connections 2024-05-26T15:41:54.448 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.448+0000 7f5fb2000640 1 -- 172.21.15.8:0/1983177377 wait complete. 2024-05-26T15:41:54.467 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:41:54.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.672+0000 7f7fcbe00640 1 Processor -- start 2024-05-26T15:41:54.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.672+0000 7f7fcbe00640 1 -- start start 2024-05-26T15:41:54.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.674+0000 7f7fcbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7fcc144180 0x7f7fcc0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.674+0000 7f7fcbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7fcc070c80 0x7f7fcc06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.674+0000 7f7fcbe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc144560 con 0x7f7fcc06db60 2024-05-26T15:41:54.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.674+0000 7f7fcbe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc15b190 con 0x7f7fcc144180 2024-05-26T15:41:54.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.674+0000 7f7fcbe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc15b470 con 0x7f7fcc070c80 2024-05-26T15:41:54.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.674+0000 7f7fcaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7fcc144180 0x7f7fcc0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.675+0000 7f7fcaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7fcc144180 0x7f7fcc0cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44108/0 (socket says 172.21.15.8:44108) 2024-05-26T15:41:54.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.675+0000 7f7fcaa00640 1 -- 172.21.15.8:0/3022915441 learned_addr learned my addr 172.21.15.8:0/3022915441 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:54.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.675+0000 7f7fcb400640 1 --2- 172.21.15.8:0/3022915441 >> v2:172.21.15.47:3300/0 conn(0x7f7fcc070c80 0x7f7fcc06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.675+0000 7f7fcaa00640 1 -- 172.21.15.8:0/3022915441 >> v2:172.21.15.47:3300/0 conn(0x7f7fcc070c80 msgr2=0x7f7fcc06dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:54.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.675+0000 7f7fcaa00640 1 --2- 172.21.15.8:0/3022915441 >> v2:172.21.15.47:3300/0 conn(0x7f7fcc070c80 0x7f7fcc06dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.675+0000 7f7fcaa00640 1 -- 172.21.15.8:0/3022915441 >> v1:172.21.15.47:6789/0 conn(0x7f7fcc06db60 legacy=0x7f7fcc070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:54.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.675+0000 7f7fcaa00640 1 -- 172.21.15.8:0/3022915441 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc15b750 con 0x7f7fcc144180 2024-05-26T15:41:54.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.676+0000 7f7fcaa00640 1 --2- 172.21.15.8:0/3022915441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 0x7f7fcc0cb160 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0b3e30 tx=0x7f7fbc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3194b17e6bcfc039 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:54.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.677+0000 7f7fca000640 1 -- 172.21.15.8:0/3022915441 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc032440 con 0x7f7fcc144180 2024-05-26T15:41:54.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.677+0000 7f7fca000640 1 -- 172.21.15.8:0/3022915441 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc0325a0 con 0x7f7fcc144180 2024-05-26T15:41:54.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.677+0000 7f7fca000640 1 -- 172.21.15.8:0/3022915441 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc032930 con 0x7f7fcc144180 2024-05-26T15:41:54.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.677+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3022915441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 msgr2=0x7f7fcc0cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:54.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.677+0000 7f7fcbe00640 1 --2- 172.21.15.8:0/3022915441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 0x7f7fcc0cb160 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0b3e30 tx=0x7f7fbc02a1a0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.677+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3022915441 shutdown_connections 2024-05-26T15:41:54.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.677+0000 7f7fcbe00640 1 --2- 172.21.15.8:0/3022915441 >> v2:172.21.15.47:3300/0 conn(0x7f7fcc070c80 0x7f7fcc06dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.677+0000 7f7fcbe00640 1 --2- 172.21.15.8:0/3022915441 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 0x7f7fcc0cb160 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.677+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3022915441 >> 172.21.15.8:0/3022915441 conn(0x7f7fcc069ed0 msgr2=0x7f7fcc06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:54.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.678+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3022915441 shutdown_connections 2024-05-26T15:41:54.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.678+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3022915441 wait complete. 2024-05-26T15:41:54.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.680+0000 7f7fcbe00640 1 Processor -- start 2024-05-26T15:41:54.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.680+0000 7f7fcbe00640 1 -- start start 2024-05-26T15:41:54.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.681+0000 7f7fcbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7fcc06db60 0x7f7fcc1431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.681+0000 7f7fcbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fcc070c80 0x7f7fcc139380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 0x7f7fcc140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcbe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc158830 con 0x7f7fcc144180 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc157c20 con 0x7f7fcc070c80 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcbe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc157f00 con 0x7f7fcc06db60 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 0x7f7fcc140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 0x7f7fcc140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44114/0 (socket says 172.21.15.8:44114) 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcb400640 1 -- 172.21.15.8:0/3598024686 learned_addr learned my addr 172.21.15.8:0/3598024686 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcaa00640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7fcc06db60 0x7f7fcc1431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fc2000640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fcc070c80 0x7f7fcc139380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcb400640 1 -- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7fcc06db60 msgr2=0x7f7fcc1431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcb400640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7fcc06db60 0x7f7fcc1431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcb400640 1 -- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fcc070c80 msgr2=0x7f7fcc139380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:54.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcb400640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fcc070c80 0x7f7fcc139380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.682+0000 7f7fcb400640 1 -- 172.21.15.8:0/3598024686 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0094d0 con 0x7f7fcc144180 2024-05-26T15:41:54.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.683+0000 7f7fcb400640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 0x7f7fcc140890 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400d5d0 tx=0x7f7fc400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:54.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.683+0000 7f7fc3400640 1 -- 172.21.15.8:0/3598024686 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc40125f0 con 0x7f7fcc144180 2024-05-26T15:41:54.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.683+0000 7f7fc3400640 1 -- 172.21.15.8:0/3598024686 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc4012750 con 0x7f7fcc144180 2024-05-26T15:41:54.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.683+0000 7f7fc3400640 1 -- 172.21.15.8:0/3598024686 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4012b00 con 0x7f7fcc144180 2024-05-26T15:41:54.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.683+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3598024686 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc15af60 con 0x7f7fcc144180 2024-05-26T15:41:54.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.683+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3598024686 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc1584c0 con 0x7f7fcc144180 2024-05-26T15:41:54.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.684+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3598024686 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc1589a0 con 0x7f7fcc144180 2024-05-26T15:41:54.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.685+0000 7f7fc3400640 1 -- 172.21.15.8:0/3598024686 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7fc4012c60 con 0x7f7fcc144180 2024-05-26T15:41:54.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.686+0000 7f7fc3400640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fa806ac30 0x7f7fa806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:54.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.686+0000 7f7fc3400640 1 -- 172.21.15.8:0/3598024686 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f7fc4089a20 con 0x7f7fcc144180 2024-05-26T15:41:54.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.687+0000 7f7fcaa00640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fa806ac30 0x7f7fa806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:54.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.688+0000 7f7fcaa00640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fa806ac30 0x7f7fa806d0f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc034000 tx=0x7f7fbc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:54.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.692+0000 7f7fc3400640 1 -- 172.21.15.8:0/3598024686 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7fc4054a10 con 0x7f7fcc144180 2024-05-26T15:41:54.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.891+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3598024686 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fcc04e210 con 0x7f7fcc144180 2024-05-26T15:41:54.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.894+0000 7f7fc3400640 1 -- 172.21.15.8:0/3598024686 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16467 (secure 0 0 0) 0x7f7fc4058030 con 0x7f7fcc144180 2024-05-26T15:41:54.893 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:54.893 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":43,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:41:22.482852+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:41:11.994768+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-26T15:41:12.729228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3972699618":"2024-05-27T15:41:22.474515+0000","172.21.15.47:6837/2181130163":"2024-05-27T15:41:22.454549+0000","172.21.15.8:6834/3972699618":"2024-05-27T15:41:22.474515+0000","172.21.15.47:6834/2181130163":"2024-05-27T15:41:22.454549+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:41:54.895 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fa806ac30 msgr2=0x7f7fa806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fa806ac30 0x7f7fa806d0f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc034000 tx=0x7f7fbc02e000 comp rx=0 tx=0).stop 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3598024686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 msgr2=0x7f7fcc140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 0x7f7fcc140890 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400d5d0 tx=0x7f7fc400da90 comp rx=0 tx=0).stop 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3598024686 shutdown_connections 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7fcc144180 0x7f7fcc140890 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fa806ac30 0x7f7fa806d0f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fcc070c80 0x7f7fcc139380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 --2- 172.21.15.8:0/3598024686 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7fcc06db60 0x7f7fcc1431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3598024686 >> 172.21.15.8:0/3598024686 conn(0x7f7fcc069ed0 msgr2=0x7f7fcc06c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3598024686 shutdown_connections 2024-05-26T15:41:54.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:54.897+0000 7f7fcbe00640 1 -- 172.21.15.8:0/3598024686 wait complete. 2024-05-26T15:41:54.916 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-26T15:41:54.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:41:55.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.130+0000 7fe8c5600640 1 Processor -- start 2024-05-26T15:41:55.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.131+0000 7fe8c5600640 1 -- start start 2024-05-26T15:41:55.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.132+0000 7fe8c5600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe8c00cde90 0x7fe8c0160890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.132+0000 7fe8c5600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8c00b8420 0x7fe8c00d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.132+0000 7fe8c5600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c01617c0 con 0x7fe8c015cca0 2024-05-26T15:41:55.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.132+0000 7fe8c5600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c00b5b50 con 0x7fe8c00cde90 2024-05-26T15:41:55.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.132+0000 7fe8c5600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c0160f20 con 0x7fe8c00b8420 2024-05-26T15:41:55.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.133+0000 7fe8bfe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe8c015cca0 0x7fe8c00cd780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34554/0 (socket says 172.21.15.8:34554) 2024-05-26T15:41:55.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.133+0000 7fe8bfe00640 1 -- 172.21.15.8:0/1627717910 learned_addr learned my addr 172.21.15.8:0/1627717910 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:55.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.133+0000 7fe8bf400640 1 --2- 172.21.15.8:0/1627717910 >> v2:172.21.15.8:3300/0 conn(0x7fe8c00cde90 0x7fe8c0160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.133+0000 7fe8c4c00640 1 --2- 172.21.15.8:0/1627717910 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8c00b8420 0x7fe8c00d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.133+0000 7fe8bea00640 1 -- 172.21.15.8:0/1627717910 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018627832 0 0) 0x7fe8c01617c0 con 0x7fe8c015cca0 2024-05-26T15:41:55.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.133+0000 7fe8bea00640 1 -- 172.21.15.8:0/1627717910 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a4003520 con 0x7fe8c015cca0 2024-05-26T15:41:55.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.133+0000 7fe8bf400640 1 -- 172.21.15.8:0/1627717910 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8c00b8420 msgr2=0x7fe8c00d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:55.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.133+0000 7fe8bf400640 1 --2- 172.21.15.8:0/1627717910 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8c00b8420 0x7fe8c00d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.133+0000 7fe8bf400640 1 -- 172.21.15.8:0/1627717910 >> v1:172.21.15.8:6789/0 conn(0x7fe8c015cca0 legacy=0x7fe8c00cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.133+0000 7fe8bf400640 1 -- 172.21.15.8:0/1627717910 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c0161200 con 0x7fe8c00cde90 2024-05-26T15:41:55.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.135+0000 7fe8bf400640 1 --2- 172.21.15.8:0/1627717910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00cde90 0x7fe8c0160890 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0097a0 tx=0x7fe8ac02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09e256e5ae1d455 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:55.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.135+0000 7fe8bea00640 1 -- 172.21.15.8:0/1627717910 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac02ae50 con 0x7fe8c00cde90 2024-05-26T15:41:55.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.135+0000 7fe8bea00640 1 -- 172.21.15.8:0/1627717910 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac032440 con 0x7fe8c00cde90 2024-05-26T15:41:55.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.135+0000 7fe8bea00640 1 -- 172.21.15.8:0/1627717910 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0327d0 con 0x7fe8c00cde90 2024-05-26T15:41:55.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.135+0000 7fe8c5600640 1 -- 172.21.15.8:0/1627717910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00cde90 msgr2=0x7fe8c0160890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.135+0000 7fe8c5600640 1 --2- 172.21.15.8:0/1627717910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00cde90 0x7fe8c0160890 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac0097a0 tx=0x7fe8ac02a100 comp rx=0 tx=0).stop 2024-05-26T15:41:55.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.136+0000 7fe8c5600640 1 -- 172.21.15.8:0/1627717910 shutdown_connections 2024-05-26T15:41:55.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.136+0000 7fe8c5600640 1 --2- 172.21.15.8:0/1627717910 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8c00b8420 0x7fe8c00d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.136+0000 7fe8c5600640 1 --2- 172.21.15.8:0/1627717910 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00cde90 0x7fe8c0160890 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.136+0000 7fe8c5600640 1 -- 172.21.15.8:0/1627717910 >> 172.21.15.8:0/1627717910 conn(0x7fe8c006b740 msgr2=0x7fe8c006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:55.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.136+0000 7fe8c5600640 1 -- 172.21.15.8:0/1627717910 shutdown_connections 2024-05-26T15:41:55.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.136+0000 7fe8c5600640 1 -- 172.21.15.8:0/1627717910 wait complete. 2024-05-26T15:41:55.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.137+0000 7fe8c5600640 1 Processor -- start 2024-05-26T15:41:55.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.138+0000 7fe8c5600640 1 -- start start 2024-05-26T15:41:55.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8c5600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00b8420 0x7fe8c00c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8c5600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8c00cde90 0x7fe8c00c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8c5600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8c015cca0 0x7fe8c00b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8c5600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00c64e0 con 0x7fe8c00b8420 2024-05-26T15:41:55.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8c5600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00c83b0 con 0x7fe8c00cde90 2024-05-26T15:41:55.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8c5600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00b2ad0 con 0x7fe8c015cca0 2024-05-26T15:41:55.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8bfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00b8420 0x7fe8c00c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8bfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00b8420 0x7fe8c00c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44128/0 (socket says 172.21.15.8:44128) 2024-05-26T15:41:55.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8bfe00640 1 -- 172.21.15.8:0/2780012426 learned_addr learned my addr 172.21.15.8:0/2780012426 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:55.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8c4c00640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8c015cca0 0x7fe8c00b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8bf400640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8c00cde90 0x7fe8c00c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8bfe00640 1 -- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8c015cca0 msgr2=0x7fe8c00b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8bfe00640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8c015cca0 0x7fe8c00b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8bfe00640 1 -- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8c00cde90 msgr2=0x7fe8c00c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.139+0000 7fe8bfe00640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8c00cde90 0x7fe8c00c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.140+0000 7fe8bfe00640 1 -- 172.21.15.8:0/2780012426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac009400 con 0x7fe8c00b8420 2024-05-26T15:41:55.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.140+0000 7fe8bfe00640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00b8420 0x7fe8c00c7e70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c500 tx=0x7fe8b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:55.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.140+0000 7fe8b7e00640 1 -- 172.21.15.8:0/2780012426 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0005ce0 con 0x7fe8c00b8420 2024-05-26T15:41:55.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.140+0000 7fe8b7e00640 1 -- 172.21.15.8:0/2780012426 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0005e40 con 0x7fe8c00b8420 2024-05-26T15:41:55.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.140+0000 7fe8b7e00640 1 -- 172.21.15.8:0/2780012426 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0007330 con 0x7fe8c00b8420 2024-05-26T15:41:55.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.140+0000 7fe8c5600640 1 -- 172.21.15.8:0/2780012426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c00b2db0 con 0x7fe8c00b8420 2024-05-26T15:41:55.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.140+0000 7fe8c5600640 1 -- 172.21.15.8:0/2780012426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c00b3370 con 0x7fe8c00b8420 2024-05-26T15:41:55.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.142+0000 7fe8c5600640 1 -- 172.21.15.8:0/2780012426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c004e210 con 0x7fe8c00b8420 2024-05-26T15:41:55.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.143+0000 7fe8b7e00640 1 -- 172.21.15.8:0/2780012426 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8b0007550 con 0x7fe8c00b8420 2024-05-26T15:41:55.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.144+0000 7fe8b7e00640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8a006ac00 0x7fe8a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.144+0000 7fe8b7e00640 1 -- 172.21.15.8:0/2780012426 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fe8b0088c60 con 0x7fe8c00b8420 2024-05-26T15:41:55.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.144+0000 7fe8bf400640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8a006ac00 0x7fe8a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.145+0000 7fe8bf400640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8a006ac00 0x7fe8a006d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac034000 tx=0x7fe8ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:55.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.148+0000 7fe8b7e00640 1 -- 172.21.15.8:0/2780012426 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe8b0053d00 con 0x7fe8c00b8420 2024-05-26T15:41:55.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.385+0000 7fe8c5600640 1 -- 172.21.15.8:0/2780012426 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8c00d06c0 con 0x7fe8c00b8420 2024-05-26T15:41:55.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.386+0000 7fe8b7e00640 1 -- 172.21.15.8:0/2780012426 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4723 (secure 0 0 0) 0x7fe8b0017020 con 0x7fe8c00b8420 2024-05-26T15:41:55.384 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:55.385 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/481709676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":481709676},{"type":"v1","addr":"172.21.15.47:6837","nonce":481709676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/463162567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":463162567},{"type":"v1","addr":"172.21.15.8:6834","nonce":463162567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2479192780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":2479192780},{"type":"v1","addr":"172.21.15.8:6835","nonce":2479192780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:41:13.704888+0000","modified":"2024-05-26T15:41:26.509872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5122":{"gid":5122,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6835/1710654961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1710654961},{"type":"v1","addr":"172.21.15.47:6835","nonce":1710654961}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-26T15:41:55.385 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 24 2024-05-26T15:41:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.388+0000 7fe8c5600640 1 -- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8a006ac00 msgr2=0x7fe8a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.388+0000 7fe8c5600640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8a006ac00 0x7fe8a006d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac034000 tx=0x7fe8ac02e000 comp rx=0 tx=0).stop 2024-05-26T15:41:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.388+0000 7fe8c5600640 1 -- 172.21.15.8:0/2780012426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00b8420 msgr2=0x7fe8c00c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.388+0000 7fe8c5600640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00b8420 0x7fe8c00c7e70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c500 tx=0x7fe8b000c9c0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.388+0000 7fe8c5600640 1 -- 172.21.15.8:0/2780012426 shutdown_connections 2024-05-26T15:41:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.388+0000 7fe8c5600640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8c015cca0 0x7fe8c00b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.388+0000 7fe8c5600640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe8a006ac00 0x7fe8a006d0c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.388+0000 7fe8c5600640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8c00cde90 0x7fe8c00c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.388+0000 7fe8c5600640 1 --2- 172.21.15.8:0/2780012426 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8c00b8420 0x7fe8c00c7e70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.388+0000 7fe8c5600640 1 -- 172.21.15.8:0/2780012426 >> 172.21.15.8:0/2780012426 conn(0x7fe8c006b740 msgr2=0x7fe8c015d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.389+0000 7fe8c5600640 1 -- 172.21.15.8:0/2780012426 shutdown_connections 2024-05-26T15:41:55.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.389+0000 7fe8c5600640 1 -- 172.21.15.8:0/2780012426 wait complete. 2024-05-26T15:41:55.408 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:41:55.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.625+0000 7fb343200640 1 Processor -- start 2024-05-26T15:41:55.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.625+0000 7fb343200640 1 -- start start 2024-05-26T15:41:55.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.626+0000 7fb343200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb34415cca0 0x7fb344160890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.626+0000 7fb343200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb3440cde90 0x7fb3440d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.626+0000 7fb343200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3441617c0 con 0x7fb3440b8420 2024-05-26T15:41:55.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.626+0000 7fb343200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3440b5b50 con 0x7fb34415cca0 2024-05-26T15:41:55.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.626+0000 7fb343200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb344160f20 con 0x7fb3440cde90 2024-05-26T15:41:55.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.627+0000 7fb341e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb34415cca0 0x7fb344160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.627+0000 7fb341e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb34415cca0 0x7fb344160890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44138/0 (socket says 172.21.15.8:44138) 2024-05-26T15:41:55.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.627+0000 7fb341e00640 1 -- 172.21.15.8:0/1710368786 learned_addr learned my addr 172.21.15.8:0/1710368786 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:55.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.627+0000 7fb342800640 1 --2- 172.21.15.8:0/1710368786 >> v2:172.21.15.47:3300/0 conn(0x7fb3440cde90 0x7fb3440d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.627+0000 7fb341e00640 1 -- 172.21.15.8:0/1710368786 >> v2:172.21.15.47:3300/0 conn(0x7fb3440cde90 msgr2=0x7fb3440d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:55.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.627+0000 7fb341e00640 1 --2- 172.21.15.8:0/1710368786 >> v2:172.21.15.47:3300/0 conn(0x7fb3440cde90 0x7fb3440d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.627+0000 7fb341e00640 1 -- 172.21.15.8:0/1710368786 >> v1:172.21.15.47:6789/0 conn(0x7fb3440b8420 legacy=0x7fb3440cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:55.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.627+0000 7fb341e00640 1 -- 172.21.15.8:0/1710368786 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344161200 con 0x7fb34415cca0 2024-05-26T15:41:55.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.628+0000 7fb341e00640 1 --2- 172.21.15.8:0/1710368786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb34415cca0 0x7fb344160890 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb3440b55a0 tx=0x7fb33402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e229b434b76c95a server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:55.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.629+0000 7fb341400640 1 -- 172.21.15.8:0/1710368786 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33402ae70 con 0x7fb34415cca0 2024-05-26T15:41:55.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.629+0000 7fb341400640 1 -- 172.21.15.8:0/1710368786 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb334032440 con 0x7fb34415cca0 2024-05-26T15:41:55.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.629+0000 7fb341400640 1 -- 172.21.15.8:0/1710368786 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3340327d0 con 0x7fb34415cca0 2024-05-26T15:41:55.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.630+0000 7fb343200640 1 -- 172.21.15.8:0/1710368786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb34415cca0 msgr2=0x7fb344160890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.630+0000 7fb343200640 1 --2- 172.21.15.8:0/1710368786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb34415cca0 0x7fb344160890 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb3440b55a0 tx=0x7fb33402a160 comp rx=0 tx=0).stop 2024-05-26T15:41:55.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.630+0000 7fb343200640 1 -- 172.21.15.8:0/1710368786 shutdown_connections 2024-05-26T15:41:55.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.630+0000 7fb343200640 1 --2- 172.21.15.8:0/1710368786 >> v2:172.21.15.47:3300/0 conn(0x7fb3440cde90 0x7fb3440d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.630+0000 7fb343200640 1 --2- 172.21.15.8:0/1710368786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb34415cca0 0x7fb344160890 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.630+0000 7fb343200640 1 -- 172.21.15.8:0/1710368786 >> 172.21.15.8:0/1710368786 conn(0x7fb34406b740 msgr2=0x7fb34406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:55.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.630+0000 7fb343200640 1 -- 172.21.15.8:0/1710368786 shutdown_connections 2024-05-26T15:41:55.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.630+0000 7fb343200640 1 -- 172.21.15.8:0/1710368786 wait complete. 2024-05-26T15:41:55.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.632+0000 7fb343200640 1 Processor -- start 2024-05-26T15:41:55.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.632+0000 7fb343200640 1 -- start start 2024-05-26T15:41:55.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.633+0000 7fb343200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3440b8420 0x7fb3441f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.633+0000 7fb343200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3440cde90 0x7fb3440c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.633+0000 7fb343200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415cca0 0x7fb3440c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.633+0000 7fb343200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440ca950 con 0x7fb3440cde90 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.633+0000 7fb343200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440c9a80 con 0x7fb34415cca0 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.633+0000 7fb343200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440c9cd0 con 0x7fb3440b8420 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.633+0000 7fb339400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3440cde90 0x7fb3440c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.633+0000 7fb339400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3440cde90 0x7fb3440c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44150/0 (socket says 172.21.15.8:44150) 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.633+0000 7fb339400640 1 -- 172.21.15.8:0/705707334 learned_addr learned my addr 172.21.15.8:0/705707334 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.634+0000 7fb341e00640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3440b8420 0x7fb3441f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.634+0000 7fb342800640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415cca0 0x7fb3440c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.634+0000 7fb339400640 1 -- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3440b8420 msgr2=0x7fb3441f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.634+0000 7fb339400640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3440b8420 0x7fb3441f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.634+0000 7fb339400640 1 -- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415cca0 msgr2=0x7fb3440c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.634+0000 7fb339400640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415cca0 0x7fb3440c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.634+0000 7fb339400640 1 -- 172.21.15.8:0/705707334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3340094d0 con 0x7fb3440cde90 2024-05-26T15:41:55.633 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.634+0000 7fb341e00640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3440b8420 0x7fb3441f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:55.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.634+0000 7fb339400640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3440cde90 0x7fb3440c7870 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00c430 tx=0x7fb32c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:55.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.635+0000 7fb33aa00640 1 -- 172.21.15.8:0/705707334 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c011790 con 0x7fb3440cde90 2024-05-26T15:41:55.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.635+0000 7fb33aa00640 1 -- 172.21.15.8:0/705707334 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c0118f0 con 0x7fb3440cde90 2024-05-26T15:41:55.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.635+0000 7fb33aa00640 1 -- 172.21.15.8:0/705707334 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c011ca0 con 0x7fb3440cde90 2024-05-26T15:41:55.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.635+0000 7fb343200640 1 -- 172.21.15.8:0/705707334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3440c9fb0 con 0x7fb3440cde90 2024-05-26T15:41:55.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.635+0000 7fb343200640 1 -- 172.21.15.8:0/705707334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3440ca570 con 0x7fb3440cde90 2024-05-26T15:41:55.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.636+0000 7fb343200640 1 -- 172.21.15.8:0/705707334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34404e210 con 0x7fb3440cde90 2024-05-26T15:41:55.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.637+0000 7fb33aa00640 1 -- 172.21.15.8:0/705707334 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb32c01c460 con 0x7fb3440cde90 2024-05-26T15:41:55.636 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.638+0000 7fb33aa00640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb32006ac00 0x7fb32006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:55.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.638+0000 7fb33aa00640 1 -- 172.21.15.8:0/705707334 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fb32c089490 con 0x7fb3440cde90 2024-05-26T15:41:55.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.639+0000 7fb341e00640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb32006ac00 0x7fb32006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:55.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.640+0000 7fb341e00640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb32006ac00 0x7fb32006d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb334034000 tx=0x7fb33402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:55.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.643+0000 7fb33aa00640 1 -- 172.21.15.8:0/705707334 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb32c054480 con 0x7fb3440cde90 2024-05-26T15:41:55.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.879+0000 7fb343200640 1 -- 172.21.15.8:0/705707334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3440cf010 con 0x7fb3440cde90 2024-05-26T15:41:55.878 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.880+0000 7fb33aa00640 1 -- 172.21.15.8:0/705707334 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4723 (secure 0 0 0) 0x7fb32c057aa0 con 0x7fb3440cde90 2024-05-26T15:41:55.879 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:55.879 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":24,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/481709676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":481709676},{"type":"v1","addr":"172.21.15.47:6837","nonce":481709676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/463162567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":463162567},{"type":"v1","addr":"172.21.15.8:6834","nonce":463162567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2479192780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":2479192780},{"type":"v1","addr":"172.21.15.8:6835","nonce":2479192780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:41:13.704888+0000","modified":"2024-05-26T15:41:26.509872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5122},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5122":{"gid":5122,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":5,"addr":"172.21.15.47:6835/1710654961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":1710654961},{"type":"v1","addr":"172.21.15.47:6835","nonce":1710654961}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-05-26T15:41:55.879 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 24 2024-05-26T15:41:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 -- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb32006ac00 msgr2=0x7fb32006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb32006ac00 0x7fb32006d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb334034000 tx=0x7fb33402e000 comp rx=0 tx=0).stop 2024-05-26T15:41:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 -- 172.21.15.8:0/705707334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3440cde90 msgr2=0x7fb3440c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3440cde90 0x7fb3440c7870 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00c430 tx=0x7fb32c00c8f0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 -- 172.21.15.8:0/705707334 shutdown_connections 2024-05-26T15:41:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb32006ac00 0x7fb32006d0c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb34415cca0 0x7fb3440c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb3440cde90 0x7fb3440c7870 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 --2- 172.21.15.8:0/705707334 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb3440b8420 0x7fb3441f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:55.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 -- 172.21.15.8:0/705707334 >> 172.21.15.8:0/705707334 conn(0x7fb34406b740 msgr2=0x7fb3440cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:55.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 -- 172.21.15.8:0/705707334 shutdown_connections 2024-05-26T15:41:55.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:55.883+0000 7fb343200640 1 -- 172.21.15.8:0/705707334 wait complete. 2024-05-26T15:41:55.903 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:41:56.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.115+0000 7f1074c00640 1 Processor -- start 2024-05-26T15:41:56.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.116+0000 7f1074c00640 1 -- start start 2024-05-26T15:41:56.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.118+0000 7f1074c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1070161040 0x7f10700cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.118+0000 7f1074c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1070164a60 0x7f1070070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.118+0000 7f1074c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10700ccc30 con 0x7f107006d690 2024-05-26T15:41:56.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.118+0000 7f1074c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1070164ef0 con 0x7f1070161040 2024-05-26T15:41:56.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.118+0000 7f1074c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10701651d0 con 0x7f1070164a60 2024-05-26T15:41:56.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.118+0000 7f106f400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1070161040 0x7f10700cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.118+0000 7f106fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f107006d690 0x7f10700b1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34556/0 (socket says 172.21.15.8:34556) 2024-05-26T15:41:56.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.118+0000 7f106fe00640 1 -- 172.21.15.8:0/1117494648 learned_addr learned my addr 172.21.15.8:0/1117494648 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.118+0000 7f1067e00640 1 --2- 172.21.15.8:0/1117494648 >> v2:172.21.15.47:3300/0 conn(0x7f1070164a60 0x7f1070070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.119+0000 7f106f400640 1 -- 172.21.15.8:0/1117494648 >> v2:172.21.15.47:3300/0 conn(0x7f1070164a60 msgr2=0x7f1070070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.119+0000 7f106f400640 1 --2- 172.21.15.8:0/1117494648 >> v2:172.21.15.47:3300/0 conn(0x7f1070164a60 0x7f1070070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.119+0000 7f106f400640 1 -- 172.21.15.8:0/1117494648 >> v1:172.21.15.8:6789/0 conn(0x7f107006d690 legacy=0x7f10700b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.119+0000 7f106f400640 1 -- 172.21.15.8:0/1117494648 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10701654b0 con 0x7f1070161040 2024-05-26T15:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.119+0000 7f106ea00640 1 -- 172.21.15.8:0/1117494648 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591477095 0 0) 0x7f10700ccc30 con 0x7f107006d690 2024-05-26T15:41:56.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.119+0000 7f1067e00640 1 --2- 172.21.15.8:0/1117494648 >> v2:172.21.15.47:3300/0 conn(0x7f1070164a60 0x7f1070070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.120+0000 7f106f400640 1 --2- 172.21.15.8:0/1117494648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1070161040 0x7f10700cc6f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f107006ac90 tx=0x7f106002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263bfc7a3f8a13c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f106ea00640 1 -- 172.21.15.8:0/1117494648 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060032440 con 0x7f1070161040 2024-05-26T15:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f106ea00640 1 -- 172.21.15.8:0/1117494648 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10600325a0 con 0x7f1070161040 2024-05-26T15:41:56.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f106ea00640 1 -- 172.21.15.8:0/1117494648 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060032930 con 0x7f1070161040 2024-05-26T15:41:56.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f1074c00640 1 -- 172.21.15.8:0/1117494648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1070161040 msgr2=0x7f10700cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f1074c00640 1 --2- 172.21.15.8:0/1117494648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1070161040 0x7f10700cc6f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f107006ac90 tx=0x7f106002a1a0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f1074c00640 1 -- 172.21.15.8:0/1117494648 shutdown_connections 2024-05-26T15:41:56.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f1074c00640 1 --2- 172.21.15.8:0/1117494648 >> v2:172.21.15.47:3300/0 conn(0x7f1070164a60 0x7f1070070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f1074c00640 1 --2- 172.21.15.8:0/1117494648 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1070161040 0x7f10700cc6f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f1074c00640 1 -- 172.21.15.8:0/1117494648 >> 172.21.15.8:0/1117494648 conn(0x7f1070069ed0 msgr2=0x7f107006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:56.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f1074c00640 1 -- 172.21.15.8:0/1117494648 shutdown_connections 2024-05-26T15:41:56.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.121+0000 7f1074c00640 1 -- 172.21.15.8:0/1117494648 wait complete. 2024-05-26T15:41:56.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.123+0000 7f1074c00640 1 Processor -- start 2024-05-26T15:41:56.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.123+0000 7f1074c00640 1 -- start start 2024-05-26T15:41:56.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.124+0000 7f1074c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107006d690 0x7f1070141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.124+0000 7f1074c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070161040 0x7f1070153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.124+0000 7f1074c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1070153570 0x7f10701559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.124+0000 7f1074c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070153a20 con 0x7f107006d690 2024-05-26T15:41:56.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.124+0000 7f1074c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070141d40 con 0x7f1070161040 2024-05-26T15:41:56.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.124+0000 7f1074c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1070161a50 con 0x7f1070153570 2024-05-26T15:41:56.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f106f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107006d690 0x7f1070141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f106f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107006d690 0x7f1070141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44170/0 (socket says 172.21.15.8:44170) 2024-05-26T15:41:56.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f106f400640 1 -- 172.21.15.8:0/3105982728 learned_addr learned my addr 172.21.15.8:0/3105982728 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f1067e00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070161040 0x7f1070153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f106fe00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1070153570 0x7f10701559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f106f400640 1 -- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1070153570 msgr2=0x7f10701559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f106f400640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1070153570 0x7f10701559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f106f400640 1 -- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070161040 msgr2=0x7f1070153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f106f400640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070161040 0x7f1070153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f106f400640 1 -- 172.21.15.8:0/3105982728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060009400 con 0x7f107006d690 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.125+0000 7f1067e00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070161040 0x7f1070153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.126+0000 7f106f400640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107006d690 0x7f1070141800 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1060000c00 tx=0x7f10600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.126+0000 7f1067400640 1 -- 172.21.15.8:0/3105982728 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060032440 con 0x7f107006d690 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.126+0000 7f1067400640 1 -- 172.21.15.8:0/3105982728 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060030ba0 con 0x7f107006d690 2024-05-26T15:41:56.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.126+0000 7f1067400640 1 -- 172.21.15.8:0/3105982728 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060006e10 con 0x7f107006d690 2024-05-26T15:41:56.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.126+0000 7f1074c00640 1 -- 172.21.15.8:0/3105982728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1070161d30 con 0x7f107006d690 2024-05-26T15:41:56.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.126+0000 7f1074c00640 1 -- 172.21.15.8:0/3105982728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10701622f0 con 0x7f107006d690 2024-05-26T15:41:56.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.127+0000 7f1074c00640 1 -- 172.21.15.8:0/3105982728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107004e210 con 0x7f107006d690 2024-05-26T15:41:56.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.128+0000 7f1067400640 1 -- 172.21.15.8:0/3105982728 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1060039040 con 0x7f107006d690 2024-05-26T15:41:56.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.129+0000 7f1067400640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f104c06ac30 0x7f104c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.129+0000 7f1067400640 1 -- 172.21.15.8:0/3105982728 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f10600aa080 con 0x7f107006d690 2024-05-26T15:41:56.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.130+0000 7f1067e00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f104c06ac30 0x7f104c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.131+0000 7f1067e00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f104c06ac30 0x7f104c06d0f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1058006fd0 tx=0x7f1058008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:56.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.133+0000 7f1067400640 1 -- 172.21.15.8:0/3105982728 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f10600dd900 con 0x7f107006d690 2024-05-26T15:41:56.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.332+0000 7f1074c00640 1 -- 172.21.15.8:0/3105982728 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10700b1ee0 con 0x7f107006d690 2024-05-26T15:41:56.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.335+0000 7f1067400640 1 -- 172.21.15.8:0/3105982728 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16467 (secure 0 0 0) 0x7f1060041090 con 0x7f107006d690 2024-05-26T15:41:56.334 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:41:56.334 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":43,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:41:22.482852+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:41:11.994768+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-26T15:41:12.729228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6835/3972699618":"2024-05-27T15:41:22.474515+0000","172.21.15.47:6837/2181130163":"2024-05-27T15:41:22.454549+0000","172.21.15.8:6834/3972699618":"2024-05-27T15:41:22.474515+0000","172.21.15.47:6834/2181130163":"2024-05-27T15:41:22.454549+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:41:56.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 -- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f104c06ac30 msgr2=0x7f104c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f104c06ac30 0x7f104c06d0f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1058006fd0 tx=0x7f1058008040 comp rx=0 tx=0).stop 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 -- 172.21.15.8:0/3105982728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107006d690 msgr2=0x7f1070141800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107006d690 0x7f1070141800 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1060000c00 tx=0x7f10600046c0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 -- 172.21.15.8:0/3105982728 shutdown_connections 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1070153570 0x7f10701559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f104c06ac30 0x7f104c06d0f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1070161040 0x7f1070153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 --2- 172.21.15.8:0/3105982728 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f107006d690 0x7f1070141800 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 -- 172.21.15.8:0/3105982728 >> 172.21.15.8:0/3105982728 conn(0x7f1070069ed0 msgr2=0x7f107006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 -- 172.21.15.8:0/3105982728 shutdown_connections 2024-05-26T15:41:56.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.338+0000 7f1074c00640 1 -- 172.21.15.8:0/3105982728 wait complete. 2024-05-26T15:41:56.358 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-26T15:41:56.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.568+0000 7f80dd400640 1 Processor -- start 2024-05-26T15:41:56.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.568+0000 7f80dd400640 1 -- start start 2024-05-26T15:41:56.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.569+0000 7f80dd400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80d8142fe0 0x7f80d80cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.569+0000 7f80dd400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f80d806de60 0x7f80d80b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.569+0000 7f80dd400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d8070680 con 0x7f80d80ae030 2024-05-26T15:41:56.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.569+0000 7f80dd400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d8070960 con 0x7f80d806de60 2024-05-26T15:41:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.569+0000 7f80dd400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d8070c40 con 0x7f80d8142fe0 2024-05-26T15:41:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d7400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f80d80ae030 0x7f80d806d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34570/0 (socket says 172.21.15.8:34570) 2024-05-26T15:41:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d7400640 1 -- 172.21.15.8:0/2721365942 learned_addr learned my addr 172.21.15.8:0/2721365942 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d7e00640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80d8142fe0 0x7f80d80cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181424354 0 0) 0x7f80d8070680 con 0x7f80d80ae030 2024-05-26T15:41:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80dca00640 1 --2- 172.21.15.8:0/2721365942 >> v2:172.21.15.47:3300/0 conn(0x7f80d806de60 0x7f80d80b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80bc003520 con 0x7f80d80ae030 2024-05-26T15:41:56.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1347903679 0 0) 0x7f80bc003520 con 0x7f80d80ae030 2024-05-26T15:41:56.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80d8142fe0 msgr2=0x7f80d80cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:56.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d6a00640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80d8142fe0 0x7f80d80cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 >> v2:172.21.15.47:3300/0 conn(0x7f80d806de60 msgr2=0x7f80d80b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:56.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d6a00640 1 --2- 172.21.15.8:0/2721365942 >> v2:172.21.15.47:3300/0 conn(0x7f80d806de60 0x7f80d80b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8070f20 con 0x7f80d80ae030 2024-05-26T15:41:56.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.570+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f80c4001670 con 0x7f80d80ae030 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 >> v1:172.21.15.8:6789/0 conn(0x7f80d80ae030 legacy=0x7f80d806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d6a00640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80bc003970 0x7f80bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d6a00640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80bc0047c0 0x7f80bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d6a00640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80d8142fe0 0x7f80bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d8070960 con 0x7f80bc0047c0 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d8070c40 con 0x7f80bc003970 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc00b980 con 0x7f80d8142fe0 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d7400640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80bc0047c0 0x7f80bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d7e00640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80bc003970 0x7f80bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80dca00640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80d8142fe0 0x7f80bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d7400640 1 -- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80d8142fe0 msgr2=0x7f80bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d7400640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80d8142fe0 0x7f80bc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d7400640 1 -- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80bc003970 msgr2=0x7f80bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d7400640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80bc003970 0x7f80bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.571+0000 7f80d7400640 1 -- 172.21.15.8:0/2721365942 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc003520 con 0x7f80bc0047c0 2024-05-26T15:41:56.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.572+0000 7f80d7400640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80bc0047c0 0x7f80bc004c40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f80c400c210 tx=0x7f80bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad3c2c65de3a71d server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:56.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.573+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4005ad0 con 0x7f80bc0047c0 2024-05-26T15:41:56.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.573+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c402d070 con 0x7f80bc0047c0 2024-05-26T15:41:56.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.573+0000 7f80d6a00640 1 -- 172.21.15.8:0/2721365942 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4005e90 con 0x7f80bc0047c0 2024-05-26T15:41:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.573+0000 7f80dd400640 1 -- 172.21.15.8:0/2721365942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80bc0047c0 msgr2=0x7f80bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.573+0000 7f80dd400640 1 --2- 172.21.15.8:0/2721365942 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80bc0047c0 0x7f80bc004c40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f80c400c210 tx=0x7f80bc0057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.573+0000 7f80dca00640 1 -- 172.21.15.8:0/2721365942 reap_dead start 2024-05-26T15:41:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.573+0000 7f80dd400640 1 -- 172.21.15.8:0/2721365942 shutdown_connections 2024-05-26T15:41:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.573+0000 7f80dd400640 1 -- 172.21.15.8:0/2721365942 >> 172.21.15.8:0/2721365942 conn(0x7f80d8069ed0 msgr2=0x7f80d806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.574+0000 7f80dd400640 1 -- 172.21.15.8:0/2721365942 shutdown_connections 2024-05-26T15:41:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.574+0000 7f80dd400640 1 -- 172.21.15.8:0/2721365942 wait complete. 2024-05-26T15:41:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.575+0000 7f80dd400640 1 Processor -- start 2024-05-26T15:41:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.575+0000 7f80dd400640 1 -- start start 2024-05-26T15:41:56.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.576+0000 7f80dd400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80bc0047c0 0x7f80d81437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.576+0000 7f80dd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80d815c2d0 0x7f80d80c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.576+0000 7f80dd400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d8134830 0x7f80d8134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.576+0000 7f80dd400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d8143e20 con 0x7f80d8134830 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.576+0000 7f80dd400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d80c8470 con 0x7f80d815c2d0 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.576+0000 7f80dd400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815c750 con 0x7f80bc0047c0 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.577+0000 7f80dca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d8134830 0x7f80d8134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.577+0000 7f80dca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d8134830 0x7f80d8134cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44182/0 (socket says 172.21.15.8:44182) 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.577+0000 7f80dca00640 1 -- 172.21.15.8:0/2466780415 learned_addr learned my addr 172.21.15.8:0/2466780415 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.577+0000 7f80d7e00640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80bc0047c0 0x7f80d81437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.577+0000 7f80d7400640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80d815c2d0 0x7f80d80c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.577+0000 7f80dca00640 1 -- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80bc0047c0 msgr2=0x7f80d81437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.577+0000 7f80dca00640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80bc0047c0 0x7f80d81437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.577+0000 7f80dca00640 1 -- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80d815c2d0 msgr2=0x7f80d80c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.577+0000 7f80dca00640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80d815c2d0 0x7f80d80c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.577+0000 7f80dca00640 1 -- 172.21.15.8:0/2466780415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80c86c0 con 0x7f80d8134830 2024-05-26T15:41:56.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.578+0000 7f80dca00640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d8134830 0x7f80d8134cb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f80d80b1c70 tx=0x7f80d000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:56.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.578+0000 7f80cfe00640 1 -- 172.21.15.8:0/2466780415 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d0017400 con 0x7f80d8134830 2024-05-26T15:41:56.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.578+0000 7f80cfe00640 1 -- 172.21.15.8:0/2466780415 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d0011040 con 0x7f80d8134830 2024-05-26T15:41:56.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.578+0000 7f80cfe00640 1 -- 172.21.15.8:0/2466780415 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00177c0 con 0x7f80d8134830 2024-05-26T15:41:56.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.578+0000 7f80dd400640 1 -- 172.21.15.8:0/2466780415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d80c89a0 con 0x7f80d8134830 2024-05-26T15:41:56.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.578+0000 7f80dd400640 1 -- 172.21.15.8:0/2466780415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d80c6500 con 0x7f80d8134830 2024-05-26T15:41:56.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.579+0000 7f80dd400640 1 -- 172.21.15.8:0/2466780415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d8067300 con 0x7f80d8134830 2024-05-26T15:41:56.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.581+0000 7f80cfe00640 1 -- 172.21.15.8:0/2466780415 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f80d0017920 con 0x7f80d8134830 2024-05-26T15:41:56.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.581+0000 7f80cfe00640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f80b806ac30 0x7f80b806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:56.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.581+0000 7f80cfe00640 1 -- 172.21.15.8:0/2466780415 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f80d0089b20 con 0x7f80d8134830 2024-05-26T15:41:56.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.582+0000 7f80d7e00640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f80b806ac30 0x7f80b806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:56.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.583+0000 7f80d7e00640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f80b806ac30 0x7f80b806d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f80c80098b0 tx=0x7f80c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:56.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.586+0000 7f80cfe00640 1 -- 172.21.15.8:0/2466780415 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f80d0054a70 con 0x7f80d8134830 2024-05-26T15:41:56.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.829+0000 7f80dd400640 1 -- 172.21.15.8:0/2466780415 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f80d815cb90 con 0x7f80d8134830 2024-05-26T15:41:56.830 INFO:tasks.ceph.mon.a.smithi008.stderr:2024-05-26T15:41:56.831+0000 7f3e01a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-26T15:41:56.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.844+0000 7f80cfe00640 1 -- 172.21.15.8:0/2466780415 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f80d0058090 con 0x7f80d8134830 2024-05-26T15:41:56.842 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-26T15:41:56.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.846+0000 7f80dd400640 1 -- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f80b806ac30 msgr2=0x7f80b806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.846+0000 7f80dd400640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f80b806ac30 0x7f80b806d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f80c80098b0 tx=0x7f80c8008040 comp rx=0 tx=0).stop 2024-05-26T15:41:56.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.847+0000 7f80dd400640 1 -- 172.21.15.8:0/2466780415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d8134830 msgr2=0x7f80d8134cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:56.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.847+0000 7f80dd400640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d8134830 0x7f80d8134cb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f80d80b1c70 tx=0x7f80d000f4a0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.847+0000 7f80dd400640 1 -- 172.21.15.8:0/2466780415 shutdown_connections 2024-05-26T15:41:56.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.847+0000 7f80dd400640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f80d8134830 0x7f80d8134cb0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.847+0000 7f80dd400640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f80b806ac30 0x7f80b806d0f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.847+0000 7f80dd400640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80d815c2d0 0x7f80d80c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.847+0000 7f80dd400640 1 --2- 172.21.15.8:0/2466780415 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f80bc0047c0 0x7f80d81437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:56.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.847+0000 7f80dd400640 1 -- 172.21.15.8:0/2466780415 >> 172.21.15.8:0/2466780415 conn(0x7f80d8069ed0 msgr2=0x7f80d80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:56.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.847+0000 7f80dd400640 1 -- 172.21.15.8:0/2466780415 shutdown_connections 2024-05-26T15:41:56.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:56.847+0000 7f80dd400640 1 -- 172.21.15.8:0/2466780415 wait complete. 2024-05-26T15:41:56.864 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-26T15:41:56.880 INFO:tasks.ceph.mds.b.smithi047.stderr: -8752> 2024-05-26T15:41:27.468+0000 7fb9ace00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-26T15:41:56.974 INFO:tasks.ceph.mds.b.smithi047.stdout:starting mds.b at 2024-05-26T15:41:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.079+0000 7f0076600640 1 Processor -- start 2024-05-26T15:41:57.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.080+0000 7f0076600640 1 -- start start 2024-05-26T15:41:57.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.081+0000 7f0076600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00700b8720 0x7f00700cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:57.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.081+0000 7f0076600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00700ce190 con 0x7f00700cf720 2024-05-26T15:41:57.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.081+0000 7f0076600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00700d0c90 con 0x7f007015cf20 2024-05-26T15:41:57.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.081+0000 7f0076600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00700d0f70 con 0x7f00700b8720 2024-05-26T15:41:57.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.082+0000 7f0075c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f00700cf720 0x7f00700d1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34578/0 (socket says 172.21.15.8:34578) 2024-05-26T15:41:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.082+0000 7f0075c00640 1 -- 172.21.15.8:0/636286597 learned_addr learned my addr 172.21.15.8:0/636286597 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:41:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.082+0000 7f006fe00640 1 --2- 172.21.15.8:0/636286597 >> v2:172.21.15.47:3300/0 conn(0x7f00700b8720 0x7f00700cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.082+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677190403 0 0) 0x7f00700ce190 con 0x7f00700cf720 2024-05-26T15:41:57.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.082+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0054003520 con 0x7f00700cf720 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2561678706 0 0) 0x7f0054003520 con 0x7f00700cf720 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 >> v2:172.21.15.47:3300/0 conn(0x7f00700b8720 msgr2=0x7f00700cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 --2- 172.21.15.8:0/636286597 >> v2:172.21.15.47:3300/0 conn(0x7f00700b8720 0x7f00700cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 >> v1:172.21.15.47:6789/0 conn(0x7f007015cf20 legacy=0x7f00700b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00700d1250 con 0x7f00700cf720 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f00680019f0 con 0x7f00700cf720 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 >> v1:172.21.15.8:6789/0 conn(0x7f00700cf720 legacy=0x7f00700d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0054003a30 0x7f0054003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f00540047c0 0x7f0054004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540051d0 0x7f005400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00700d0f70 con 0x7f0054003a30 2024-05-26T15:41:57.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005400c110 con 0x7f00540051d0 2024-05-26T15:41:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005400c2d0 con 0x7f00540047c0 2024-05-26T15:41:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f0075200640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0054003a30 0x7f0054003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f006fe00640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f00540047c0 0x7f0054004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.083+0000 7f0075c00640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540051d0 0x7f005400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.084+0000 7f0075200640 1 -- 172.21.15.8:0/636286597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f00540047c0 msgr2=0x7f0054004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.084+0000 7f0075200640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f00540047c0 0x7f0054004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.084+0000 7f0075200640 1 -- 172.21.15.8:0/636286597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540051d0 msgr2=0x7f005400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.084+0000 7f0075200640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00540051d0 0x7f005400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.084+0000 7f0075200640 1 -- 172.21.15.8:0/636286597 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054003520 con 0x7f0054003a30 2024-05-26T15:41:57.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.084+0000 7f0075c00640 1 -- 172.21.15.8:0/636286597 reap_dead start 2024-05-26T15:41:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.085+0000 7f0075200640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0054003a30 0x7f0054003e50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0060001750 tx=0x7f00540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903690b81bd65ca8 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.085+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600052d0 con 0x7f0054003a30 2024-05-26T15:41:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.085+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0060005430 con 0x7f0054003a30 2024-05-26T15:41:57.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.085+0000 7f006f400640 1 -- 172.21.15.8:0/636286597 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006002abc0 con 0x7f0054003a30 2024-05-26T15:41:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.086+0000 7f0076600640 1 -- 172.21.15.8:0/636286597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0054003a30 msgr2=0x7f0054003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.086+0000 7f0076600640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0054003a30 0x7f0054003e50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0060001750 tx=0x7f00540057f0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.086+0000 7f0076600640 1 -- 172.21.15.8:0/636286597 shutdown_connections 2024-05-26T15:41:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.086+0000 7f0076600640 1 --2- 172.21.15.8:0/636286597 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0054003a30 0x7f0054003e50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.086+0000 7f0076600640 1 -- 172.21.15.8:0/636286597 >> 172.21.15.8:0/636286597 conn(0x7f007006b760 msgr2=0x7f007006bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.086+0000 7f0076600640 1 -- 172.21.15.8:0/636286597 shutdown_connections 2024-05-26T15:41:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.086+0000 7f0076600640 1 -- 172.21.15.8:0/636286597 wait complete. 2024-05-26T15:41:57.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.088+0000 7f0076600640 1 Processor -- start 2024-05-26T15:41:57.087 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.088+0000 7f0076600640 1 -- start start 2024-05-26T15:41:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f0076600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0054003a30 0x7f00700cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f0076600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00700cac40 0x7f00700c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f0076600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f00700c8e60 0x7f00700ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f0076600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007015fcb0 con 0x7f00700cac40 2024-05-26T15:41:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f0076600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007015f0a0 con 0x7f0054003a30 2024-05-26T15:41:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f0076600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007015f380 con 0x7f00700c8e60 2024-05-26T15:41:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f006fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00700cac40 0x7f00700c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:57.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f006fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00700cac40 0x7f00700c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44198/0 (socket says 172.21.15.8:44198) 2024-05-26T15:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f006fe00640 1 -- 172.21.15.8:0/1290496651 learned_addr learned my addr 172.21.15.8:0/1290496651 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f006fe00640 1 -- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f00700c8e60 msgr2=0x7f00700ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f0075200640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0054003a30 0x7f00700cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.089+0000 7f006fe00640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f00700c8e60 0x7f00700ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.090+0000 7f006fe00640 1 -- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0054003a30 msgr2=0x7f00700cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.090+0000 7f006fe00640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0054003a30 0x7f00700cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.090+0000 7f006fe00640 1 -- 172.21.15.8:0/1290496651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007015f660 con 0x7f00700cac40 2024-05-26T15:41:57.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.090+0000 7f006fe00640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00700cac40 0x7f00700c9f80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f005c0114e0 tx=0x7f005c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.090+0000 7f006cc00640 1 -- 172.21.15.8:0/1290496651 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c015870 con 0x7f00700cac40 2024-05-26T15:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.090+0000 7f006cc00640 1 -- 172.21.15.8:0/1290496651 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c0159d0 con 0x7f00700cac40 2024-05-26T15:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.090+0000 7f006cc00640 1 -- 172.21.15.8:0/1290496651 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c015d40 con 0x7f00700cac40 2024-05-26T15:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.090+0000 7f0076600640 1 -- 172.21.15.8:0/1290496651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007015f940 con 0x7f00700cac40 2024-05-26T15:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.091+0000 7f0076600640 1 -- 172.21.15.8:0/1290496651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00700cca50 con 0x7f00700cac40 2024-05-26T15:41:57.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.091+0000 7f0076600640 1 -- 172.21.15.8:0/1290496651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0070073fa0 con 0x7f00700cac40 2024-05-26T15:41:57.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.093+0000 7f006cc00640 1 -- 172.21.15.8:0/1290496651 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f005c013400 con 0x7f00700cac40 2024-05-26T15:41:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.093+0000 7f006cc00640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f005006ac00 0x7f005006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.094+0000 7f006cc00640 1 -- 172.21.15.8:0/1290496651 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f005c089a10 con 0x7f00700cac40 2024-05-26T15:41:57.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.094+0000 7f0075200640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f005006ac00 0x7f005006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:57.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.095+0000 7f0075200640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f005006ac00 0x7f005006d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0060032000 tx=0x7f006002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:57.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.098+0000 7f006cc00640 1 -- 172.21.15.8:0/1290496651 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f005c054910 con 0x7f00700cac40 2024-05-26T15:41:57.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.336+0000 7f0076600640 1 -- 172.21.15.8:0/1290496651 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f00700d09d0 con 0x7f00700cac40 2024-05-26T15:41:57.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.848+0000 7f006cc00640 1 -- 172.21.15.8:0/1290496651 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f005c057f30 con 0x7f00700cac40 2024-05-26T15:41:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.852+0000 7f0076600640 1 -- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f005006ac00 msgr2=0x7f005006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.852+0000 7f0076600640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f005006ac00 0x7f005006d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0060032000 tx=0x7f006002e000 comp rx=0 tx=0).stop 2024-05-26T15:41:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.852+0000 7f0076600640 1 -- 172.21.15.8:0/1290496651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00700cac40 msgr2=0x7f00700c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.852+0000 7f0076600640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00700cac40 0x7f00700c9f80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f005c0114e0 tx=0x7f005c0119a0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.852+0000 7f0076600640 1 -- 172.21.15.8:0/1290496651 shutdown_connections 2024-05-26T15:41:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.852+0000 7f0076600640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f00700c8e60 0x7f00700ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.852+0000 7f0076600640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f00700cac40 0x7f00700c9f80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.852+0000 7f0076600640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f005006ac00 0x7f005006d0c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.852+0000 7f0076600640 1 --2- 172.21.15.8:0/1290496651 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0054003a30 0x7f00700cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:57.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.852+0000 7f0076600640 1 -- 172.21.15.8:0/1290496651 >> 172.21.15.8:0/1290496651 conn(0x7f007006b760 msgr2=0x7f00700b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:57.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.853+0000 7f0076600640 1 -- 172.21.15.8:0/1290496651 shutdown_connections 2024-05-26T15:41:57.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:57.853+0000 7f0076600640 1 -- 172.21.15.8:0/1290496651 wait complete. 2024-05-26T15:41:57.875 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-26T15:41:58.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.093+0000 7f3c4e000640 1 Processor -- start 2024-05-26T15:41:58.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.093+0000 7f3c4e000640 1 -- start start 2024-05-26T15:41:58.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.094+0000 7f3c4e000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 0x7f3c480ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:58.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.094+0000 7f3c4e000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3c4806c740 0x7f3c480706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:58.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.095+0000 7f3c4e000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4806ea20 con 0x7f3c480adc50 2024-05-26T15:41:58.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.095+0000 7f3c4e000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c481624a0 con 0x7f3c4806c740 2024-05-26T15:41:58.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.095+0000 7f3c4e000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4806d860 con 0x7f3c4806d480 2024-05-26T15:41:58.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.095+0000 7f3c4cc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 0x7f3c480ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:58.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.095+0000 7f3c4cc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 0x7f3c480ad710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:52392/0 (socket says 172.21.15.8:52392) 2024-05-26T15:41:58.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.095+0000 7f3c4cc00640 1 -- 172.21.15.8:0/3570019791 learned_addr learned my addr 172.21.15.8:0/3570019791 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.096+0000 7f3c47e00640 1 --2- 172.21.15.8:0/3570019791 >> v2:172.21.15.47:3300/0 conn(0x7f3c4806c740 0x7f3c480706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.096+0000 7f3c4cc00640 1 -- 172.21.15.8:0/3570019791 >> v2:172.21.15.47:3300/0 conn(0x7f3c4806c740 msgr2=0x7f3c480706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.096+0000 7f3c4cc00640 1 --2- 172.21.15.8:0/3570019791 >> v2:172.21.15.47:3300/0 conn(0x7f3c4806c740 0x7f3c480706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.096+0000 7f3c4cc00640 1 -- 172.21.15.8:0/3570019791 >> v1:172.21.15.47:6789/0 conn(0x7f3c480adc50 legacy=0x7f3c480b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:58.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.096+0000 7f3c4cc00640 1 -- 172.21.15.8:0/3570019791 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48161820 con 0x7f3c4806d480 2024-05-26T15:41:58.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.096+0000 7f3c47400640 1 -- 172.21.15.8:0/3570019791 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651710164 0 0) 0x7f3c4806ea20 con 0x7f3c480adc50 2024-05-26T15:41:58.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.098+0000 7f3c4cc00640 1 --2- 172.21.15.8:0/3570019791 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 0x7f3c480ad710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009870 tx=0x7f3c3c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=695b5e28359963e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:58.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.098+0000 7f3c47400640 1 -- 172.21.15.8:0/3570019791 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c032440 con 0x7f3c4806d480 2024-05-26T15:41:58.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.098+0000 7f3c47400640 1 -- 172.21.15.8:0/3570019791 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0325a0 con 0x7f3c4806d480 2024-05-26T15:41:58.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.098+0000 7f3c47400640 1 -- 172.21.15.8:0/3570019791 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c032930 con 0x7f3c4806d480 2024-05-26T15:41:58.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.099+0000 7f3c4e000640 1 -- 172.21.15.8:0/3570019791 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 msgr2=0x7f3c480ad710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:58.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.099+0000 7f3c4e000640 1 --2- 172.21.15.8:0/3570019791 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 0x7f3c480ad710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009870 tx=0x7f3c3c02a270 comp rx=0 tx=0).stop 2024-05-26T15:41:58.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.099+0000 7f3c4e000640 1 -- 172.21.15.8:0/3570019791 shutdown_connections 2024-05-26T15:41:58.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.099+0000 7f3c4e000640 1 --2- 172.21.15.8:0/3570019791 >> v2:172.21.15.47:3300/0 conn(0x7f3c4806c740 0x7f3c480706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:58.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.099+0000 7f3c4e000640 1 --2- 172.21.15.8:0/3570019791 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 0x7f3c480ad710 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:58.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.099+0000 7f3c4e000640 1 -- 172.21.15.8:0/3570019791 >> 172.21.15.8:0/3570019791 conn(0x7f3c480b0740 msgr2=0x7f3c480b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:58.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.099+0000 7f3c4e000640 1 -- 172.21.15.8:0/3570019791 shutdown_connections 2024-05-26T15:41:58.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.099+0000 7f3c4e000640 1 -- 172.21.15.8:0/3570019791 wait complete. 2024-05-26T15:41:58.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.101+0000 7f3c4e000640 1 Processor -- start 2024-05-26T15:41:58.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.101+0000 7f3c4e000640 1 -- start start 2024-05-26T15:41:58.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.102+0000 7f3c4e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c4806c740 0x7f3c481449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:58.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.102+0000 7f3c4e000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 0x7f3c4814a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.102+0000 7f3c4e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c480adc50 0x7f3c4815f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.102+0000 7f3c4e000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4815aaa0 con 0x7f3c4806c740 2024-05-26T15:41:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.102+0000 7f3c4e000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4814b2c0 con 0x7f3c480adc50 2024-05-26T15:41:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.102+0000 7f3c4e000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4814b5a0 con 0x7f3c4806d480 2024-05-26T15:41:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.103+0000 7f3c4cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c4806c740 0x7f3c481449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.103+0000 7f3c4cc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c4806c740 0x7f3c481449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44202/0 (socket says 172.21.15.8:44202) 2024-05-26T15:41:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.103+0000 7f3c4cc00640 1 -- 172.21.15.8:0/2382722528 learned_addr learned my addr 172.21.15.8:0/2382722528 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.103+0000 7f3c47e00640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 0x7f3c4814a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.103+0000 7f3c4d600640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c480adc50 0x7f3c4815f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:58.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.103+0000 7f3c4cc00640 1 -- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 msgr2=0x7f3c4814a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:58.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.103+0000 7f3c4cc00640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 0x7f3c4814a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:58.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.103+0000 7f3c4cc00640 1 -- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c480adc50 msgr2=0x7f3c4815f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:58.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.103+0000 7f3c4cc00640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c480adc50 0x7f3c4815f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:58.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.103+0000 7f3c4cc00640 1 -- 172.21.15.8:0/2382722528 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c0094d0 con 0x7f3c4806c740 2024-05-26T15:41:58.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.104+0000 7f3c4cc00640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c4806c740 0x7f3c481449a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c000c00 tx=0x7f3c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:58.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.104+0000 7f3c44c00640 1 -- 172.21.15.8:0/2382722528 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c032440 con 0x7f3c4806c740 2024-05-26T15:41:58.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.104+0000 7f3c44c00640 1 -- 172.21.15.8:0/2382722528 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c030980 con 0x7f3c4806c740 2024-05-26T15:41:58.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.104+0000 7f3c44c00640 1 -- 172.21.15.8:0/2382722528 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c030d30 con 0x7f3c4806c740 2024-05-26T15:41:58.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.104+0000 7f3c4e000640 1 -- 172.21.15.8:0/2382722528 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4815a6c0 con 0x7f3c4806c740 2024-05-26T15:41:58.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.104+0000 7f3c4e000640 1 -- 172.21.15.8:0/2382722528 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c48158c00 con 0x7f3c4806c740 2024-05-26T15:41:58.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.105+0000 7f3c4e000640 1 -- 172.21.15.8:0/2382722528 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4815a520 con 0x7f3c4806c740 2024-05-26T15:41:58.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.106+0000 7f3c44c00640 1 -- 172.21.15.8:0/2382722528 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c3c039040 con 0x7f3c4806c740 2024-05-26T15:41:58.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.107+0000 7f3c44c00640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3c2806ac00 0x7f3c2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:58.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.107+0000 7f3c44c00640 1 -- 172.21.15.8:0/2382722528 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f3c3c0a9f90 con 0x7f3c4806c740 2024-05-26T15:41:58.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.108+0000 7f3c47e00640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3c2806ac00 0x7f3c2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:58.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.109+0000 7f3c47e00640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3c2806ac00 0x7f3c2806d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3c48155d10 tx=0x7f3c34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:58.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.112+0000 7f3c44c00640 1 -- 172.21.15.8:0/2382722528 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3c4815a520 con 0x7f3c4806c740 2024-05-26T15:41:58.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.314+0000 7f3c4e000640 1 -- 172.21.15.8:0/2382722528 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3c4815a520 con 0x7f3c4806c740 2024-05-26T15:41:58.589 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:41:58.597 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:41:58.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.860+0000 7f3c44c00640 1 -- 172.21.15.8:0/2382722528 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3c4815a520 con 0x7f3c4806c740 2024-05-26T15:41:58.861 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2024-05-26T15:41:58.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.865+0000 7f3c4e000640 1 -- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3c2806ac00 msgr2=0x7f3c2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:58.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.865+0000 7f3c4e000640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3c2806ac00 0x7f3c2806d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3c48155d10 tx=0x7f3c34008040 comp rx=0 tx=0).stop 2024-05-26T15:41:58.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.865+0000 7f3c4e000640 1 -- 172.21.15.8:0/2382722528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c4806c740 msgr2=0x7f3c481449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:58.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.866+0000 7f3c4e000640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c4806c740 0x7f3c481449a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c000c00 tx=0x7f3c3c0046c0 comp rx=0 tx=0).stop 2024-05-26T15:41:58.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.866+0000 7f3c4e000640 1 -- 172.21.15.8:0/2382722528 shutdown_connections 2024-05-26T15:41:58.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.866+0000 7f3c4e000640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3c2806ac00 0x7f3c2806d0c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:58.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.866+0000 7f3c4e000640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c480adc50 0x7f3c4815f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:58.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.866+0000 7f3c4e000640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3c4806d480 0x7f3c4814a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:58.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.866+0000 7f3c4e000640 1 --2- 172.21.15.8:0/2382722528 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3c4806c740 0x7f3c481449a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:58.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.866+0000 7f3c4e000640 1 -- 172.21.15.8:0/2382722528 >> 172.21.15.8:0/2382722528 conn(0x7f3c480b0740 msgr2=0x7f3c4806d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:58.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.866+0000 7f3c4e000640 1 -- 172.21.15.8:0/2382722528 shutdown_connections 2024-05-26T15:41:58.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:58.866+0000 7f3c4e000640 1 -- 172.21.15.8:0/2382722528 wait complete. 2024-05-26T15:41:58.889 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-26T15:41:59.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.091+0000 7f0c32000640 1 Processor -- start 2024-05-26T15:41:59.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.091+0000 7f0c32000640 1 -- start start 2024-05-26T15:41:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.092+0000 7f0c32000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0c2c06d480 0x7f0c2c0ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.092+0000 7f0c32000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c06c740 0x7f0c2c0706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.092+0000 7f0c32000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2c06ea20 con 0x7f0c2c0adc50 2024-05-26T15:41:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.092+0000 7f0c32000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c2c1624a0 con 0x7f0c2c06d480 2024-05-26T15:41:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.092+0000 7f0c32000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c06d860 con 0x7f0c2c06c740 2024-05-26T15:41:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.092+0000 7f0c30c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0c2c06d480 0x7f0c2c0ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.093+0000 7f0c30c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0c2c06d480 0x7f0c2c0ad710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44208/0 (socket says 172.21.15.8:44208) 2024-05-26T15:41:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.093+0000 7f0c30c00640 1 -- 172.21.15.8:0/804836783 learned_addr learned my addr 172.21.15.8:0/804836783 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.093+0000 7f0c31600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0c2c0adc50 0x7f0c2c0b1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34590/0 (socket says 172.21.15.8:34590) 2024-05-26T15:41:59.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.093+0000 7f0c2be00640 1 --2- 172.21.15.8:0/804836783 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c06c740 0x7f0c2c0706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:59.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.093+0000 7f0c30c00640 1 -- 172.21.15.8:0/804836783 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c06c740 msgr2=0x7f0c2c0706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:41:59.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.093+0000 7f0c30c00640 1 --2- 172.21.15.8:0/804836783 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c06c740 0x7f0c2c0706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:59.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.093+0000 7f0c30c00640 1 -- 172.21.15.8:0/804836783 >> v1:172.21.15.8:6789/0 conn(0x7f0c2c0adc50 legacy=0x7f0c2c0b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:59.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.093+0000 7f0c30c00640 1 -- 172.21.15.8:0/804836783 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c161820 con 0x7f0c2c06d480 2024-05-26T15:41:59.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.093+0000 7f0c2b400640 1 -- 172.21.15.8:0/804836783 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259687652 0 0) 0x7f0c2c06ea20 con 0x7f0c2c0adc50 2024-05-26T15:41:59.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.093+0000 7f0c2be00640 1 --2- 172.21.15.8:0/804836783 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c06c740 0x7f0c2c0706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.094+0000 7f0c30c00640 1 --2- 172.21.15.8:0/804836783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 0x7f0c2c0ad710 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009870 tx=0x7f0c1c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cf1ba9eb085f46 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.095+0000 7f0c2b400640 1 -- 172.21.15.8:0/804836783 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c032440 con 0x7f0c2c06d480 2024-05-26T15:41:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.095+0000 7f0c2b400640 1 -- 172.21.15.8:0/804836783 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0325a0 con 0x7f0c2c06d480 2024-05-26T15:41:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.095+0000 7f0c2b400640 1 -- 172.21.15.8:0/804836783 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c032930 con 0x7f0c2c06d480 2024-05-26T15:41:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.095+0000 7f0c32000640 1 -- 172.21.15.8:0/804836783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 msgr2=0x7f0c2c0ad710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.095+0000 7f0c32000640 1 --2- 172.21.15.8:0/804836783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 0x7f0c2c0ad710 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009870 tx=0x7f0c1c02a250 comp rx=0 tx=0).stop 2024-05-26T15:41:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.095+0000 7f0c32000640 1 -- 172.21.15.8:0/804836783 shutdown_connections 2024-05-26T15:41:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.095+0000 7f0c32000640 1 --2- 172.21.15.8:0/804836783 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c06c740 0x7f0c2c0706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.095+0000 7f0c32000640 1 --2- 172.21.15.8:0/804836783 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 0x7f0c2c0ad710 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:59.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.095+0000 7f0c32000640 1 -- 172.21.15.8:0/804836783 >> 172.21.15.8:0/804836783 conn(0x7f0c2c0b0740 msgr2=0x7f0c2c0b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:59.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.095+0000 7f0c32000640 1 -- 172.21.15.8:0/804836783 shutdown_connections 2024-05-26T15:41:59.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.096+0000 7f0c32000640 1 -- 172.21.15.8:0/804836783 wait complete. 2024-05-26T15:41:59.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.097+0000 7f0c32000640 1 Processor -- start 2024-05-26T15:41:59.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.098+0000 7f0c32000640 1 -- start start 2024-05-26T15:41:59.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.098+0000 7f0c32000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2c06c740 0x7f0c2c15b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:59.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.098+0000 7f0c32000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 0x7f0c2c1473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:59.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c32000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c0adc50 0x7f0c2c147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:59.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c32000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c155b60 con 0x7f0c2c06d480 2024-05-26T15:41:59.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c32000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c15d0c0 con 0x7f0c2c06c740 2024-05-26T15:41:59.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c32000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2c14b270 con 0x7f0c2c0adc50 2024-05-26T15:41:59.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c2be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 0x7f0c2c1473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c2be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 0x7f0c2c1473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44222/0 (socket says 172.21.15.8:44222) 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c2be00640 1 -- 172.21.15.8:0/2479601725 learned_addr learned my addr 172.21.15.8:0/2479601725 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c30c00640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2c06c740 0x7f0c2c15b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c31600640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c0adc50 0x7f0c2c147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c2be00640 1 -- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c0adc50 msgr2=0x7f0c2c147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c2be00640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c0adc50 0x7f0c2c147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c2be00640 1 -- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2c06c740 msgr2=0x7f0c2c15b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c2be00640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2c06c740 0x7f0c2c15b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c2be00640 1 -- 172.21.15.8:0/2479601725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c0094d0 con 0x7f0c2c06d480 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.099+0000 7f0c31600640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c0adc50 0x7f0c2c147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:41:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.100+0000 7f0c2be00640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 0x7f0c2c1473f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800cf80 tx=0x7f0c1800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:59.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.100+0000 7f0c28c00640 1 -- 172.21.15.8:0/2479601725 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800d840 con 0x7f0c2c06d480 2024-05-26T15:41:59.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.100+0000 7f0c28c00640 1 -- 172.21.15.8:0/2479601725 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1800d9a0 con 0x7f0c2c06d480 2024-05-26T15:41:59.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.100+0000 7f0c28c00640 1 -- 172.21.15.8:0/2479601725 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800dd50 con 0x7f0c2c06d480 2024-05-26T15:41:59.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.100+0000 7f0c32000640 1 -- 172.21.15.8:0/2479601725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2c155880 con 0x7f0c2c06d480 2024-05-26T15:41:59.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.100+0000 7f0c32000640 1 -- 172.21.15.8:0/2479601725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2c15cce0 con 0x7f0c2c06d480 2024-05-26T15:41:59.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.101+0000 7f0c32000640 1 -- 172.21.15.8:0/2479601725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2c15d330 con 0x7f0c2c06d480 2024-05-26T15:41:59.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.102+0000 7f0c28c00640 1 -- 172.21.15.8:0/2479601725 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c18015440 con 0x7f0c2c06d480 2024-05-26T15:41:59.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.103+0000 7f0c28c00640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0c0c06ac00 0x7f0c0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:41:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.103+0000 7f0c28c00640 1 -- 172.21.15.8:0/2479601725 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f0c18089d70 con 0x7f0c2c06d480 2024-05-26T15:41:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.104+0000 7f0c30c00640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0c0c06ac00 0x7f0c0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:41:59.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.105+0000 7f0c30c00640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0c0c06ac00 0x7f0c0c06d0c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c034000 tx=0x7f0c1c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:41:59.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.108+0000 7f0c28c00640 1 -- 172.21.15.8:0/2479601725 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0c18054f70 con 0x7f0c2c06d480 2024-05-26T15:41:59.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.310+0000 7f0c32000640 1 -- 172.21.15.8:0/2479601725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c2c15c860 con 0x7f0c2c06d480 2024-05-26T15:41:59.864 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.864+0000 7f0c28c00640 1 -- 172.21.15.8:0/2479601725 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0c2c15c860 con 0x7f0c2c06d480 2024-05-26T15:41:59.864 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2024-05-26T15:41:59.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.870+0000 7f0c32000640 1 -- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0c0c06ac00 msgr2=0x7f0c0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:59.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.870+0000 7f0c32000640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0c0c06ac00 0x7f0c0c06d0c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c034000 tx=0x7f0c1c02e000 comp rx=0 tx=0).stop 2024-05-26T15:41:59.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.870+0000 7f0c32000640 1 -- 172.21.15.8:0/2479601725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 msgr2=0x7f0c2c1473f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:41:59.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.870+0000 7f0c32000640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 0x7f0c2c1473f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800cf80 tx=0x7f0c1800a7d0 comp rx=0 tx=0).stop 2024-05-26T15:41:59.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.870+0000 7f0c32000640 1 -- 172.21.15.8:0/2479601725 shutdown_connections 2024-05-26T15:41:59.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.870+0000 7f0c32000640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0c2c0adc50 0x7f0c2c147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:59.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.870+0000 7f0c32000640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c2c06d480 0x7f0c2c1473f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:59.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.870+0000 7f0c32000640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0c0c06ac00 0x7f0c0c06d0c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:59.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.870+0000 7f0c32000640 1 --2- 172.21.15.8:0/2479601725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c2c06c740 0x7f0c2c15b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:41:59.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.870+0000 7f0c32000640 1 -- 172.21.15.8:0/2479601725 >> 172.21.15.8:0/2479601725 conn(0x7f0c2c0b0740 msgr2=0x7f0c2c06d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:41:59.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.871+0000 7f0c32000640 1 -- 172.21.15.8:0/2479601725 shutdown_connections 2024-05-26T15:41:59.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:41:59.871+0000 7f0c32000640 1 -- 172.21.15.8:0/2479601725 wait complete. 2024-05-26T15:41:59.896 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-26T15:41:59.901 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2024-05-26T15:42:00.035 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2024-05-26T15:42:00.036 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2024-05-26T15:42:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2024-05-26T15:42:00.038 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2024-05-26T15:42:00.039 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 20 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 20 2024-05-26T15:42:00.040 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 10 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-05-26T15:42:00.041 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:42:00.042 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2024-05-26T15:42:00.043 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2024-05-26T15:42:00.044 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = "" 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds balancer = 20 2024-05-26T15:42:00.045 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:42:00.046 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2024-05-26T15:42:00.046 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2024-05-26T15:42:00.046 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2024-05-26T15:42:00.046 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2024-05-26T15:42:00.046 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-05-26T15:42:00.046 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-05-26T15:42:00.046 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-05-26T15:42:00.046 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-05-26T15:42:00.047 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-05-26T15:42:00.048 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-05-26T15:42:00.049 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on skipped message = False 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-05-26T15:42:00.050 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-05-26T15:42:00.051 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 20 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 20 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 10 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-05-26T15:42:00.052 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:42:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-05-26T15:42:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-05-26T15:42:00.055 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = "" 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-26T15:42:00.056 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-26T15:42:00.057 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-26T15:42:00.083 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-26T15:42:00.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.299+0000 7f306de00640 1 Processor -- start 2024-05-26T15:42:00.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.299+0000 7f306de00640 1 -- start start 2024-05-26T15:42:00.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.301+0000 7f306de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f30680cd890 0x7f306806dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.301+0000 7f306de00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f306806cf90 con 0x7f3068071390 2024-05-26T15:42:00.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.301+0000 7f306de00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680ce200 con 0x7f30680cdc70 2024-05-26T15:42:00.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.301+0000 7f306de00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30680cc0a0 con 0x7f30680cd890 2024-05-26T15:42:00.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.301+0000 7f306ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f30680cd890 0x7f306806dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:00.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.301+0000 7f306ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f30680cd890 0x7f306806dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44226/0 (socket says 172.21.15.8:44226) 2024-05-26T15:42:00.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.301+0000 7f306ca00640 1 -- 172.21.15.8:0/166133260 learned_addr learned my addr 172.21.15.8:0/166133260 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:00.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.301+0000 7f306d400640 1 --1- 172.21.15.8:0/166133260 >> v1:172.21.15.8:6789/0 conn(0x7f3068071390 0x7f306815b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34600/0 (socket says 172.21.15.8:34600) 2024-05-26T15:42:00.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.302+0000 7f306ca00640 1 -- 172.21.15.8:0/166133260 >> v1:172.21.15.47:6789/0 conn(0x7f30680cdc70 legacy=0x7f306815ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:00.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.302+0000 7f306ca00640 1 -- 172.21.15.8:0/166133260 >> v1:172.21.15.8:6789/0 conn(0x7f3068071390 legacy=0x7f306815b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:00.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.302+0000 7f306ca00640 1 -- 172.21.15.8:0/166133260 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306806d230 con 0x7f30680cd890 2024-05-26T15:42:00.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.303+0000 7f306ca00640 1 --2- 172.21.15.8:0/166133260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30680cd890 0x7f306806dd10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f30580098a0 tx=0x7f305802a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afce960d889cf07 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:00.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.304+0000 7f3067400640 1 -- 172.21.15.8:0/166133260 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058032440 con 0x7f30680cd890 2024-05-26T15:42:00.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.304+0000 7f3067400640 1 -- 172.21.15.8:0/166133260 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30580325a0 con 0x7f30680cd890 2024-05-26T15:42:00.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.304+0000 7f3067400640 1 -- 172.21.15.8:0/166133260 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058032930 con 0x7f30680cd890 2024-05-26T15:42:00.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.304+0000 7f306de00640 1 -- 172.21.15.8:0/166133260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30680cd890 msgr2=0x7f306806dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:00.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.304+0000 7f306de00640 1 --2- 172.21.15.8:0/166133260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30680cd890 0x7f306806dd10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f30580098a0 tx=0x7f305802a2e0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.304+0000 7f306de00640 1 -- 172.21.15.8:0/166133260 shutdown_connections 2024-05-26T15:42:00.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.304+0000 7f306de00640 1 --2- 172.21.15.8:0/166133260 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f30680cd890 0x7f306806dd10 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.305+0000 7f306de00640 1 -- 172.21.15.8:0/166133260 >> 172.21.15.8:0/166133260 conn(0x7f30680ce4d0 msgr2=0x7f30680ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:00.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.305+0000 7f306de00640 1 -- 172.21.15.8:0/166133260 shutdown_connections 2024-05-26T15:42:00.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.305+0000 7f306de00640 1 -- 172.21.15.8:0/166133260 wait complete. 2024-05-26T15:42:00.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.306+0000 7f306de00640 1 Processor -- start 2024-05-26T15:42:00.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.307+0000 7f306de00640 1 -- start start 2024-05-26T15:42:00.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3068071390 0x7f30681515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30680cd890 0x7f30681e7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306de00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30680cdc70 0x7f30681e6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306de00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30681e52b0 con 0x7f3068071390 2024-05-26T15:42:00.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306de00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30681e5590 con 0x7f30680cd890 2024-05-26T15:42:00.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306de00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30681e5870 con 0x7f30680cdc70 2024-05-26T15:42:00.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3068071390 0x7f30681515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:00.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3068071390 0x7f30681515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44228/0 (socket says 172.21.15.8:44228) 2024-05-26T15:42:00.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306ca00640 1 -- 172.21.15.8:0/1442216991 learned_addr learned my addr 172.21.15.8:0/1442216991 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:00.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306ca00640 1 -- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30680cdc70 msgr2=0x7f30681e6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:00.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306ca00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30680cdc70 0x7f30681e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306ca00640 1 -- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30680cd890 msgr2=0x7f30681e7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:00.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306ca00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30680cd890 0x7f30681e7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.308+0000 7f306ca00640 1 -- 172.21.15.8:0/1442216991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580094d0 con 0x7f3068071390 2024-05-26T15:42:00.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.309+0000 7f306ca00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3068071390 0x7f30681515a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f30580090b0 tx=0x7f30580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:00.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.309+0000 7f3064c00640 1 -- 172.21.15.8:0/1442216991 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058004230 con 0x7f3068071390 2024-05-26T15:42:00.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.309+0000 7f3064c00640 1 -- 172.21.15.8:0/1442216991 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30580043b0 con 0x7f3068071390 2024-05-26T15:42:00.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.309+0000 7f306de00640 1 -- 172.21.15.8:0/1442216991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30681e5b50 con 0x7f3068071390 2024-05-26T15:42:00.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.309+0000 7f3064c00640 1 -- 172.21.15.8:0/1442216991 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305803b910 con 0x7f3068071390 2024-05-26T15:42:00.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.309+0000 7f306de00640 1 -- 172.21.15.8:0/1442216991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3068151ae0 con 0x7f3068071390 2024-05-26T15:42:00.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.310+0000 7f306de00640 1 -- 172.21.15.8:0/1442216991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3068151c70 con 0x7f3068071390 2024-05-26T15:42:00.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.311+0000 7f3064c00640 1 -- 172.21.15.8:0/1442216991 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3058039040 con 0x7f3068071390 2024-05-26T15:42:00.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.312+0000 7f3064c00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f304406ac00 0x7f304406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.312+0000 7f3064c00640 1 -- 172.21.15.8:0/1442216991 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f30580a97e0 con 0x7f3068071390 2024-05-26T15:42:00.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.313+0000 7f3067e00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f304406ac00 0x7f304406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:00.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.314+0000 7f3067e00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f304406ac00 0x7f304406d0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3050006fd0 tx=0x7f3050006bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:00.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.317+0000 7f3064c00640 1 -- 172.21.15.8:0/1442216991 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3058074a30 con 0x7f3068071390 2024-05-26T15:42:00.516 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.517+0000 7f306de00640 1 -- 172.21.15.8:0/1442216991 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f30681e6010 con 0x7f3068071390 2024-05-26T15:42:00.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.524+0000 7f3064c00640 1 -- 172.21.15.8:0/1442216991 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3058004520 con 0x7f3068071390 2024-05-26T15:42:00.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 -- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f304406ac00 msgr2=0x7f304406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:00.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f304406ac00 0x7f304406d0c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3050006fd0 tx=0x7f3050006bc0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 -- 172.21.15.8:0/1442216991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3068071390 msgr2=0x7f30681515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:00.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3068071390 0x7f30681515a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f30580090b0 tx=0x7f30580046c0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 -- 172.21.15.8:0/1442216991 shutdown_connections 2024-05-26T15:42:00.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f30680cdc70 0x7f30681e6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f304406ac00 0x7f304406d0c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f30680cd890 0x7f30681e7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 --2- 172.21.15.8:0/1442216991 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3068071390 0x7f30681515a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 -- 172.21.15.8:0/1442216991 >> 172.21.15.8:0/1442216991 conn(0x7f30680ce4d0 msgr2=0x7f3068158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:00.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 -- 172.21.15.8:0/1442216991 shutdown_connections 2024-05-26T15:42:00.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.528+0000 7f306de00640 1 -- 172.21.15.8:0/1442216991 wait complete. 2024-05-26T15:42:00.546 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj' 2024-05-26T15:42:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.759+0000 7f1c39400640 1 Processor -- start 2024-05-26T15:42:00.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.760+0000 7f1c39400640 1 -- start start 2024-05-26T15:42:00.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.761+0000 7f1c39400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1c34154f50 0x7f1c340b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.761+0000 7f1c39400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1c3415ae70 0x7f1c3415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.761+0000 7f1c39400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3415b640 con 0x7f1c3415f0c0 2024-05-26T15:42:00.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.761+0000 7f1c39400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3415bee0 con 0x7f1c34154f50 2024-05-26T15:42:00.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.761+0000 7f1c39400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c340b0ba0 con 0x7f1c3415ae70 2024-05-26T15:42:00.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.761+0000 7f1c33e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1c34154f50 0x7f1c340b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:00.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.761+0000 7f1c38a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1c3415f0c0 0x7f1c340c36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34612/0 (socket says 172.21.15.8:34612) 2024-05-26T15:42:00.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.761+0000 7f1c33e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1c34154f50 0x7f1c340b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44244/0 (socket says 172.21.15.8:44244) 2024-05-26T15:42:00.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.761+0000 7f1c38a00640 1 -- 172.21.15.8:0/4009346490 learned_addr learned my addr 172.21.15.8:0/4009346490 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:00.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.762+0000 7f1c2be00640 1 --2- 172.21.15.8:0/4009346490 >> v2:172.21.15.47:3300/0 conn(0x7f1c3415ae70 0x7f1c3415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:00.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.762+0000 7f1c33e00640 1 -- 172.21.15.8:0/4009346490 >> v2:172.21.15.47:3300/0 conn(0x7f1c3415ae70 msgr2=0x7f1c3415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:00.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.762+0000 7f1c33e00640 1 --2- 172.21.15.8:0/4009346490 >> v2:172.21.15.47:3300/0 conn(0x7f1c3415ae70 0x7f1c3415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.762+0000 7f1c33e00640 1 -- 172.21.15.8:0/4009346490 >> v1:172.21.15.8:6789/0 conn(0x7f1c3415f0c0 legacy=0x7f1c340c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:00.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.762+0000 7f1c33e00640 1 -- 172.21.15.8:0/4009346490 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3415b920 con 0x7f1c34154f50 2024-05-26T15:42:00.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.763+0000 7f1c33e00640 1 --2- 172.21.15.8:0/4009346490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 0x7f1c340b0f60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1c34067880 tx=0x7f1c2402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626b17f640397c4e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:00.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.763+0000 7f1c33400640 1 -- 172.21.15.8:0/4009346490 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24032440 con 0x7f1c34154f50 2024-05-26T15:42:00.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.763+0000 7f1c33400640 1 -- 172.21.15.8:0/4009346490 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c240325a0 con 0x7f1c34154f50 2024-05-26T15:42:00.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.763+0000 7f1c33400640 1 -- 172.21.15.8:0/4009346490 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24032930 con 0x7f1c34154f50 2024-05-26T15:42:00.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.764+0000 7f1c39400640 1 -- 172.21.15.8:0/4009346490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 msgr2=0x7f1c340b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:00.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.764+0000 7f1c39400640 1 --2- 172.21.15.8:0/4009346490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 0x7f1c340b0f60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1c34067880 tx=0x7f1c2402a1a0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.764+0000 7f1c39400640 1 -- 172.21.15.8:0/4009346490 shutdown_connections 2024-05-26T15:42:00.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.764+0000 7f1c39400640 1 --2- 172.21.15.8:0/4009346490 >> v2:172.21.15.47:3300/0 conn(0x7f1c3415ae70 0x7f1c3415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.764+0000 7f1c39400640 1 --2- 172.21.15.8:0/4009346490 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 0x7f1c340b0f60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.764+0000 7f1c39400640 1 -- 172.21.15.8:0/4009346490 >> 172.21.15.8:0/4009346490 conn(0x7f1c34070480 msgr2=0x7f1c34070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:00.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.764+0000 7f1c39400640 1 -- 172.21.15.8:0/4009346490 shutdown_connections 2024-05-26T15:42:00.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.764+0000 7f1c39400640 1 -- 172.21.15.8:0/4009346490 wait complete. 2024-05-26T15:42:00.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.766+0000 7f1c39400640 1 Processor -- start 2024-05-26T15:42:00.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.766+0000 7f1c39400640 1 -- start start 2024-05-26T15:42:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.767+0000 7f1c39400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 0x7f1c3414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.767+0000 7f1c39400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3415ae70 0x7f1c3414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.767+0000 7f1c39400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1c3415f0c0 0x7f1c34151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.767+0000 7f1c39400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34152790 con 0x7f1c34154f50 2024-05-26T15:42:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.767+0000 7f1c39400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c341518d0 con 0x7f1c3415ae70 2024-05-26T15:42:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.767+0000 7f1c39400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c34151b10 con 0x7f1c3415f0c0 2024-05-26T15:42:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.768+0000 7f1c33e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 0x7f1c3414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.768+0000 7f1c33e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 0x7f1c3414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:44260/0 (socket says 172.21.15.8:44260) 2024-05-26T15:42:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.768+0000 7f1c33e00640 1 -- 172.21.15.8:0/3891073613 learned_addr learned my addr 172.21.15.8:0/3891073613 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.768+0000 7f1c33e00640 1 -- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1c3415f0c0 msgr2=0x7f1c34151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.768+0000 7f1c33e00640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1c3415f0c0 0x7f1c34151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.768+0000 7f1c33e00640 1 -- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3415ae70 msgr2=0x7f1c3414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.768+0000 7f1c33e00640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3415ae70 0x7f1c3414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:00.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.768+0000 7f1c33e00640 1 -- 172.21.15.8:0/3891073613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24009400 con 0x7f1c34154f50 2024-05-26T15:42:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.768+0000 7f1c33e00640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 0x7f1c3414b2e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009890 tx=0x7f1c240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.769+0000 7f1c30c00640 1 -- 172.21.15.8:0/3891073613 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24032440 con 0x7f1c34154f50 2024-05-26T15:42:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.769+0000 7f1c30c00640 1 -- 172.21.15.8:0/3891073613 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c24030ba0 con 0x7f1c34154f50 2024-05-26T15:42:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.769+0000 7f1c39400640 1 -- 172.21.15.8:0/3891073613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c34151df0 con 0x7f1c34154f50 2024-05-26T15:42:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.769+0000 7f1c30c00640 1 -- 172.21.15.8:0/3891073613 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24006e10 con 0x7f1c34154f50 2024-05-26T15:42:00.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.769+0000 7f1c39400640 1 -- 172.21.15.8:0/3891073613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c341523b0 con 0x7f1c34154f50 2024-05-26T15:42:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.770+0000 7f1c39400640 1 -- 172.21.15.8:0/3891073613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c34152540 con 0x7f1c34154f50 2024-05-26T15:42:00.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.771+0000 7f1c30c00640 1 -- 172.21.15.8:0/3891073613 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1c24039040 con 0x7f1c34154f50 2024-05-26T15:42:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.772+0000 7f1c30c00640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1c1006ac30 0x7f1c1006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.773+0000 7f1c30c00640 1 -- 172.21.15.8:0/3891073613 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f1c240a9d60 con 0x7f1c34154f50 2024-05-26T15:42:00.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.773+0000 7f1c2be00640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1c1006ac30 0x7f1c1006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:00.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.774+0000 7f1c2be00640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1c1006ac30 0x7f1c1006d0f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1c340b4880 tx=0x7f1c1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:00.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:00.777+0000 7f1c30c00640 1 -- 172.21.15.8:0/3891073613 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1c24074fb0 con 0x7f1c34154f50 2024-05-26T15:42:01.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.051+0000 7f1c39400640 1 -- 172.21.15.8:0/3891073613 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]} v 0) v1 -- 0x7f1c3404e280 con 0x7f1c34154f50 2024-05-26T15:42:01.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.890+0000 7f1c30c00640 1 -- 172.21.15.8:0/3891073613 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]}]=0 v150) v1 ==== 147+0+0 (secure 0 0 0) 0x7f1c240410d0 con 0x7f1c34154f50 2024-05-26T15:42:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.893+0000 7f1c39400640 1 -- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1c1006ac30 msgr2=0x7f1c1006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.893+0000 7f1c39400640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1c1006ac30 0x7f1c1006d0f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1c340b4880 tx=0x7f1c1c008040 comp rx=0 tx=0).stop 2024-05-26T15:42:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.893+0000 7f1c39400640 1 -- 172.21.15.8:0/3891073613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 msgr2=0x7f1c3414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.893+0000 7f1c39400640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 0x7f1c3414b2e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1c24009890 tx=0x7f1c240046c0 comp rx=0 tx=0).stop 2024-05-26T15:42:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.894+0000 7f1c39400640 1 -- 172.21.15.8:0/3891073613 shutdown_connections 2024-05-26T15:42:01.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.894+0000 7f1c39400640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1c3415f0c0 0x7f1c34151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.894+0000 7f1c39400640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1c1006ac30 0x7f1c1006d0f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.894+0000 7f1c39400640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3415ae70 0x7f1c3414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.894+0000 7f1c39400640 1 --2- 172.21.15.8:0/3891073613 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c34154f50 0x7f1c3414b2e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.894+0000 7f1c39400640 1 -- 172.21.15.8:0/3891073613 >> 172.21.15.8:0/3891073613 conn(0x7f1c34070480 msgr2=0x7f1c340c3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.894+0000 7f1c39400640 1 -- 172.21.15.8:0/3891073613 shutdown_connections 2024-05-26T15:42:01.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:01.894+0000 7f1c39400640 1 -- 172.21.15.8:0/3891073613 wait complete. 2024-05-26T15:42:01.915 INFO:tasks.cephfs_test_runner:The maximum number of openfiles omap objects keys are now equal to ... ok 2024-05-26T15:42:01.916 INFO:tasks.cephfs_test_runner:Starting test: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) Opening a file should increment omap_total_updates by 1. 2024-05-26T15:42:01.916 INFO:tasks.cephfs_test_runner:test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) 2024-05-26T15:42:01.916 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:42:02.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.125+0000 7fa022e00640 1 Processor -- start 2024-05-26T15:42:02.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.125+0000 7fa022e00640 1 -- start start 2024-05-26T15:42:02.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.127+0000 7fa022e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa01c154f50 0x7fa01c0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.127+0000 7fa022e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa01c0c36c0 0x7fa01c0c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.127+0000 7fa022e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01c15b640 con 0x7fa01c15ae70 2024-05-26T15:42:02.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.127+0000 7fa022e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c15bee0 con 0x7fa01c154f50 2024-05-26T15:42:02.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.127+0000 7fa022e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c0b0ba0 con 0x7fa01c0c36c0 2024-05-26T15:42:02.126 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.127+0000 7fa021a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa01c154f50 0x7fa01c0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.127+0000 7fa021a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fa01c154f50 0x7fa01c0b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60626/0 (socket says 172.21.15.8:60626) 2024-05-26T15:42:02.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.127+0000 7fa021a00640 1 -- 172.21.15.8:0/862318956 learned_addr learned my addr 172.21.15.8:0/862318956 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:02.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.128+0000 7fa021a00640 1 -- 172.21.15.8:0/862318956 >> v2:172.21.15.47:3300/0 conn(0x7fa01c0c36c0 msgr2=0x7fa01c0c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:02.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.128+0000 7fa022400640 1 --2- 172.21.15.8:0/862318956 >> v2:172.21.15.47:3300/0 conn(0x7fa01c0c36c0 0x7fa01c0c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.128+0000 7fa021a00640 1 --2- 172.21.15.8:0/862318956 >> v2:172.21.15.47:3300/0 conn(0x7fa01c0c36c0 0x7fa01c0c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.128+0000 7fa021a00640 1 -- 172.21.15.8:0/862318956 >> v1:172.21.15.47:6789/0 conn(0x7fa01c15ae70 legacy=0x7fa01c15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:02.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.128+0000 7fa021a00640 1 -- 172.21.15.8:0/862318956 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c15b920 con 0x7fa01c154f50 2024-05-26T15:42:02.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.128+0000 7fa022400640 1 --2- 172.21.15.8:0/862318956 >> v2:172.21.15.47:3300/0 conn(0x7fa01c0c36c0 0x7fa01c0c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:02.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.129+0000 7fa021a00640 1 --2- 172.21.15.8:0/862318956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 0x7fa01c0b0f60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0c6990 tx=0x7fa01002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2890392f877caf server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:02.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.129+0000 7fa01be00640 1 -- 172.21.15.8:0/862318956 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa010032440 con 0x7fa01c154f50 2024-05-26T15:42:02.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.129+0000 7fa01be00640 1 -- 172.21.15.8:0/862318956 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0100325a0 con 0x7fa01c154f50 2024-05-26T15:42:02.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.129+0000 7fa01be00640 1 -- 172.21.15.8:0/862318956 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa010032930 con 0x7fa01c154f50 2024-05-26T15:42:02.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.130+0000 7fa022e00640 1 -- 172.21.15.8:0/862318956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 msgr2=0x7fa01c0b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.130+0000 7fa022e00640 1 --2- 172.21.15.8:0/862318956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 0x7fa01c0b0f60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa01c0c6990 tx=0x7fa01002a230 comp rx=0 tx=0).stop 2024-05-26T15:42:02.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.130+0000 7fa022e00640 1 -- 172.21.15.8:0/862318956 shutdown_connections 2024-05-26T15:42:02.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.130+0000 7fa022e00640 1 --2- 172.21.15.8:0/862318956 >> v2:172.21.15.47:3300/0 conn(0x7fa01c0c36c0 0x7fa01c0c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.130+0000 7fa022e00640 1 --2- 172.21.15.8:0/862318956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 0x7fa01c0b0f60 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.130+0000 7fa022e00640 1 -- 172.21.15.8:0/862318956 >> 172.21.15.8:0/862318956 conn(0x7fa01c070480 msgr2=0x7fa01c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:02.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.130+0000 7fa022e00640 1 -- 172.21.15.8:0/862318956 shutdown_connections 2024-05-26T15:42:02.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.130+0000 7fa022e00640 1 -- 172.21.15.8:0/862318956 wait complete. 2024-05-26T15:42:02.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.132+0000 7fa022e00640 1 Processor -- start 2024-05-26T15:42:02.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.133+0000 7fa022e00640 1 -- start start 2024-05-26T15:42:02.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.134+0000 7fa022e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa01c0c36c0 0x7fa01c1f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.134+0000 7fa022e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 0x7fa01c0b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.134+0000 7fa022e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa01c15ae70 0x7fa01c1f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.134+0000 7fa022e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0b2ee0 con 0x7fa01c154f50 2024-05-26T15:42:02.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.134+0000 7fa022e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0b2a50 con 0x7fa01c0c36c0 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.134+0000 7fa022e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c1f3730 con 0x7fa01c15ae70 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.134+0000 7fa021000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 0x7fa01c0b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.134+0000 7fa021000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 0x7fa01c0b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60636/0 (socket says 172.21.15.8:60636) 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.134+0000 7fa021000640 1 -- 172.21.15.8:0/1777384952 learned_addr learned my addr 172.21.15.8:0/1777384952 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.135+0000 7fa021a00640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa01c0c36c0 0x7fa01c1f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.135+0000 7fa022400640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa01c15ae70 0x7fa01c1f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.135+0000 7fa021000640 1 -- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa01c15ae70 msgr2=0x7fa01c1f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.135+0000 7fa021000640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa01c15ae70 0x7fa01c1f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.135+0000 7fa021000640 1 -- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa01c0c36c0 msgr2=0x7fa01c1f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.135+0000 7fa021000640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa01c0c36c0 0x7fa01c1f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.135+0000 7fa021000640 1 -- 172.21.15.8:0/1777384952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0100094d0 con 0x7fa01c154f50 2024-05-26T15:42:02.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.135+0000 7fa021a00640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa01c0c36c0 0x7fa01c1f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:42:02.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.135+0000 7fa021000640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 0x7fa01c0b3790 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa00800b420 tx=0x7fa00800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:02.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.136+0000 7fa019600640 1 -- 172.21.15.8:0/1777384952 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008011830 con 0x7fa01c154f50 2024-05-26T15:42:02.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.136+0000 7fa019600640 1 -- 172.21.15.8:0/1777384952 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa008011990 con 0x7fa01c154f50 2024-05-26T15:42:02.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.136+0000 7fa019600640 1 -- 172.21.15.8:0/1777384952 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa008011d40 con 0x7fa01c154f50 2024-05-26T15:42:02.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.136+0000 7fa022e00640 1 -- 172.21.15.8:0/1777384952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c0b1e40 con 0x7fa01c154f50 2024-05-26T15:42:02.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.136+0000 7fa022e00640 1 -- 172.21.15.8:0/1777384952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c0b2400 con 0x7fa01c154f50 2024-05-26T15:42:02.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.137+0000 7fa022e00640 1 -- 172.21.15.8:0/1777384952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01c0b2c00 con 0x7fa01c154f50 2024-05-26T15:42:02.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.138+0000 7fa019600640 1 -- 172.21.15.8:0/1777384952 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa00801b460 con 0x7fa01c154f50 2024-05-26T15:42:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.139+0000 7fa019600640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9ffc06ac00 0x7f9ffc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.139+0000 7fa019600640 1 -- 172.21.15.8:0/1777384952 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fa008088e60 con 0x7fa01c154f50 2024-05-26T15:42:02.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.140+0000 7fa021a00640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9ffc06ac00 0x7f9ffc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.141+0000 7fa021a00640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9ffc06ac00 0x7f9ffc06d0c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa010034000 tx=0x7fa01002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:02.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.145+0000 7fa019600640 1 -- 172.21.15.8:0/1777384952 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa01c0b2c00 con 0x7fa01c154f50 2024-05-26T15:42:02.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.347+0000 7fa022e00640 1 -- 172.21.15.8:0/1777384952 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa01c0b2c00 con 0x7fa01c154f50 2024-05-26T15:42:02.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.349+0000 7fa019600640 1 -- 172.21.15.8:0/1777384952 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+12885 (secure 0 0 0) 0x7fa01c0b2c00 con 0x7fa01c154f50 2024-05-26T15:42:02.348 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:02.348 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":46,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:41:59.856681+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6835/1710654961":"2024-05-27T15:41:56.831152+0000","172.21.15.47:6834/1710654961":"2024-05-27T15:41:56.831152+0000","172.21.15.8:6835/3972699618":"2024-05-27T15:41:22.474515+0000","172.21.15.47:6837/2181130163":"2024-05-27T15:41:22.454549+0000","172.21.15.8:6834/3972699618":"2024-05-27T15:41:22.474515+0000","172.21.15.47:6834/2181130163":"2024-05-27T15:41:22.454549+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:42:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 -- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9ffc06ac00 msgr2=0x7f9ffc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9ffc06ac00 0x7f9ffc06d0c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa010034000 tx=0x7fa01002e000 comp rx=0 tx=0).stop 2024-05-26T15:42:02.350 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 -- 172.21.15.8:0/1777384952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 msgr2=0x7fa01c0b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 0x7fa01c0b3790 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa00800b420 tx=0x7fa00800b8e0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 -- 172.21.15.8:0/1777384952 shutdown_connections 2024-05-26T15:42:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa01c15ae70 0x7fa01c1f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa01c154f50 0x7fa01c0b3790 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9ffc06ac00 0x7f9ffc06d0c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 --2- 172.21.15.8:0/1777384952 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa01c0c36c0 0x7fa01c1f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 -- 172.21.15.8:0/1777384952 >> 172.21.15.8:0/1777384952 conn(0x7fa01c070480 msgr2=0x7fa01c153740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 -- 172.21.15.8:0/1777384952 shutdown_connections 2024-05-26T15:42:02.351 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.352+0000 7fa022e00640 1 -- 172.21.15.8:0/1777384952 wait complete. 2024-05-26T15:42:02.370 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-26T15:42:02.370 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:42:02.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.579+0000 7fc45e000640 1 Processor -- start 2024-05-26T15:42:02.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.579+0000 7fc45e000640 1 -- start start 2024-05-26T15:42:02.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.580+0000 7fc45e000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc45815e080 0x7fc4580c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.580+0000 7fc45e000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc45815e460 0x7fc4580cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.580+0000 7fc45e000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580998c0 con 0x7fc4580cf460 2024-05-26T15:42:02.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.580+0000 7fc45e000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc458099ba0 con 0x7fc45815e080 2024-05-26T15:42:02.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.580+0000 7fc45e000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc458099e80 con 0x7fc45815e460 2024-05-26T15:42:02.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.581+0000 7fc45d600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc4580cf460 0x7fc458098a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59332/0 (socket says 172.21.15.8:59332) 2024-05-26T15:42:02.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.581+0000 7fc45d600640 1 -- 172.21.15.8:0/3112177740 learned_addr learned my addr 172.21.15.8:0/3112177740 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:02.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.581+0000 7fc45cc00640 1 --2- 172.21.15.8:0/3112177740 >> v2:172.21.15.47:3300/0 conn(0x7fc45815e080 0x7fc4580c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.581+0000 7fc44fe00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc45815e460 0x7fc4580cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.581+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606089052 0 0) 0x7fc4580998c0 con 0x7fc4580cf460 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.581+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc43c003520 con 0x7fc4580cf460 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1483627133 0 0) 0x7fc43c003520 con 0x7fc4580cf460 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc45815e460 msgr2=0x7fc4580cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc45815e460 0x7fc4580cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 >> v2:172.21.15.47:3300/0 conn(0x7fc45815e080 msgr2=0x7fc4580c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 --2- 172.21.15.8:0/3112177740 >> v2:172.21.15.47:3300/0 conn(0x7fc45815e080 0x7fc4580c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4580cb6e0 con 0x7fc4580cf460 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fc4500019f0 con 0x7fc4580cf460 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 >> v1:172.21.15.8:6789/0 conn(0x7fc4580cf460 legacy=0x7fc458098a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc45815e460 0x7fc43c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c003f40 0x7fc43c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc43c004d00 0x7fc43c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc458099ba0 con 0x7fc43c003f40 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc458099e80 con 0x7fc43c004d00 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c00ba30 con 0x7fc45815e460 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.582+0000 7fc44fe00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c003f40 0x7fc43c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.583+0000 7fc45d600640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc43c004d00 0x7fc43c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.583+0000 7fc45cc00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc45815e460 0x7fc43c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.583+0000 7fc44fe00640 1 -- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc45815e460 msgr2=0x7fc43c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.583+0000 7fc44fe00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc45815e460 0x7fc43c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.583+0000 7fc44fe00640 1 -- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc43c004d00 msgr2=0x7fc43c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.583+0000 7fc44fe00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc43c004d00 0x7fc43c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.583+0000 7fc44fe00640 1 -- 172.21.15.8:0/3112177740 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c003520 con 0x7fc43c003f40 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.583+0000 7fc45d600640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc43c004d00 0x7fc43c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:02.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.583+0000 7fc45cc00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc45815e460 0x7fc43c003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:02.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.584+0000 7fc44fe00640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c003f40 0x7fc43c0047c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc440009ac0 tx=0x7fc43c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e1af891c122b6c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:02.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.584+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440031400 con 0x7fc43c003f40 2024-05-26T15:42:02.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.584+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44002d050 con 0x7fc43c003f40 2024-05-26T15:42:02.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.584+0000 7fc457e00640 1 -- 172.21.15.8:0/3112177740 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440031780 con 0x7fc43c003f40 2024-05-26T15:42:02.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.585+0000 7fc45e000640 1 -- 172.21.15.8:0/3112177740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c003f40 msgr2=0x7fc43c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.585+0000 7fc45e000640 1 --2- 172.21.15.8:0/3112177740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc43c003f40 0x7fc43c0047c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc440009ac0 tx=0x7fc43c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.585+0000 7fc45d600640 1 -- 172.21.15.8:0/3112177740 reap_dead start 2024-05-26T15:42:02.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.585+0000 7fc45e000640 1 -- 172.21.15.8:0/3112177740 shutdown_connections 2024-05-26T15:42:02.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.585+0000 7fc45e000640 1 -- 172.21.15.8:0/3112177740 >> 172.21.15.8:0/3112177740 conn(0x7fc4580b2270 msgr2=0x7fc4580b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:02.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.585+0000 7fc45e000640 1 -- 172.21.15.8:0/3112177740 shutdown_connections 2024-05-26T15:42:02.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.585+0000 7fc45e000640 1 -- 172.21.15.8:0/3112177740 wait complete. 2024-05-26T15:42:02.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.587+0000 7fc45e000640 1 Processor -- start 2024-05-26T15:42:02.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.587+0000 7fc45e000640 1 -- start start 2024-05-26T15:42:02.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.588+0000 7fc45e000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc43c003f40 0x7fc4581578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.588+0000 7fc45e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4580b56e0 0x7fc4580b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.588+0000 7fc45e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4580c8400 0x7fc4580c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.588+0000 7fc45e000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4581ef090 con 0x7fc4580c8400 2024-05-26T15:42:02.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.588+0000 7fc45e000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580c8dc0 con 0x7fc4580b56e0 2024-05-26T15:42:02.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.588+0000 7fc45e000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580b6170 con 0x7fc43c003f40 2024-05-26T15:42:02.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc45d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4580c8400 0x7fc4580c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc45d600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4580c8400 0x7fc4580c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60642/0 (socket says 172.21.15.8:60642) 2024-05-26T15:42:02.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc45d600640 1 -- 172.21.15.8:0/3493591938 learned_addr learned my addr 172.21.15.8:0/3493591938 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:02.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc44fe00640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4580b56e0 0x7fc4580b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc45cc00640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc43c003f40 0x7fc4581578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc45d600640 1 -- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc43c003f40 msgr2=0x7fc4581578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc45d600640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc43c003f40 0x7fc4581578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc45d600640 1 -- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4580b56e0 msgr2=0x7fc4580b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc45d600640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4580b56e0 0x7fc4580b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc45d600640 1 -- 172.21.15.8:0/3493591938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4581ee6f0 con 0x7fc4580c8400 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.589+0000 7fc45d600640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4580c8400 0x7fc4580c8880 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc45806de90 tx=0x7fc45000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.590+0000 7fc455600640 1 -- 172.21.15.8:0/3493591938 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450004d60 con 0x7fc4580c8400 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.590+0000 7fc455600640 1 -- 172.21.15.8:0/3493591938 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45000bb80 con 0x7fc4580c8400 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.590+0000 7fc455600640 1 -- 172.21.15.8:0/3493591938 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450007110 con 0x7fc4580c8400 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.590+0000 7fc45e000640 1 -- 172.21.15.8:0/3493591938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4581ee9d0 con 0x7fc4580c8400 2024-05-26T15:42:02.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.590+0000 7fc45e000640 1 -- 172.21.15.8:0/3493591938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc458157e10 con 0x7fc4580c8400 2024-05-26T15:42:02.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.591+0000 7fc45e000640 1 -- 172.21.15.8:0/3493591938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4581ef1d0 con 0x7fc4580c8400 2024-05-26T15:42:02.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.592+0000 7fc455600640 1 -- 172.21.15.8:0/3493591938 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc450007270 con 0x7fc4580c8400 2024-05-26T15:42:02.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.593+0000 7fc455600640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc43406ac00 0x7fc43406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:02.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.593+0000 7fc455600640 1 -- 172.21.15.8:0/3493591938 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fc450089700 con 0x7fc4580c8400 2024-05-26T15:42:02.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.594+0000 7fc45cc00640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc43406ac00 0x7fc43406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:02.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.595+0000 7fc45cc00640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc43406ac00 0x7fc43406d0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc4580c83b0 tx=0x7fc448008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:02.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.597+0000 7fc455600640 1 -- 172.21.15.8:0/3493591938 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc4581ef1d0 con 0x7fc4580c8400 2024-05-26T15:42:02.800 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.802+0000 7fc45e000640 1 -- 172.21.15.8:0/3493591938 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4581ef1d0 con 0x7fc4580c8400 2024-05-26T15:42:02.801 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.803+0000 7fc455600640 1 -- 172.21.15.8:0/3493591938 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4581ef1d0 con 0x7fc4580c8400 2024-05-26T15:42:02.801 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:42:02.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.805+0000 7fc45e000640 1 -- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc43406ac00 msgr2=0x7fc43406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.804 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.805+0000 7fc45e000640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc43406ac00 0x7fc43406d0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc4580c83b0 tx=0x7fc448008040 comp rx=0 tx=0).stop 2024-05-26T15:42:02.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.805+0000 7fc45e000640 1 -- 172.21.15.8:0/3493591938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4580c8400 msgr2=0x7fc4580c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:02.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.805+0000 7fc45e000640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4580c8400 0x7fc4580c8880 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc45806de90 tx=0x7fc45000b4a0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.806+0000 7fc45e000640 1 -- 172.21.15.8:0/3493591938 shutdown_connections 2024-05-26T15:42:02.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.806+0000 7fc45e000640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc4580c8400 0x7fc4580c8880 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.806+0000 7fc45e000640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc43406ac00 0x7fc43406d0c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.806+0000 7fc45e000640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc4580b56e0 0x7fc4580b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.806+0000 7fc45e000640 1 --2- 172.21.15.8:0/3493591938 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc43c003f40 0x7fc4581578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:02.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.806+0000 7fc45e000640 1 -- 172.21.15.8:0/3493591938 >> 172.21.15.8:0/3493591938 conn(0x7fc4580b2270 msgr2=0x7fc458159c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:02.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.806+0000 7fc45e000640 1 -- 172.21.15.8:0/3493591938 shutdown_connections 2024-05-26T15:42:02.805 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:02.806+0000 7fc45e000640 1 -- 172.21.15.8:0/3493591938 wait complete. 2024-05-26T15:42:02.824 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters' 2024-05-26T15:42:03.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.041+0000 7f06c6a00640 1 Processor -- start 2024-05-26T15:42:03.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.041+0000 7f06c6a00640 1 -- start start 2024-05-26T15:42:03.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.043+0000 7f06c6a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06c00b0f60 0x7f06c015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:03.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.043+0000 7f06c6a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c015b640 con 0x7f06c015f0c0 2024-05-26T15:42:03.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.043+0000 7f06c6a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c015b920 con 0x7f06c0154f50 2024-05-26T15:42:03.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.043+0000 7f06c6a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c015bee0 con 0x7f06c00b0f60 2024-05-26T15:42:03.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.043+0000 7f06c6000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f06c015f0c0 0x7f06c00c36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59348/0 (socket says 172.21.15.8:59348) 2024-05-26T15:42:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.043+0000 7f06c6000640 1 -- 172.21.15.8:0/933521 learned_addr learned my addr 172.21.15.8:0/933521 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.044+0000 7f06c4c00640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06c00b0f60 0x7f06c015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.044+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432855971 0 0) 0x7f06c015b640 con 0x7f06c015f0c0 2024-05-26T15:42:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.044+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a8003520 con 0x7f06c015f0c0 2024-05-26T15:42:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.044+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654091627 0 0) 0x7f06c015b920 con 0x7f06c0154f50 2024-05-26T15:42:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.044+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c015b640 con 0x7f06c0154f50 2024-05-26T15:42:03.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3288152579 0 0) 0x7f06a8003520 con 0x7f06c015f0c0 2024-05-26T15:42:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06c00b0f60 msgr2=0x7f06c015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06c00b0f60 0x7f06c015eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 >> v1:172.21.15.47:6789/0 conn(0x7f06c0154f50 legacy=0x7f06c015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c015bc00 con 0x7f06c015f0c0 2024-05-26T15:42:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f06b80019f0 con 0x7f06c015f0c0 2024-05-26T15:42:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 >> v1:172.21.15.8:6789/0 conn(0x7f06c015f0c0 legacy=0x7f06c00c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a8003b30 0x7f06a8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06a80047c0 0x7f06a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06c00b0f60 0x7f06a80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:03.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c015bee0 con 0x7f06a80047c0 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a800ff20 con 0x7f06a8003b30 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80100b0 con 0x7f06c00b0f60 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06c4c00640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06a80047c0 0x7f06a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.045+0000 7f06c5600640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a8003b30 0x7f06a8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.046+0000 7f06c6000640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06c00b0f60 0x7f06a80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.046+0000 7f06c4c00640 1 -- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06c00b0f60 msgr2=0x7f06a80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.046+0000 7f06c4c00640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06c00b0f60 0x7f06a80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.046+0000 7f06c4c00640 1 -- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a8003b30 msgr2=0x7f06a8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.046+0000 7f06c4c00640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a8003b30 0x7f06a8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.046+0000 7f06c4c00640 1 -- 172.21.15.8:0/933521 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a8003520 con 0x7f06a80047c0 2024-05-26T15:42:03.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.046+0000 7f06c6000640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06c00b0f60 0x7f06a80051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:03.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.047+0000 7f06c4c00640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06a80047c0 0x7f06a8004c40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009af0 tx=0x7f06a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9542497e90c75eb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:03.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.047+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac031400 con 0x7f06a80047c0 2024-05-26T15:42:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.047+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac02d050 con 0x7f06a80047c0 2024-05-26T15:42:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.047+0000 7f06bfe00640 1 -- 172.21.15.8:0/933521 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac031780 con 0x7f06a80047c0 2024-05-26T15:42:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.048+0000 7f06c6a00640 1 -- 172.21.15.8:0/933521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06a80047c0 msgr2=0x7f06a8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.048+0000 7f06c6a00640 1 --2- 172.21.15.8:0/933521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06a80047c0 0x7f06a8004c40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f06ac009af0 tx=0x7f06a80057f0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.048+0000 7f06c6000640 1 -- 172.21.15.8:0/933521 reap_dead start 2024-05-26T15:42:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.048+0000 7f06c6a00640 1 -- 172.21.15.8:0/933521 shutdown_connections 2024-05-26T15:42:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.048+0000 7f06c6a00640 1 -- 172.21.15.8:0/933521 >> 172.21.15.8:0/933521 conn(0x7f06c0070480 msgr2=0x7f06c0070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.048+0000 7f06c6a00640 1 -- 172.21.15.8:0/933521 shutdown_connections 2024-05-26T15:42:03.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.048+0000 7f06c6a00640 1 -- 172.21.15.8:0/933521 wait complete. 2024-05-26T15:42:03.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.050+0000 7f06c6a00640 1 Processor -- start 2024-05-26T15:42:03.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.050+0000 7f06c6a00640 1 -- start start 2024-05-26T15:42:03.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.051+0000 7f06c6a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06a80047c0 0x7f06c01eda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:03.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.051+0000 7f06c6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c0159330 0x7f06c0159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:03.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.051+0000 7f06c6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06c00c9e20 0x7f06c00ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:03.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.051+0000 7f06c6a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0159cd0 con 0x7f06c00c9e20 2024-05-26T15:42:03.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.051+0000 7f06c6a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0157f60 con 0x7f06c0159330 2024-05-26T15:42:03.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.051+0000 7f06c6a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00ca7e0 con 0x7f06a80047c0 2024-05-26T15:42:03.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.052+0000 7f06c6000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06c00c9e20 0x7f06c00ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:03.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.052+0000 7f06c6000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06c00c9e20 0x7f06c00ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60660/0 (socket says 172.21.15.8:60660) 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.052+0000 7f06c6000640 1 -- 172.21.15.8:0/3608578939 learned_addr learned my addr 172.21.15.8:0/3608578939 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.052+0000 7f06c4c00640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c0159330 0x7f06c0159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.052+0000 7f06c5600640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06a80047c0 0x7f06c01eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.052+0000 7f06c6000640 1 -- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06a80047c0 msgr2=0x7f06c01eda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.052+0000 7f06c6000640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06a80047c0 0x7f06c01eda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.052+0000 7f06c6000640 1 -- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c0159330 msgr2=0x7f06c0159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.052+0000 7f06c6000640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c0159330 0x7f06c0159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.052+0000 7f06c6000640 1 -- 172.21.15.8:0/3608578939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c015aa30 con 0x7f06c00c9e20 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.053+0000 7f06c6000640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06c00c9e20 0x7f06c00ca2a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f06c00ca990 tx=0x7f06b800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.053+0000 7f06bd600640 1 -- 172.21.15.8:0/3608578939 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8004d60 con 0x7f06c00c9e20 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.053+0000 7f06bd600640 1 -- 172.21.15.8:0/3608578939 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b800bb50 con 0x7f06c00c9e20 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.053+0000 7f06bd600640 1 -- 172.21.15.8:0/3608578939 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8007110 con 0x7f06c00c9e20 2024-05-26T15:42:03.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.053+0000 7f06c6a00640 1 -- 172.21.15.8:0/3608578939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c0159eb0 con 0x7f06c00c9e20 2024-05-26T15:42:03.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.053+0000 7f06c6a00640 1 -- 172.21.15.8:0/3608578939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c015a470 con 0x7f06c00c9e20 2024-05-26T15:42:03.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.054+0000 7f06c6a00640 1 -- 172.21.15.8:0/3608578939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c004e280 con 0x7f06c00c9e20 2024-05-26T15:42:03.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.055+0000 7f06bd600640 1 -- 172.21.15.8:0/3608578939 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06b8007270 con 0x7f06c00c9e20 2024-05-26T15:42:03.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.056+0000 7f06bd600640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06a006ac00 0x7f06a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:03.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.056+0000 7f06bd600640 1 -- 172.21.15.8:0/3608578939 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f06b8089630 con 0x7f06c00c9e20 2024-05-26T15:42:03.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.057+0000 7f06c5600640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06a006ac00 0x7f06a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:03.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.058+0000 7f06c5600640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06a006ac00 0x7f06a006d0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f06b4007ae0 tx=0x7f06b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:03.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.061+0000 7f06bd600640 1 -- 172.21.15.8:0/3608578939 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f06b8054910 con 0x7f06c00c9e20 2024-05-26T15:42:03.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.328+0000 7f06c6a00640 1 -- 172.21.15.8:0/3608578939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]} v 0) v1 -- 0x7f06c00714a0 con 0x7f06c00c9e20 2024-05-26T15:42:03.900 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.902+0000 7f06bd600640 1 -- 172.21.15.8:0/3608578939 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]}]=0 v152) v1 ==== 146+0+0 (secure 0 0 0) 0x7f06b8057f30 con 0x7f06c00c9e20 2024-05-26T15:42:03.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.905+0000 7f06c6a00640 1 -- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06a006ac00 msgr2=0x7f06a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:03.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.905+0000 7f06c6a00640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06a006ac00 0x7f06a006d0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f06b4007ae0 tx=0x7f06b4009040 comp rx=0 tx=0).stop 2024-05-26T15:42:03.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.905+0000 7f06c6a00640 1 -- 172.21.15.8:0/3608578939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06c00c9e20 msgr2=0x7f06c00ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:03.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.905+0000 7f06c6a00640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06c00c9e20 0x7f06c00ca2a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f06c00ca990 tx=0x7f06b800b4a0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.906+0000 7f06c6a00640 1 -- 172.21.15.8:0/3608578939 shutdown_connections 2024-05-26T15:42:03.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.906+0000 7f06c6a00640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06c00c9e20 0x7f06c00ca2a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.906+0000 7f06c6a00640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06a006ac00 0x7f06a006d0c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.906+0000 7f06c6a00640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06c0159330 0x7f06c0159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.906+0000 7f06c6a00640 1 --2- 172.21.15.8:0/3608578939 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06a80047c0 0x7f06c01eda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:03.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.906+0000 7f06c6a00640 1 -- 172.21.15.8:0/3608578939 >> 172.21.15.8:0/3608578939 conn(0x7f06c0070480 msgr2=0x7f06c00c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:03.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.906+0000 7f06c6a00640 1 -- 172.21.15.8:0/3608578939 shutdown_connections 2024-05-26T15:42:03.905 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:03.906+0000 7f06c6a00640 1 -- 172.21.15.8:0/3608578939 wait complete. 2024-05-26T15:42:03.925 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-26T15:42:04.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.143+0000 7fef35600640 1 Processor -- start 2024-05-26T15:42:04.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.143+0000 7fef35600640 1 -- start start 2024-05-26T15:42:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.144+0000 7fef35600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef3015a910 0x7fef300ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.144+0000 7fef35600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fef300adba0 0x7fef300ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.145+0000 7fef35600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef301607c0 con 0x7fef300ce8e0 2024-05-26T15:42:04.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.145+0000 7fef35600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef300ced90 con 0x7fef300adba0 2024-05-26T15:42:04.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.145+0000 7fef35600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef30160a80 con 0x7fef3015a910 2024-05-26T15:42:04.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.145+0000 7fef2f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fef300ce8e0 0x7fef30070490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59352/0 (socket says 172.21.15.8:59352) 2024-05-26T15:42:04.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.145+0000 7fef2f400640 1 -- 172.21.15.8:0/1420927416 learned_addr learned my addr 172.21.15.8:0/1420927416 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:04.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.145+0000 7fef2e000640 1 --2- 172.21.15.8:0/1420927416 >> v2:172.21.15.47:3300/0 conn(0x7fef300adba0 0x7fef300ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:04.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.145+0000 7fef2ea00640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef3015a910 0x7fef300ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:04.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.145+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709961623 0 0) 0x7fef301607c0 con 0x7fef300ce8e0 2024-05-26T15:42:04.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.145+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef14003520 con 0x7fef300ce8e0 2024-05-26T15:42:04.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 644107725 0 0) 0x7fef14003520 con 0x7fef300ce8e0 2024-05-26T15:42:04.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef3015a910 msgr2=0x7fef300ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:04.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef3015a910 0x7fef300ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 >> v2:172.21.15.47:3300/0 conn(0x7fef300adba0 msgr2=0x7fef300ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:04.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 --2- 172.21.15.8:0/1420927416 >> v2:172.21.15.47:3300/0 conn(0x7fef300adba0 0x7fef300ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30160d60 con 0x7fef300ce8e0 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fef28001670 con 0x7fef300ce8e0 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 >> v1:172.21.15.8:6789/0 conn(0x7fef300ce8e0 legacy=0x7fef30070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef140039e0 0x7fef14003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef140047c0 0x7fef14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef3015a910 0x7fef14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300ced90 con 0x7fef140047c0 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30160a80 con 0x7fef140039e0 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1400b980 con 0x7fef3015a910 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.146+0000 7fef2e000640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef140047c0 0x7fef14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.147+0000 7fef2ea00640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef140039e0 0x7fef14003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.147+0000 7fef2f400640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef3015a910 0x7fef14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.147+0000 7fef2e000640 1 -- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef3015a910 msgr2=0x7fef14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.147+0000 7fef2e000640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef3015a910 0x7fef14005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.147+0000 7fef2e000640 1 -- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef140039e0 msgr2=0x7fef14003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:04.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.147+0000 7fef2e000640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef140039e0 0x7fef14003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.147+0000 7fef2e000640 1 -- 172.21.15.8:0/1420927416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef14003520 con 0x7fef140047c0 2024-05-26T15:42:04.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.148+0000 7fef2e000640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef140047c0 0x7fef14004c40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fef18009ac0 tx=0x7fef140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74be372415351c66 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:04.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.148+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18031400 con 0x7fef140047c0 2024-05-26T15:42:04.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.148+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1802d050 con 0x7fef140047c0 2024-05-26T15:42:04.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.148+0000 7fef2d600640 1 -- 172.21.15.8:0/1420927416 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18031780 con 0x7fef140047c0 2024-05-26T15:42:04.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.149+0000 7fef35600640 1 -- 172.21.15.8:0/1420927416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef140047c0 msgr2=0x7fef14004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:04.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.149+0000 7fef35600640 1 --2- 172.21.15.8:0/1420927416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef140047c0 0x7fef14004c40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fef18009ac0 tx=0x7fef140057f0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.149+0000 7fef2f400640 1 -- 172.21.15.8:0/1420927416 reap_dead start 2024-05-26T15:42:04.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.149+0000 7fef35600640 1 -- 172.21.15.8:0/1420927416 shutdown_connections 2024-05-26T15:42:04.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.149+0000 7fef35600640 1 -- 172.21.15.8:0/1420927416 >> 172.21.15.8:0/1420927416 conn(0x7fef30069e70 msgr2=0x7fef3006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:04.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.149+0000 7fef35600640 1 -- 172.21.15.8:0/1420927416 shutdown_connections 2024-05-26T15:42:04.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.149+0000 7fef35600640 1 -- 172.21.15.8:0/1420927416 wait complete. 2024-05-26T15:42:04.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.151+0000 7fef35600640 1 Processor -- start 2024-05-26T15:42:04.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.151+0000 7fef35600640 1 -- start start 2024-05-26T15:42:04.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.152+0000 7fef35600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef140047c0 0x7fef301f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.152+0000 7fef35600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef30141350 0x7fef300cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.152+0000 7fef35600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef300cd640 0x7fef300b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.152+0000 7fef35600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300cdbc0 con 0x7fef300cd640 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.152+0000 7fef35600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300cdea0 con 0x7fef140047c0 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.152+0000 7fef35600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef301f5ca0 con 0x7fef30141350 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.152+0000 7fef2f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef300cd640 0x7fef300b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.152+0000 7fef2f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef300cd640 0x7fef300b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60670/0 (socket says 172.21.15.8:60670) 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.152+0000 7fef2f400640 1 -- 172.21.15.8:0/1011948784 learned_addr learned my addr 172.21.15.8:0/1011948784 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.153+0000 7fef2e000640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef30141350 0x7fef300cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.153+0000 7fef2ea00640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef140047c0 0x7fef301f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:04.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.153+0000 7fef2f400640 1 -- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef30141350 msgr2=0x7fef300cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:04.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.153+0000 7fef2f400640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef30141350 0x7fef300cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.153+0000 7fef2f400640 1 -- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef140047c0 msgr2=0x7fef301f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:04.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.153+0000 7fef2f400640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef140047c0 0x7fef301f6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.153+0000 7fef2f400640 1 -- 172.21.15.8:0/1011948784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef301f5f80 con 0x7fef300cd640 2024-05-26T15:42:04.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.153+0000 7fef2f400640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef300cd640 0x7fef300b22e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fef28000c00 tx=0x7fef2800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:04.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.154+0000 7fef26a00640 1 -- 172.21.15.8:0/1011948784 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2800eed0 con 0x7fef300cd640 2024-05-26T15:42:04.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.154+0000 7fef26a00640 1 -- 172.21.15.8:0/1011948784 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2800c610 con 0x7fef300cd640 2024-05-26T15:42:04.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.154+0000 7fef26a00640 1 -- 172.21.15.8:0/1011948784 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2800c9a0 con 0x7fef300cd640 2024-05-26T15:42:04.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.154+0000 7fef35600640 1 -- 172.21.15.8:0/1011948784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef301f6260 con 0x7fef300cd640 2024-05-26T15:42:04.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.154+0000 7fef35600640 1 -- 172.21.15.8:0/1011948784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef30147d00 con 0x7fef300cd640 2024-05-26T15:42:04.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.155+0000 7fef35600640 1 -- 172.21.15.8:0/1011948784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef30147e90 con 0x7fef300cd640 2024-05-26T15:42:04.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.156+0000 7fef26a00640 1 -- 172.21.15.8:0/1011948784 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef2800cb00 con 0x7fef300cd640 2024-05-26T15:42:04.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.157+0000 7fef26a00640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fef0c06ac30 0x7fef0c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:04.155 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.157+0000 7fef26a00640 1 -- 172.21.15.8:0/1011948784 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fef28088ef0 con 0x7fef300cd640 2024-05-26T15:42:04.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.158+0000 7fef2ea00640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fef0c06ac30 0x7fef0c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:04.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.159+0000 7fef2ea00640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fef0c06ac30 0x7fef0c06d0f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fef20007440 tx=0x7fef2000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:04.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.161+0000 7fef26a00640 1 -- 172.21.15.8:0/1011948784 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fef280541d0 con 0x7fef300cd640 2024-05-26T15:42:04.356 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.357+0000 7fef35600640 1 -- 172.21.15.8:0/1011948784 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fef300cdd00 con 0x7fef300cd640 2024-05-26T15:42:04.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.363+0000 7fef26a00640 1 -- 172.21.15.8:0/1011948784 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fef300cdd00 con 0x7fef300cd640 2024-05-26T15:42:04.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.366+0000 7fef35600640 1 -- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fef0c06ac30 msgr2=0x7fef0c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:04.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.366+0000 7fef35600640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fef0c06ac30 0x7fef0c06d0f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fef20007440 tx=0x7fef2000b040 comp rx=0 tx=0).stop 2024-05-26T15:42:04.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.366+0000 7fef35600640 1 -- 172.21.15.8:0/1011948784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef300cd640 msgr2=0x7fef300b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:04.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.366+0000 7fef35600640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef300cd640 0x7fef300b22e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fef28000c00 tx=0x7fef2800eb90 comp rx=0 tx=0).stop 2024-05-26T15:42:04.365 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.366+0000 7fef35600640 1 -- 172.21.15.8:0/1011948784 shutdown_connections 2024-05-26T15:42:04.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.366+0000 7fef35600640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fef300cd640 0x7fef300b22e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.366+0000 7fef35600640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fef30141350 0x7fef300cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.366+0000 7fef35600640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fef0c06ac30 0x7fef0c06d0f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.366+0000 7fef35600640 1 --2- 172.21.15.8:0/1011948784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef140047c0 0x7fef301f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:04.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.366+0000 7fef35600640 1 -- 172.21.15.8:0/1011948784 >> 172.21.15.8:0/1011948784 conn(0x7fef30069e70 msgr2=0x7fef30159830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:04.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.367+0000 7fef35600640 1 -- 172.21.15.8:0/1011948784 shutdown_connections 2024-05-26T15:42:04.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:04.367+0000 7fef35600640 1 -- 172.21.15.8:0/1011948784 wait complete. 2024-05-26T15:42:04.381 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-26T15:42:04.381 DEBUG:teuthology.orchestra.run.smithi008:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-26T15:42:04.489 DEBUG:teuthology.orchestra.run.smithi047:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-26T15:42:04.609 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-26T15:42:04.609 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:42:04.609 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:42:04.669 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-26T15:42:04.669 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:42:04.669 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:42:04.730 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-26T15:42:04.730 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:42:04.730 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:42:04.792 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-26T15:42:04.792 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:42:04.792 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:42:04.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-26T15:42:04.853 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-26T15:42:04.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.069+0000 7fddbbe00640 1 Processor -- start 2024-05-26T15:42:05.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.069+0000 7fddbbe00640 1 -- start start 2024-05-26T15:42:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.071+0000 7fddbbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fddbc0b0ef0 0x7fddbc167780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.071+0000 7fddbbe00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddbc15d480 con 0x7fddbc15cfe0 2024-05-26T15:42:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.071+0000 7fddbbe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddbc15d760 con 0x7fddbc1571a0 2024-05-26T15:42:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.071+0000 7fddbbe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddbc15e090 con 0x7fddbc0b0ef0 2024-05-26T15:42:05.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.072+0000 7fddbb400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fddbc0b0ef0 0x7fddbc167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.072+0000 7fddbb400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fddbc0b0ef0 0x7fddbc167780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60674/0 (socket says 172.21.15.8:60674) 2024-05-26T15:42:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.072+0000 7fddbb400640 1 -- 172.21.15.8:0/622116440 learned_addr learned my addr 172.21.15.8:0/622116440 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.072+0000 7fddbb400640 1 -- 172.21.15.8:0/622116440 >> v1:172.21.15.47:6789/0 conn(0x7fddbc1571a0 legacy=0x7fddbc0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:05.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.072+0000 7fddbb400640 1 -- 172.21.15.8:0/622116440 >> v1:172.21.15.8:6789/0 conn(0x7fddbc15cfe0 legacy=0x7fddbc0b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.072+0000 7fddbb400640 1 -- 172.21.15.8:0/622116440 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc15da40 con 0x7fddbc0b0ef0 2024-05-26T15:42:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.073+0000 7fddbb400640 1 --2- 172.21.15.8:0/622116440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc0b0ef0 0x7fddbc167780 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009e50 tx=0x7fddb402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5298c3a00f40f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.074+0000 7fddb9600640 1 -- 172.21.15.8:0/622116440 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4031600 con 0x7fddbc0b0ef0 2024-05-26T15:42:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.074+0000 7fddb9600640 1 -- 172.21.15.8:0/622116440 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb402d050 con 0x7fddbc0b0ef0 2024-05-26T15:42:05.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.074+0000 7fddb9600640 1 -- 172.21.15.8:0/622116440 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4031980 con 0x7fddbc0b0ef0 2024-05-26T15:42:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.074+0000 7fddbbe00640 1 -- 172.21.15.8:0/622116440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc0b0ef0 msgr2=0x7fddbc167780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.074+0000 7fddbbe00640 1 --2- 172.21.15.8:0/622116440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc0b0ef0 0x7fddbc167780 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009e50 tx=0x7fddb402a760 comp rx=0 tx=0).stop 2024-05-26T15:42:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.074+0000 7fddbbe00640 1 -- 172.21.15.8:0/622116440 shutdown_connections 2024-05-26T15:42:05.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.074+0000 7fddbbe00640 1 --2- 172.21.15.8:0/622116440 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc0b0ef0 0x7fddbc167780 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.074+0000 7fddbbe00640 1 -- 172.21.15.8:0/622116440 >> 172.21.15.8:0/622116440 conn(0x7fddbc070480 msgr2=0x7fddbc070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.075+0000 7fddbbe00640 1 -- 172.21.15.8:0/622116440 shutdown_connections 2024-05-26T15:42:05.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.075+0000 7fddbbe00640 1 -- 172.21.15.8:0/622116440 wait complete. 2024-05-26T15:42:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.076+0000 7fddbbe00640 1 Processor -- start 2024-05-26T15:42:05.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.077+0000 7fddbbe00640 1 -- start start 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.077+0000 7fddbbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0b0ef0 0x7fddbc0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.077+0000 7fddbbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fddbc1571a0 0x7fddbc143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc15cfe0 0x7fddbc152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbbe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc15a5e0 con 0x7fddbc15cfe0 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc0b1ec0 con 0x7fddbc0b0ef0 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbbe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc15a020 con 0x7fddbc1571a0 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc15cfe0 0x7fddbc152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc15cfe0 0x7fddbc152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60680/0 (socket says 172.21.15.8:60680) 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbb400640 1 -- 172.21.15.8:0/3865019178 learned_addr learned my addr 172.21.15.8:0/3865019178 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbaa00640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0b0ef0 0x7fddbc0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddba000640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fddbc1571a0 0x7fddbc143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbb400640 1 -- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fddbc1571a0 msgr2=0x7fddbc143f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbb400640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fddbc1571a0 0x7fddbc143f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbb400640 1 -- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0b0ef0 msgr2=0x7fddbc0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbb400640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0b0ef0 0x7fddbc0b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.078+0000 7fddbb400640 1 -- 172.21.15.8:0/3865019178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb4009b30 con 0x7fddbc15cfe0 2024-05-26T15:42:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.079+0000 7fddbb400640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc15cfe0 0x7fddbc152780 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fddb4034040 tx=0x7fddb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.079+0000 7fddb2a00640 1 -- 172.21.15.8:0/3865019178 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb403d860 con 0x7fddbc15cfe0 2024-05-26T15:42:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.079+0000 7fddb2a00640 1 -- 172.21.15.8:0/3865019178 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb403d9c0 con 0x7fddbc15cfe0 2024-05-26T15:42:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.079+0000 7fddb2a00640 1 -- 172.21.15.8:0/3865019178 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb403dd70 con 0x7fddbc15cfe0 2024-05-26T15:42:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.079+0000 7fddbbe00640 1 -- 172.21.15.8:0/3865019178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddbc15a300 con 0x7fddbc15cfe0 2024-05-26T15:42:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.079+0000 7fddbbe00640 1 -- 172.21.15.8:0/3865019178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc0b46a0 con 0x7fddbc15cfe0 2024-05-26T15:42:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.081+0000 7fddbbe00640 1 -- 172.21.15.8:0/3865019178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddbc0b19b0 con 0x7fddbc15cfe0 2024-05-26T15:42:05.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.081+0000 7fddb2a00640 1 -- 172.21.15.8:0/3865019178 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fddb403b400 con 0x7fddbc15cfe0 2024-05-26T15:42:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.082+0000 7fddb2a00640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd9c06ac30 0x7fdd9c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.082+0000 7fddb2a00640 1 -- 172.21.15.8:0/3865019178 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fddb40aa2e0 con 0x7fddbc15cfe0 2024-05-26T15:42:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.083+0000 7fddbaa00640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd9c06ac30 0x7fdd9c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.084+0000 7fddbaa00640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd9c06ac30 0x7fdd9c06d0f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fddac004ea0 tx=0x7fddac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.087+0000 7fddb2a00640 1 -- 172.21.15.8:0/3865019178 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fddbc0b19b0 con 0x7fddbc15cfe0 2024-05-26T15:42:05.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.323+0000 7fddbbe00640 1 -- 172.21.15.8:0/3865019178 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddbc0b19b0 con 0x7fddbc15cfe0 2024-05-26T15:42:05.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.324+0000 7fddb2a00640 1 -- 172.21.15.8:0/3865019178 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3517 (secure 0 0 0) 0x7fddb4036dd0 con 0x7fddbc15cfe0 2024-05-26T15:42:05.323 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:05.323 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4859,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/481709676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":481709676},{"type":"v1","addr":"172.21.15.47:6837","nonce":481709676}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/463162567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":463162567},{"type":"v1","addr":"172.21.15.8:6834","nonce":463162567}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":4865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2479192780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":2479192780},{"type":"v1","addr":"172.21.15.8:6835","nonce":2479192780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":4934,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/2204105031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":2204105031},{"type":"v1","addr":"172.21.15.47:6835","nonce":2204105031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2024-05-26T15:42:05.323 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 26 2024-05-26T15:42:05.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.326+0000 7fddbbe00640 1 -- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd9c06ac30 msgr2=0x7fdd9c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:05.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.326+0000 7fddbbe00640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd9c06ac30 0x7fdd9c06d0f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fddac004ea0 tx=0x7fddac009040 comp rx=0 tx=0).stop 2024-05-26T15:42:05.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.326+0000 7fddbbe00640 1 -- 172.21.15.8:0/3865019178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc15cfe0 msgr2=0x7fddbc152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:05.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.326+0000 7fddbbe00640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc15cfe0 0x7fddbc152780 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fddb4034040 tx=0x7fddb4004a40 comp rx=0 tx=0).stop 2024-05-26T15:42:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.327+0000 7fddbbe00640 1 -- 172.21.15.8:0/3865019178 shutdown_connections 2024-05-26T15:42:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.327+0000 7fddbbe00640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fddbc15cfe0 0x7fddbc152780 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.327+0000 7fddbbe00640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fddbc1571a0 0x7fddbc143f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.327+0000 7fddbbe00640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fdd9c06ac30 0x7fdd9c06d0f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.327+0000 7fddbbe00640 1 --2- 172.21.15.8:0/3865019178 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0b0ef0 0x7fddbc0b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.327+0000 7fddbbe00640 1 -- 172.21.15.8:0/3865019178 >> 172.21.15.8:0/3865019178 conn(0x7fddbc070480 msgr2=0x7fddbc0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.327+0000 7fddbbe00640 1 -- 172.21.15.8:0/3865019178 shutdown_connections 2024-05-26T15:42:05.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.327+0000 7fddbbe00640 1 -- 172.21.15.8:0/3865019178 wait complete. 2024-05-26T15:42:05.345 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-26T15:42:05.345 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-26T15:42:05.346 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-26T15:42:05.346 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:42:05.346 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-26T15:42:05.346 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-26T15:42:05.346 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-26T15:42:05.346 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:42:05.346 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-26T15:42:05.347 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-26T15:42:05.347 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-26T15:42:05.347 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:42:05.347 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-26T15:42:05.347 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-26T15:42:05.347 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-26T15:42:05.347 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:42:05.364 INFO:tasks.ceph.mds.a:Stopped 2024-05-26T15:42:05.364 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-26T15:42:05.365 INFO:tasks.ceph.mds.c:Stopped 2024-05-26T15:42:05.365 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-26T15:42:05.370 INFO:tasks.ceph.mds.d:Stopped 2024-05-26T15:42:05.371 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-26T15:42:05.371 INFO:tasks.ceph.mds.b:Stopped 2024-05-26T15:42:05.372 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-26T15:42:05.411 INFO:tasks.ceph.mds.a:Started 2024-05-26T15:42:05.411 DEBUG:teuthology.parallel:result is None 2024-05-26T15:42:05.417 INFO:tasks.ceph.mds.c:Started 2024-05-26T15:42:05.418 DEBUG:teuthology.parallel:result is None 2024-05-26T15:42:05.418 INFO:tasks.ceph.mds.d:Started 2024-05-26T15:42:05.418 DEBUG:teuthology.parallel:result is None 2024-05-26T15:42:05.423 INFO:tasks.ceph.mds.b:Started 2024-05-26T15:42:05.424 DEBUG:teuthology.parallel:result is None 2024-05-26T15:42:05.424 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-26T15:42:05.564 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2024-05-26T15:42:05.570 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2024-05-26T15:42:05.586 INFO:tasks.ceph.mds.d.smithi047.stdout:starting mds.d at 2024-05-26T15:42:05.587 INFO:tasks.ceph.mds.b.smithi047.stdout:starting mds.b at 2024-05-26T15:42:05.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.616+0000 7f9404400640 1 Processor -- start 2024-05-26T15:42:05.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.616+0000 7f9404400640 1 -- start start 2024-05-26T15:42:05.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.617+0000 7f9404400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f93fc144150 0x7f93fc0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.617+0000 7f9404400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f93fc144530 0x7f93fc070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.617+0000 7f9404400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93fc070ba0 0x7f93fc0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.617+0000 7f9404400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc071050 con 0x7f93fc070ba0 2024-05-26T15:42:05.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.617+0000 7f9404400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93fc0b1db0 con 0x7f93fc144150 2024-05-26T15:42:05.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.617+0000 7f9404400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc0cc8f0 con 0x7f93fc144530 2024-05-26T15:42:05.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.617+0000 7f9402400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93fc070ba0 0x7f93fc0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.617+0000 7f9402400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93fc070ba0 0x7f93fc0cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60726/0 (socket says 172.21.15.8:60726) 2024-05-26T15:42:05.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.617+0000 7f9402400640 1 -- 172.21.15.8:0/383934803 learned_addr learned my addr 172.21.15.8:0/383934803 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:05.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.618+0000 7f9401a00640 1 --2- 172.21.15.8:0/383934803 >> v2:172.21.15.47:3300/0 conn(0x7f93fc144150 0x7f93fc0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.618+0000 7f9401000640 1 --2- 172.21.15.8:0/383934803 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f93fc144530 0x7f93fc070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.618+0000 7f9402400640 1 -- 172.21.15.8:0/383934803 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f93fc144530 msgr2=0x7f93fc070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:05.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.618+0000 7f9402400640 1 --2- 172.21.15.8:0/383934803 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f93fc144530 0x7f93fc070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.618+0000 7f9402400640 1 -- 172.21.15.8:0/383934803 >> v2:172.21.15.47:3300/0 conn(0x7f93fc144150 msgr2=0x7f93fc0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:05.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.618+0000 7f9402400640 1 --2- 172.21.15.8:0/383934803 >> v2:172.21.15.47:3300/0 conn(0x7f93fc144150 0x7f93fc0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.617 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.618+0000 7f9402400640 1 -- 172.21.15.8:0/383934803 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc0cbac0 con 0x7f93fc070ba0 2024-05-26T15:42:05.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.619+0000 7f9402400640 1 --2- 172.21.15.8:0/383934803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc070ba0 0x7f93fc0cad90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f93fc06ea10 tx=0x7f93f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368ee230630ceec8 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.619+0000 7f93fbe00640 1 -- 172.21.15.8:0/383934803 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4031600 con 0x7f93fc070ba0 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.619+0000 7f93fbe00640 1 -- 172.21.15.8:0/383934803 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f402d050 con 0x7f93fc070ba0 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.619+0000 7f93fbe00640 1 -- 172.21.15.8:0/383934803 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4031980 con 0x7f93fc070ba0 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.620+0000 7f9404400640 1 -- 172.21.15.8:0/383934803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc070ba0 msgr2=0x7f93fc0cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.620+0000 7f9404400640 1 --2- 172.21.15.8:0/383934803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc070ba0 0x7f93fc0cad90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f93fc06ea10 tx=0x7f93f402a6a0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.620+0000 7f9404400640 1 -- 172.21.15.8:0/383934803 shutdown_connections 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.620+0000 7f9404400640 1 --2- 172.21.15.8:0/383934803 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc070ba0 0x7f93fc0cad90 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.620+0000 7f9404400640 1 --2- 172.21.15.8:0/383934803 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f93fc144530 0x7f93fc070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.620+0000 7f9404400640 1 --2- 172.21.15.8:0/383934803 >> v2:172.21.15.47:3300/0 conn(0x7f93fc144150 0x7f93fc0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.620+0000 7f9404400640 1 -- 172.21.15.8:0/383934803 >> 172.21.15.8:0/383934803 conn(0x7f93fc0b0570 msgr2=0x7f93fc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:05.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.620+0000 7f9404400640 1 -- 172.21.15.8:0/383934803 shutdown_connections 2024-05-26T15:42:05.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.620+0000 7f9404400640 1 -- 172.21.15.8:0/383934803 wait complete. 2024-05-26T15:42:05.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.622+0000 7f9404400640 1 Processor -- start 2024-05-26T15:42:05.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.622+0000 7f9404400640 1 -- start start 2024-05-26T15:42:05.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9404400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93fc070ba0 0x7f93fc13f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9404400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f93fc144150 0x7f93fc13fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9404400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc144530 0x7f93fc13bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9404400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc130a40 con 0x7f93fc144530 2024-05-26T15:42:05.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9404400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc140ed0 con 0x7f93fc070ba0 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9404400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc1402c0 con 0x7f93fc144150 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9402400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc144530 0x7f93fc13bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9402400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc144530 0x7f93fc13bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60738/0 (socket says 172.21.15.8:60738) 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9402400640 1 -- 172.21.15.8:0/1551028041 learned_addr learned my addr 172.21.15.8:0/1551028041 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9401a00640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93fc070ba0 0x7f93fc13f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.623+0000 7f9401000640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f93fc144150 0x7f93fc13fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f9402400640 1 -- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f93fc144150 msgr2=0x7f93fc13fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f9402400640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f93fc144150 0x7f93fc13fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f9402400640 1 -- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93fc070ba0 msgr2=0x7f93fc13f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f9402400640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93fc070ba0 0x7f93fc13f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f9402400640 1 -- 172.21.15.8:0/1551028041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f4009b30 con 0x7f93fc144530 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f9401a00640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93fc070ba0 0x7f93fc13f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:42:05.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f9402400640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc144530 0x7f93fc13bc90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f93f4034040 tx=0x7f93f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:05.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f93f9600640 1 -- 172.21.15.8:0/1551028041 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f403d860 con 0x7f93fc144530 2024-05-26T15:42:05.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f93f9600640 1 -- 172.21.15.8:0/1551028041 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f403d9e0 con 0x7f93fc144530 2024-05-26T15:42:05.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f9404400640 1 -- 172.21.15.8:0/1551028041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc1405a0 con 0x7f93fc144530 2024-05-26T15:42:05.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.624+0000 7f93f9600640 1 -- 172.21.15.8:0/1551028041 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f403dd90 con 0x7f93fc144530 2024-05-26T15:42:05.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.625+0000 7f9404400640 1 -- 172.21.15.8:0/1551028041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc140b60 con 0x7f93fc144530 2024-05-26T15:42:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.626+0000 7f9404400640 1 -- 172.21.15.8:0/1551028041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc0681d0 con 0x7f93fc144530 2024-05-26T15:42:05.625 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.627+0000 7f93f9600640 1 -- 172.21.15.8:0/1551028041 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f93f403b400 con 0x7f93fc144530 2024-05-26T15:42:05.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.627+0000 7f93f9600640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f93dc06ac00 0x7f93dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:05.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.628+0000 7f93f9600640 1 -- 172.21.15.8:0/1551028041 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f93f40aa260 con 0x7f93fc144530 2024-05-26T15:42:05.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.628+0000 7f9401a00640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f93dc06ac00 0x7f93dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:05.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.629+0000 7f9401a00640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f93dc06ac00 0x7f93dc06d0c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f93f0006fd0 tx=0x7f93f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:05.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.632+0000 7f93f9600640 1 -- 172.21.15.8:0/1551028041 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f93f40754b0 con 0x7f93fc144530 2024-05-26T15:42:05.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:05.843+0000 7f9404400640 1 -- 172.21.15.8:0/1551028041 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f93fc141010 con 0x7f93fc144530 2024-05-26T15:42:06.614 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.615+0000 7f93f9600640 1 -- 172.21.15.8:0/1551028041 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7f93f4009510 con 0x7f93fc144530 2024-05-26T15:42:06.614 INFO:teuthology.orchestra.run.smithi008.stderr: removed all blocklist entries 2024-05-26T15:42:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.619+0000 7f9404400640 1 -- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f93dc06ac00 msgr2=0x7f93dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.619+0000 7f9404400640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f93dc06ac00 0x7f93dc06d0c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f93f0006fd0 tx=0x7f93f0008040 comp rx=0 tx=0).stop 2024-05-26T15:42:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.619+0000 7f9404400640 1 -- 172.21.15.8:0/1551028041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc144530 msgr2=0x7f93fc13bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.619+0000 7f9404400640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc144530 0x7f93fc13bc90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f93f4034040 tx=0x7f93f4004a40 comp rx=0 tx=0).stop 2024-05-26T15:42:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.620+0000 7f9404400640 1 -- 172.21.15.8:0/1551028041 shutdown_connections 2024-05-26T15:42:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.620+0000 7f9404400640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93fc144530 0x7f93fc13bc90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.620+0000 7f9404400640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f93fc144150 0x7f93fc13fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.620+0000 7f9404400640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f93dc06ac00 0x7f93dc06d0c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.620+0000 7f9404400640 1 --2- 172.21.15.8:0/1551028041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f93fc070ba0 0x7f93fc13f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.620+0000 7f9404400640 1 -- 172.21.15.8:0/1551028041 >> 172.21.15.8:0/1551028041 conn(0x7f93fc0b0570 msgr2=0x7f93fc15b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.620+0000 7f9404400640 1 -- 172.21.15.8:0/1551028041 shutdown_connections 2024-05-26T15:42:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.620+0000 7f9404400640 1 -- 172.21.15.8:0/1551028041 wait complete. 2024-05-26T15:42:06.641 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-26T15:42:06.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.845+0000 7fa703200640 1 Processor -- start 2024-05-26T15:42:06.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.846+0000 7fa703200640 1 -- start start 2024-05-26T15:42:06.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.847+0000 7fa703200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6fc070d70 0x7fa6fc0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:06.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.847+0000 7fa703200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6fc0cc8f0 con 0x7fa6fc144530 2024-05-26T15:42:06.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.848+0000 7fa703200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6fc0cbac0 con 0x7fa6fc144150 2024-05-26T15:42:06.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.848+0000 7fa703200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc0ccb90 con 0x7fa6fc070d70 2024-05-26T15:42:06.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.848+0000 7fa6fb400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fa6fc144530 0x7fa6fc0cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59376/0 (socket says 172.21.15.8:59376) 2024-05-26T15:42:06.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.848+0000 7fa6fb400640 1 -- 172.21.15.8:0/91441814 learned_addr learned my addr 172.21.15.8:0/91441814 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:06.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.848+0000 7fa701200640 1 --2- 172.21.15.8:0/91441814 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6fc070d70 0x7fa6fc0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:06.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.848+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411870634 0 0) 0x7fa6fc0cc8f0 con 0x7fa6fc144530 2024-05-26T15:42:06.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e0003520 con 0x7fa6fc144530 2024-05-26T15:42:06.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1400736385 0 0) 0x7fa6e0003520 con 0x7fa6fc144530 2024-05-26T15:42:06.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6fc070d70 msgr2=0x7fa6fc0cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:06.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 --2- 172.21.15.8:0/91441814 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6fc070d70 0x7fa6fc0cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:06.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 >> v1:172.21.15.47:6789/0 conn(0x7fa6fc144150 legacy=0x7fa6fc070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:06.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc0cce70 con 0x7fa6fc144530 2024-05-26T15:42:06.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fa6e4001670 con 0x7fa6fc144530 2024-05-26T15:42:06.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 >> v1:172.21.15.8:6789/0 conn(0x7fa6fc144530 legacy=0x7fa6fc0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:06.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 --2- 172.21.15.8:0/91441814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e00039a0 0x7fa6e0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:06.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 --2- 172.21.15.8:0/91441814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e00047c0 0x7fa6e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:06.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 --2- 172.21.15.8:0/91441814 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6fc070d70 0x7fa6e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:06.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc0ccb90 con 0x7fa6e00039a0 2024-05-26T15:42:06.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e000bab0 con 0x7fa6e00047c0 2024-05-26T15:42:06.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e000bc70 con 0x7fa6fc070d70 2024-05-26T15:42:06.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.849+0000 7fa6fbe00640 1 --2- 172.21.15.8:0/91441814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e00039a0 0x7fa6e0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:06.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.850+0000 7fa6fbe00640 1 -- 172.21.15.8:0/91441814 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6fc070d70 msgr2=0x7fa6e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.850+0000 7fa6fbe00640 1 --2- 172.21.15.8:0/91441814 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6fc070d70 0x7fa6e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.850+0000 7fa6fbe00640 1 -- 172.21.15.8:0/91441814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e00047c0 msgr2=0x7fa6e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.850+0000 7fa6fbe00640 1 --2- 172.21.15.8:0/91441814 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6e00047c0 0x7fa6e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.850+0000 7fa6fbe00640 1 -- 172.21.15.8:0/91441814 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e0003520 con 0x7fa6e00039a0 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.851+0000 7fa6fbe00640 1 --2- 172.21.15.8:0/91441814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e00039a0 0x7fa6e0003dc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec001e50 tx=0x7fa6e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37416fe6f52e49c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.851+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec02ae70 con 0x7fa6e00039a0 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.851+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec003970 con 0x7fa6e00039a0 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.851+0000 7fa6faa00640 1 -- 172.21.15.8:0/91441814 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec003d20 con 0x7fa6e00039a0 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.852+0000 7fa703200640 1 -- 172.21.15.8:0/91441814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e00039a0 msgr2=0x7fa6e0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.852+0000 7fa703200640 1 --2- 172.21.15.8:0/91441814 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6e00039a0 0x7fa6e0003dc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec001e50 tx=0x7fa6e00057f0 comp rx=0 tx=0).stop 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.852+0000 7fa701200640 1 -- 172.21.15.8:0/91441814 reap_dead start 2024-05-26T15:42:06.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.852+0000 7fa703200640 1 -- 172.21.15.8:0/91441814 shutdown_connections 2024-05-26T15:42:06.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.852+0000 7fa703200640 1 -- 172.21.15.8:0/91441814 >> 172.21.15.8:0/91441814 conn(0x7fa6fc0b0570 msgr2=0x7fa6fc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:06.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.852+0000 7fa703200640 1 -- 172.21.15.8:0/91441814 shutdown_connections 2024-05-26T15:42:06.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.852+0000 7fa703200640 1 -- 172.21.15.8:0/91441814 wait complete. 2024-05-26T15:42:06.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.854+0000 7fa703200640 1 Processor -- start 2024-05-26T15:42:06.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.854+0000 7fa703200640 1 -- start start 2024-05-26T15:42:06.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.855+0000 7fa703200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6e00039a0 0x7fa6fc159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.855+0000 7fa703200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6fc0af0e0 0x7fa6fc0af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.855+0000 7fa703200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6fc13ef10 0x7fa6fc13f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.855+0000 7fa703200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc1421d0 con 0x7fa6fc13ef10 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.855+0000 7fa703200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc13f8e0 con 0x7fa6fc0af0e0 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.855+0000 7fa703200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc0afb60 con 0x7fa6e00039a0 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.855+0000 7fa701200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6fc13ef10 0x7fa6fc13f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa701200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6fc13ef10 0x7fa6fc13f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60760/0 (socket says 172.21.15.8:60760) 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa701200640 1 -- 172.21.15.8:0/3356952770 learned_addr learned my addr 172.21.15.8:0/3356952770 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa6fbe00640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6e00039a0 0x7fa6fc159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa6fb400640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6fc0af0e0 0x7fa6fc0af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa701200640 1 -- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6e00039a0 msgr2=0x7fa6fc159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:06.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa701200640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6e00039a0 0x7fa6fc159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:06.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa701200640 1 -- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6fc0af0e0 msgr2=0x7fa6fc0af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:06.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa701200640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6fc0af0e0 0x7fa6fc0af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:06.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa701200640 1 -- 172.21.15.8:0/3356952770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc0afe40 con 0x7fa6fc13ef10 2024-05-26T15:42:06.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa6fb400640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6fc0af0e0 0x7fa6fc0af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:06.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.856+0000 7fa701200640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6fc13ef10 0x7fa6fc13f3a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc144910 tx=0x7fa6f400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:06.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.857+0000 7fa6f3e00640 1 -- 172.21.15.8:0/3356952770 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400c680 con 0x7fa6fc13ef10 2024-05-26T15:42:06.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.857+0000 7fa6f3e00640 1 -- 172.21.15.8:0/3356952770 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f400c7e0 con 0x7fa6fc13ef10 2024-05-26T15:42:06.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.857+0000 7fa6f3e00640 1 -- 172.21.15.8:0/3356952770 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400cb90 con 0x7fa6fc13ef10 2024-05-26T15:42:06.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.857+0000 7fa703200640 1 -- 172.21.15.8:0/3356952770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc141b10 con 0x7fa6fc13ef10 2024-05-26T15:42:06.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.857+0000 7fa703200640 1 -- 172.21.15.8:0/3356952770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc0ad940 con 0x7fa6fc13ef10 2024-05-26T15:42:06.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.858+0000 7fa703200640 1 -- 172.21.15.8:0/3356952770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6fc0681d0 con 0x7fa6fc13ef10 2024-05-26T15:42:06.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.859+0000 7fa6f3e00640 1 -- 172.21.15.8:0/3356952770 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa6f400ccf0 con 0x7fa6fc13ef10 2024-05-26T15:42:06.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.861+0000 7fa6f3e00640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa6d806ac00 0x7fa6d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:06.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.861+0000 7fa6f3e00640 1 -- 172.21.15.8:0/3356952770 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa6f4088e40 con 0x7fa6fc13ef10 2024-05-26T15:42:06.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.861+0000 7fa6fbe00640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa6d806ac00 0x7fa6d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:06.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.863+0000 7fa6fbe00640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa6d806ac00 0x7fa6d806d0c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec032000 tx=0x7fa6ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:06.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:06.865+0000 7fa6f3e00640 1 -- 172.21.15.8:0/3356952770 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa6f4054220 con 0x7fa6fc13ef10 2024-05-26T15:42:07.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.145+0000 7fa703200640 1 -- 172.21.15.8:0/3356952770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa6fc0ade70 con 0x7fa6fc13ef10 2024-05-26T15:42:07.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.147+0000 7fa6f3e00640 1 -- 172.21.15.8:0/3356952770 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa6f4057840 con 0x7fa6fc13ef10 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout: "auth_dump": [ 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.a", 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3V1NmZ26wMRAAoZoNjeFBUXMxHbYTfCOtBA==", 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2024-05-26T15:42:07.146 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.b", 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB4V1Nmy8AOFRAAjOVwhaaLUK6wSxy7D1Z3QA==", 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.147 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.c", 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB4V1NmX+V9BhAAx6S6tCtBR2tDklqe7CG7wA==", 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mds.d", 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB4V1NmXO+YIRAA88P2s22Ru5aq9vPYoW92qw==", 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.148 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.0", 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB7V1NmUOpZARAAc3uRvjCYeU4lJw7r1s3AiQ==", 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:42:07.149 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.1", 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB+V1Nmk/3GKxAAp8wyZeQKXPi9V+o7LVAbKg==", 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.150 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.2", 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCBV1NmLTbpOBAAaC6G7SPiVuU6KmTlRSClbA==", 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.3", 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCFV1NmYoKqFhAAflK4KjRRmrOu+EgBuQT7jg==", 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:42:07.151 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.4", 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCKV1NmqHWPBBAAruqt9oErqNVChgDC1iRGGA==", 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.152 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.5", 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCNV1NmgukeHxAAvVd3SjLYAJ6QZKmNwMmWow==", 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.6", 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCQV1Nmd4vuOBAAJHtG1d3rWdmKu/7rTPOlBw==", 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.153 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "osd.7", 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQCUV1Nm/CGlBxAA8STfkaBPPGT7qdfhMsO42g==", 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow profile osd", 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile osd", 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.154 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.0", 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB4V1NmxdRoLhAAY+pqIQGp2qO1BhQMGzQCHg==", 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow r", 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.1", 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB5V1NmdWPVBxAAOZColRSycWDkdlALIYEyow==", 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2024-05-26T15:42:07.155 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.2", 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB4V1NmosBQOBAAKKnJi6JYefpiRa0WliTUyw==", 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.156 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.3", 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB5V1Nmu2cxEhAA7SM7KN9DjHqazqVSC1Fjeg==", 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow", 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow r", 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow rw", 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow rwx" 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "client.admin", 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB2V1NmT7pDLBAA8v0iG713juyg3PQu/tILEg==", 2024-05-26T15:42:07.157 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: "mgr": "allow *", 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow *", 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mgr.x", 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3V1Nm+T1xJhAA3mTY1BPQLGk3uIbA1mic8Q==", 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2024-05-26T15:42:07.158 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile mgr", 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: "entity": "mgr.y", 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: "key": "AQB3V1NmaWlhHBAAAmAg0cJJXK6UzcMmFMT/yw==", 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: "caps": { 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: "mds": "allow *", 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: "mon": "allow profile mgr", 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: "osd": "allow *" 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2024-05-26T15:42:07.159 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:42:07.160 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 -- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa6d806ac00 msgr2=0x7fa6d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa6d806ac00 0x7fa6d806d0c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec032000 tx=0x7fa6ec02e000 comp rx=0 tx=0).stop 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 -- 172.21.15.8:0/3356952770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6fc13ef10 msgr2=0x7fa6fc13f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6fc13ef10 0x7fa6fc13f3a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc144910 tx=0x7fa6f400ec00 comp rx=0 tx=0).stop 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 -- 172.21.15.8:0/3356952770 shutdown_connections 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa6fc13ef10 0x7fa6fc13f3a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fa6d806ac00 0x7fa6d806d0c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6fc0af0e0 0x7fa6fc0af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 --2- 172.21.15.8:0/3356952770 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fa6e00039a0 0x7fa6fc159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 -- 172.21.15.8:0/3356952770 >> 172.21.15.8:0/3356952770 conn(0x7fa6fc0b0570 msgr2=0x7fa6fc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 -- 172.21.15.8:0/3356952770 shutdown_connections 2024-05-26T15:42:07.161 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.150+0000 7fa703200640 1 -- 172.21.15.8:0/3356952770 wait complete. 2024-05-26T15:42:07.168 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:42:07.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.382+0000 7fbb2b800640 1 Processor -- start 2024-05-26T15:42:07.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.383+0000 7fbb2b800640 1 -- start start 2024-05-26T15:42:07.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.384+0000 7fbb2b800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbb24144150 0x7fbb240b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.384+0000 7fbb2b800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbb24144530 0x7fbb24070660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.384+0000 7fbb2b800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240b1db0 con 0x7fbb24070ba0 2024-05-26T15:42:07.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.384+0000 7fbb2b800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb24070fd0 con 0x7fbb24144530 2024-05-26T15:42:07.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.384+0000 7fbb2b800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb240cc8f0 con 0x7fbb24144150 2024-05-26T15:42:07.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.385+0000 7fbb23e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbb24144530 0x7fbb24070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:07.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.385+0000 7fbb23e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbb24144530 0x7fbb24070660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60764/0 (socket says 172.21.15.8:60764) 2024-05-26T15:42:07.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.385+0000 7fbb23e00640 1 -- 172.21.15.8:0/1665169679 learned_addr learned my addr 172.21.15.8:0/1665169679 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:07.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.385+0000 7fbb23e00640 1 -- 172.21.15.8:0/1665169679 >> v2:172.21.15.47:3300/0 conn(0x7fbb24144150 msgr2=0x7fbb240b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:07.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.385+0000 7fbb23e00640 1 --2- 172.21.15.8:0/1665169679 >> v2:172.21.15.47:3300/0 conn(0x7fbb24144150 0x7fbb240b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.385+0000 7fbb23e00640 1 -- 172.21.15.8:0/1665169679 >> v1:172.21.15.47:6789/0 conn(0x7fbb24070ba0 legacy=0x7fbb240cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:07.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.385+0000 7fbb23e00640 1 -- 172.21.15.8:0/1665169679 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb240cbac0 con 0x7fbb24144530 2024-05-26T15:42:07.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.386+0000 7fbb23e00640 1 --2- 172.21.15.8:0/1665169679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144530 0x7fbb24070660 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbb2406ea10 tx=0x7fbb1402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57045bfb6255a90e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:07.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.387+0000 7fbb23400640 1 -- 172.21.15.8:0/1665169679 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14031600 con 0x7fbb24144530 2024-05-26T15:42:07.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.387+0000 7fbb23400640 1 -- 172.21.15.8:0/1665169679 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1402d050 con 0x7fbb24144530 2024-05-26T15:42:07.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.387+0000 7fbb23400640 1 -- 172.21.15.8:0/1665169679 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14031980 con 0x7fbb24144530 2024-05-26T15:42:07.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.387+0000 7fbb2b800640 1 -- 172.21.15.8:0/1665169679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144530 msgr2=0x7fbb24070660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:07.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.387+0000 7fbb2b800640 1 --2- 172.21.15.8:0/1665169679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144530 0x7fbb24070660 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbb2406ea10 tx=0x7fbb1402a6f0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.387+0000 7fbb2b800640 1 -- 172.21.15.8:0/1665169679 shutdown_connections 2024-05-26T15:42:07.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.387+0000 7fbb2b800640 1 --2- 172.21.15.8:0/1665169679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144530 0x7fbb24070660 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.387+0000 7fbb2b800640 1 --2- 172.21.15.8:0/1665169679 >> v2:172.21.15.47:3300/0 conn(0x7fbb24144150 0x7fbb240b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.387+0000 7fbb2b800640 1 -- 172.21.15.8:0/1665169679 >> 172.21.15.8:0/1665169679 conn(0x7fbb240b0570 msgr2=0x7fbb240b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:07.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.388+0000 7fbb2b800640 1 -- 172.21.15.8:0/1665169679 shutdown_connections 2024-05-26T15:42:07.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.388+0000 7fbb2b800640 1 -- 172.21.15.8:0/1665169679 wait complete. 2024-05-26T15:42:07.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.389+0000 7fbb2b800640 1 Processor -- start 2024-05-26T15:42:07.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.390+0000 7fbb2b800640 1 -- start start 2024-05-26T15:42:07.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb24070ba0 0x7fbb24139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144150 0x7fbb2406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb2b800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb24144530 0x7fbb2406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb2b800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2413b940 con 0x7fbb24144150 2024-05-26T15:42:07.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb2b800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2413ad70 con 0x7fbb24144530 2024-05-26T15:42:07.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb2b800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2413b010 con 0x7fbb24070ba0 2024-05-26T15:42:07.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb23e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144150 0x7fbb2406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb23e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144150 0x7fbb2406d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60774/0 (socket says 172.21.15.8:60774) 2024-05-26T15:42:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb23e00640 1 -- 172.21.15.8:0/1070599014 learned_addr learned my addr 172.21.15.8:0/1070599014 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb23e00640 1 -- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb24070ba0 msgr2=0x7fbb24139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb23e00640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb24070ba0 0x7fbb24139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb23e00640 1 -- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb24144530 msgr2=0x7fbb2406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb23e00640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb24144530 0x7fbb2406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.391+0000 7fbb23e00640 1 -- 172.21.15.8:0/1070599014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb14009b30 con 0x7fbb24144150 2024-05-26T15:42:07.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.392+0000 7fbb23e00640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144150 0x7fbb2406d710 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbb140093e0 tx=0x7fbb14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:07.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.392+0000 7fbb20c00640 1 -- 172.21.15.8:0/1070599014 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1403b820 con 0x7fbb24144150 2024-05-26T15:42:07.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.392+0000 7fbb20c00640 1 -- 172.21.15.8:0/1070599014 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1403b9a0 con 0x7fbb24144150 2024-05-26T15:42:07.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.392+0000 7fbb2b800640 1 -- 172.21.15.8:0/1070599014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2413b2f0 con 0x7fbb24144150 2024-05-26T15:42:07.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.392+0000 7fbb20c00640 1 -- 172.21.15.8:0/1070599014 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1403bd50 con 0x7fbb24144150 2024-05-26T15:42:07.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.392+0000 7fbb2b800640 1 -- 172.21.15.8:0/1070599014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2413a530 con 0x7fbb24144150 2024-05-26T15:42:07.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.393+0000 7fbb2b800640 1 -- 172.21.15.8:0/1070599014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2413b150 con 0x7fbb24144150 2024-05-26T15:42:07.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.394+0000 7fbb20c00640 1 -- 172.21.15.8:0/1070599014 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbb14038050 con 0x7fbb24144150 2024-05-26T15:42:07.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.395+0000 7fbb20c00640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbb0006ac30 0x7fbb0006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.395+0000 7fbb20c00640 1 -- 172.21.15.8:0/1070599014 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbb140a9d70 con 0x7fbb24144150 2024-05-26T15:42:07.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.396+0000 7fbb28e00640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbb0006ac30 0x7fbb0006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:07.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.398+0000 7fbb28e00640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbb0006ac30 0x7fbb0006d0f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009710 tx=0x7fbb0c006c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:07.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.400+0000 7fbb20c00640 1 -- 172.21.15.8:0/1070599014 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbb2413b150 con 0x7fbb24144150 2024-05-26T15:42:07.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.600+0000 7fbb2b800640 1 -- 172.21.15.8:0/1070599014 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb2413b150 con 0x7fbb24144150 2024-05-26T15:42:07.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.601+0000 7fbb20c00640 1 -- 172.21.15.8:0/1070599014 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+12498 (secure 0 0 0) 0x7fbb2413b150 con 0x7fbb24144150 2024-05-26T15:42:07.600 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:07.601 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":51,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:42:06.608198+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:42:07.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.604+0000 7fbb2b800640 1 -- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbb0006ac30 msgr2=0x7fbb0006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:07.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.604+0000 7fbb2b800640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbb0006ac30 0x7fbb0006d0f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009710 tx=0x7fbb0c006c90 comp rx=0 tx=0).stop 2024-05-26T15:42:07.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.604+0000 7fbb2b800640 1 -- 172.21.15.8:0/1070599014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144150 msgr2=0x7fbb2406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:07.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.604+0000 7fbb2b800640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144150 0x7fbb2406d710 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbb140093e0 tx=0x7fbb14004a40 comp rx=0 tx=0).stop 2024-05-26T15:42:07.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.604+0000 7fbb2b800640 1 -- 172.21.15.8:0/1070599014 shutdown_connections 2024-05-26T15:42:07.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.604+0000 7fbb2b800640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbb0006ac30 0x7fbb0006d0f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.604+0000 7fbb2b800640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbb24144530 0x7fbb2406dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.604+0000 7fbb2b800640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbb24144150 0x7fbb2406d710 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.604+0000 7fbb2b800640 1 --2- 172.21.15.8:0/1070599014 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbb24070ba0 0x7fbb24139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.604+0000 7fbb2b800640 1 -- 172.21.15.8:0/1070599014 >> 172.21.15.8:0/1070599014 conn(0x7fbb240b0570 msgr2=0x7fbb240b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:07.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.605+0000 7fbb2b800640 1 -- 172.21.15.8:0/1070599014 shutdown_connections 2024-05-26T15:42:07.604 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.605+0000 7fbb2b800640 1 -- 172.21.15.8:0/1070599014 wait complete. 2024-05-26T15:42:07.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-26T15:42:07.623 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:42:07.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.842+0000 7f9e87200640 1 Processor -- start 2024-05-26T15:42:07.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.842+0000 7f9e87200640 1 -- start start 2024-05-26T15:42:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.844+0000 7f9e87200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9e881599a0 0x7f9e8806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.844+0000 7f9e87200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e8815d300 0x7f9e8806da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.844+0000 7f9e87200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e880cd570 con 0x7f9e880cc3d0 2024-05-26T15:42:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.844+0000 7f9e87200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e880cc960 con 0x7f9e8815d300 2024-05-26T15:42:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.844+0000 7f9e87200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e880ccc40 con 0x7f9e881599a0 2024-05-26T15:42:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.844+0000 7f9e85400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e8815d300 0x7f9e8806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.844+0000 7f9e85400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9e8815d300 0x7f9e8806da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60790/0 (socket says 172.21.15.8:60790) 2024-05-26T15:42:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.844+0000 7f9e85400640 1 -- 172.21.15.8:0/1641441429 learned_addr learned my addr 172.21.15.8:0/1641441429 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:07.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.844+0000 7f9e85e00640 1 --2- 172.21.15.8:0/1641441429 >> v2:172.21.15.47:3300/0 conn(0x7f9e881599a0 0x7f9e8806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.845+0000 7f9e85400640 1 -- 172.21.15.8:0/1641441429 >> v2:172.21.15.47:3300/0 conn(0x7f9e881599a0 msgr2=0x7f9e8806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.845+0000 7f9e85400640 1 --2- 172.21.15.8:0/1641441429 >> v2:172.21.15.47:3300/0 conn(0x7f9e881599a0 0x7f9e8806d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.845+0000 7f9e85400640 1 -- 172.21.15.8:0/1641441429 >> v1:172.21.15.47:6789/0 conn(0x7f9e880cc3d0 legacy=0x7f9e88070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.845+0000 7f9e85400640 1 -- 172.21.15.8:0/1641441429 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e880ccf20 con 0x7f9e8815d300 2024-05-26T15:42:07.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.846+0000 7f9e85400640 1 --2- 172.21.15.8:0/1641441429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e8815d300 0x7f9e8806da10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9e8806e3f0 tx=0x7f9e7002c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a182814a77f13f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.846+0000 7f9e84a00640 1 -- 172.21.15.8:0/1641441429 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70034640 con 0x7f9e8815d300 2024-05-26T15:42:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.846+0000 7f9e84a00640 1 -- 172.21.15.8:0/1641441429 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e700347a0 con 0x7f9e8815d300 2024-05-26T15:42:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.846+0000 7f9e84a00640 1 -- 172.21.15.8:0/1641441429 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e70034b30 con 0x7f9e8815d300 2024-05-26T15:42:07.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.847+0000 7f9e87200640 1 -- 172.21.15.8:0/1641441429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e8815d300 msgr2=0x7f9e8806da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.847+0000 7f9e87200640 1 --2- 172.21.15.8:0/1641441429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e8815d300 0x7f9e8806da10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9e8806e3f0 tx=0x7f9e7002c3b0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.847+0000 7f9e87200640 1 -- 172.21.15.8:0/1641441429 shutdown_connections 2024-05-26T15:42:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.847+0000 7f9e87200640 1 --2- 172.21.15.8:0/1641441429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e8815d300 0x7f9e8806da10 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.847+0000 7f9e87200640 1 --2- 172.21.15.8:0/1641441429 >> v2:172.21.15.47:3300/0 conn(0x7f9e881599a0 0x7f9e8806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.847+0000 7f9e87200640 1 -- 172.21.15.8:0/1641441429 >> 172.21.15.8:0/1641441429 conn(0x7f9e880ce4f0 msgr2=0x7f9e880ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.847+0000 7f9e87200640 1 -- 172.21.15.8:0/1641441429 shutdown_connections 2024-05-26T15:42:07.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.847+0000 7f9e87200640 1 -- 172.21.15.8:0/1641441429 wait complete. 2024-05-26T15:42:07.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.849+0000 7f9e87200640 1 Processor -- start 2024-05-26T15:42:07.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.850+0000 7f9e87200640 1 -- start start 2024-05-26T15:42:07.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.851+0000 7f9e87200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cc3d0 0x7f9e88157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.851+0000 7f9e87200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8815d300 0x7f9e881f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.851+0000 7f9e87200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9e88157a60 0x7f9e881f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.851+0000 7f9e87200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e88157f20 con 0x7f9e880cc3d0 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.851+0000 7f9e87200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e88158200 con 0x7f9e8815d300 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.851+0000 7f9e87200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e881584e0 con 0x7f9e88157a60 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.851+0000 7f9e85e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cc3d0 0x7f9e88157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.851+0000 7f9e85e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cc3d0 0x7f9e88157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60804/0 (socket says 172.21.15.8:60804) 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.851+0000 7f9e85e00640 1 -- 172.21.15.8:0/3295492990 learned_addr learned my addr 172.21.15.8:0/3295492990 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.851+0000 7f9e85400640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8815d300 0x7f9e881f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e86800640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9e88157a60 0x7f9e881f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e85e00640 1 -- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9e88157a60 msgr2=0x7f9e881f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e85e00640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9e88157a60 0x7f9e881f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e85e00640 1 -- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8815d300 msgr2=0x7f9e881f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e85e00640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8815d300 0x7f9e881f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e85e00640 1 -- 172.21.15.8:0/3295492990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e700094d0 con 0x7f9e880cc3d0 2024-05-26T15:42:07.851 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e85e00640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cc3d0 0x7f9e88157520 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9e78007ef0 tx=0x7f9e7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:07.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e7e000640 1 -- 172.21.15.8:0/3295492990 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78014620 con 0x7f9e880cc3d0 2024-05-26T15:42:07.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e7e000640 1 -- 172.21.15.8:0/3295492990 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e78014780 con 0x7f9e880cc3d0 2024-05-26T15:42:07.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e7e000640 1 -- 172.21.15.8:0/3295492990 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78014b30 con 0x7f9e880cc3d0 2024-05-26T15:42:07.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.852+0000 7f9e87200640 1 -- 172.21.15.8:0/3295492990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e881587c0 con 0x7f9e880cc3d0 2024-05-26T15:42:07.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.853+0000 7f9e87200640 1 -- 172.21.15.8:0/3295492990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e88158fc0 con 0x7f9e880cc3d0 2024-05-26T15:42:07.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.854+0000 7f9e87200640 1 -- 172.21.15.8:0/3295492990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8804e210 con 0x7f9e880cc3d0 2024-05-26T15:42:07.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.855+0000 7f9e7e000640 1 -- 172.21.15.8:0/3295492990 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9e78014c90 con 0x7f9e880cc3d0 2024-05-26T15:42:07.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.856+0000 7f9e7e000640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9e6406ac00 0x7f9e6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:07.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.856+0000 7f9e7e000640 1 -- 172.21.15.8:0/3295492990 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9e78089c40 con 0x7f9e880cc3d0 2024-05-26T15:42:07.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.856+0000 7f9e85400640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9e6406ac00 0x7f9e6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:07.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.858+0000 7f9e85400640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9e6406ac00 0x7f9e6406d0c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9e70036000 tx=0x7f9e70030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:07.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:07.862+0000 7f9e7e000640 1 -- 172.21.15.8:0/3295492990 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9e78054f90 con 0x7f9e880cc3d0 2024-05-26T15:42:08.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.062+0000 7f9e87200640 1 -- 172.21.15.8:0/3295492990 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e88155bd0 con 0x7f9e880cc3d0 2024-05-26T15:42:08.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.063+0000 7f9e7e000640 1 -- 172.21.15.8:0/3295492990 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e780585b0 con 0x7f9e880cc3d0 2024-05-26T15:42:08.061 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:42:08.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.065+0000 7f9e87200640 1 -- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9e6406ac00 msgr2=0x7f9e6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.065+0000 7f9e87200640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9e6406ac00 0x7f9e6406d0c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9e70036000 tx=0x7f9e70030000 comp rx=0 tx=0).stop 2024-05-26T15:42:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.065+0000 7f9e87200640 1 -- 172.21.15.8:0/3295492990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cc3d0 msgr2=0x7f9e88157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.065+0000 7f9e87200640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cc3d0 0x7f9e88157520 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9e78007ef0 tx=0x7f9e7800e4b0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.065+0000 7f9e87200640 1 -- 172.21.15.8:0/3295492990 shutdown_connections 2024-05-26T15:42:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.065+0000 7f9e87200640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9e88157a60 0x7f9e881f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.065+0000 7f9e87200640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9e6406ac00 0x7f9e6406d0c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.065+0000 7f9e87200640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e8815d300 0x7f9e881f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.065+0000 7f9e87200640 1 --2- 172.21.15.8:0/3295492990 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9e880cc3d0 0x7f9e88157520 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.065+0000 7f9e87200640 1 -- 172.21.15.8:0/3295492990 >> 172.21.15.8:0/3295492990 conn(0x7f9e880ce4f0 msgr2=0x7f9e8806d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:08.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.066+0000 7f9e87200640 1 -- 172.21.15.8:0/3295492990 shutdown_connections 2024-05-26T15:42:08.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.066+0000 7f9e87200640 1 -- 172.21.15.8:0/3295492990 wait complete. 2024-05-26T15:42:08.084 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-26T15:42:08.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.295+0000 7f6a17e00640 1 Processor -- start 2024-05-26T15:42:08.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.295+0000 7f6a17e00640 1 -- start start 2024-05-26T15:42:08.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.297+0000 7f6a17e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6a10144150 0x7f6a100b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.297+0000 7f6a17e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a100b1db0 con 0x7f6a10070d70 2024-05-26T15:42:08.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.297+0000 7f6a17e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a100cc8f0 con 0x7f6a10144530 2024-05-26T15:42:08.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.297+0000 7f6a17e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a100cbac0 con 0x7f6a10144150 2024-05-26T15:42:08.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.298+0000 7f6a15e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6a10070d70 0x7f6a100cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59382/0 (socket says 172.21.15.8:59382) 2024-05-26T15:42:08.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.298+0000 7f6a15e00640 1 -- 172.21.15.8:0/3071837739 learned_addr learned my addr 172.21.15.8:0/3071837739 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:08.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.298+0000 7f6a15400640 1 --2- 172.21.15.8:0/3071837739 >> v2:172.21.15.8:3300/0 conn(0x7f6a10144150 0x7f6a100b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.299+0000 7f6a15400640 1 -- 172.21.15.8:0/3071837739 >> v1:172.21.15.47:6789/0 conn(0x7f6a10144530 legacy=0x7f6a10070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.298+0000 7f6a0fe00640 1 -- 172.21.15.8:0/3071837739 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074061260 0 0) 0x7f6a100b1db0 con 0x7f6a10070d70 2024-05-26T15:42:08.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.299+0000 7f6a15400640 1 -- 172.21.15.8:0/3071837739 >> v1:172.21.15.8:6789/0 conn(0x7f6a10070d70 legacy=0x7f6a100cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.299+0000 7f6a15400640 1 -- 172.21.15.8:0/3071837739 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100ccb90 con 0x7f6a10144150 2024-05-26T15:42:08.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.300+0000 7f6a15400640 1 --2- 172.21.15.8:0/3071837739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 0x7f6a100b1870 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097a0 tx=0x7f6a0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ba44dfa719adb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:08.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.300+0000 7f6a0fe00640 1 -- 172.21.15.8:0/3071837739 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04032440 con 0x7f6a10144150 2024-05-26T15:42:08.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.300+0000 7f6a0fe00640 1 -- 172.21.15.8:0/3071837739 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a040325a0 con 0x7f6a10144150 2024-05-26T15:42:08.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.300+0000 7f6a0fe00640 1 -- 172.21.15.8:0/3071837739 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04032930 con 0x7f6a10144150 2024-05-26T15:42:08.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.301+0000 7f6a17e00640 1 -- 172.21.15.8:0/3071837739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 msgr2=0x7f6a100b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.301+0000 7f6a17e00640 1 --2- 172.21.15.8:0/3071837739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 0x7f6a100b1870 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6a040097a0 tx=0x7f6a0402a230 comp rx=0 tx=0).stop 2024-05-26T15:42:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.301+0000 7f6a17e00640 1 -- 172.21.15.8:0/3071837739 shutdown_connections 2024-05-26T15:42:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.301+0000 7f6a17e00640 1 --2- 172.21.15.8:0/3071837739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 0x7f6a100b1870 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.301+0000 7f6a17e00640 1 -- 172.21.15.8:0/3071837739 >> 172.21.15.8:0/3071837739 conn(0x7f6a100b0570 msgr2=0x7f6a100b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.301+0000 7f6a17e00640 1 -- 172.21.15.8:0/3071837739 shutdown_connections 2024-05-26T15:42:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.301+0000 7f6a17e00640 1 -- 172.21.15.8:0/3071837739 wait complete. 2024-05-26T15:42:08.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.303+0000 7f6a17e00640 1 Processor -- start 2024-05-26T15:42:08.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.303+0000 7f6a17e00640 1 -- start start 2024-05-26T15:42:08.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.304+0000 7f6a17e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a10070d70 0x7f6a101435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.304+0000 7f6a17e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 0x7f6a10139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.304+0000 7f6a17e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a10144530 0x7f6a1006dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.304+0000 7f6a17e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100afeb0 con 0x7f6a10144150 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.304+0000 7f6a17e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a100b0190 con 0x7f6a10144530 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.304+0000 7f6a17e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a10142dd0 con 0x7f6a10070d70 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.304+0000 7f6a14a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 0x7f6a10139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.304+0000 7f6a14a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 0x7f6a10139370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60832/0 (socket says 172.21.15.8:60832) 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.305+0000 7f6a14a00640 1 -- 172.21.15.8:0/3045716429 learned_addr learned my addr 172.21.15.8:0/3045716429 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.305+0000 7f6a15400640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a10070d70 0x7f6a101435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.305+0000 7f6a15e00640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a10144530 0x7f6a1006dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.305+0000 7f6a14a00640 1 -- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a10070d70 msgr2=0x7f6a101435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.305+0000 7f6a14a00640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a10070d70 0x7f6a101435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.305+0000 7f6a14a00640 1 -- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a10144530 msgr2=0x7f6a1006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.305+0000 7f6a14a00640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a10144530 0x7f6a1006dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.305+0000 7f6a14a00640 1 -- 172.21.15.8:0/3045716429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04009400 con 0x7f6a10144150 2024-05-26T15:42:08.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.305+0000 7f6a14a00640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 0x7f6a10139370 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000c400 tx=0x7f6a0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.306+0000 7f6a0d600640 1 -- 172.21.15.8:0/3045716429 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000052d0 con 0x7f6a10144150 2024-05-26T15:42:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.306+0000 7f6a0d600640 1 -- 172.21.15.8:0/3045716429 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a00005430 con 0x7f6a10144150 2024-05-26T15:42:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.306+0000 7f6a0d600640 1 -- 172.21.15.8:0/3045716429 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00003830 con 0x7f6a10144150 2024-05-26T15:42:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.306+0000 7f6a17e00640 1 -- 172.21.15.8:0/3045716429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a101430b0 con 0x7f6a10144150 2024-05-26T15:42:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.306+0000 7f6a17e00640 1 -- 172.21.15.8:0/3045716429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1006e400 con 0x7f6a10144150 2024-05-26T15:42:08.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.307+0000 7f6a17e00640 1 -- 172.21.15.8:0/3045716429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a100672c0 con 0x7f6a10144150 2024-05-26T15:42:08.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.308+0000 7f6a0d600640 1 -- 172.21.15.8:0/3045716429 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a00003990 con 0x7f6a10144150 2024-05-26T15:42:08.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.309+0000 7f6a0d600640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f69f406ac00 0x7f69f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.309+0000 7f6a0d600640 1 -- 172.21.15.8:0/3045716429 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6a00088770 con 0x7f6a10144150 2024-05-26T15:42:08.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.310+0000 7f6a15400640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f69f406ac00 0x7f69f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.311+0000 7f6a15400640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f69f406ac00 0x7f69f406d0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a04034000 tx=0x7f6a0402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:08.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.314+0000 7f6a0d600640 1 -- 172.21.15.8:0/3045716429 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6a00053ac0 con 0x7f6a10144150 2024-05-26T15:42:08.513 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.515+0000 7f6a17e00640 1 -- 172.21.15.8:0/3045716429 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6a1006e620 con 0x7f6a10144150 2024-05-26T15:42:08.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.516+0000 7f6a0d600640 1 -- 172.21.15.8:0/3045716429 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6a00017060 con 0x7f6a10144150 2024-05-26T15:42:08.514 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:08.514 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2024-05-26T15:42:08.515 INFO:teuthology.orchestra.run.smithi008.stdout: { 2024-05-26T15:42:08.515 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2024-05-26T15:42:08.515 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2024-05-26T15:42:08.515 INFO:teuthology.orchestra.run.smithi008.stdout: } 2024-05-26T15:42:08.515 INFO:teuthology.orchestra.run.smithi008.stdout:] 2024-05-26T15:42:08.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.518+0000 7f6a17e00640 1 -- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f69f406ac00 msgr2=0x7f69f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.518+0000 7f6a17e00640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f69f406ac00 0x7f69f406d0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a04034000 tx=0x7f6a0402e000 comp rx=0 tx=0).stop 2024-05-26T15:42:08.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.518+0000 7f6a17e00640 1 -- 172.21.15.8:0/3045716429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 msgr2=0x7f6a10139370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.518+0000 7f6a17e00640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 0x7f6a10139370 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000c400 tx=0x7f6a0000c8c0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.518+0000 7f6a17e00640 1 -- 172.21.15.8:0/3045716429 shutdown_connections 2024-05-26T15:42:08.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.518+0000 7f6a17e00640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f69f406ac00 0x7f69f406d0c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.518+0000 7f6a17e00640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a10144530 0x7f6a1006dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.518+0000 7f6a17e00640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6a10144150 0x7f6a10139370 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.518+0000 7f6a17e00640 1 --2- 172.21.15.8:0/3045716429 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6a10070d70 0x7f6a101435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.518+0000 7f6a17e00640 1 -- 172.21.15.8:0/3045716429 >> 172.21.15.8:0/3045716429 conn(0x7f6a100b0570 msgr2=0x7f6a10140790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:08.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.519+0000 7f6a17e00640 1 -- 172.21.15.8:0/3045716429 shutdown_connections 2024-05-26T15:42:08.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.519+0000 7f6a17e00640 1 -- 172.21.15.8:0/3045716429 wait complete. 2024-05-26T15:42:08.537 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-26T15:42:08.537 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-26T15:42:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.756+0000 7f5056e00640 1 Processor -- start 2024-05-26T15:42:08.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.757+0000 7f5056e00640 1 -- start start 2024-05-26T15:42:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.758+0000 7f5056e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f50500b4b20 0x7f50500b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.758+0000 7f5056e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50500d0b40 con 0x7f50500b5ac0 2024-05-26T15:42:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.758+0000 7f5056e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50500d0e20 con 0x7f505015ff90 2024-05-26T15:42:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.758+0000 7f5056e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50500b89c0 con 0x7f50500b4b20 2024-05-26T15:42:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.758+0000 7f5055000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f50500b5ac0 0x7f50500b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59384/0 (socket says 172.21.15.8:59384) 2024-05-26T15:42:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.759+0000 7f5055000640 1 -- 172.21.15.8:0/2084047511 learned_addr learned my addr 172.21.15.8:0/2084047511 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.759+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678900809 0 0) 0x7f50500d0b40 con 0x7f50500b5ac0 2024-05-26T15:42:08.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.759+0000 7f5056400640 1 --2- 172.21.15.8:0/2084047511 >> v2:172.21.15.47:3300/0 conn(0x7f50500b4b20 0x7f50500b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.758 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.759+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5038003520 con 0x7f50500b5ac0 2024-05-26T15:42:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3118686472 0 0) 0x7f5038003520 con 0x7f50500b5ac0 2024-05-26T15:42:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 >> v2:172.21.15.47:3300/0 conn(0x7f50500b4b20 msgr2=0x7f50500b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 --2- 172.21.15.8:0/2084047511 >> v2:172.21.15.47:3300/0 conn(0x7f50500b4b20 0x7f50500b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 >> v1:172.21.15.47:6789/0 conn(0x7f505015ff90 legacy=0x7f50500b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.759 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50500d1100 con 0x7f50500b5ac0 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f503c001670 con 0x7f50500b5ac0 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 >> v1:172.21.15.8:6789/0 conn(0x7f50500b5ac0 legacy=0x7f50500b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5038003970 0x7f5038003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50380047c0 0x7f5038004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5038005180 0x7f503800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500b89c0 con 0x7f50380047c0 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503800c0d0 con 0x7f5038005180 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.760+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503800c290 con 0x7f5038003970 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.761+0000 7f5055000640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50380047c0 0x7f5038004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.761+0000 7f5056400640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5038005180 0x7f503800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.761+0000 7f5055a00640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5038003970 0x7f5038003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.762+0000 7f5056400640 1 -- 172.21.15.8:0/2084047511 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5038003970 msgr2=0x7f5038003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.762+0000 7f5056400640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5038003970 0x7f5038003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.762+0000 7f5056400640 1 -- 172.21.15.8:0/2084047511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50380047c0 msgr2=0x7f5038004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.762+0000 7f5056400640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50380047c0 0x7f5038004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.762+0000 7f5056400640 1 -- 172.21.15.8:0/2084047511 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038003520 con 0x7f5038005180 2024-05-26T15:42:08.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.762+0000 7f5056400640 1 -- 172.21.15.8:0/2084047511 reap_dead start 2024-05-26T15:42:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.763+0000 7f5056400640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5038005180 0x7f503800b980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5048007360 tx=0x7f50380057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b4ada71316c9d8d server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.763+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048003b90 con 0x7f5038005180 2024-05-26T15:42:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.763+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048003d30 con 0x7f5038005180 2024-05-26T15:42:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.764+0000 7f504fe00640 1 -- 172.21.15.8:0/2084047511 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5048003ea0 con 0x7f5038005180 2024-05-26T15:42:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.764+0000 7f5056e00640 1 -- 172.21.15.8:0/2084047511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5038005180 msgr2=0x7f503800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.764+0000 7f5056e00640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5038005180 0x7f503800b980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5048007360 tx=0x7f50380057f0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.764+0000 7f5056e00640 1 -- 172.21.15.8:0/2084047511 shutdown_connections 2024-05-26T15:42:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.764+0000 7f5056e00640 1 --2- 172.21.15.8:0/2084047511 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5038005180 0x7f503800b980 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.764+0000 7f5056e00640 1 -- 172.21.15.8:0/2084047511 >> 172.21.15.8:0/2084047511 conn(0x7f505006b8c0 msgr2=0x7f50500cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.765+0000 7f5056e00640 1 -- 172.21.15.8:0/2084047511 shutdown_connections 2024-05-26T15:42:08.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.765+0000 7f5056e00640 1 -- 172.21.15.8:0/2084047511 wait complete. 2024-05-26T15:42:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.766+0000 7f5056e00640 1 Processor -- start 2024-05-26T15:42:08.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.767+0000 7f5056e00640 1 -- start start 2024-05-26T15:42:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5056e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5038005180 0x7f5050150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5056e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50501f5b00 0x7f505015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5056e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50501f5f80 0x7f505015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5056e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50501f6aa0 con 0x7f5038005180 2024-05-26T15:42:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5056e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5050159e30 con 0x7f50501f5b00 2024-05-26T15:42:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5056e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50501f64e0 con 0x7f50501f5f80 2024-05-26T15:42:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5055a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5038005180 0x7f5050150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5055a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5038005180 0x7f5050150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60856/0 (socket says 172.21.15.8:60856) 2024-05-26T15:42:08.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5055a00640 1 -- 172.21.15.8:0/1878133203 learned_addr learned my addr 172.21.15.8:0/1878133203 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5055a00640 1 -- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50501f5f80 msgr2=0x7f505015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5055a00640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50501f5f80 0x7f505015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5055a00640 1 -- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50501f5b00 msgr2=0x7f505015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5055a00640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50501f5b00 0x7f505015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.768+0000 7f5055a00640 1 -- 172.21.15.8:0/1878133203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50501f67c0 con 0x7f5038005180 2024-05-26T15:42:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.769+0000 7f5055a00640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5038005180 0x7f5050150020 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f504400f5f0 tx=0x7f504400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:08.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.769+0000 7f504d600640 1 -- 172.21.15.8:0/1878133203 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50440052e0 con 0x7f5038005180 2024-05-26T15:42:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.769+0000 7f504d600640 1 -- 172.21.15.8:0/1878133203 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5044005440 con 0x7f5038005180 2024-05-26T15:42:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.769+0000 7f5056e00640 1 -- 172.21.15.8:0/1878133203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5050159a50 con 0x7f5038005180 2024-05-26T15:42:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.769+0000 7f504d600640 1 -- 172.21.15.8:0/1878133203 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044003810 con 0x7f5038005180 2024-05-26T15:42:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.769+0000 7f5056e00640 1 -- 172.21.15.8:0/1878133203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50500c7340 con 0x7f5038005180 2024-05-26T15:42:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.770+0000 7f5056e00640 1 -- 172.21.15.8:0/1878133203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50501598b0 con 0x7f5038005180 2024-05-26T15:42:08.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.771+0000 7f504d600640 1 -- 172.21.15.8:0/1878133203 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5044003970 con 0x7f5038005180 2024-05-26T15:42:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.772+0000 7f504d600640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f503006ac00 0x7f503006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:08.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.772+0000 7f504d600640 1 -- 172.21.15.8:0/1878133203 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5044089060 con 0x7f5038005180 2024-05-26T15:42:08.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.773+0000 7f5055000640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f503006ac00 0x7f503006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:08.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.774+0000 7f5055000640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f503006ac00 0x7f503006d0c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f50500c7140 tx=0x7f503c001ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:08.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.777+0000 7f504d600640 1 -- 172.21.15.8:0/1878133203 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f50440bc900 con 0x7f5038005180 2024-05-26T15:42:08.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:08.976+0000 7f5056e00640 1 -- 172.21.15.8:0/1878133203 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f50500b1fa0 con 0x7f5038005180 2024-05-26T15:42:09.952 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.953+0000 7f504d600640 1 -- 172.21.15.8:0/1878133203 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v52) v1 ==== 138+0+0 (secure 0 0 0) 0x7f50501598b0 con 0x7f5038005180 2024-05-26T15:42:09.952 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2024-05-26T15:42:09.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.958+0000 7f5056e00640 1 -- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f503006ac00 msgr2=0x7f503006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.958+0000 7f5056e00640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f503006ac00 0x7f503006d0c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f50500c7140 tx=0x7f503c001ba0 comp rx=0 tx=0).stop 2024-05-26T15:42:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.958+0000 7f5056e00640 1 -- 172.21.15.8:0/1878133203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5038005180 msgr2=0x7f5050150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.958+0000 7f5056e00640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5038005180 0x7f5050150020 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f504400f5f0 tx=0x7f504400fab0 comp rx=0 tx=0).stop 2024-05-26T15:42:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.959+0000 7f5056e00640 1 -- 172.21.15.8:0/1878133203 shutdown_connections 2024-05-26T15:42:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.959+0000 7f5056e00640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f50501f5f80 0x7f505015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.959+0000 7f5056e00640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f503006ac00 0x7f503006d0c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.959+0000 7f5056e00640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f50501f5b00 0x7f505015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.959+0000 7f5056e00640 1 --2- 172.21.15.8:0/1878133203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5038005180 0x7f5050150020 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:09.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.959+0000 7f5056e00640 1 -- 172.21.15.8:0/1878133203 >> 172.21.15.8:0/1878133203 conn(0x7f505006b8c0 msgr2=0x7f505015f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:09.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.960+0000 7f5056e00640 1 -- 172.21.15.8:0/1878133203 shutdown_connections 2024-05-26T15:42:09.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:09.960+0000 7f5056e00640 1 -- 172.21.15.8:0/1878133203 wait complete. 2024-05-26T15:42:09.986 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-26T15:42:10.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.197+0000 7f0bcfe00640 1 Processor -- start 2024-05-26T15:42:10.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.197+0000 7f0bcfe00640 1 -- start start 2024-05-26T15:42:10.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.199+0000 7f0bcfe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0bd0098a50 0x7f0bd0098e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:10.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.199+0000 7f0bcfe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0bd006af80 0x7f0bd006b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:10.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.199+0000 7f0bcfe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0bd015f5d0 0x7f0bd015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:10.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.199+0000 7f0bcfe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd015df10 con 0x7f0bd0098a50 2024-05-26T15:42:10.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.199+0000 7f0bcfe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00ce950 con 0x7f0bd006af80 2024-05-26T15:42:10.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.199+0000 7f0bcfe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00ceac0 con 0x7f0bd015f5d0 2024-05-26T15:42:10.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.199+0000 7f0bcea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0bd0098a50 0x7f0bd0098e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.199+0000 7f0bcea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0bd0098a50 0x7f0bd0098e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60862/0 (socket says 172.21.15.8:60862) 2024-05-26T15:42:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.199+0000 7f0bcea00640 1 -- 172.21.15.8:0/198423689 learned_addr learned my addr 172.21.15.8:0/198423689 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.200+0000 7f0bcf400640 1 --2- 172.21.15.8:0/198423689 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0bd015f5d0 0x7f0bd015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.200+0000 7f0bce000640 1 --2- 172.21.15.8:0/198423689 >> v2:172.21.15.47:3300/0 conn(0x7f0bd006af80 0x7f0bd006b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.200+0000 7f0bcea00640 1 -- 172.21.15.8:0/198423689 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0bd015f5d0 msgr2=0x7f0bd015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.200+0000 7f0bcea00640 1 --2- 172.21.15.8:0/198423689 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0bd015f5d0 0x7f0bd015fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.200+0000 7f0bcea00640 1 -- 172.21.15.8:0/198423689 >> v2:172.21.15.47:3300/0 conn(0x7f0bd006af80 msgr2=0x7f0bd006b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.200+0000 7f0bcea00640 1 --2- 172.21.15.8:0/198423689 >> v2:172.21.15.47:3300/0 conn(0x7f0bd006af80 0x7f0bd006b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.200+0000 7f0bcea00640 1 -- 172.21.15.8:0/198423689 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd0157420 con 0x7f0bd0098a50 2024-05-26T15:42:10.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.202+0000 7f0bcea00640 1 --2- 172.21.15.8:0/198423689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd0098a50 0x7f0bd0098e30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00b20a0 tx=0x7f0bc002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62b24c4fc4cdc1e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:10.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.202+0000 7f0bcd600640 1 -- 172.21.15.8:0/198423689 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0032440 con 0x7f0bd0098a50 2024-05-26T15:42:10.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.202+0000 7f0bcd600640 1 -- 172.21.15.8:0/198423689 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc00325a0 con 0x7f0bd0098a50 2024-05-26T15:42:10.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.202+0000 7f0bcd600640 1 -- 172.21.15.8:0/198423689 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0032930 con 0x7f0bd0098a50 2024-05-26T15:42:10.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.203+0000 7f0bcfe00640 1 -- 172.21.15.8:0/198423689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd0098a50 msgr2=0x7f0bd0098e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:10.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.203+0000 7f0bcfe00640 1 --2- 172.21.15.8:0/198423689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd0098a50 0x7f0bd0098e30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00b20a0 tx=0x7f0bc002a210 comp rx=0 tx=0).stop 2024-05-26T15:42:10.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.203+0000 7f0bcfe00640 1 -- 172.21.15.8:0/198423689 shutdown_connections 2024-05-26T15:42:10.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.203+0000 7f0bcfe00640 1 --2- 172.21.15.8:0/198423689 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0bd015f5d0 0x7f0bd015fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.203+0000 7f0bcfe00640 1 --2- 172.21.15.8:0/198423689 >> v2:172.21.15.47:3300/0 conn(0x7f0bd006af80 0x7f0bd006b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.203+0000 7f0bcfe00640 1 --2- 172.21.15.8:0/198423689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd0098a50 0x7f0bd0098e30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.203+0000 7f0bcfe00640 1 -- 172.21.15.8:0/198423689 >> 172.21.15.8:0/198423689 conn(0x7f0bd00b20d0 msgr2=0x7f0bd00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:10.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.203+0000 7f0bcfe00640 1 -- 172.21.15.8:0/198423689 shutdown_connections 2024-05-26T15:42:10.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.203+0000 7f0bcfe00640 1 -- 172.21.15.8:0/198423689 wait complete. 2024-05-26T15:42:10.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.205+0000 7f0bcfe00640 1 Processor -- start 2024-05-26T15:42:10.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.205+0000 7f0bcfe00640 1 -- start start 2024-05-26T15:42:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.206+0000 7f0bcfe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd006af80 0x7f0bd015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.206+0000 7f0bcfe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0bd0098a50 0x7f0bd015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.206+0000 7f0bcfe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bd015f5d0 0x7f0bd01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.206+0000 7f0bcfe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd015bf70 con 0x7f0bd006af80 2024-05-26T15:42:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.206+0000 7f0bcfe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd015b090 con 0x7f0bd015f5d0 2024-05-26T15:42:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.206+0000 7f0bcfe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd015b360 con 0x7f0bd0098a50 2024-05-26T15:42:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bcea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd006af80 0x7f0bd015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:10.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bcea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd006af80 0x7f0bd015c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60878/0 (socket says 172.21.15.8:60878) 2024-05-26T15:42:10.343 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bcea00640 1 -- 172.21.15.8:0/1460171757 learned_addr learned my addr 172.21.15.8:0/1460171757 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bce000640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0bd0098a50 0x7f0bd015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bcf400640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bd015f5d0 0x7f0bd01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bcea00640 1 -- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0bd0098a50 msgr2=0x7f0bd015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bcea00640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0bd0098a50 0x7f0bd015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bcea00640 1 -- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bd015f5d0 msgr2=0x7f0bd01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bcea00640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bd015f5d0 0x7f0bd01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bcea00640 1 -- 172.21.15.8:0/1460171757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc00094d0 con 0x7f0bd006af80 2024-05-26T15:42:10.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.207+0000 7f0bcf400640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bd015f5d0 0x7f0bd01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.208+0000 7f0bcea00640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd006af80 0x7f0bd015c400 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0000c00 tx=0x7f0bc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.208+0000 7f0bc7400640 1 -- 172.21.15.8:0/1460171757 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0032440 con 0x7f0bd006af80 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.208+0000 7f0bc7400640 1 -- 172.21.15.8:0/1460171757 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc0032e90 con 0x7f0bd006af80 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.208+0000 7f0bc7400640 1 -- 172.21.15.8:0/1460171757 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0030dc0 con 0x7f0bd006af80 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.208+0000 7f0bcfe00640 1 -- 172.21.15.8:0/1460171757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd015b640 con 0x7f0bd006af80 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.208+0000 7f0bcfe00640 1 -- 172.21.15.8:0/1460171757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd015bc00 con 0x7f0bd006af80 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.209+0000 7f0bcfe00640 1 -- 172.21.15.8:0/1460171757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd015bd90 con 0x7f0bd006af80 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.211+0000 7f0bc7400640 1 -- 172.21.15.8:0/1460171757 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0bc0039040 con 0x7f0bd006af80 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.212+0000 7f0bc7400640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0bb006ac00 0x7f0bb006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.212+0000 7f0bc7400640 1 -- 172.21.15.8:0/1460171757 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f0bc00aa000 con 0x7f0bd006af80 2024-05-26T15:42:10.346 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.213+0000 7f0bce000640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0bb006ac00 0x7f0bb006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.214+0000 7f0bce000640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0bb006ac00 0x7f0bb006d0c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc006fd0 tx=0x7f0bbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:10.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.217+0000 7f0bc7400640 1 -- 172.21.15.8:0/1460171757 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0bc0075480 con 0x7f0bd006af80 2024-05-26T15:42:10.417 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.419+0000 7f0bcfe00640 1 -- 172.21.15.8:0/1460171757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0bd004e210 con 0x7f0bd006af80 2024-05-26T15:42:10.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.963+0000 7f0bc7400640 1 -- 172.21.15.8:0/1460171757 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v53) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0bc0078aa0 con 0x7f0bd006af80 2024-05-26T15:42:10.962 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2024-05-26T15:42:10.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.971+0000 7f0bcfe00640 1 -- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0bb006ac00 msgr2=0x7f0bb006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:10.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.971+0000 7f0bcfe00640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0bb006ac00 0x7f0bb006d0c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc006fd0 tx=0x7f0bbc008040 comp rx=0 tx=0).stop 2024-05-26T15:42:10.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.971+0000 7f0bcfe00640 1 -- 172.21.15.8:0/1460171757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd006af80 msgr2=0x7f0bd015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:10.970 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.971+0000 7f0bcfe00640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd006af80 0x7f0bd015c400 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0000c00 tx=0x7f0bc00046c0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.973+0000 7f0bcfe00640 1 -- 172.21.15.8:0/1460171757 shutdown_connections 2024-05-26T15:42:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.973+0000 7f0bcfe00640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0bb006ac00 0x7f0bb006d0c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.973+0000 7f0bcfe00640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bd015f5d0 0x7f0bd01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.973+0000 7f0bcfe00640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0bd0098a50 0x7f0bd015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.973+0000 7f0bcfe00640 1 --2- 172.21.15.8:0/1460171757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0bd006af80 0x7f0bd015c400 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:10.971 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.973+0000 7f0bcfe00640 1 -- 172.21.15.8:0/1460171757 >> 172.21.15.8:0/1460171757 conn(0x7f0bd00b20d0 msgr2=0x7f0bd01e6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:10.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.977+0000 7f0bcfe00640 1 -- 172.21.15.8:0/1460171757 shutdown_connections 2024-05-26T15:42:10.976 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:10.977+0000 7f0bcfe00640 1 -- 172.21.15.8:0/1460171757 wait complete. 2024-05-26T15:42:11.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-26T15:42:11.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.191+0000 7f1cd7e00640 1 Processor -- start 2024-05-26T15:42:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.191+0000 7f1cd7e00640 1 -- start start 2024-05-26T15:42:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.192+0000 7f1cd7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1cd80b1b70 0x7f1cd80d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.192+0000 7f1cd7e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd80d0da0 con 0x7f1cd80d2340 2024-05-26T15:42:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.192+0000 7f1cd7e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd80d1040 con 0x7f1cd815cab0 2024-05-26T15:42:11.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.192+0000 7f1cd7e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd80d19e0 con 0x7f1cd80b1b70 2024-05-26T15:42:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.193+0000 7f1cd7400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1cd80d2340 0x7f1cd80cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51052/0 (socket says 172.21.15.8:51052) 2024-05-26T15:42:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.193+0000 7f1cd7400640 1 -- 172.21.15.8:0/3705501504 learned_addr learned my addr 172.21.15.8:0/3705501504 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.193+0000 7f1cd6000640 1 --2- 172.21.15.8:0/3705501504 >> v2:172.21.15.47:3300/0 conn(0x7f1cd80b1b70 0x7f1cd80d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.193+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931353609 0 0) 0x7f1cd80d0da0 con 0x7f1cd80d2340 2024-05-26T15:42:11.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.193+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb8003520 con 0x7f1cd80d2340 2024-05-26T15:42:11.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423378077 0 0) 0x7f1cb8003520 con 0x7f1cd80d2340 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 >> v2:172.21.15.47:3300/0 conn(0x7f1cd80b1b70 msgr2=0x7f1cd80d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 --2- 172.21.15.8:0/3705501504 >> v2:172.21.15.47:3300/0 conn(0x7f1cd80b1b70 0x7f1cd80d1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 >> v1:172.21.15.47:6789/0 conn(0x7f1cd815cab0 legacy=0x7f1cd80b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd80d1320 con 0x7f1cd80d2340 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f1cd0001670 con 0x7f1cd80d2340 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 >> v1:172.21.15.8:6789/0 conn(0x7f1cd80d2340 legacy=0x7f1cd80cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80039c0 0x7f1cb8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb80047c0 0x7f1cb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb80052a0 0x7f1cb800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80d19e0 con 0x7f1cb80052a0 2024-05-26T15:42:11.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb800c1a0 con 0x7f1cb80047c0 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb800c360 con 0x7f1cb80039c0 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.194+0000 7f1cd7400640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb80052a0 0x7f1cb800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.195+0000 7f1cd6a00640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80039c0 0x7f1cb8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.195+0000 7f1cd7400640 1 -- 172.21.15.8:0/3705501504 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80039c0 msgr2=0x7f1cb8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.195+0000 7f1cd6000640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb80047c0 0x7f1cb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.195+0000 7f1cd7400640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80039c0 0x7f1cb8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.195+0000 7f1cd7400640 1 -- 172.21.15.8:0/3705501504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb80047c0 msgr2=0x7f1cb8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.195+0000 7f1cd7400640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb80047c0 0x7f1cb8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.195+0000 7f1cd7400640 1 -- 172.21.15.8:0/3705501504 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8003520 con 0x7f1cb80052a0 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.195+0000 7f1cd6a00640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80039c0 0x7f1cb8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:11.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.195+0000 7f1cd6000640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cb80047c0 0x7f1cb8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:11.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.196+0000 7f1cd7400640 1 -- 172.21.15.8:0/3705501504 reap_dead start 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.196+0000 7f1cd7400640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb80052a0 0x7f1cb800b980 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c0e0 tx=0x7f1cb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53e32a9b7eb70d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.196+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0005ad0 con 0x7f1cb80052a0 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.196+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd002d070 con 0x7f1cb80052a0 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.196+0000 7f1cd5600640 1 -- 172.21.15.8:0/3705501504 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0007070 con 0x7f1cb80052a0 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.197+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3705501504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb80052a0 msgr2=0x7f1cb800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.197+0000 7f1cd7e00640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb80052a0 0x7f1cb800b980 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c0e0 tx=0x7f1cb80057f0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.197+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3705501504 shutdown_connections 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.197+0000 7f1cd7e00640 1 --2- 172.21.15.8:0/3705501504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cb80052a0 0x7f1cb800b980 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.197+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3705501504 >> 172.21.15.8:0/3705501504 conn(0x7f1cd806b640 msgr2=0x7f1cd806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.197+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3705501504 shutdown_connections 2024-05-26T15:42:11.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.197+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3705501504 wait complete. 2024-05-26T15:42:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.199+0000 7f1cd7e00640 1 Processor -- start 2024-05-26T15:42:11.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.199+0000 7f1cd7e00640 1 -- start start 2024-05-26T15:42:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.200+0000 7f1cd7e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80052a0 0x7f1cd81536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.200+0000 7f1cd7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cd8156640 0x7f1cd8157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.200+0000 7f1cd7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd80b2890 0x7f1cd80b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.200+0000 7f1cd7e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd81f6660 con 0x7f1cd80b2890 2024-05-26T15:42:11.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.200+0000 7f1cd7e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd8157830 con 0x7f1cd8156640 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.200+0000 7f1cd7e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd80b3250 con 0x7f1cb80052a0 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.200+0000 7f1cd7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd80b2890 0x7f1cd80b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd80b2890 0x7f1cd80b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32908/0 (socket says 172.21.15.8:32908) 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd7400640 1 -- 172.21.15.8:0/3344242446 learned_addr learned my addr 172.21.15.8:0/3344242446 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd6a00640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80052a0 0x7f1cd81536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd7400640 1 -- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80052a0 msgr2=0x7f1cd81536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd6000640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cd8156640 0x7f1cd8157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd7400640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80052a0 0x7f1cd81536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd7400640 1 -- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cd8156640 msgr2=0x7f1cd8157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd7400640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cd8156640 0x7f1cd8157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd7400640 1 -- 172.21.15.8:0/3344242446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd81f61d0 con 0x7f1cd80b2890 2024-05-26T15:42:11.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd6a00640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80052a0 0x7f1cd81536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:11.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.201+0000 7f1cd7400640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd80b2890 0x7f1cd80b2d10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c200 tx=0x7f1cd0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:11.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.202+0000 7f1ccf400640 1 -- 172.21.15.8:0/3344242446 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0040070 con 0x7f1cd80b2890 2024-05-26T15:42:11.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.202+0000 7f1ccf400640 1 -- 172.21.15.8:0/3344242446 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd00015c0 con 0x7f1cd80b2890 2024-05-26T15:42:11.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.202+0000 7f1ccf400640 1 -- 172.21.15.8:0/3344242446 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd00047e0 con 0x7f1cd80b2890 2024-05-26T15:42:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.202+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3344242446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd8153c10 con 0x7f1cd80b2890 2024-05-26T15:42:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.202+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3344242446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd81f58a0 con 0x7f1cd80b2890 2024-05-26T15:42:11.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.203+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3344242446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd804e210 con 0x7f1cd80b2890 2024-05-26T15:42:11.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.204+0000 7f1ccf400640 1 -- 172.21.15.8:0/3344242446 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1cd002f030 con 0x7f1cd80b2890 2024-05-26T15:42:11.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.205+0000 7f1ccf400640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cb406ac00 0x7f1cb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.205+0000 7f1ccf400640 1 -- 172.21.15.8:0/3344242446 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f1cd00a8fc0 con 0x7f1cd80b2890 2024-05-26T15:42:11.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.206+0000 7f1cd6a00640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cb406ac00 0x7f1cb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.207+0000 7f1cd6a00640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cb406ac00 0x7f1cb406d0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8007fd0 tx=0x7f1cc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:11.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.210+0000 7f1ccf400640 1 -- 172.21.15.8:0/3344242446 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1cd00742a0 con 0x7f1cd80b2890 2024-05-26T15:42:11.446 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.447+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3344242446 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1cd804e210 con 0x7f1cd80b2890 2024-05-26T15:42:11.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.463+0000 7f1ccf400640 1 -- 172.21.15.8:0/3344242446 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1cd00778c0 con 0x7f1cd80b2890 2024-05-26T15:42:11.466 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 7 and data pool 8 2024-05-26T15:42:11.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.469+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cb406ac00 msgr2=0x7f1cb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.469+0000 7f1cd7e00640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cb406ac00 0x7f1cb406d0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8007fd0 tx=0x7f1cc8009040 comp rx=0 tx=0).stop 2024-05-26T15:42:11.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.469+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3344242446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd80b2890 msgr2=0x7f1cd80b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.469+0000 7f1cd7e00640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd80b2890 0x7f1cd80b2d10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000c200 tx=0x7f1cd0001930 comp rx=0 tx=0).stop 2024-05-26T15:42:11.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.470+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3344242446 shutdown_connections 2024-05-26T15:42:11.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.470+0000 7f1cd7e00640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cd80b2890 0x7f1cd80b2d10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.470+0000 7f1cd7e00640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cb406ac00 0x7f1cb406d0c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.470+0000 7f1cd7e00640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cd8156640 0x7f1cd8157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.470+0000 7f1cd7e00640 1 --2- 172.21.15.8:0/3344242446 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cb80052a0 0x7f1cd81536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.470+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3344242446 >> 172.21.15.8:0/3344242446 conn(0x7f1cd806b640 msgr2=0x7f1cd80cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:11.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.470+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3344242446 shutdown_connections 2024-05-26T15:42:11.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.471+0000 7f1cd7e00640 1 -- 172.21.15.8:0/3344242446 wait complete. 2024-05-26T15:42:11.501 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:42:11.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.672+0000 7f252fe00640 1 Processor -- start 2024-05-26T15:42:11.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.672+0000 7f252fe00640 1 -- start start 2024-05-26T15:42:11.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f25301571a0 0x7f25300caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25300b0ef0 0x7f25300c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252fe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253015d480 con 0x7f253015cfe0 2024-05-26T15:42:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252fe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253015e090 con 0x7f25301571a0 2024-05-26T15:42:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252fe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2530157580 con 0x7f25300b0ef0 2024-05-26T15:42:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f25301571a0 0x7f25300caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252ea00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f25301571a0 0x7f25300caaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32920/0 (socket says 172.21.15.8:32920) 2024-05-26T15:42:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252ea00640 1 -- 172.21.15.8:0/138990656 learned_addr learned my addr 172.21.15.8:0/138990656 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252ea00640 1 -- 172.21.15.8:0/138990656 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25300b0ef0 msgr2=0x7f25300c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:11.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252ea00640 1 --2- 172.21.15.8:0/138990656 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25300b0ef0 0x7f25300c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252ea00640 1 -- 172.21.15.8:0/138990656 >> v1:172.21.15.47:6789/0 conn(0x7f253015cfe0 legacy=0x7f25300b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.674+0000 7f252ea00640 1 -- 172.21.15.8:0/138990656 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253015d760 con 0x7f25301571a0 2024-05-26T15:42:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.675+0000 7f252ea00640 1 --2- 172.21.15.8:0/138990656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25301571a0 0x7f25300caaf0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2520009870 tx=0x7f252002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63e0199e8c2133c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.676+0000 7f252d600640 1 -- 172.21.15.8:0/138990656 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520032440 con 0x7f25301571a0 2024-05-26T15:42:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.676+0000 7f252d600640 1 -- 172.21.15.8:0/138990656 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25200325a0 con 0x7f25301571a0 2024-05-26T15:42:11.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.676+0000 7f252d600640 1 -- 172.21.15.8:0/138990656 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520032930 con 0x7f25301571a0 2024-05-26T15:42:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.676+0000 7f252fe00640 1 -- 172.21.15.8:0/138990656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25301571a0 msgr2=0x7f25300caaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.676+0000 7f252fe00640 1 --2- 172.21.15.8:0/138990656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25301571a0 0x7f25300caaf0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2520009870 tx=0x7f252002a210 comp rx=0 tx=0).stop 2024-05-26T15:42:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.677+0000 7f252fe00640 1 -- 172.21.15.8:0/138990656 shutdown_connections 2024-05-26T15:42:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.677+0000 7f252fe00640 1 --2- 172.21.15.8:0/138990656 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25300b0ef0 0x7f25300c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.677+0000 7f252fe00640 1 --2- 172.21.15.8:0/138990656 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25301571a0 0x7f25300caaf0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.677+0000 7f252fe00640 1 -- 172.21.15.8:0/138990656 >> 172.21.15.8:0/138990656 conn(0x7f2530070480 msgr2=0x7f2530070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.677+0000 7f252fe00640 1 -- 172.21.15.8:0/138990656 shutdown_connections 2024-05-26T15:42:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.677+0000 7f252fe00640 1 -- 172.21.15.8:0/138990656 wait complete. 2024-05-26T15:42:11.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.678+0000 7f252fe00640 1 Processor -- start 2024-05-26T15:42:11.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.678+0000 7f252fe00640 1 -- start start 2024-05-26T15:42:11.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.679+0000 7f252fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300b0ef0 0x7f2530152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.679+0000 7f252fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25301571a0 0x7f2530158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.679+0000 7f252fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f253015cfe0 0x7f253006c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.679+0000 7f252fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530161040 con 0x7f25300b0ef0 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.679+0000 7f252fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253015f700 con 0x7f253015cfe0 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.679+0000 7f252fe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253015e660 con 0x7f25301571a0 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300b0ef0 0x7f2530152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300b0ef0 0x7f2530152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32936/0 (socket says 172.21.15.8:32936) 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252ea00640 1 -- 172.21.15.8:0/3502443657 learned_addr learned my addr 172.21.15.8:0/3502443657 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252f400640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f253015cfe0 0x7f253006c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252e000640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25301571a0 0x7f2530158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252ea00640 1 -- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25301571a0 msgr2=0x7f2530158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252ea00640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25301571a0 0x7f2530158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252ea00640 1 -- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f253015cfe0 msgr2=0x7f253006c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252ea00640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f253015cfe0 0x7f253006c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252ea00640 1 -- 172.21.15.8:0/3502443657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200094d0 con 0x7f25300b0ef0 2024-05-26T15:42:11.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252e000640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25301571a0 0x7f2530158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:11.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.680+0000 7f252ea00640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300b0ef0 0x7f2530152130 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2520009870 tx=0x7f25200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:11.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.681+0000 7f2526a00640 1 -- 172.21.15.8:0/3502443657 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520030b00 con 0x7f25300b0ef0 2024-05-26T15:42:11.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.681+0000 7f2526a00640 1 -- 172.21.15.8:0/3502443657 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2520030c60 con 0x7f25300b0ef0 2024-05-26T15:42:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.681+0000 7f2526a00640 1 -- 172.21.15.8:0/3502443657 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252003b400 con 0x7f25300b0ef0 2024-05-26T15:42:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.681+0000 7f252fe00640 1 -- 172.21.15.8:0/3502443657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253015e940 con 0x7f25300b0ef0 2024-05-26T15:42:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.681+0000 7f252fe00640 1 -- 172.21.15.8:0/3502443657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253015ef00 con 0x7f25300b0ef0 2024-05-26T15:42:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.682+0000 7f252fe00640 1 -- 172.21.15.8:0/3502443657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253004e280 con 0x7f25300b0ef0 2024-05-26T15:42:11.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.683+0000 7f2526a00640 1 -- 172.21.15.8:0/3502443657 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2520039040 con 0x7f25300b0ef0 2024-05-26T15:42:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.684+0000 7f2526a00640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f251006ac00 0x7f251006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:11.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.684+0000 7f2526a00640 1 -- 172.21.15.8:0/3502443657 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f25200a9e30 con 0x7f25300b0ef0 2024-05-26T15:42:11.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.685+0000 7f252e000640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f251006ac00 0x7f251006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:11.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.686+0000 7f252e000640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f251006ac00 0x7f251006d0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f253015c460 tx=0x7f251c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:11.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.688+0000 7f2526a00640 1 -- 172.21.15.8:0/3502443657 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2520074ec0 con 0x7f25300b0ef0 2024-05-26T15:42:11.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.887+0000 7f252fe00640 1 -- 172.21.15.8:0/3502443657 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25300c9f90 con 0x7f25300b0ef0 2024-05-26T15:42:11.888 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.890+0000 7f2526a00640 1 -- 172.21.15.8:0/3502443657 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16223 (secure 0 0 0) 0x7f2520037090 con 0x7f25300b0ef0 2024-05-26T15:42:11.889 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:11.889 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":54,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:42:11.449695+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:42:09.031612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-26T15:42:10.475864+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:42:11.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.892+0000 7f252fe00640 1 -- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f251006ac00 msgr2=0x7f251006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.892+0000 7f252fe00640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f251006ac00 0x7f251006d0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f253015c460 tx=0x7f251c008040 comp rx=0 tx=0).stop 2024-05-26T15:42:11.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.892+0000 7f252fe00640 1 -- 172.21.15.8:0/3502443657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300b0ef0 msgr2=0x7f2530152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:11.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.892+0000 7f252fe00640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300b0ef0 0x7f2530152130 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2520009870 tx=0x7f25200046c0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.893+0000 7f252fe00640 1 -- 172.21.15.8:0/3502443657 shutdown_connections 2024-05-26T15:42:11.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.893+0000 7f252fe00640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f251006ac00 0x7f251006d0c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.893+0000 7f252fe00640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f253015cfe0 0x7f253006c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.893+0000 7f252fe00640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25301571a0 0x7f2530158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.893+0000 7f252fe00640 1 --2- 172.21.15.8:0/3502443657 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f25300b0ef0 0x7f2530152130 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:11.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.893+0000 7f252fe00640 1 -- 172.21.15.8:0/3502443657 >> 172.21.15.8:0/3502443657 conn(0x7f2530070480 msgr2=0x7f25300cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:11.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.893+0000 7f252fe00640 1 -- 172.21.15.8:0/3502443657 shutdown_connections 2024-05-26T15:42:11.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:11.893+0000 7f252fe00640 1 -- 172.21.15.8:0/3502443657 wait complete. 2024-05-26T15:42:11.910 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:42:12.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.119+0000 7fe866c00640 1 Processor -- start 2024-05-26T15:42:12.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.119+0000 7fe866c00640 1 -- start start 2024-05-26T15:42:12.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.121+0000 7fe866c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe86015cb60 0x7fe8600d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.121+0000 7fe866c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe8600cdde0 0x7fe8600b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.121+0000 7fe866c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8600d1440 con 0x7fe8600b8470 2024-05-26T15:42:12.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.121+0000 7fe866c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8600d1720 con 0x7fe8600cdde0 2024-05-26T15:42:12.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.121+0000 7fe866c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600d1a00 con 0x7fe86015cb60 2024-05-26T15:42:12.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.121+0000 7fe866200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe8600cdde0 0x7fe8600b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.121+0000 7fe866200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe8600cdde0 0x7fe8600b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32944/0 (socket says 172.21.15.8:32944) 2024-05-26T15:42:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.121+0000 7fe866200640 1 -- 172.21.15.8:0/891696439 learned_addr learned my addr 172.21.15.8:0/891696439 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.122+0000 7fe865800640 1 --2- 172.21.15.8:0/891696439 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe86015cb60 0x7fe8600d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.122+0000 7fe866200640 1 -- 172.21.15.8:0/891696439 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe86015cb60 msgr2=0x7fe8600d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.122+0000 7fe866200640 1 --2- 172.21.15.8:0/891696439 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe86015cb60 0x7fe8600d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.122+0000 7fe866200640 1 -- 172.21.15.8:0/891696439 >> v1:172.21.15.47:6789/0 conn(0x7fe8600b8470 legacy=0x7fe8600cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.122+0000 7fe866200640 1 -- 172.21.15.8:0/891696439 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8600d1ce0 con 0x7fe8600cdde0 2024-05-26T15:42:12.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.123+0000 7fe866200640 1 --2- 172.21.15.8:0/891696439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8600cdde0 0x7fe8600b5ba0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe858009e50 tx=0x7fe85802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464fb4329c413cd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.124+0000 7fe85fe00640 1 -- 172.21.15.8:0/891696439 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85802aea0 con 0x7fe8600cdde0 2024-05-26T15:42:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.124+0000 7fe85fe00640 1 -- 172.21.15.8:0/891696439 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85802d050 con 0x7fe8600cdde0 2024-05-26T15:42:12.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.124+0000 7fe85fe00640 1 -- 172.21.15.8:0/891696439 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858031820 con 0x7fe8600cdde0 2024-05-26T15:42:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.124+0000 7fe866c00640 1 -- 172.21.15.8:0/891696439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8600cdde0 msgr2=0x7fe8600b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.124+0000 7fe866c00640 1 --2- 172.21.15.8:0/891696439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8600cdde0 0x7fe8600b5ba0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe858009e50 tx=0x7fe85802a6c0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.125+0000 7fe866c00640 1 -- 172.21.15.8:0/891696439 shutdown_connections 2024-05-26T15:42:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.125+0000 7fe866c00640 1 --2- 172.21.15.8:0/891696439 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe8600cdde0 0x7fe8600b5ba0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.125+0000 7fe866c00640 1 --2- 172.21.15.8:0/891696439 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe86015cb60 0x7fe8600d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.125+0000 7fe866c00640 1 -- 172.21.15.8:0/891696439 >> 172.21.15.8:0/891696439 conn(0x7fe8600cf480 msgr2=0x7fe8600cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.125+0000 7fe866c00640 1 -- 172.21.15.8:0/891696439 shutdown_connections 2024-05-26T15:42:12.124 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.125+0000 7fe866c00640 1 -- 172.21.15.8:0/891696439 wait complete. 2024-05-26T15:42:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.126+0000 7fe866c00640 1 Processor -- start 2024-05-26T15:42:12.125 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.127+0000 7fe866c00640 1 -- start start 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.127+0000 7fe866c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8600b8470 0x7fe8600cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.127+0000 7fe866c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8600cdde0 0x7fe8600c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86015cb60 0x7fe86015e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860149660 con 0x7fe86015cb60 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600c6740 con 0x7fe8600b8470 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600c6a20 con 0x7fe8600cdde0 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86015cb60 0x7fe86015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86015cb60 0x7fe86015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32954/0 (socket says 172.21.15.8:32954) 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866200640 1 -- 172.21.15.8:0/1148271482 learned_addr learned my addr 172.21.15.8:0/1148271482 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe864e00640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8600cdde0 0x7fe8600c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe865800640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8600b8470 0x7fe8600cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866200640 1 -- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8600cdde0 msgr2=0x7fe8600c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:12.127 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866200640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8600cdde0 0x7fe8600c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866200640 1 -- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8600b8470 msgr2=0x7fe8600cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866200640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8600b8470 0x7fe8600cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe866200640 1 -- 172.21.15.8:0/1148271482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe858009b30 con 0x7fe86015cb60 2024-05-26T15:42:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe864e00640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8600cdde0 0x7fe8600c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.128+0000 7fe865800640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8600b8470 0x7fe8600cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.129+0000 7fe866200640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86015cb60 0x7fe86015e790 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe858034040 tx=0x7fe858004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:12.128 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.129+0000 7fe85d600640 1 -- 172.21.15.8:0/1148271482 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85803d860 con 0x7fe86015cb60 2024-05-26T15:42:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.129+0000 7fe85d600640 1 -- 172.21.15.8:0/1148271482 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85803d9e0 con 0x7fe86015cb60 2024-05-26T15:42:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.129+0000 7fe866c00640 1 -- 172.21.15.8:0/1148271482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8600c6d00 con 0x7fe86015cb60 2024-05-26T15:42:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.129+0000 7fe85d600640 1 -- 172.21.15.8:0/1148271482 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85803dd90 con 0x7fe86015cb60 2024-05-26T15:42:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.129+0000 7fe866c00640 1 -- 172.21.15.8:0/1148271482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8600c72c0 con 0x7fe86015cb60 2024-05-26T15:42:12.129 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.131+0000 7fe866c00640 1 -- 172.21.15.8:0/1148271482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8600c74b0 con 0x7fe86015cb60 2024-05-26T15:42:12.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.132+0000 7fe85d600640 1 -- 172.21.15.8:0/1148271482 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe85803b400 con 0x7fe86015cb60 2024-05-26T15:42:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.133+0000 7fe85d600640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe84006ac00 0x7fe84006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.133+0000 7fe85d600640 1 -- 172.21.15.8:0/1148271482 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe8580aa320 con 0x7fe86015cb60 2024-05-26T15:42:12.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.134+0000 7fe865800640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe84006ac00 0x7fe84006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.135+0000 7fe865800640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe84006ac00 0x7fe84006d0c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe854006fd0 tx=0x7fe854008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:12.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.137+0000 7fe85d600640 1 -- 172.21.15.8:0/1148271482 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe858075320 con 0x7fe86015cb60 2024-05-26T15:42:12.342 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.343+0000 7fe866c00640 1 -- 172.21.15.8:0/1148271482 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe86004e280 con 0x7fe86015cb60 2024-05-26T15:42:12.344 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.346+0000 7fe85d600640 1 -- 172.21.15.8:0/1148271482 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16223 (secure 0 0 0) 0x7fe858009510 con 0x7fe86015cb60 2024-05-26T15:42:12.345 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:12.345 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":54,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:42:11.449695+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:42:09.031612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-26T15:42:10.475864+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:42:12.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.348+0000 7fe866c00640 1 -- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe84006ac00 msgr2=0x7fe84006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:12.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.348+0000 7fe866c00640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe84006ac00 0x7fe84006d0c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe854006fd0 tx=0x7fe854008040 comp rx=0 tx=0).stop 2024-05-26T15:42:12.347 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.348+0000 7fe866c00640 1 -- 172.21.15.8:0/1148271482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86015cb60 msgr2=0x7fe86015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:12.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.348+0000 7fe866c00640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86015cb60 0x7fe86015e790 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe858034040 tx=0x7fe858004a40 comp rx=0 tx=0).stop 2024-05-26T15:42:12.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.349+0000 7fe866c00640 1 -- 172.21.15.8:0/1148271482 shutdown_connections 2024-05-26T15:42:12.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.349+0000 7fe866c00640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe86015cb60 0x7fe86015e790 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.349+0000 7fe866c00640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe8600cdde0 0x7fe8600c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.349+0000 7fe866c00640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe84006ac00 0x7fe84006d0c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.349+0000 7fe866c00640 1 --2- 172.21.15.8:0/1148271482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe8600b8470 0x7fe8600cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.349+0000 7fe866c00640 1 -- 172.21.15.8:0/1148271482 >> 172.21.15.8:0/1148271482 conn(0x7fe8600cf480 msgr2=0x7fe8600d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:12.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.349+0000 7fe866c00640 1 -- 172.21.15.8:0/1148271482 shutdown_connections 2024-05-26T15:42:12.348 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.349+0000 7fe866c00640 1 -- 172.21.15.8:0/1148271482 wait complete. 2024-05-26T15:42:12.367 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-26T15:42:12.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.588+0000 7fedcc400640 1 Processor -- start 2024-05-26T15:42:12.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.589+0000 7fedcc400640 1 -- start start 2024-05-26T15:42:12.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.590+0000 7fedcc400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fedc40cd910 0x7fedc40b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.590+0000 7fedcc400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40b1620 con 0x7fedc406e540 2024-05-26T15:42:12.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.590+0000 7fedcc400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40b1900 con 0x7fedc41596c0 2024-05-26T15:42:12.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.590+0000 7fedcc400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc40b1be0 con 0x7fedc40cd910 2024-05-26T15:42:12.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.591+0000 7fedc9000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fedc406e540 0x7fedc40b2c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51066/0 (socket says 172.21.15.8:51066) 2024-05-26T15:42:12.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.591+0000 7fedc9000640 1 -- 172.21.15.8:0/584265801 learned_addr learned my addr 172.21.15.8:0/584265801 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:12.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.591+0000 7fedca400640 1 --2- 172.21.15.8:0/584265801 >> v2:172.21.15.47:3300/0 conn(0x7fedc40cd910 0x7fedc40b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.591+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295547651 0 0) 0x7fedc40b1620 con 0x7fedc406e540 2024-05-26T15:42:12.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.591+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedac003520 con 0x7fedc406e540 2024-05-26T15:42:12.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1619745638 0 0) 0x7fedac003520 con 0x7fedc406e540 2024-05-26T15:42:12.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 >> v2:172.21.15.47:3300/0 conn(0x7fedc40cd910 msgr2=0x7fedc40b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:12.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 --2- 172.21.15.8:0/584265801 >> v2:172.21.15.47:3300/0 conn(0x7fedc40cd910 0x7fedc40b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 >> v1:172.21.15.47:6789/0 conn(0x7fedc41596c0 legacy=0x7fedc406de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40b1ec0 con 0x7fedc406e540 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fedb80019f0 con 0x7fedc406e540 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 >> v1:172.21.15.8:6789/0 conn(0x7fedc406e540 legacy=0x7fedc40b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedac003a30 0x7fedac003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedac0051d0 0x7fedac00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40b1be0 con 0x7fedac0047c0 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac00e310 con 0x7fedac003a30 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac00e4d0 con 0x7fedac0051d0 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc9000640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.592+0000 7fedc9a00640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedac003a30 0x7fedac003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.593+0000 7fedca400640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedac0051d0 0x7fedac00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.593+0000 7fedc9000640 1 -- 172.21.15.8:0/584265801 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedac0051d0 msgr2=0x7fedac00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:12.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.593+0000 7fedc9000640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedac0051d0 0x7fedac00db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.593+0000 7fedc9000640 1 -- 172.21.15.8:0/584265801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedac003a30 msgr2=0x7fedac003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:12.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.593+0000 7fedc9000640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedac003a30 0x7fedac003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.593+0000 7fedc9000640 1 -- 172.21.15.8:0/584265801 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac003520 con 0x7fedac0047c0 2024-05-26T15:42:12.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.593+0000 7fedca400640 1 -- 172.21.15.8:0/584265801 reap_dead start 2024-05-26T15:42:12.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.594+0000 7fedc9000640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedac004c40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fedb800a760 tx=0x7fedac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64365ebcca340a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:12.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.594+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb802b910 con 0x7fedac0047c0 2024-05-26T15:42:12.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.594+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb802ba70 con 0x7fedac0047c0 2024-05-26T15:42:12.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.594+0000 7fedc3e00640 1 -- 172.21.15.8:0/584265801 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb802bea0 con 0x7fedac0047c0 2024-05-26T15:42:12.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.595+0000 7fedcc400640 1 -- 172.21.15.8:0/584265801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 msgr2=0x7fedac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:12.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.595+0000 7fedcc400640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedac004c40 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fedb800a760 tx=0x7fedac0057f0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.595+0000 7fedcc400640 1 -- 172.21.15.8:0/584265801 shutdown_connections 2024-05-26T15:42:12.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.595+0000 7fedcc400640 1 --2- 172.21.15.8:0/584265801 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedac004c40 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.595+0000 7fedcc400640 1 -- 172.21.15.8:0/584265801 >> 172.21.15.8:0/584265801 conn(0x7fedc4069e70 msgr2=0x7fedc406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:12.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.595+0000 7fedcc400640 1 -- 172.21.15.8:0/584265801 shutdown_connections 2024-05-26T15:42:12.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.595+0000 7fedcc400640 1 -- 172.21.15.8:0/584265801 wait complete. 2024-05-26T15:42:12.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.597+0000 7fedcc400640 1 Processor -- start 2024-05-26T15:42:12.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.597+0000 7fedcc400640 1 -- start start 2024-05-26T15:42:12.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.598+0000 7fedcc400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedc40ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.598+0000 7fedcc400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedc4149d50 0x7fedc4149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.598+0000 7fedcc400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc414d210 0x7fedc414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.598+0000 7fedcc400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc414dbd0 con 0x7fedac0047c0 2024-05-26T15:42:12.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.598+0000 7fedcc400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40ae920 con 0x7fedc414d210 2024-05-26T15:42:12.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.598+0000 7fedcc400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40aec00 con 0x7fedc4149d50 2024-05-26T15:42:12.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.598+0000 7fedc9a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedc40ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.598+0000 7fedc9a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedc40ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32976/0 (socket says 172.21.15.8:32976) 2024-05-26T15:42:12.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.598+0000 7fedc9a00640 1 -- 172.21.15.8:0/3978725873 learned_addr learned my addr 172.21.15.8:0/3978725873 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:12.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.599+0000 7fedc9000640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedc4149d50 0x7fedc4149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.599+0000 7fedc9a00640 1 -- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedc4149d50 msgr2=0x7fedc4149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.599+0000 7fedc9a00640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedc4149d50 0x7fedc4149540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.599+0000 7fedca400640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc414d210 0x7fedc414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.599+0000 7fedc9a00640 1 -- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc414d210 msgr2=0x7fedc414d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.599+0000 7fedc9a00640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc414d210 0x7fedc414d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.599+0000 7fedc9a00640 1 -- 172.21.15.8:0/3978725873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40aeee0 con 0x7fedac0047c0 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.599+0000 7fedc9a00640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedc40ae0d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fedb400e4d0 tx=0x7fedb400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.599+0000 7fedc1600640 1 -- 172.21.15.8:0/3978725873 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb40052e0 con 0x7fedac0047c0 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.600+0000 7fedc1600640 1 -- 172.21.15.8:0/3978725873 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb4005440 con 0x7fedac0047c0 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.600+0000 7fedc1600640 1 -- 172.21.15.8:0/3978725873 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4003810 con 0x7fedac0047c0 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.600+0000 7fedcc400640 1 -- 172.21.15.8:0/3978725873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc40af1c0 con 0x7fedac0047c0 2024-05-26T15:42:12.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.600+0000 7fedcc400640 1 -- 172.21.15.8:0/3978725873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc40ae610 con 0x7fedac0047c0 2024-05-26T15:42:12.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.601+0000 7fedcc400640 1 -- 172.21.15.8:0/3978725873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc404e210 con 0x7fedac0047c0 2024-05-26T15:42:12.600 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.602+0000 7fedc1600640 1 -- 172.21.15.8:0/3978725873 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fedb4003970 con 0x7fedac0047c0 2024-05-26T15:42:12.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.603+0000 7fedc1600640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feda806ac00 0x7feda806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:12.601 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.603+0000 7fedc1600640 1 -- 172.21.15.8:0/3978725873 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fedb4089200 con 0x7fedac0047c0 2024-05-26T15:42:12.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.604+0000 7fedc9000640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feda806ac00 0x7feda806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:12.603 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.605+0000 7fedc9000640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feda806ac00 0x7feda806d0c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fedb8033000 tx=0x7fedb8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:12.605 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.607+0000 7fedc1600640 1 -- 172.21.15.8:0/3978725873 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fedb4054290 con 0x7fedac0047c0 2024-05-26T15:42:12.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:12.847+0000 7fedcc400640 1 -- 172.21.15.8:0/3978725873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fedc4071180 con 0x7fedac0047c0 2024-05-26T15:42:13.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.471+0000 7fedc1600640 1 -- 172.21.15.8:0/3978725873 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fedb40578b0 con 0x7fedac0047c0 2024-05-26T15:42:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.474+0000 7fedcc400640 1 -- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feda806ac00 msgr2=0x7feda806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.474+0000 7fedcc400640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feda806ac00 0x7feda806d0c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fedb8033000 tx=0x7fedb8009030 comp rx=0 tx=0).stop 2024-05-26T15:42:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.474+0000 7fedcc400640 1 -- 172.21.15.8:0/3978725873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 msgr2=0x7fedc40ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.474+0000 7fedcc400640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedc40ae0d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fedb400e4d0 tx=0x7fedb400e990 comp rx=0 tx=0).stop 2024-05-26T15:42:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.474+0000 7fedcc400640 1 -- 172.21.15.8:0/3978725873 shutdown_connections 2024-05-26T15:42:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.474+0000 7fedcc400640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feda806ac00 0x7feda806d0c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.475+0000 7fedcc400640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedc414d210 0x7fedc414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:13.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.475+0000 7fedcc400640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fedc4149d50 0x7fedc4149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:13.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.475+0000 7fedcc400640 1 --2- 172.21.15.8:0/3978725873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedac0047c0 0x7fedc40ae0d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:13.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.475+0000 7fedcc400640 1 -- 172.21.15.8:0/3978725873 >> 172.21.15.8:0/3978725873 conn(0x7fedc4069e70 msgr2=0x7fedc415d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:13.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.475+0000 7fedcc400640 1 -- 172.21.15.8:0/3978725873 shutdown_connections 2024-05-26T15:42:13.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.475+0000 7fedcc400640 1 -- 172.21.15.8:0/3978725873 wait complete. 2024-05-26T15:42:13.498 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-26T15:42:13.498 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-26T15:42:13.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.716+0000 7f0f61c00640 1 Processor -- start 2024-05-26T15:42:13.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.716+0000 7f0f61c00640 1 -- start start 2024-05-26T15:42:13.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.718+0000 7f0f61c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0f5c0cf360 0x7f0f5c0ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:13.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.718+0000 7f0f61c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 0x7f0f5c0cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:13.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.718+0000 7f0f61c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c0b09f0 con 0x7f0f5c15aa10 2024-05-26T15:42:13.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.718+0000 7f0f61c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c0cd9c0 con 0x7f0f5c0cf360 2024-05-26T15:42:13.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.718+0000 7f0f61c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c15adf0 con 0x7f0f5c0cd510 2024-05-26T15:42:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.719+0000 7f0f61200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 0x7f0f5c0cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.719+0000 7f0f61200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 0x7f0f5c0cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:47494/0 (socket says 172.21.15.8:47494) 2024-05-26T15:42:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.719+0000 7f0f61200640 1 -- 172.21.15.8:0/2175485094 learned_addr learned my addr 172.21.15.8:0/2175485094 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.719+0000 7f0f5be00640 1 --1- 172.21.15.8:0/2175485094 >> v1:172.21.15.47:6789/0 conn(0x7f0f5c15aa10 0x7f0f5c0b02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:33928/0 (socket says 172.21.15.8:33928) 2024-05-26T15:42:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.719+0000 7f0f5b400640 1 --2- 172.21.15.8:0/2175485094 >> v2:172.21.15.47:3300/0 conn(0x7f0f5c0cf360 0x7f0f5c0ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:13.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.720+0000 7f0f5b400640 1 -- 172.21.15.8:0/2175485094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 msgr2=0x7f0f5c0cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:13.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.720+0000 7f0f5b400640 1 --2- 172.21.15.8:0/2175485094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 0x7f0f5c0cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:13.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.720+0000 7f0f5b400640 1 -- 172.21.15.8:0/2175485094 >> v1:172.21.15.47:6789/0 conn(0x7f0f5c15aa10 legacy=0x7f0f5c0b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:13.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.720+0000 7f0f5b400640 1 -- 172.21.15.8:0/2175485094 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c0b0c50 con 0x7f0f5c0cf360 2024-05-26T15:42:13.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.721+0000 7f0f5b400640 1 --2- 172.21.15.8:0/2175485094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0cf360 0x7f0f5c0ccfd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0f480097a0 tx=0x7f0f4802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=117350cc0dae1285 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:13.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.722+0000 7f0f5aa00640 1 -- 172.21.15.8:0/2175485094 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48032440 con 0x7f0f5c0cf360 2024-05-26T15:42:13.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.722+0000 7f0f5aa00640 1 -- 172.21.15.8:0/2175485094 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f480325a0 con 0x7f0f5c0cf360 2024-05-26T15:42:13.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.722+0000 7f0f5aa00640 1 -- 172.21.15.8:0/2175485094 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48032930 con 0x7f0f5c0cf360 2024-05-26T15:42:13.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.723+0000 7f0f61c00640 1 -- 172.21.15.8:0/2175485094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0cf360 msgr2=0x7f0f5c0ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:13.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.723+0000 7f0f61c00640 1 --2- 172.21.15.8:0/2175485094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0cf360 0x7f0f5c0ccfd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0f480097a0 tx=0x7f0f4802a180 comp rx=0 tx=0).stop 2024-05-26T15:42:13.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.723+0000 7f0f61c00640 1 -- 172.21.15.8:0/2175485094 shutdown_connections 2024-05-26T15:42:13.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.723+0000 7f0f61c00640 1 --2- 172.21.15.8:0/2175485094 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 0x7f0f5c0cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.723+0000 7f0f61c00640 1 --2- 172.21.15.8:0/2175485094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0cf360 0x7f0f5c0ccfd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.723+0000 7f0f61c00640 1 -- 172.21.15.8:0/2175485094 >> 172.21.15.8:0/2175485094 conn(0x7f0f5c0d0670 msgr2=0x7f0f5c0d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.723+0000 7f0f61c00640 1 -- 172.21.15.8:0/2175485094 shutdown_connections 2024-05-26T15:42:13.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.723+0000 7f0f61c00640 1 -- 172.21.15.8:0/2175485094 wait complete. 2024-05-26T15:42:13.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.725+0000 7f0f61c00640 1 Processor -- start 2024-05-26T15:42:13.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.725+0000 7f0f61c00640 1 -- start start 2024-05-26T15:42:13.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.726+0000 7f0f61c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 0x7f0f5c152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.726+0000 7f0f61c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5c15aa10 0x7f0f5c0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.726+0000 7f0f61c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ca0b0 0x7f0f5c0c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.726+0000 7f0f61c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c15bd50 con 0x7f0f5c15aa10 2024-05-26T15:42:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.726+0000 7f0f61c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0b6230 con 0x7f0f5c0ca0b0 2024-05-26T15:42:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.726+0000 7f0f61c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0b5510 con 0x7f0f5c0cd510 2024-05-26T15:42:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.726+0000 7f0f5b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5c15aa10 0x7f0f5c0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.726+0000 7f0f5b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5c15aa10 0x7f0f5c0c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32984/0 (socket says 172.21.15.8:32984) 2024-05-26T15:42:13.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.726+0000 7f0f5b400640 1 -- 172.21.15.8:0/3970117912 learned_addr learned my addr 172.21.15.8:0/3970117912 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:13.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.727+0000 7f0f5be00640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 0x7f0f5c152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.727+0000 7f0f61200640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ca0b0 0x7f0f5c0c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.727+0000 7f0f5b400640 1 -- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 msgr2=0x7f0f5c152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.727+0000 7f0f5b400640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 0x7f0f5c152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.727+0000 7f0f5b400640 1 -- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ca0b0 msgr2=0x7f0f5c0c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.727+0000 7f0f5b400640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ca0b0 0x7f0f5c0c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.727+0000 7f0f5b400640 1 -- 172.21.15.8:0/3970117912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f48009400 con 0x7f0f5c15aa10 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.727+0000 7f0f61200640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ca0b0 0x7f0f5c0c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.727+0000 7f0f5b400640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5c15aa10 0x7f0f5c0c7740 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0f4802a770 tx=0x7f0f480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.728+0000 7f0f53e00640 1 -- 172.21.15.8:0/3970117912 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48030b00 con 0x7f0f5c15aa10 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.728+0000 7f0f53e00640 1 -- 172.21.15.8:0/3970117912 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f48030c80 con 0x7f0f5c15aa10 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.728+0000 7f0f61c00640 1 -- 172.21.15.8:0/3970117912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c15b420 con 0x7f0f5c15aa10 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.728+0000 7f0f53e00640 1 -- 172.21.15.8:0/3970117912 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4803c400 con 0x7f0f5c15aa10 2024-05-26T15:42:13.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.728+0000 7f0f61c00640 1 -- 172.21.15.8:0/3970117912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c15b9e0 con 0x7f0f5c15aa10 2024-05-26T15:42:13.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.729+0000 7f0f61c00640 1 -- 172.21.15.8:0/3970117912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c15bec0 con 0x7f0f5c15aa10 2024-05-26T15:42:13.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.730+0000 7f0f53e00640 1 -- 172.21.15.8:0/3970117912 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f4803c560 con 0x7f0f5c15aa10 2024-05-26T15:42:13.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.731+0000 7f0f53e00640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f3c06ac00 0x7f0f3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:13.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.731+0000 7f0f53e00640 1 -- 172.21.15.8:0/3970117912 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0f480aa330 con 0x7f0f5c15aa10 2024-05-26T15:42:13.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.732+0000 7f0f5be00640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f3c06ac00 0x7f0f3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:13.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.733+0000 7f0f5be00640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f3c06ac00 0x7f0f3c06d0c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c000f60 tx=0x7f0f4c007c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:13.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.736+0000 7f0f53e00640 1 -- 172.21.15.8:0/3970117912 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0f48075330 con 0x7f0f5c15aa10 2024-05-26T15:42:13.977 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:13.978+0000 7f0f61c00640 1 -- 172.21.15.8:0/3970117912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0f5c04e210 con 0x7f0f5c15aa10 2024-05-26T15:42:14.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.474+0000 7f0f53e00640 1 -- 172.21.15.8:0/3970117912 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0f48078950 con 0x7f0f5c15aa10 2024-05-26T15:42:14.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 -- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f3c06ac00 msgr2=0x7f0f3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:14.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f3c06ac00 0x7f0f3c06d0c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c000f60 tx=0x7f0f4c007c80 comp rx=0 tx=0).stop 2024-05-26T15:42:14.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 -- 172.21.15.8:0/3970117912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5c15aa10 msgr2=0x7f0f5c0c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:14.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5c15aa10 0x7f0f5c0c7740 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0f4802a770 tx=0x7f0f480046c0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 -- 172.21.15.8:0/3970117912 shutdown_connections 2024-05-26T15:42:14.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0f3c06ac00 0x7f0f3c06d0c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0f5c0ca0b0 0x7f0f5c0c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5c15aa10 0x7f0f5c0c7740 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 --2- 172.21.15.8:0/3970117912 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0f5c0cd510 0x7f0f5c152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 -- 172.21.15.8:0/3970117912 >> 172.21.15.8:0/3970117912 conn(0x7f0f5c0d0670 msgr2=0x7f0f5c06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:14.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 -- 172.21.15.8:0/3970117912 shutdown_connections 2024-05-26T15:42:14.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.479+0000 7f0f61c00640 1 -- 172.21.15.8:0/3970117912 wait complete. 2024-05-26T15:42:14.501 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-26T15:42:14.501 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:14.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.714+0000 7ff837e00640 1 Processor -- start 2024-05-26T15:42:14.713 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.714+0000 7ff837e00640 1 -- start start 2024-05-26T15:42:14.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.716+0000 7ff837e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830144530 0x7ff8300b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:14.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.716+0000 7ff837e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff830070d70 0x7ff8300cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:14.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.716+0000 7ff837e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300b1db0 con 0x7ff830144150 2024-05-26T15:42:14.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.716+0000 7ff837e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8300cc8f0 con 0x7ff830070d70 2024-05-26T15:42:14.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.716+0000 7ff837e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300cbac0 con 0x7ff830144530 2024-05-26T15:42:14.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.716+0000 7ff835e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff830070d70 0x7ff8300cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:14.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.716+0000 7ff835400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff830144150 0x7ff830070660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51070/0 (socket says 172.21.15.8:51070) 2024-05-26T15:42:14.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.716+0000 7ff835e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff830070d70 0x7ff8300cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32994/0 (socket says 172.21.15.8:32994) 2024-05-26T15:42:14.715 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.716+0000 7ff835400640 1 -- 172.21.15.8:0/3086249857 learned_addr learned my addr 172.21.15.8:0/3086249857 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:14.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.717+0000 7ff834a00640 1 --2- 172.21.15.8:0/3086249857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830144530 0x7ff8300b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:14.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.717+0000 7ff835e00640 1 -- 172.21.15.8:0/3086249857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830144530 msgr2=0x7ff8300b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:14.716 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.717+0000 7ff835e00640 1 --2- 172.21.15.8:0/3086249857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830144530 0x7ff8300b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.717+0000 7ff835e00640 1 -- 172.21.15.8:0/3086249857 >> v1:172.21.15.8:6789/0 conn(0x7ff830144150 legacy=0x7ff830070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.717+0000 7ff835e00640 1 -- 172.21.15.8:0/3086249857 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300ccb90 con 0x7ff830070d70 2024-05-26T15:42:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.717+0000 7ff834a00640 1 --2- 172.21.15.8:0/3086249857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830144530 0x7ff8300b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.718+0000 7ff835e00640 1 --2- 172.21.15.8:0/3086249857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830070d70 0x7ff8300cad90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff828009d90 tx=0x7ff82802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfe321c7f21e1d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.718+0000 7ff82fe00640 1 -- 172.21.15.8:0/3086249857 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828007740 con 0x7ff830070d70 2024-05-26T15:42:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.718+0000 7ff82fe00640 1 -- 172.21.15.8:0/3086249857 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82802d050 con 0x7ff830070d70 2024-05-26T15:42:14.717 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.718+0000 7ff82fe00640 1 -- 172.21.15.8:0/3086249857 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828007ac0 con 0x7ff830070d70 2024-05-26T15:42:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.719+0000 7ff837e00640 1 -- 172.21.15.8:0/3086249857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830070d70 msgr2=0x7ff8300cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.719+0000 7ff837e00640 1 --2- 172.21.15.8:0/3086249857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830070d70 0x7ff8300cad90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff828009d90 tx=0x7ff82802a660 comp rx=0 tx=0).stop 2024-05-26T15:42:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.719+0000 7ff837e00640 1 -- 172.21.15.8:0/3086249857 shutdown_connections 2024-05-26T15:42:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.719+0000 7ff837e00640 1 --2- 172.21.15.8:0/3086249857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830070d70 0x7ff8300cad90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.719+0000 7ff837e00640 1 --2- 172.21.15.8:0/3086249857 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830144530 0x7ff8300b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.719+0000 7ff837e00640 1 -- 172.21.15.8:0/3086249857 >> 172.21.15.8:0/3086249857 conn(0x7ff8300b0570 msgr2=0x7ff8300b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.719+0000 7ff837e00640 1 -- 172.21.15.8:0/3086249857 shutdown_connections 2024-05-26T15:42:14.718 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.719+0000 7ff837e00640 1 -- 172.21.15.8:0/3086249857 wait complete. 2024-05-26T15:42:14.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.721+0000 7ff837e00640 1 Processor -- start 2024-05-26T15:42:14.720 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.721+0000 7ff837e00640 1 -- start start 2024-05-26T15:42:14.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.723+0000 7ff837e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830070d70 0x7ff830139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:14.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.723+0000 7ff837e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830144150 0x7ff8300ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:14.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.723+0000 7ff837e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830144530 0x7ff830142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:14.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.723+0000 7ff837e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83013ad50 con 0x7ff830144530 2024-05-26T15:42:14.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.723+0000 7ff837e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83006cad0 con 0x7ff830144150 2024-05-26T15:42:14.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.723+0000 7ff837e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff830157910 con 0x7ff830070d70 2024-05-26T15:42:14.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.723+0000 7ff835e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830144530 0x7ff830142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:14.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.723+0000 7ff835e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830144530 0x7ff830142bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32998/0 (socket says 172.21.15.8:32998) 2024-05-26T15:42:14.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.723+0000 7ff835e00640 1 -- 172.21.15.8:0/2804708700 learned_addr learned my addr 172.21.15.8:0/2804708700 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:14.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.724+0000 7ff835400640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830070d70 0x7ff830139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:14.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.724+0000 7ff835e00640 1 -- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830070d70 msgr2=0x7ff830139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:14.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.724+0000 7ff834a00640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830144150 0x7ff8300ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:14.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.724+0000 7ff835e00640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830070d70 0x7ff830139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.724+0000 7ff835e00640 1 -- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830144150 msgr2=0x7ff8300ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:14.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.724+0000 7ff835e00640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830144150 0x7ff8300ac850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.724+0000 7ff835e00640 1 -- 172.21.15.8:0/2804708700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff828009a70 con 0x7ff830144530 2024-05-26T15:42:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.724+0000 7ff835e00640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830144530 0x7ff830142bf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff828009eb0 tx=0x7ff828004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.724+0000 7ff82d600640 1 -- 172.21.15.8:0/2804708700 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828031910 con 0x7ff830144530 2024-05-26T15:42:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.725+0000 7ff82d600640 1 -- 172.21.15.8:0/2804708700 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828031a70 con 0x7ff830144530 2024-05-26T15:42:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.725+0000 7ff82d600640 1 -- 172.21.15.8:0/2804708700 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828031de0 con 0x7ff830144530 2024-05-26T15:42:14.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.725+0000 7ff837e00640 1 -- 172.21.15.8:0/2804708700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff830157bf0 con 0x7ff830144530 2024-05-26T15:42:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.725+0000 7ff837e00640 1 -- 172.21.15.8:0/2804708700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83013a530 con 0x7ff830144530 2024-05-26T15:42:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.726+0000 7ff837e00640 1 -- 172.21.15.8:0/2804708700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83006cc80 con 0x7ff830144530 2024-05-26T15:42:14.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.727+0000 7ff82d600640 1 -- 172.21.15.8:0/2804708700 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff82803c420 con 0x7ff830144530 2024-05-26T15:42:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.728+0000 7ff82d600640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff81006ac30 0x7ff81006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:14.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.728+0000 7ff82d600640 1 -- 172.21.15.8:0/2804708700 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff8280aad10 con 0x7ff830144530 2024-05-26T15:42:14.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.729+0000 7ff835400640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff81006ac30 0x7ff81006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:14.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.730+0000 7ff835400640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff81006ac30 0x7ff81006d0f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff824005880 tx=0x7ff824009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:14.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.732+0000 7ff82d600640 1 -- 172.21.15.8:0/2804708700 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff83006cc80 con 0x7ff830144530 2024-05-26T15:42:14.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.975+0000 7ff837e00640 1 -- 172.21.15.8:0/2804708700 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff83006cc40 con 0x7ff830144530 2024-05-26T15:42:14.975 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.976+0000 7ff82d600640 1 -- 172.21.15.8:0/2804708700 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4728 (secure 0 0 0) 0x7ff828075c00 con 0x7ff830144530 2024-05-26T15:42:14.975 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:14.975 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3587572492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3587572492},{"type":"v1","addr":"172.21.15.47:6837","nonce":3587572492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1256296404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1256296404},{"type":"v1","addr":"172.21.15.8:6833","nonce":1256296404}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2317627606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2317627606},{"type":"v1","addr":"172.21.15.8:6835","nonce":2317627606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:14.468139+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5787},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5787":{"gid":5787,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6836/3388176100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3388176100},{"type":"v1","addr":"172.21.15.47:6836","nonce":3388176100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:14.975 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 32 2024-05-26T15:42:14.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.979+0000 7ff837e00640 1 -- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff81006ac30 msgr2=0x7ff81006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:14.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.979+0000 7ff837e00640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff81006ac30 0x7ff81006d0f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff824005880 tx=0x7ff824009040 comp rx=0 tx=0).stop 2024-05-26T15:42:14.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.979+0000 7ff837e00640 1 -- 172.21.15.8:0/2804708700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830144530 msgr2=0x7ff830142bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:14.978 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.979+0000 7ff837e00640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830144530 0x7ff830142bf0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff828009eb0 tx=0x7ff828004a40 comp rx=0 tx=0).stop 2024-05-26T15:42:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.980+0000 7ff837e00640 1 -- 172.21.15.8:0/2804708700 shutdown_connections 2024-05-26T15:42:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.980+0000 7ff837e00640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff830144530 0x7ff830142bf0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.980+0000 7ff837e00640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff81006ac30 0x7ff81006d0f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.980+0000 7ff837e00640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff830144150 0x7ff8300ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.980+0000 7ff837e00640 1 --2- 172.21.15.8:0/2804708700 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff830070d70 0x7ff830139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.980+0000 7ff837e00640 1 -- 172.21.15.8:0/2804708700 >> 172.21.15.8:0/2804708700 conn(0x7ff8300b0570 msgr2=0x7ff8300b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.980+0000 7ff837e00640 1 -- 172.21.15.8:0/2804708700 shutdown_connections 2024-05-26T15:42:14.979 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:14.980+0000 7ff837e00640 1 -- 172.21.15.8:0/2804708700 wait complete. 2024-05-26T15:42:14.999 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:42:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.213+0000 7f7f4b400640 1 Processor -- start 2024-05-26T15:42:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.213+0000 7f7f4b400640 1 -- start start 2024-05-26T15:42:15.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.215+0000 7f7f4b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7f44144150 0x7f7f440b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.215+0000 7f7f4b400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 0x7f7f440cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.215+0000 7f7f4b400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440b1db0 con 0x7f7f44144530 2024-05-26T15:42:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.215+0000 7f7f4b400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f440cc8f0 con 0x7f7f44144150 2024-05-26T15:42:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.215+0000 7f7f4b400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440cbac0 con 0x7f7f44070d70 2024-05-26T15:42:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.216+0000 7f7f49400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 0x7f7f440cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.216+0000 7f7f49400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 0x7f7f440cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:47526/0 (socket says 172.21.15.8:47526) 2024-05-26T15:42:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.216+0000 7f7f49400640 1 -- 172.21.15.8:0/2740682231 learned_addr learned my addr 172.21.15.8:0/2740682231 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.216+0000 7f7f48a00640 1 --2- 172.21.15.8:0/2740682231 >> v2:172.21.15.47:3300/0 conn(0x7f7f44144150 0x7f7f440b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.217+0000 7f7f49400640 1 -- 172.21.15.8:0/2740682231 >> v2:172.21.15.47:3300/0 conn(0x7f7f44144150 msgr2=0x7f7f440b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.217+0000 7f7f49400640 1 --2- 172.21.15.8:0/2740682231 >> v2:172.21.15.47:3300/0 conn(0x7f7f44144150 0x7f7f440b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.217+0000 7f7f49400640 1 -- 172.21.15.8:0/2740682231 >> v1:172.21.15.47:6789/0 conn(0x7f7f44144530 legacy=0x7f7f44070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.217+0000 7f7f49400640 1 -- 172.21.15.8:0/2740682231 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440ccb90 con 0x7f7f44070d70 2024-05-26T15:42:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.218+0000 7f7f49400640 1 --2- 172.21.15.8:0/2740682231 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 0x7f7f440cad90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009870 tx=0x7f7f3c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15cc354dcc4f6f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.219+0000 7f7f43400640 1 -- 172.21.15.8:0/2740682231 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c032440 con 0x7f7f44070d70 2024-05-26T15:42:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.219+0000 7f7f43400640 1 -- 172.21.15.8:0/2740682231 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c0325a0 con 0x7f7f44070d70 2024-05-26T15:42:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.219+0000 7f7f43400640 1 -- 172.21.15.8:0/2740682231 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c032930 con 0x7f7f44070d70 2024-05-26T15:42:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.220+0000 7f7f4b400640 1 -- 172.21.15.8:0/2740682231 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 msgr2=0x7f7f440cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.220+0000 7f7f4b400640 1 --2- 172.21.15.8:0/2740682231 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 0x7f7f440cad90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009870 tx=0x7f7f3c02a270 comp rx=0 tx=0).stop 2024-05-26T15:42:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.220+0000 7f7f4b400640 1 -- 172.21.15.8:0/2740682231 shutdown_connections 2024-05-26T15:42:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.220+0000 7f7f4b400640 1 --2- 172.21.15.8:0/2740682231 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 0x7f7f440cad90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.220+0000 7f7f4b400640 1 --2- 172.21.15.8:0/2740682231 >> v2:172.21.15.47:3300/0 conn(0x7f7f44144150 0x7f7f440b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.220+0000 7f7f4b400640 1 -- 172.21.15.8:0/2740682231 >> 172.21.15.8:0/2740682231 conn(0x7f7f440b0570 msgr2=0x7f7f440b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.220+0000 7f7f4b400640 1 -- 172.21.15.8:0/2740682231 shutdown_connections 2024-05-26T15:42:15.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.220+0000 7f7f4b400640 1 -- 172.21.15.8:0/2740682231 wait complete. 2024-05-26T15:42:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.222+0000 7f7f4b400640 1 Processor -- start 2024-05-26T15:42:15.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.222+0000 7f7f4b400640 1 -- start start 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.223+0000 7f7f4b400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 0x7f7f4413d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.223+0000 7f7f4b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f44144150 0x7f7f4414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.223+0000 7f7f4b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f44144530 0x7f7f4414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.223+0000 7f7f4b400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f44149ec0 con 0x7f7f44144150 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.223+0000 7f7f4b400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4414a1a0 con 0x7f7f44144530 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.223+0000 7f7f4b400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4414a480 con 0x7f7f44070d70 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.224+0000 7f7f43e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f44144150 0x7f7f4414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.224+0000 7f7f43e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f44144150 0x7f7f4414b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33010/0 (socket says 172.21.15.8:33010) 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.224+0000 7f7f43e00640 1 -- 172.21.15.8:0/1359151564 learned_addr learned my addr 172.21.15.8:0/1359151564 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.224+0000 7f7f49400640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f44144530 0x7f7f4414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.224+0000 7f7f48a00640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 0x7f7f4413d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.224+0000 7f7f43e00640 1 -- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 msgr2=0x7f7f4413d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.224+0000 7f7f43e00640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 0x7f7f4413d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.224+0000 7f7f43e00640 1 -- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f44144530 msgr2=0x7f7f4414b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.224+0000 7f7f43e00640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f44144530 0x7f7f4414b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.224+0000 7f7f43e00640 1 -- 172.21.15.8:0/1359151564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0094d0 con 0x7f7f44144150 2024-05-26T15:42:15.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.225+0000 7f7f43e00640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f44144150 0x7f7f4414b290 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000c730 tx=0x7f7f3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:15.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.225+0000 7f7f40c00640 1 -- 172.21.15.8:0/1359151564 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30003b70 con 0x7f7f44144150 2024-05-26T15:42:15.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.225+0000 7f7f40c00640 1 -- 172.21.15.8:0/1359151564 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f30003cf0 con 0x7f7f44144150 2024-05-26T15:42:15.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.225+0000 7f7f40c00640 1 -- 172.21.15.8:0/1359151564 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30003ea0 con 0x7f7f44144150 2024-05-26T15:42:15.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.225+0000 7f7f4b400640 1 -- 172.21.15.8:0/1359151564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4414a760 con 0x7f7f44144150 2024-05-26T15:42:15.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.225+0000 7f7f4b400640 1 -- 172.21.15.8:0/1359151564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4413d5b0 con 0x7f7f44144150 2024-05-26T15:42:15.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.226+0000 7f7f4b400640 1 -- 172.21.15.8:0/1359151564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4414ac80 con 0x7f7f44144150 2024-05-26T15:42:15.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.227+0000 7f7f40c00640 1 -- 172.21.15.8:0/1359151564 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f3000aa90 con 0x7f7f44144150 2024-05-26T15:42:15.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.229+0000 7f7f40c00640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f2406ac00 0x7f7f2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.229+0000 7f7f40c00640 1 -- 172.21.15.8:0/1359151564 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7f300893e0 con 0x7f7f44144150 2024-05-26T15:42:15.227 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.229+0000 7f7f48a00640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f2406ac00 0x7f7f2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.231+0000 7f7f48a00640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f2406ac00 0x7f7f2406d0c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009ad0 tx=0x7f7f34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:15.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.233+0000 7f7f40c00640 1 -- 172.21.15.8:0/1359151564 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7f4414ac80 con 0x7f7f44144150 2024-05-26T15:42:15.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.432+0000 7f7f4b400640 1 -- 172.21.15.8:0/1359151564 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f4414ac80 con 0x7f7f44144150 2024-05-26T15:42:15.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.435+0000 7f7f40c00640 1 -- 172.21.15.8:0/1359151564 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16210 (secure 0 0 0) 0x7f7f4414ac80 con 0x7f7f44144150 2024-05-26T15:42:15.434 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:15.434 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":55,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:42:12.455748+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:42:09.031612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-26T15:42:10.475864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:42:15.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.437+0000 7f7f4b400640 1 -- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f2406ac00 msgr2=0x7f7f2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.437+0000 7f7f4b400640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f2406ac00 0x7f7f2406d0c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009ad0 tx=0x7f7f34008040 comp rx=0 tx=0).stop 2024-05-26T15:42:15.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.437+0000 7f7f4b400640 1 -- 172.21.15.8:0/1359151564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f44144150 msgr2=0x7f7f4414b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.436 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.437+0000 7f7f4b400640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f44144150 0x7f7f4414b290 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7f3000c730 tx=0x7f7f3000cbf0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.438+0000 7f7f4b400640 1 -- 172.21.15.8:0/1359151564 shutdown_connections 2024-05-26T15:42:15.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.438+0000 7f7f4b400640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7f2406ac00 0x7f7f2406d0c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.438+0000 7f7f4b400640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f44144530 0x7f7f4414b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.438+0000 7f7f4b400640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7f44144150 0x7f7f4414b290 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.438+0000 7f7f4b400640 1 --2- 172.21.15.8:0/1359151564 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7f44070d70 0x7f7f4413d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.438+0000 7f7f4b400640 1 -- 172.21.15.8:0/1359151564 >> 172.21.15.8:0/1359151564 conn(0x7f7f440b0570 msgr2=0x7f7f44070660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:15.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.438+0000 7f7f4b400640 1 -- 172.21.15.8:0/1359151564 shutdown_connections 2024-05-26T15:42:15.437 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.438+0000 7f7f4b400640 1 -- 172.21.15.8:0/1359151564 wait complete. 2024-05-26T15:42:15.456 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-26T15:42:15.457 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:42:15.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.670+0000 7f917be00640 1 Processor -- start 2024-05-26T15:42:15.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.670+0000 7f917be00640 1 -- start start 2024-05-26T15:42:15.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.672+0000 7f917be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f917c0b0f60 0x7f917c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.672+0000 7f917be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f917c15f0c0 0x7f917c0c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.672+0000 7f917be00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c15b640 con 0x7f917c154f50 2024-05-26T15:42:15.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.672+0000 7f917be00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c15bee0 con 0x7f917c0b0f60 2024-05-26T15:42:15.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.672+0000 7f917be00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0b0ba0 con 0x7f917c15f0c0 2024-05-26T15:42:15.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.672+0000 7f917a000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f917c0b0f60 0x7f917c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.672+0000 7f917aa00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f917c154f50 0x7f917c15ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51078/0 (socket says 172.21.15.8:51078) 2024-05-26T15:42:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.672+0000 7f917aa00640 1 -- 172.21.15.8:0/841701883 learned_addr learned my addr 172.21.15.8:0/841701883 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.673+0000 7f917b400640 1 --2- 172.21.15.8:0/841701883 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f917c15f0c0 0x7f917c0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.673+0000 7f917a000640 1 -- 172.21.15.8:0/841701883 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f917c15f0c0 msgr2=0x7f917c0c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.673+0000 7f917a000640 1 --2- 172.21.15.8:0/841701883 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f917c15f0c0 0x7f917c0c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.673+0000 7f917a000640 1 -- 172.21.15.8:0/841701883 >> v1:172.21.15.8:6789/0 conn(0x7f917c154f50 legacy=0x7f917c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.673+0000 7f917a000640 1 -- 172.21.15.8:0/841701883 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c15b920 con 0x7f917c0b0f60 2024-05-26T15:42:15.672 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.673+0000 7f9179600640 1 -- 172.21.15.8:0/841701883 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930472537 0 0) 0x7f917c15b640 con 0x7f917c154f50 2024-05-26T15:42:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.674+0000 7f917a000640 1 --2- 172.21.15.8:0/841701883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c0b0f60 0x7f917c15eb80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f91680097d0 tx=0x7f916802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4be753b750ec069 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.675+0000 7f9179600640 1 -- 172.21.15.8:0/841701883 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916802ae40 con 0x7f917c0b0f60 2024-05-26T15:42:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.675+0000 7f9179600640 1 -- 172.21.15.8:0/841701883 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9168032440 con 0x7f917c0b0f60 2024-05-26T15:42:15.673 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.675+0000 7f9179600640 1 -- 172.21.15.8:0/841701883 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91680327d0 con 0x7f917c0b0f60 2024-05-26T15:42:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.675+0000 7f917be00640 1 -- 172.21.15.8:0/841701883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c0b0f60 msgr2=0x7f917c15eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.675+0000 7f917be00640 1 --2- 172.21.15.8:0/841701883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c0b0f60 0x7f917c15eb80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f91680097d0 tx=0x7f916802a130 comp rx=0 tx=0).stop 2024-05-26T15:42:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.676+0000 7f917be00640 1 -- 172.21.15.8:0/841701883 shutdown_connections 2024-05-26T15:42:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.676+0000 7f917be00640 1 --2- 172.21.15.8:0/841701883 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f917c15f0c0 0x7f917c0c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.676+0000 7f917be00640 1 --2- 172.21.15.8:0/841701883 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c0b0f60 0x7f917c15eb80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.676+0000 7f917be00640 1 -- 172.21.15.8:0/841701883 >> 172.21.15.8:0/841701883 conn(0x7f917c070480 msgr2=0x7f917c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:15.674 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.676+0000 7f917be00640 1 -- 172.21.15.8:0/841701883 shutdown_connections 2024-05-26T15:42:15.675 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.676+0000 7f917be00640 1 -- 172.21.15.8:0/841701883 wait complete. 2024-05-26T15:42:15.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.677+0000 7f917be00640 1 Processor -- start 2024-05-26T15:42:15.676 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.678+0000 7f917be00640 1 -- start start 2024-05-26T15:42:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.678+0000 7f917be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f917c0b0f60 0x7f917c149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f917c154f50 0x7f917c1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c15f0c0 0x7f917c159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.679 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c14f090 con 0x7f917c15f0c0 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c14ead0 con 0x7f917c0b0f60 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917be00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c14edb0 con 0x7f917c154f50 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c15f0c0 0x7f917c159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c15f0c0 0x7f917c159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33042/0 (socket says 172.21.15.8:33042) 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917b400640 1 -- 172.21.15.8:0/2067488224 learned_addr learned my addr 172.21.15.8:0/2067488224 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917a000640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f917c154f50 0x7f917c1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917aa00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f917c0b0f60 0x7f917c149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917b400640 1 -- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f917c154f50 msgr2=0x7f917c1598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917b400640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f917c154f50 0x7f917c1598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917b400640 1 -- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f917c0b0f60 msgr2=0x7f917c149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917b400640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f917c0b0f60 0x7f917c149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917b400640 1 -- 172.21.15.8:0/2067488224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9168009400 con 0x7f917c15f0c0 2024-05-26T15:42:15.680 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.679+0000 7f917aa00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f917c0b0f60 0x7f917c149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.680+0000 7f917b400640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c15f0c0 0x7f917c159e00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9174007e60 tx=0x7f917400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.680+0000 7f9172a00640 1 -- 172.21.15.8:0/2067488224 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174014420 con 0x7f917c15f0c0 2024-05-26T15:42:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.680+0000 7f9172a00640 1 -- 172.21.15.8:0/2067488224 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91740145a0 con 0x7f917c15f0c0 2024-05-26T15:42:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.680+0000 7f9172a00640 1 -- 172.21.15.8:0/2067488224 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174014950 con 0x7f917c15f0c0 2024-05-26T15:42:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.680+0000 7f917be00640 1 -- 172.21.15.8:0/2067488224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c0cb2d0 con 0x7f917c15f0c0 2024-05-26T15:42:15.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.680+0000 7f917be00640 1 -- 172.21.15.8:0/2067488224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c14dda0 con 0x7f917c15f0c0 2024-05-26T15:42:15.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.682+0000 7f917be00640 1 -- 172.21.15.8:0/2067488224 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c0cb7f0 con 0x7f917c15f0c0 2024-05-26T15:42:15.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.683+0000 7f9172a00640 1 -- 172.21.15.8:0/2067488224 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9174014ab0 con 0x7f917c15f0c0 2024-05-26T15:42:15.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.683+0000 7f9172a00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f915c06ac00 0x7f915c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:15.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.684+0000 7f9172a00640 1 -- 172.21.15.8:0/2067488224 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9174089db0 con 0x7f917c15f0c0 2024-05-26T15:42:15.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.684+0000 7f917aa00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f915c06ac00 0x7f915c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:15.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.685+0000 7f917aa00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f915c06ac00 0x7f915c06d0c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f916c000f60 tx=0x7f916c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:15.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.688+0000 7f9172a00640 1 -- 172.21.15.8:0/2067488224 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f917c0cb7f0 con 0x7f917c15f0c0 2024-05-26T15:42:15.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.882+0000 7f917be00640 1 -- 172.21.15.8:0/2067488224 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f917c155330 con 0x7f915c06ac00 2024-05-26T15:42:15.904 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.906+0000 7f9172a00640 1 -- 172.21.15.8:0/2067488224 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283684 (secure 0 0 0) 0x7f916c0013d0 con 0x7f915c06ac00 2024-05-26T15:42:15.909 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:15.911 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:42:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 -- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f915c06ac00 msgr2=0x7f915c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f915c06ac00 0x7f915c06d0c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f916c000f60 tx=0x7f916c009040 comp rx=0 tx=0).stop 2024-05-26T15:42:15.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 -- 172.21.15.8:0/2067488224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c15f0c0 msgr2=0x7f917c159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c15f0c0 0x7f917c159e00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9174007e60 tx=0x7f917400e4b0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 -- 172.21.15.8:0/2067488224 shutdown_connections 2024-05-26T15:42:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f917c15f0c0 0x7f917c159e00 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f917c154f50 0x7f917c1598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f915c06ac00 0x7f915c06d0c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 --2- 172.21.15.8:0/2067488224 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f917c0b0f60 0x7f917c149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 -- 172.21.15.8:0/2067488224 >> 172.21.15.8:0/2067488224 conn(0x7f917c070480 msgr2=0x7f917c070860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 -- 172.21.15.8:0/2067488224 shutdown_connections 2024-05-26T15:42:15.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:15.913+0000 7f917be00640 1 -- 172.21.15.8:0/2067488224 wait complete. 2024-05-26T15:42:15.923 INFO:tasks.ceph.mds.b.smithi047.stderr:2024-05-26T15:42:15.925+0000 7f76b1800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-26T15:42:15.933 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-05-26T15:42:14.220902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254908,"kb_used_data":5980,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754719812,"statfs":{"total":773094113280,"available":772833087488,"internally_reserved":0,"allocated":6123520,"data_stored":3363839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.271005"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974058+0000","last_change":"2024-05-26T15:42:10.974058+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974058+0000","last_undegraded":"2024-05-26T15:42:10.974058+0000","last_fullsized":"2024-05-26T15:42:10.974058+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:14:28.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988946+0000","last_change":"2024-05-26T15:42:10.988946+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988946+0000","last_undegraded":"2024-05-26T15:42:10.988946+0000","last_fullsized":"2024-05-26T15:42:10.988946+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:03:47.944320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.976785+0000","last_change":"2024-05-26T15:42:10.976785+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.976785+0000","last_undegraded":"2024-05-26T15:42:10.976785+0000","last_fullsized":"2024-05-26T15:42:10.976785+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:26:52.879894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.987272+0000","last_change":"2024-05-26T15:42:10.987272+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.987272+0000","last_undegraded":"2024-05-26T15:42:10.987272+0000","last_fullsized":"2024-05-26T15:42:10.987272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974140+0000","last_change":"2024-05-26T15:42:10.974140+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974140+0000","last_undegraded":"2024-05-26T15:42:10.974140+0000","last_fullsized":"2024-05-26T15:42:10.974140+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974243+0000","last_change":"2024-05-26T15:42:10.974243+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974243+0000","last_undegraded":"2024-05-26T15:42:10.974243+0000","last_fullsized":"2024-05-26T15:42:10.974243+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977844+0000","last_change":"2024-05-26T15:42:10.977844+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977844+0000","last_undegraded":"2024-05-26T15:42:10.977844+0000","last_fullsized":"2024-05-26T15:42:10.977844+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:47:58.290205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975812+0000","last_change":"2024-05-26T15:42:10.975812+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975812+0000","last_undegraded":"2024-05-26T15:42:10.975812+0000","last_fullsized":"2024-05-26T15:42:10.975812+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:49.249092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.986295+0000","last_change":"2024-05-26T15:42:10.986295+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.986295+0000","last_undegraded":"2024-05-26T15:42:10.986295+0000","last_fullsized":"2024-05-26T15:42:10.986295+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:26:49.715010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971434+0000","last_change":"2024-05-26T15:42:10.971434+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971434+0000","last_undegraded":"2024-05-26T15:42:10.971434+0000","last_fullsized":"2024-05-26T15:42:10.971434+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:06:39.785296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971784+0000","last_change":"2024-05-26T15:42:10.971784+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971784+0000","last_undegraded":"2024-05-26T15:42:10.971784+0000","last_fullsized":"2024-05-26T15:42:10.971784+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:13:27.388279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.983781+0000","last_change":"2024-05-26T15:42:10.983781+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.983781+0000","last_undegraded":"2024-05-26T15:42:10.983781+0000","last_fullsized":"2024-05-26T15:42:10.983781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:00:13.066137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971976+0000","last_change":"2024-05-26T15:42:10.971976+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971976+0000","last_undegraded":"2024-05-26T15:42:10.971976+0000","last_fullsized":"2024-05-26T15:42:10.971976+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:48:48.284704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975266+0000","last_change":"2024-05-26T15:42:10.975266+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975266+0000","last_undegraded":"2024-05-26T15:42:10.975266+0000","last_fullsized":"2024-05-26T15:42:10.975266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:43.290565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.982157+0000","last_change":"2024-05-26T15:42:10.982157+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.982157+0000","last_undegraded":"2024-05-26T15:42:10.982157+0000","last_fullsized":"2024-05-26T15:42:10.982157+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.969404+0000","last_change":"2024-05-26T15:42:10.969404+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.969404+0000","last_undegraded":"2024-05-26T15:42:10.969404+0000","last_fullsized":"2024-05-26T15:42:10.969404+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.978129+0000","last_change":"2024-05-26T15:42:10.978129+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.978129+0000","last_undegraded":"2024-05-26T15:42:10.978129+0000","last_fullsized":"2024-05-26T15:42:10.978129+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:05:26.003496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988452+0000","last_change":"2024-05-26T15:42:10.988452+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988452+0000","last_undegraded":"2024-05-26T15:42:10.988452+0000","last_fullsized":"2024-05-26T15:42:10.988452+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.973475+0000","last_change":"2024-05-26T15:42:10.973475+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.973475+0000","last_undegraded":"2024-05-26T15:42:10.973475+0000","last_fullsized":"2024-05-26T15:42:10.973475+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:34:54.694204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.979922+0000","last_change":"2024-05-26T15:42:10.979922+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.979922+0000","last_undegraded":"2024-05-26T15:42:10.979922+0000","last_fullsized":"2024-05-26T15:42:10.979922+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.976550+0000","last_change":"2024-05-26T15:42:10.976550+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.976550+0000","last_undegraded":"2024-05-26T15:42:10.976550+0000","last_fullsized":"2024-05-26T15:42:10.976550+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977961+0000","last_change":"2024-05-26T15:42:10.977961+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977961+0000","last_undegraded":"2024-05-26T15:42:10.977961+0000","last_fullsized":"2024-05-26T15:42:10.977961+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:38:38.915738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.970017+0000","last_change":"2024-05-26T15:42:10.970017+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.970017+0000","last_undegraded":"2024-05-26T15:42:10.970017+0000","last_fullsized":"2024-05-26T15:42:10.970017+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:51:09.231165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.972288+0000","last_change":"2024-05-26T15:42:10.972288+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.972288+0000","last_undegraded":"2024-05-26T15:42:10.972288+0000","last_fullsized":"2024-05-26T15:42:10.972288+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:10:03.718462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975622+0000","last_change":"2024-05-26T15:42:10.975622+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975622+0000","last_undegraded":"2024-05-26T15:42:10.975622+0000","last_fullsized":"2024-05-26T15:42:10.975622+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977727+0000","last_change":"2024-05-26T15:42:10.977727+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977727+0000","last_undegraded":"2024-05-26T15:42:10.977727+0000","last_fullsized":"2024-05-26T15:42:10.977727+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:59.291291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.970363+0000","last_change":"2024-05-26T15:42:10.970363+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.970363+0000","last_undegraded":"2024-05-26T15:42:10.970363+0000","last_fullsized":"2024-05-26T15:42:10.970363+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977942+0000","last_change":"2024-05-26T15:42:10.977942+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977942+0000","last_undegraded":"2024-05-26T15:42:10.977942+0000","last_fullsized":"2024-05-26T15:42:10.977942+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971202+0000","last_change":"2024-05-26T15:42:10.971202+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971202+0000","last_undegraded":"2024-05-26T15:42:10.971202+0000","last_fullsized":"2024-05-26T15:42:10.971202+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:42:35.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.979756+0000","last_change":"2024-05-26T15:42:10.979756+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.979756+0000","last_undegraded":"2024-05-26T15:42:10.979756+0000","last_fullsized":"2024-05-26T15:42:10.979756+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975086+0000","last_change":"2024-05-26T15:42:10.975086+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975086+0000","last_undegraded":"2024-05-26T15:42:10.975086+0000","last_fullsized":"2024-05-26T15:42:10.975086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:16:26.570143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.965441+0000","last_change":"2024-05-26T15:42:10.965441+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.965441+0000","last_undegraded":"2024-05-26T15:42:10.965441+0000","last_fullsized":"2024-05-26T15:42:10.965441+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.984759+0000","last_change":"2024-05-26T15:42:10.984759+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.984759+0000","last_undegraded":"2024-05-26T15:42:10.984759+0000","last_fullsized":"2024-05-26T15:42:10.984759+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999898+0000","last_change":"2024-05-26T15:42:10.994305+0000","last_active":"2024-05-26T15:42:10.999898+0000","last_peered":"2024-05-26T15:42:10.999898+0000","last_clean":"2024-05-26T15:42:10.999898+0000","last_became_active":"2024-05-26T15:42:10.992501+0000","last_became_peered":"2024-05-26T15:42:10.992501+0000","last_unstale":"2024-05-26T15:42:10.999898+0000","last_undegraded":"2024-05-26T15:42:10.999898+0000","last_fullsized":"2024-05-26T15:42:10.999898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.963244+0000","last_change":"2024-05-26T15:42:10.963244+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.963244+0000","last_undegraded":"2024-05-26T15:42:10.963244+0000","last_fullsized":"2024-05-26T15:42:10.963244+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.990548+0000","last_change":"2024-05-26T15:42:10.988783+0000","last_active":"2024-05-26T15:42:10.990548+0000","last_peered":"2024-05-26T15:42:10.990548+0000","last_clean":"2024-05-26T15:42:10.990548+0000","last_became_active":"2024-05-26T15:42:10.987904+0000","last_became_peered":"2024-05-26T15:42:10.987904+0000","last_unstale":"2024-05-26T15:42:10.990548+0000","last_undegraded":"2024-05-26T15:42:10.990548+0000","last_fullsized":"2024-05-26T15:42:10.990548+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:28:20.962641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974455+0000","last_change":"2024-05-26T15:42:10.974455+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974455+0000","last_undegraded":"2024-05-26T15:42:10.974455+0000","last_fullsized":"2024-05-26T15:42:10.974455+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.996224+0000","last_change":"2024-05-26T15:42:10.990216+0000","last_active":"2024-05-26T15:42:10.996224+0000","last_peered":"2024-05-26T15:42:10.996224+0000","last_clean":"2024-05-26T15:42:10.996224+0000","last_became_active":"2024-05-26T15:42:10.988791+0000","last_became_peered":"2024-05-26T15:42:10.988791+0000","last_unstale":"2024-05-26T15:42:10.996224+0000","last_undegraded":"2024-05-26T15:42:10.996224+0000","last_fullsized":"2024-05-26T15:42:10.996224+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.979694+0000","last_change":"2024-05-26T15:42:10.979694+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.979694+0000","last_undegraded":"2024-05-26T15:42:10.979694+0000","last_fullsized":"2024-05-26T15:42:10.979694+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:54:37.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997016+0000","last_change":"2024-05-26T15:42:10.993769+0000","last_active":"2024-05-26T15:42:10.997016+0000","last_peered":"2024-05-26T15:42:10.997016+0000","last_clean":"2024-05-26T15:42:10.997016+0000","last_became_active":"2024-05-26T15:42:10.993475+0000","last_became_peered":"2024-05-26T15:42:10.993475+0000","last_unstale":"2024-05-26T15:42:10.997016+0000","last_undegraded":"2024-05-26T15:42:10.997016+0000","last_fullsized":"2024-05-26T15:42:10.997016+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:42.382894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974867+0000","last_change":"2024-05-26T15:42:10.974867+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974867+0000","last_undegraded":"2024-05-26T15:42:10.974867+0000","last_fullsized":"2024-05-26T15:42:10.974867+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.986886+0000","last_change":"2024-05-26T15:42:10.984163+0000","last_active":"2024-05-26T15:42:10.986886+0000","last_peered":"2024-05-26T15:42:10.986886+0000","last_clean":"2024-05-26T15:42:10.986886+0000","last_became_active":"2024-05-26T15:42:10.982899+0000","last_became_peered":"2024-05-26T15:42:10.982899+0000","last_unstale":"2024-05-26T15:42:10.986886+0000","last_undegraded":"2024-05-26T15:42:10.986886+0000","last_fullsized":"2024-05-26T15:42:10.986886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.986730+0000","last_change":"2024-05-26T15:42:10.986730+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.986730+0000","last_undegraded":"2024-05-26T15:42:10.986730+0000","last_fullsized":"2024-05-26T15:42:10.986730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.993901+0000","last_change":"2024-05-26T15:42:10.990225+0000","last_active":"2024-05-26T15:42:10.993901+0000","last_peered":"2024-05-26T15:42:10.993901+0000","last_clean":"2024-05-26T15:42:10.993901+0000","last_became_active":"2024-05-26T15:42:10.989032+0000","last_became_peered":"2024-05-26T15:42:10.989032+0000","last_unstale":"2024-05-26T15:42:10.993901+0000","last_undegraded":"2024-05-26T15:42:10.993901+0000","last_fullsized":"2024-05-26T15:42:10.993901+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:04.490649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.976258+0000","last_change":"2024-05-26T15:42:10.976258+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.976258+0000","last_undegraded":"2024-05-26T15:42:10.976258+0000","last_fullsized":"2024-05-26T15:42:10.976258+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999554+0000","last_change":"2024-05-26T15:42:10.993335+0000","last_active":"2024-05-26T15:42:10.999554+0000","last_peered":"2024-05-26T15:42:10.999554+0000","last_clean":"2024-05-26T15:42:10.999554+0000","last_became_active":"2024-05-26T15:42:10.992580+0000","last_became_peered":"2024-05-26T15:42:10.992580+0000","last_unstale":"2024-05-26T15:42:10.999554+0000","last_undegraded":"2024-05-26T15:42:10.999554+0000","last_fullsized":"2024-05-26T15:42:10.999554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:28:20.962641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988191+0000","last_change":"2024-05-26T15:42:10.988191+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988191+0000","last_undegraded":"2024-05-26T15:42:10.988191+0000","last_fullsized":"2024-05-26T15:42:10.988191+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.989009+0000","last_change":"2024-05-26T15:42:10.985611+0000","last_active":"2024-05-26T15:42:10.989009+0000","last_peered":"2024-05-26T15:42:10.989009+0000","last_clean":"2024-05-26T15:42:10.989009+0000","last_became_active":"2024-05-26T15:42:10.985306+0000","last_became_peered":"2024-05-26T15:42:10.985306+0000","last_unstale":"2024-05-26T15:42:10.989009+0000","last_undegraded":"2024-05-26T15:42:10.989009+0000","last_fullsized":"2024-05-26T15:42:10.989009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:42.382894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.972322+0000","last_change":"2024-05-26T15:42:10.972322+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.972322+0000","last_undegraded":"2024-05-26T15:42:10.972322+0000","last_fullsized":"2024-05-26T15:42:10.972322+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001352+0000","last_change":"2024-05-26T15:42:11.000242+0000","last_active":"2024-05-26T15:42:11.001352+0000","last_peered":"2024-05-26T15:42:11.001352+0000","last_clean":"2024-05-26T15:42:11.001352+0000","last_became_active":"2024-05-26T15:42:10.999921+0000","last_became_peered":"2024-05-26T15:42:10.999921+0000","last_unstale":"2024-05-26T15:42:11.001352+0000","last_undegraded":"2024-05-26T15:42:11.001352+0000","last_fullsized":"2024-05-26T15:42:11.001352+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:47:33.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.965601+0000","last_change":"2024-05-26T15:42:10.965601+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.965601+0000","last_undegraded":"2024-05-26T15:42:10.965601+0000","last_fullsized":"2024-05-26T15:42:10.965601+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.991937+0000","last_change":"2024-05-26T15:42:10.988391+0000","last_active":"2024-05-26T15:42:10.991937+0000","last_peered":"2024-05-26T15:42:10.991937+0000","last_clean":"2024-05-26T15:42:10.991937+0000","last_became_active":"2024-05-26T15:42:10.987480+0000","last_became_peered":"2024-05-26T15:42:10.987480+0000","last_unstale":"2024-05-26T15:42:10.991937+0000","last_undegraded":"2024-05-26T15:42:10.991937+0000","last_fullsized":"2024-05-26T15:42:10.991937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.970692+0000","last_change":"2024-05-26T15:42:10.970692+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.970692+0000","last_undegraded":"2024-05-26T15:42:10.970692+0000","last_fullsized":"2024-05-26T15:42:10.970692+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:11:38.601829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001000+0000","last_change":"2024-05-26T15:42:10.998727+0000","last_active":"2024-05-26T15:42:11.001000+0000","last_peered":"2024-05-26T15:42:11.001000+0000","last_clean":"2024-05-26T15:42:11.001000+0000","last_became_active":"2024-05-26T15:42:10.998442+0000","last_became_peered":"2024-05-26T15:42:10.998442+0000","last_unstale":"2024-05-26T15:42:11.001000+0000","last_undegraded":"2024-05-26T15:42:11.001000+0000","last_fullsized":"2024-05-26T15:42:11.001000+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.972823+0000","last_change":"2024-05-26T15:42:10.972823+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.972823+0000","last_undegraded":"2024-05-26T15:42:10.972823+0000","last_fullsized":"2024-05-26T15:42:10.972823+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.998700+0000","last_change":"2024-05-26T15:42:10.992839+0000","last_active":"2024-05-26T15:42:10.998700+0000","last_peered":"2024-05-26T15:42:10.998700+0000","last_clean":"2024-05-26T15:42:10.998700+0000","last_became_active":"2024-05-26T15:42:10.992579+0000","last_became_peered":"2024-05-26T15:42:10.992579+0000","last_unstale":"2024-05-26T15:42:10.998700+0000","last_undegraded":"2024-05-26T15:42:10.998700+0000","last_fullsized":"2024-05-26T15:42:10.998700+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:42.284507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.965840+0000","last_change":"2024-05-26T15:42:10.965840+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.965840+0000","last_undegraded":"2024-05-26T15:42:10.965840+0000","last_fullsized":"2024-05-26T15:42:10.965840+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999433+0000","last_change":"2024-05-26T15:42:10.997701+0000","last_active":"2024-05-26T15:42:10.999433+0000","last_peered":"2024-05-26T15:42:10.999433+0000","last_clean":"2024-05-26T15:42:10.999433+0000","last_became_active":"2024-05-26T15:42:10.997346+0000","last_became_peered":"2024-05-26T15:42:10.997346+0000","last_unstale":"2024-05-26T15:42:10.999433+0000","last_undegraded":"2024-05-26T15:42:10.999433+0000","last_fullsized":"2024-05-26T15:42:10.999433+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:33.637114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971101+0000","last_change":"2024-05-26T15:42:10.971101+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971101+0000","last_undegraded":"2024-05-26T15:42:10.971101+0000","last_fullsized":"2024-05-26T15:42:10.971101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:12:21.904002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997217+0000","last_change":"2024-05-26T15:42:10.991731+0000","last_active":"2024-05-26T15:42:10.997217+0000","last_peered":"2024-05-26T15:42:10.997217+0000","last_clean":"2024-05-26T15:42:10.997217+0000","last_became_active":"2024-05-26T15:42:10.991441+0000","last_became_peered":"2024-05-26T15:42:10.991441+0000","last_unstale":"2024-05-26T15:42:10.997217+0000","last_undegraded":"2024-05-26T15:42:10.997217+0000","last_fullsized":"2024-05-26T15:42:10.997217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:42:08.139990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977096+0000","last_change":"2024-05-26T15:42:10.977096+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977096+0000","last_undegraded":"2024-05-26T15:42:10.977096+0000","last_fullsized":"2024-05-26T15:42:10.977096+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:16:18.154776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000959+0000","last_change":"2024-05-26T15:42:10.998347+0000","last_active":"2024-05-26T15:42:11.000959+0000","last_peered":"2024-05-26T15:42:11.000959+0000","last_clean":"2024-05-26T15:42:11.000959+0000","last_became_active":"2024-05-26T15:42:10.998044+0000","last_became_peered":"2024-05-26T15:42:10.998044+0000","last_unstale":"2024-05-26T15:42:11.000959+0000","last_undegraded":"2024-05-26T15:42:11.000959+0000","last_fullsized":"2024-05-26T15:42:11.000959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:29:49.530204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974584+0000","last_change":"2024-05-26T15:42:10.974584+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974584+0000","last_undegraded":"2024-05-26T15:42:10.974584+0000","last_fullsized":"2024-05-26T15:42:10.974584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:04:06.159661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.993130+0000","last_change":"2024-05-26T15:42:10.986901+0000","last_active":"2024-05-26T15:42:10.993130+0000","last_peered":"2024-05-26T15:42:10.993130+0000","last_clean":"2024-05-26T15:42:10.993130+0000","last_became_active":"2024-05-26T15:42:10.986607+0000","last_became_peered":"2024-05-26T15:42:10.986607+0000","last_unstale":"2024-05-26T15:42:10.993130+0000","last_undegraded":"2024-05-26T15:42:10.993130+0000","last_fullsized":"2024-05-26T15:42:10.993130+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:34:53.688146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975208+0000","last_change":"2024-05-26T15:42:10.975208+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975208+0000","last_undegraded":"2024-05-26T15:42:10.975208+0000","last_fullsized":"2024-05-26T15:42:10.975208+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:54:36.629232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001369+0000","last_change":"2024-05-26T15:42:10.998759+0000","last_active":"2024-05-26T15:42:11.001369+0000","last_peered":"2024-05-26T15:42:11.001369+0000","last_clean":"2024-05-26T15:42:11.001369+0000","last_became_active":"2024-05-26T15:42:10.997608+0000","last_became_peered":"2024-05-26T15:42:10.997608+0000","last_unstale":"2024-05-26T15:42:11.001369+0000","last_undegraded":"2024-05-26T15:42:11.001369+0000","last_fullsized":"2024-05-26T15:42:11.001369+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:02.353379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.970843+0000","last_change":"2024-05-26T15:42:10.970843+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.970843+0000","last_undegraded":"2024-05-26T15:42:10.970843+0000","last_fullsized":"2024-05-26T15:42:10.970843+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:33:15.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.993978+0000","last_change":"2024-05-26T15:42:10.987809+0000","last_active":"2024-05-26T15:42:10.993978+0000","last_peered":"2024-05-26T15:42:10.993978+0000","last_clean":"2024-05-26T15:42:10.993978+0000","last_became_active":"2024-05-26T15:42:10.987533+0000","last_became_peered":"2024-05-26T15:42:10.987533+0000","last_unstale":"2024-05-26T15:42:10.993978+0000","last_undegraded":"2024-05-26T15:42:10.993978+0000","last_fullsized":"2024-05-26T15:42:10.993978+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:23:08.480431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.973727+0000","last_change":"2024-05-26T15:42:10.973727+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.973727+0000","last_undegraded":"2024-05-26T15:42:10.973727+0000","last_fullsized":"2024-05-26T15:42:10.973727+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997174+0000","last_change":"2024-05-26T15:42:10.991160+0000","last_active":"2024-05-26T15:42:10.997174+0000","last_peered":"2024-05-26T15:42:10.997174+0000","last_clean":"2024-05-26T15:42:10.997174+0000","last_became_active":"2024-05-26T15:42:10.990470+0000","last_became_peered":"2024-05-26T15:42:10.990470+0000","last_unstale":"2024-05-26T15:42:10.997174+0000","last_undegraded":"2024-05-26T15:42:10.997174+0000","last_fullsized":"2024-05-26T15:42:10.997174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:52:01.513775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971358+0000","last_change":"2024-05-26T15:42:10.971358+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971358+0000","last_undegraded":"2024-05-26T15:42:10.971358+0000","last_fullsized":"2024-05-26T15:42:10.971358+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000827+0000","last_change":"2024-05-26T15:42:10.996147+0000","last_active":"2024-05-26T15:42:11.000827+0000","last_peered":"2024-05-26T15:42:11.000827+0000","last_clean":"2024-05-26T15:42:11.000827+0000","last_became_active":"2024-05-26T15:42:10.995452+0000","last_became_peered":"2024-05-26T15:42:10.995452+0000","last_unstale":"2024-05-26T15:42:11.000827+0000","last_undegraded":"2024-05-26T15:42:11.000827+0000","last_fullsized":"2024-05-26T15:42:11.000827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:05:01.848852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.963272+0000","last_change":"2024-05-26T15:42:10.963272+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.963272+0000","last_undegraded":"2024-05-26T15:42:10.963272+0000","last_fullsized":"2024-05-26T15:42:10.963272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.987200+0000","last_change":"2024-05-26T15:42:10.975898+0000","last_active":"2024-05-26T15:42:10.987200+0000","last_peered":"2024-05-26T15:42:10.987200+0000","last_clean":"2024-05-26T15:42:10.987200+0000","last_became_active":"2024-05-26T15:42:10.975600+0000","last_became_peered":"2024-05-26T15:42:10.975600+0000","last_unstale":"2024-05-26T15:42:10.987200+0000","last_undegraded":"2024-05-26T15:42:10.987200+0000","last_fullsized":"2024-05-26T15:42:10.987200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.978558+0000","last_change":"2024-05-26T15:42:10.978558+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.978558+0000","last_undegraded":"2024-05-26T15:42:10.978558+0000","last_fullsized":"2024-05-26T15:42:10.978558+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.996209+0000","last_change":"2024-05-26T15:42:10.991079+0000","last_active":"2024-05-26T15:42:10.996209+0000","last_peered":"2024-05-26T15:42:10.996209+0000","last_clean":"2024-05-26T15:42:10.996209+0000","last_became_active":"2024-05-26T15:42:10.990406+0000","last_became_peered":"2024-05-26T15:42:10.990406+0000","last_unstale":"2024-05-26T15:42:10.996209+0000","last_undegraded":"2024-05-26T15:42:10.996209+0000","last_fullsized":"2024-05-26T15:42:10.996209+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:42:34.129309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974545+0000","last_change":"2024-05-26T15:42:10.974545+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974545+0000","last_undegraded":"2024-05-26T15:42:10.974545+0000","last_fullsized":"2024-05-26T15:42:10.974545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:08:18.416170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.991527+0000","last_change":"2024-05-26T15:42:10.989749+0000","last_active":"2024-05-26T15:42:10.991527+0000","last_peered":"2024-05-26T15:42:10.991527+0000","last_clean":"2024-05-26T15:42:10.991527+0000","last_became_active":"2024-05-26T15:42:10.989423+0000","last_became_peered":"2024-05-26T15:42:10.989423+0000","last_unstale":"2024-05-26T15:42:10.991527+0000","last_undegraded":"2024-05-26T15:42:10.991527+0000","last_fullsized":"2024-05-26T15:42:10.991527+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:40.916618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971110+0000","last_change":"2024-05-26T15:42:10.971110+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971110+0000","last_undegraded":"2024-05-26T15:42:10.971110+0000","last_fullsized":"2024-05-26T15:42:10.971110+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.994677+0000","last_change":"2024-05-26T15:42:10.991543+0000","last_active":"2024-05-26T15:42:10.994677+0000","last_peered":"2024-05-26T15:42:10.994677+0000","last_clean":"2024-05-26T15:42:10.994677+0000","last_became_active":"2024-05-26T15:42:10.991274+0000","last_became_peered":"2024-05-26T15:42:10.991274+0000","last_unstale":"2024-05-26T15:42:10.994677+0000","last_undegraded":"2024-05-26T15:42:10.994677+0000","last_fullsized":"2024-05-26T15:42:10.994677+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:53:19.992334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.963475+0000","last_change":"2024-05-26T15:42:10.963475+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.963475+0000","last_undegraded":"2024-05-26T15:42:10.963475+0000","last_fullsized":"2024-05-26T15:42:10.963475+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:48:48.284704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997270+0000","last_change":"2024-05-26T15:42:10.991882+0000","last_active":"2024-05-26T15:42:10.997270+0000","last_peered":"2024-05-26T15:42:10.997270+0000","last_clean":"2024-05-26T15:42:10.997270+0000","last_became_active":"2024-05-26T15:42:10.991556+0000","last_became_peered":"2024-05-26T15:42:10.991556+0000","last_unstale":"2024-05-26T15:42:10.997270+0000","last_undegraded":"2024-05-26T15:42:10.997270+0000","last_fullsized":"2024-05-26T15:42:10.997270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.969690+0000","last_change":"2024-05-26T15:42:10.969690+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.969690+0000","last_undegraded":"2024-05-26T15:42:10.969690+0000","last_fullsized":"2024-05-26T15:42:10.969690+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000286+0000","last_change":"2024-05-26T15:42:10.996454+0000","last_active":"2024-05-26T15:42:11.000286+0000","last_peered":"2024-05-26T15:42:11.000286+0000","last_clean":"2024-05-26T15:42:11.000286+0000","last_became_active":"2024-05-26T15:42:10.996007+0000","last_became_peered":"2024-05-26T15:42:10.996007+0000","last_unstale":"2024-05-26T15:42:11.000286+0000","last_undegraded":"2024-05-26T15:42:11.000286+0000","last_fullsized":"2024-05-26T15:42:11.000286+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:15:52.653657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.979264+0000","last_change":"2024-05-26T15:42:10.979264+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.979264+0000","last_undegraded":"2024-05-26T15:42:10.979264+0000","last_fullsized":"2024-05-26T15:42:10.979264+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:10:12.251535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.998218+0000","last_change":"2024-05-26T15:42:10.994854+0000","last_active":"2024-05-26T15:42:10.998218+0000","last_peered":"2024-05-26T15:42:10.998218+0000","last_clean":"2024-05-26T15:42:10.998218+0000","last_became_active":"2024-05-26T15:42:10.994565+0000","last_became_peered":"2024-05-26T15:42:10.994565+0000","last_unstale":"2024-05-26T15:42:10.998218+0000","last_undegraded":"2024-05-26T15:42:10.998218+0000","last_fullsized":"2024-05-26T15:42:10.998218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:17.523734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.973797+0000","last_change":"2024-05-26T15:42:10.973797+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.973797+0000","last_undegraded":"2024-05-26T15:42:10.973797+0000","last_fullsized":"2024-05-26T15:42:10.973797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:56:54.463216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000140+0000","last_change":"2024-05-26T15:42:10.995708+0000","last_active":"2024-05-26T15:42:11.000140+0000","last_peered":"2024-05-26T15:42:11.000140+0000","last_clean":"2024-05-26T15:42:11.000140+0000","last_became_active":"2024-05-26T15:42:10.994183+0000","last_became_peered":"2024-05-26T15:42:10.994183+0000","last_unstale":"2024-05-26T15:42:11.000140+0000","last_undegraded":"2024-05-26T15:42:11.000140+0000","last_fullsized":"2024-05-26T15:42:11.000140+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:16:25.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.963259+0000","last_change":"2024-05-26T15:42:10.963259+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.963259+0000","last_undegraded":"2024-05-26T15:42:10.963259+0000","last_fullsized":"2024-05-26T15:42:10.963259+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999965+0000","last_change":"2024-05-26T15:42:10.996318+0000","last_active":"2024-05-26T15:42:10.999965+0000","last_peered":"2024-05-26T15:42:10.999965+0000","last_clean":"2024-05-26T15:42:10.999965+0000","last_became_active":"2024-05-26T15:42:10.996055+0000","last_became_peered":"2024-05-26T15:42:10.996055+0000","last_unstale":"2024-05-26T15:42:10.999965+0000","last_undegraded":"2024-05-26T15:42:10.999965+0000","last_fullsized":"2024-05-26T15:42:10.999965+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:12:49.868345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977618+0000","last_change":"2024-05-26T15:42:10.977618+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977618+0000","last_undegraded":"2024-05-26T15:42:10.977618+0000","last_fullsized":"2024-05-26T15:42:10.977618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:12:02.298237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.991961+0000","last_change":"2024-05-26T15:42:10.988191+0000","last_active":"2024-05-26T15:42:10.991961+0000","last_peered":"2024-05-26T15:42:10.991961+0000","last_clean":"2024-05-26T15:42:10.991961+0000","last_became_active":"2024-05-26T15:42:10.987878+0000","last_became_peered":"2024-05-26T15:42:10.987878+0000","last_unstale":"2024-05-26T15:42:10.991961+0000","last_undegraded":"2024-05-26T15:42:10.991961+0000","last_fullsized":"2024-05-26T15:42:10.991961+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.985809+0000","last_change":"2024-05-26T15:42:10.985809+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.985809+0000","last_undegraded":"2024-05-26T15:42:10.985809+0000","last_fullsized":"2024-05-26T15:42:10.985809+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:58:56.943330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.987095+0000","last_change":"2024-05-26T15:42:10.984171+0000","last_active":"2024-05-26T15:42:10.987095+0000","last_peered":"2024-05-26T15:42:10.987095+0000","last_clean":"2024-05-26T15:42:10.987095+0000","last_became_active":"2024-05-26T15:42:10.983594+0000","last_became_peered":"2024-05-26T15:42:10.983594+0000","last_unstale":"2024-05-26T15:42:10.987095+0000","last_undegraded":"2024-05-26T15:42:10.987095+0000","last_fullsized":"2024-05-26T15:42:10.987095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.972240+0000","last_change":"2024-05-26T15:42:10.972240+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.972240+0000","last_undegraded":"2024-05-26T15:42:10.972240+0000","last_fullsized":"2024-05-26T15:42:10.972240+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.998959+0000","last_change":"2024-05-26T15:42:10.997668+0000","last_active":"2024-05-26T15:42:10.998959+0000","last_peered":"2024-05-26T15:42:10.998959+0000","last_clean":"2024-05-26T15:42:10.998959+0000","last_became_active":"2024-05-26T15:42:10.997353+0000","last_became_peered":"2024-05-26T15:42:10.997353+0000","last_unstale":"2024-05-26T15:42:10.998959+0000","last_undegraded":"2024-05-26T15:42:10.998959+0000","last_fullsized":"2024-05-26T15:42:10.998959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:45.987751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-26T15:42:09.976056+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:42:09.976056+0000","last_peered":"2024-05-26T15:42:09.976056+0000","last_clean":"2024-05-26T15:42:09.976056+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:42:09.976056+0000","last_undegraded":"2024-05-26T15:42:09.976056+0000","last_fullsized":"2024-05-26T15:42:09.976056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1212416,"data_stored":863638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.643,"5min":1.802,"15min":1.802},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.84399999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.55,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2310000000000001,"15min":1.2330000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.204},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2669999999999999,"15min":1.2709999999999999},"min":{"1min":0.91000000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.601}]},{"osd":2,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3300000000000001,"15min":1.3240000000000001},"min":{"1min":0.92000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6870000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.137}]},{"osd":3,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":0.85999999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.946,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.498},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4830000000000001,"15min":1.484},"min":{"1min":1.0189999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.968,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.417}]},{"osd":4,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.448,"15min":1.446},"min":{"1min":0.873,"5min":0.87,"15min":0.87},"max":{"1min":2.0800000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.5640000000000001,"15min":1.5660000000000001},"min":{"1min":1.0589999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.0659999999999998,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.5489999999999999}]},{"osd":5,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.542,"15min":1.552},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.0409999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.25},{"interface":"front","average":{"1min":1.71,"5min":1.669,"15min":1.6619999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.2050000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.272}]},{"osd":6,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6819999999999999,"15min":1.6879999999999999},"min":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"max":{"1min":2.2480000000000002,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8240000000000001,"15min":1.8220000000000001},"min":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"max":{"1min":2.4609999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.3939999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":618496,"data_stored":273270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1599999999999999,"15min":1.1639999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5249999999999999,"5min":1.736,"15min":1.736},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.83599999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.96799999999999997}]},{"osd":1,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.202,"15min":1.1990000000000001},"min":{"1min":0.78700000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.024},{"interface":"front","average":{"1min":1.276,"5min":1.2410000000000001,"15min":1.2350000000000001},"min":{"1min":0.92500000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6859999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.4379999999999999}]},{"osd":2,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.85699999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6659999999999999,"5min":2.157,"15min":2.157},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.5029999999999999,"15min":1.516},"min":{"1min":0.998,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.032,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.81899999999999995}]},{"osd":3,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.403,"15min":1.4139999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.76,"5min":2.169,"15min":2.169},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.639,"15min":1.6830000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.9890000000000001,"5min":4.452,"15min":4.452},"last":1.1399999999999999}]},{"osd":4,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.637,"15min":1.657},"min":{"1min":0.82799999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.893,"5min":3.282,"15min":3.282},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.512,"15min":1.524},"min":{"1min":0.71499999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.931,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.476}]},{"osd":5,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.7130000000000001,"15min":1.7410000000000001},"min":{"1min":0.89600000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0219999999999998,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.399},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.615,"15min":1.645},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.1459999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.365}]},{"osd":7,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.7789999999999999,"15min":1.8109999999999999},"min":{"1min":1.1240000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.145,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.7889999999999999,"15min":1.8200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.2200000000000002,"5min":2.843,"15min":2.843},"last":1.24}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":614400,"data_stored":272251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.127,"15min":1.143},"min":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5489999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.87},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.0860000000000001,"15min":1.0700000000000001},"min":{"1min":0.81100000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.6180000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.569}]},{"osd":1,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.1220000000000001,"15min":1.089},"min":{"1min":0.89900000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.232,"5min":1.1439999999999999,"15min":1.129},"min":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.181}]},{"osd":2,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.1879999999999999,"15min":1.181},"min":{"1min":0.92700000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4550000000000001,"5min":1.659,"15min":1.659},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.2949999999999999,"15min":1.2829999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.284}]},{"osd":3,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.337,"15min":1.3440000000000001},"min":{"1min":0.94299999999999995,"5min":0.871,"15min":0.871},"max":{"1min":1.7849999999999999,"5min":1.879,"15min":1.879},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.76,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.0369999999999999}]},{"osd":4,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3440000000000001,"15min":1.3380000000000001},"min":{"1min":0.84799999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.736,"5min":2.077,"15min":2.077},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5720000000000001,"15min":1.5820000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.9630000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.468}]},{"osd":6,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.5269999999999999,"15min":1.538},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.927},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.47,"15min":1.462},"min":{"1min":1.1839999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.8939999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.821}]},{"osd":7,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.623,"15min":1.6299999999999999},"min":{"1min":1.173,"5min":1.036,"15min":1.036},"max":{"1min":2.3159999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.645,"15min":1.6499999999999999},"min":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.857}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":618496,"data_stored":273270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.1479999999999999,"15min":1.1619999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7190000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.179,"5min":1.238,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.601,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.79500000000000004}]},{"osd":1,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2470000000000001,"15min":1.2589999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.764,"5min":2.238,"15min":2.238},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.139,"15min":1.1299999999999999},"min":{"1min":0.86399999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.75,"15min":1.75},"last":0.85199999999999998}]},{"osd":2,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.86799999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6479999999999999,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.302,"15min":1.3049999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7490000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.1799999999999999}]},{"osd":3,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.292,"15min":1.28},"min":{"1min":1.077,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.6639999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.129},{"interface":"front","average":{"1min":1.411,"5min":1.4790000000000001,"15min":1.49},"min":{"1min":1.1579999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":1.7529999999999999,"5min":2.734,"15min":2.734},"last":1.573}]},{"osd":5,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.502,"15min":1.502},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":1.8759999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.504,"15min":1.512},"min":{"1min":1.206,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":1.794,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.28}]},{"osd":6,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.5720000000000001,"15min":1.5860000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.879,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.752},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.653,"15min":1.6619999999999999},"min":{"1min":1.2889999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.917,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.931}]},{"osd":7,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.6559999999999999,"15min":1.6779999999999999},"min":{"1min":1.236,"5min":1.147,"15min":1.147},"max":{"1min":1.9490000000000001,"5min":4.008,"15min":4.008},"last":1.51},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.75,"15min":1.7709999999999999},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.9730000000000001,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.885}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":618496,"data_stored":273270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90000000000000002,"15min":0.90500000000000003},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.508,"15min":1.508},"last":0.745},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94599999999999995,"15min":0.94699999999999995},"min":{"1min":0.56999999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.2929999999999999,"5min":1.659,"15min":1.659},"last":0.86699999999999999}]},{"osd":1,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.98899999999999999,"15min":1.0009999999999999},"min":{"1min":0.52800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3149999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.089,"5min":1.198,"15min":1.216},"min":{"1min":0.70399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6439999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.107}]},{"osd":2,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.1419999999999999,"15min":1.1659999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.226,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.70499999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7789999999999999,"5min":1.954,"15min":1.954},"last":1.1850000000000001}]},{"osd":4,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.296,"15min":1.3009999999999999},"min":{"1min":0.97799999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.915,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.302},{"interface":"front","average":{"1min":1.306,"5min":1.4219999999999999,"15min":1.4419999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8149999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.696}]},{"osd":5,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.4750000000000001,"15min":1.492},"min":{"1min":0.96399999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.968,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.327},{"interface":"front","average":{"1min":1.429,"5min":1.4239999999999999,"15min":1.423},"min":{"1min":0.875,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.794,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.7769999999999999}]},{"osd":6,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.51,"15min":1.536},"min":{"1min":0.93000000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.9430000000000001,"5min":2.863,"15min":2.863},"last":1.601},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.593,"15min":1.605},"min":{"1min":1.105,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.0659999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.6339999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.5149999999999999,"15min":1.5109999999999999},"min":{"1min":1.224,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.0640000000000001,"5min":2.306,"15min":2.306},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.478,"5min":1.575,"15min":1.591},"min":{"1min":1.0069999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.145,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.4139999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":614400,"data_stored":272251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0129999999999999,"15min":1.026},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3260000000000001,"5min":1.47,"15min":1.47},"last":1.097},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52300000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.6339999999999999,"5min":1.748,"15min":1.748},"last":1.1990000000000001}]},{"osd":1,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.04,"15min":1.056},"min":{"1min":0.626,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":2.0880000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2170000000000001,"15min":1.1970000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":7.4770000000000003,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.623}]},{"osd":3,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.04,"15min":1.0349999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.141,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":0.69199999999999995,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1789999999999998,"5min":2.903,"15min":2.903},"last":1.556}]},{"osd":4,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":1.5549999999999999,"15min":1.502},"min":{"1min":0.93500000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":10.438000000000001,"5min":10.438000000000001,"15min":10.438000000000001},"last":1.302},{"interface":"front","average":{"1min":1.363,"5min":1.4610000000000001,"15min":1.4770000000000001},"min":{"1min":1.046,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.6930000000000001,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.7030000000000001}]},{"osd":5,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8220000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.7150000000000001,"15min":1.6699999999999999},"min":{"1min":1.105,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":10.798999999999999,"5min":10.798999999999999,"15min":10.798999999999999},"last":2.1930000000000001}]},{"osd":6,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.6379999999999999,"15min":1.6040000000000001},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":7.851,"5min":7.851,"15min":7.851},"last":1.454},{"interface":"front","average":{"1min":1.962,"5min":1.6779999999999999,"15min":1.6299999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":10.672000000000001,"5min":10.672000000000001,"15min":10.672000000000001},"last":1.637}]},{"osd":7,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":2.0339999999999998,"5min":1.794,"15min":1.754},"min":{"1min":1.224,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":10.249000000000001,"5min":10.249000000000001,"15min":10.249000000000001},"last":1.972},{"interface":"front","average":{"1min":1.544,"5min":1.5980000000000001,"15min":1.607},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.401}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":618496,"data_stored":273270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.0529999999999999,"15min":1.0840000000000001},"min":{"1min":0.59999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.417,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.107,"15min":1.129},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.639,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.32400000000000001}]},{"osd":2,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.99399999999999999,"15min":1.0149999999999999},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.623,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.054,"5min":1.266,"15min":1.302},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5349999999999999,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.337,"15min":1.371},"min":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7809999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.016,"5min":1.2350000000000001,"15min":1.2709999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.48,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.022}]},{"osd":4,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.369,"15min":1.3839999999999999},"min":{"1min":0.877,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7490000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.3879999999999999,"15min":1.4159999999999999},"min":{"1min":0.86099999999999999,"5min":0.75,"15min":0.75},"max":{"1min":1.8260000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.111}]},{"osd":5,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.468,"15min":1.508},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.7509999999999999,"5min":2.621,"15min":2.621},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6080000000000001,"15min":1.643},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.8660000000000001,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":0.88200000000000001}]},{"osd":6,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.522,"15min":1.544},"min":{"1min":0.82799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.704,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.137},{"interface":"front","average":{"1min":1.298,"5min":1.631,"15min":1.6870000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.7130000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.0629999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.6910000000000001,"15min":1.73},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.877,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.6020000000000001,"15min":1.635},"min":{"1min":0.95499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8220000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.2809999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1208320,"data_stored":862619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2470000000000001,"5min":1.454,"15min":1.454},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":1,"15min":1.014},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.6499999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0800000000000001,"15min":1.1080000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3759999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0329999999999999,"15min":1.0409999999999999},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.419,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.282,"15min":1.3120000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2570000000000001,"5min":4.024,"15min":4.024},"last":0.873},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.2450000000000001,"15min":1.2689999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.198,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":0.88400000000000001}]},{"osd":4,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.452,"15min":1.49},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6759999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.998},{"interface":"front","average":{"1min":1.133,"5min":1.1519999999999999,"15min":1.155},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.071}]},{"osd":5,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.516,"15min":1.552},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7030000000000001,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.514,"15min":1.54},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9119999999999999,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.22}]},{"osd":6,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.258,"15min":1.276},"min":{"1min":0.81100000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.6679999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.026},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.512,"15min":1.544},"min":{"1min":0.88600000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.0569999999999999,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.117}]},{"osd":7,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.6160000000000001,"15min":1.6459999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.835,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.335},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3740000000000001,"15min":1.381},"min":{"1min":0.82699999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1219999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.204}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:42:15.938 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:42:16.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.194+0000 7f1ce2400640 1 Processor -- start 2024-05-26T15:42:16.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.194+0000 7f1ce2400640 1 -- start start 2024-05-26T15:42:16.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.196+0000 7f1ce2400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1cdc1571a0 0x7f1cdc0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.196+0000 7f1ce2400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1cdc15cfe0 0x7f1cdc0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.196+0000 7f1ce2400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cdc0b0d20 0x7f1cdc160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.196+0000 7f1ce2400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cdc15e090 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.196+0000 7f1ce2400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cdc0b11b0 con 0x7f1cdc1571a0 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.196+0000 7f1ce2400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc157580 con 0x7f1cdc0b0d20 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.196+0000 7f1cdbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1cdc15cfe0 0x7f1cdc0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.197+0000 7f1cdbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1cdc15cfe0 0x7f1cdc0b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33050/0 (socket says 172.21.15.8:33050) 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.197+0000 7f1cdbe00640 1 -- 172.21.15.8:0/1241185401 learned_addr learned my addr 172.21.15.8:0/1241185401 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.197+0000 7f1ce1a00640 1 --2- 172.21.15.8:0/1241185401 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cdc0b0d20 0x7f1cdc160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.197+0000 7f1ce1000640 1 --2- 172.21.15.8:0/1241185401 >> v2:172.21.15.47:3300/0 conn(0x7f1cdc1571a0 0x7f1cdc0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.197+0000 7f1cdbe00640 1 -- 172.21.15.8:0/1241185401 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cdc0b0d20 msgr2=0x7f1cdc160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.197+0000 7f1cdbe00640 1 --2- 172.21.15.8:0/1241185401 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cdc0b0d20 0x7f1cdc160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.197+0000 7f1cdbe00640 1 -- 172.21.15.8:0/1241185401 >> v2:172.21.15.47:3300/0 conn(0x7f1cdc1571a0 msgr2=0x7f1cdc0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.197+0000 7f1cdbe00640 1 --2- 172.21.15.8:0/1241185401 >> v2:172.21.15.47:3300/0 conn(0x7f1cdc1571a0 0x7f1cdc0caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.197+0000 7f1cdbe00640 1 -- 172.21.15.8:0/1241185401 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc15d480 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.197+0000 7f1ce1000640 1 --2- 172.21.15.8:0/1241185401 >> v2:172.21.15.47:3300/0 conn(0x7f1cdc1571a0 0x7f1cdc0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:16.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.198+0000 7f1cdbe00640 1 --2- 172.21.15.8:0/1241185401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 0x7f1cdc0b07e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc071500 tx=0x7f1cc802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7308f536d648572 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:16.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.199+0000 7f1cdb400640 1 -- 172.21.15.8:0/1241185401 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8032440 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.199+0000 7f1cdb400640 1 -- 172.21.15.8:0/1241185401 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc80325a0 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.199+0000 7f1cdb400640 1 -- 172.21.15.8:0/1241185401 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8032930 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.199+0000 7f1ce2400640 1 -- 172.21.15.8:0/1241185401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 msgr2=0x7f1cdc0b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.199+0000 7f1ce2400640 1 --2- 172.21.15.8:0/1241185401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 0x7f1cdc0b07e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc071500 tx=0x7f1cc802a1e0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.199+0000 7f1ce2400640 1 -- 172.21.15.8:0/1241185401 shutdown_connections 2024-05-26T15:42:16.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.199+0000 7f1ce2400640 1 --2- 172.21.15.8:0/1241185401 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cdc0b0d20 0x7f1cdc160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.199+0000 7f1ce2400640 1 --2- 172.21.15.8:0/1241185401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 0x7f1cdc0b07e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.199+0000 7f1ce2400640 1 --2- 172.21.15.8:0/1241185401 >> v2:172.21.15.47:3300/0 conn(0x7f1cdc1571a0 0x7f1cdc0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.199+0000 7f1ce2400640 1 -- 172.21.15.8:0/1241185401 >> 172.21.15.8:0/1241185401 conn(0x7f1cdc070480 msgr2=0x7f1cdc070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:16.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.200+0000 7f1ce2400640 1 -- 172.21.15.8:0/1241185401 shutdown_connections 2024-05-26T15:42:16.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.200+0000 7f1ce2400640 1 -- 172.21.15.8:0/1241185401 wait complete. 2024-05-26T15:42:16.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.201+0000 7f1ce2400640 1 Processor -- start 2024-05-26T15:42:16.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.202+0000 7f1ce2400640 1 -- start start 2024-05-26T15:42:16.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.202+0000 7f1ce2400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0b0d20 0x7f1cdc14b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.202+0000 7f1ce2400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cdc1571a0 0x7f1cdc1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce2400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 0x7f1cdc154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce2400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc0b29e0 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce2400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc14b690 con 0x7f1cdc0b0d20 2024-05-26T15:42:16.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce2400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc152ff0 con 0x7f1cdc1571a0 2024-05-26T15:42:16.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce1a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 0x7f1cdc154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce1a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 0x7f1cdc154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33064/0 (socket says 172.21.15.8:33064) 2024-05-26T15:42:16.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce1a00640 1 -- 172.21.15.8:0/2251314281 learned_addr learned my addr 172.21.15.8:0/2251314281 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:16.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce1000640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0b0d20 0x7f1cdc14b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1cdbe00640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cdc1571a0 0x7f1cdc1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce1a00640 1 -- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cdc1571a0 msgr2=0x7f1cdc1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce1a00640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cdc1571a0 0x7f1cdc1526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce1a00640 1 -- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0b0d20 msgr2=0x7f1cdc14b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce1a00640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0b0d20 0x7f1cdc14b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce1a00640 1 -- 172.21.15.8:0/2251314281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80094d0 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.203+0000 7f1ce1000640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0b0d20 0x7f1cdc14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:16.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.204+0000 7f1ce1a00640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 0x7f1cdc154b10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4007e60 tx=0x7f1cd400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:16.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.204+0000 7f1cd8c00640 1 -- 172.21.15.8:0/2251314281 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4014620 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.204+0000 7f1cd8c00640 1 -- 172.21.15.8:0/2251314281 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd400ee90 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.204+0000 7f1ce2400640 1 -- 172.21.15.8:0/2251314281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cdc1532d0 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.204+0000 7f1cd8c00640 1 -- 172.21.15.8:0/2251314281 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40149e0 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.204+0000 7f1ce2400640 1 -- 172.21.15.8:0/2251314281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cdc153890 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.205+0000 7f1ce2400640 1 -- 172.21.15.8:0/2251314281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cdc0b2b20 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.207+0000 7f1cd8c00640 1 -- 172.21.15.8:0/2251314281 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1cd4014b40 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.207+0000 7f1cd8c00640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cbc06ac30 0x7f1cbc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.208+0000 7f1cd8c00640 1 -- 172.21.15.8:0/2251314281 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1cd4089d40 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.208+0000 7f1ce1000640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cbc06ac30 0x7f1cbc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.210+0000 7f1ce1000640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cbc06ac30 0x7f1cbc06d0f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc155750 tx=0x7f1cd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:16.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.212+0000 7f1cd8c00640 1 -- 172.21.15.8:0/2251314281 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1cdc0b2b20 con 0x7f1cdc15cfe0 2024-05-26T15:42:16.408 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.409+0000 7f1ce2400640 1 -- 172.21.15.8:0/2251314281 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1cdc0b2760 con 0x7f1cbc06ac30 2024-05-26T15:42:16.432 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.433+0000 7f1cd8c00640 1 -- 172.21.15.8:0/2251314281 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285320 (secure 0 0 0) 0x7f1cd000c040 con 0x7f1cbc06ac30 2024-05-26T15:42:16.436 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:16.437 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:42:16.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 -- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cbc06ac30 msgr2=0x7f1cbc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cbc06ac30 0x7f1cbc06d0f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc155750 tx=0x7f1cd0008040 comp rx=0 tx=0).stop 2024-05-26T15:42:16.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 -- 172.21.15.8:0/2251314281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 msgr2=0x7f1cdc154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 0x7f1cdc154b10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4007e60 tx=0x7f1cd400e4b0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 -- 172.21.15.8:0/2251314281 shutdown_connections 2024-05-26T15:42:16.439 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1cdc15cfe0 0x7f1cdc154b10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1cdc1571a0 0x7f1cdc1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1cbc06ac30 0x7f1cbc06d0f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 --2- 172.21.15.8:0/2251314281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cdc0b0d20 0x7f1cdc14b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 -- 172.21.15.8:0/2251314281 >> 172.21.15.8:0/2251314281 conn(0x7f1cdc070480 msgr2=0x7f1cdc0ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:16.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 -- 172.21.15.8:0/2251314281 shutdown_connections 2024-05-26T15:42:16.440 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.440+0000 7f1ce2400640 1 -- 172.21.15.8:0/2251314281 wait complete. 2024-05-26T15:42:16.460 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-05-26T15:42:16.221475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591932,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255168,"kb_used_data":6200,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754719552,"statfs":{"total":773094113280,"available":772832821248,"internally_reserved":0,"allocated":6348800,"data_stored":3469281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1564,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001727"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.478258+0000","last_change":"2024-05-26T15:42:11.475784+0000","last_active":"2024-05-26T15:42:11.478258+0000","last_peered":"2024-05-26T15:42:11.478258+0000","last_clean":"2024-05-26T15:42:11.478258+0000","last_became_active":"2024-05-26T15:42:11.474366+0000","last_became_peered":"2024-05-26T15:42:11.474366+0000","last_unstale":"2024-05-26T15:42:11.478258+0000","last_undegraded":"2024-05-26T15:42:11.478258+0000","last_fullsized":"2024-05-26T15:42:11.478258+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:14:28.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988946+0000","last_change":"2024-05-26T15:42:10.988946+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988946+0000","last_undegraded":"2024-05-26T15:42:10.988946+0000","last_fullsized":"2024-05-26T15:42:10.988946+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:03:47.944320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.976785+0000","last_change":"2024-05-26T15:42:10.976785+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.976785+0000","last_undegraded":"2024-05-26T15:42:10.976785+0000","last_fullsized":"2024-05-26T15:42:10.976785+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:26:52.879894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.987272+0000","last_change":"2024-05-26T15:42:10.987272+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.987272+0000","last_undegraded":"2024-05-26T15:42:10.987272+0000","last_fullsized":"2024-05-26T15:42:10.987272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500715+0000","last_change":"2024-05-26T15:42:11.497533+0000","last_active":"2024-05-26T15:42:11.500715+0000","last_peered":"2024-05-26T15:42:11.500715+0000","last_clean":"2024-05-26T15:42:11.500715+0000","last_became_active":"2024-05-26T15:42:11.496938+0000","last_became_peered":"2024-05-26T15:42:11.496938+0000","last_unstale":"2024-05-26T15:42:11.500715+0000","last_undegraded":"2024-05-26T15:42:11.500715+0000","last_fullsized":"2024-05-26T15:42:11.500715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499447+0000","last_change":"2024-05-26T15:42:11.494471+0000","last_active":"2024-05-26T15:42:11.499447+0000","last_peered":"2024-05-26T15:42:11.499447+0000","last_clean":"2024-05-26T15:42:11.499447+0000","last_became_active":"2024-05-26T15:42:11.494235+0000","last_became_peered":"2024-05-26T15:42:11.494235+0000","last_unstale":"2024-05-26T15:42:11.499447+0000","last_undegraded":"2024-05-26T15:42:11.499447+0000","last_fullsized":"2024-05-26T15:42:11.499447+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977844+0000","last_change":"2024-05-26T15:42:10.977844+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977844+0000","last_undegraded":"2024-05-26T15:42:10.977844+0000","last_fullsized":"2024-05-26T15:42:10.977844+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:47:58.290205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494005+0000","last_change":"2024-05-26T15:42:11.491743+0000","last_active":"2024-05-26T15:42:11.494005+0000","last_peered":"2024-05-26T15:42:11.494005+0000","last_clean":"2024-05-26T15:42:11.494005+0000","last_became_active":"2024-05-26T15:42:11.491512+0000","last_became_peered":"2024-05-26T15:42:11.491512+0000","last_unstale":"2024-05-26T15:42:11.494005+0000","last_undegraded":"2024-05-26T15:42:11.494005+0000","last_fullsized":"2024-05-26T15:42:11.494005+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:49.249092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494033+0000","last_change":"2024-05-26T15:42:11.492582+0000","last_active":"2024-05-26T15:42:11.494033+0000","last_peered":"2024-05-26T15:42:11.494033+0000","last_clean":"2024-05-26T15:42:11.494033+0000","last_became_active":"2024-05-26T15:42:11.492271+0000","last_became_peered":"2024-05-26T15:42:11.492271+0000","last_unstale":"2024-05-26T15:42:11.494033+0000","last_undegraded":"2024-05-26T15:42:11.494033+0000","last_fullsized":"2024-05-26T15:42:11.494033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:26:49.715010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499336+0000","last_change":"2024-05-26T15:42:11.496192+0000","last_active":"2024-05-26T15:42:11.499336+0000","last_peered":"2024-05-26T15:42:11.499336+0000","last_clean":"2024-05-26T15:42:11.499336+0000","last_became_active":"2024-05-26T15:42:11.495944+0000","last_became_peered":"2024-05-26T15:42:11.495944+0000","last_unstale":"2024-05-26T15:42:11.499336+0000","last_undegraded":"2024-05-26T15:42:11.499336+0000","last_fullsized":"2024-05-26T15:42:11.499336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:06:39.785296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.496073+0000","last_change":"2024-05-26T15:42:11.489235+0000","last_active":"2024-05-26T15:42:11.496073+0000","last_peered":"2024-05-26T15:42:11.496073+0000","last_clean":"2024-05-26T15:42:11.496073+0000","last_became_active":"2024-05-26T15:42:11.488907+0000","last_became_peered":"2024-05-26T15:42:11.488907+0000","last_unstale":"2024-05-26T15:42:11.496073+0000","last_undegraded":"2024-05-26T15:42:11.496073+0000","last_fullsized":"2024-05-26T15:42:11.496073+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:13:27.388279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.487693+0000","last_change":"2024-05-26T15:42:11.486461+0000","last_active":"2024-05-26T15:42:11.487693+0000","last_peered":"2024-05-26T15:42:11.487693+0000","last_clean":"2024-05-26T15:42:11.487693+0000","last_became_active":"2024-05-26T15:42:11.485854+0000","last_became_peered":"2024-05-26T15:42:11.485854+0000","last_unstale":"2024-05-26T15:42:11.487693+0000","last_undegraded":"2024-05-26T15:42:11.487693+0000","last_fullsized":"2024-05-26T15:42:11.487693+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:00:13.066137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499405+0000","last_change":"2024-05-26T15:42:11.496586+0000","last_active":"2024-05-26T15:42:11.499405+0000","last_peered":"2024-05-26T15:42:11.499405+0000","last_clean":"2024-05-26T15:42:11.499405+0000","last_became_active":"2024-05-26T15:42:11.496340+0000","last_became_peered":"2024-05-26T15:42:11.496340+0000","last_unstale":"2024-05-26T15:42:11.499405+0000","last_undegraded":"2024-05-26T15:42:11.499405+0000","last_fullsized":"2024-05-26T15:42:11.499405+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:48:48.284704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975266+0000","last_change":"2024-05-26T15:42:10.975266+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975266+0000","last_undegraded":"2024-05-26T15:42:10.975266+0000","last_fullsized":"2024-05-26T15:42:10.975266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:43.290565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.982157+0000","last_change":"2024-05-26T15:42:10.982157+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.982157+0000","last_undegraded":"2024-05-26T15:42:10.982157+0000","last_fullsized":"2024-05-26T15:42:10.982157+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499462+0000","last_change":"2024-05-26T15:42:11.497654+0000","last_active":"2024-05-26T15:42:11.499462+0000","last_peered":"2024-05-26T15:42:11.499462+0000","last_clean":"2024-05-26T15:42:11.499462+0000","last_became_active":"2024-05-26T15:42:11.495683+0000","last_became_peered":"2024-05-26T15:42:11.495683+0000","last_unstale":"2024-05-26T15:42:11.499462+0000","last_undegraded":"2024-05-26T15:42:11.499462+0000","last_fullsized":"2024-05-26T15:42:11.499462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.978129+0000","last_change":"2024-05-26T15:42:10.978129+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.978129+0000","last_undegraded":"2024-05-26T15:42:10.978129+0000","last_fullsized":"2024-05-26T15:42:10.978129+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:05:26.003496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988452+0000","last_change":"2024-05-26T15:42:10.988452+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988452+0000","last_undegraded":"2024-05-26T15:42:10.988452+0000","last_fullsized":"2024-05-26T15:42:10.988452+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.973475+0000","last_change":"2024-05-26T15:42:10.973475+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.973475+0000","last_undegraded":"2024-05-26T15:42:10.973475+0000","last_fullsized":"2024-05-26T15:42:10.973475+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:34:54.694204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.979922+0000","last_change":"2024-05-26T15:42:10.979922+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.979922+0000","last_undegraded":"2024-05-26T15:42:10.979922+0000","last_fullsized":"2024-05-26T15:42:10.979922+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.976550+0000","last_change":"2024-05-26T15:42:10.976550+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.976550+0000","last_undegraded":"2024-05-26T15:42:10.976550+0000","last_fullsized":"2024-05-26T15:42:10.976550+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.504687+0000","last_change":"2024-05-26T15:42:11.503856+0000","last_active":"2024-05-26T15:42:11.504687+0000","last_peered":"2024-05-26T15:42:11.504687+0000","last_clean":"2024-05-26T15:42:11.504687+0000","last_became_active":"2024-05-26T15:42:11.503619+0000","last_became_peered":"2024-05-26T15:42:11.503619+0000","last_unstale":"2024-05-26T15:42:11.504687+0000","last_undegraded":"2024-05-26T15:42:11.504687+0000","last_fullsized":"2024-05-26T15:42:11.504687+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:38:38.915738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.495384+0000","last_change":"2024-05-26T15:42:11.488723+0000","last_active":"2024-05-26T15:42:11.495384+0000","last_peered":"2024-05-26T15:42:11.495384+0000","last_clean":"2024-05-26T15:42:11.495384+0000","last_became_active":"2024-05-26T15:42:11.488410+0000","last_became_peered":"2024-05-26T15:42:11.488410+0000","last_unstale":"2024-05-26T15:42:11.495384+0000","last_undegraded":"2024-05-26T15:42:11.495384+0000","last_fullsized":"2024-05-26T15:42:11.495384+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:51:09.231165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.972288+0000","last_change":"2024-05-26T15:42:10.972288+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.972288+0000","last_undegraded":"2024-05-26T15:42:10.972288+0000","last_fullsized":"2024-05-26T15:42:10.972288+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:10:03.718462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975622+0000","last_change":"2024-05-26T15:42:10.975622+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975622+0000","last_undegraded":"2024-05-26T15:42:10.975622+0000","last_fullsized":"2024-05-26T15:42:10.975622+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486266+0000","last_change":"2024-05-26T15:42:11.482860+0000","last_active":"2024-05-26T15:42:11.486266+0000","last_peered":"2024-05-26T15:42:11.486266+0000","last_clean":"2024-05-26T15:42:11.486266+0000","last_became_active":"2024-05-26T15:42:11.482579+0000","last_became_peered":"2024-05-26T15:42:11.482579+0000","last_unstale":"2024-05-26T15:42:11.486266+0000","last_undegraded":"2024-05-26T15:42:11.486266+0000","last_fullsized":"2024-05-26T15:42:11.486266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:59.291291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494385+0000","last_change":"2024-05-26T15:42:11.491800+0000","last_active":"2024-05-26T15:42:11.494385+0000","last_peered":"2024-05-26T15:42:11.494385+0000","last_clean":"2024-05-26T15:42:11.494385+0000","last_became_active":"2024-05-26T15:42:11.491522+0000","last_became_peered":"2024-05-26T15:42:11.491522+0000","last_unstale":"2024-05-26T15:42:11.494385+0000","last_undegraded":"2024-05-26T15:42:11.494385+0000","last_fullsized":"2024-05-26T15:42:11.494385+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977942+0000","last_change":"2024-05-26T15:42:10.977942+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977942+0000","last_undegraded":"2024-05-26T15:42:10.977942+0000","last_fullsized":"2024-05-26T15:42:10.977942+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971202+0000","last_change":"2024-05-26T15:42:10.971202+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971202+0000","last_undegraded":"2024-05-26T15:42:10.971202+0000","last_fullsized":"2024-05-26T15:42:10.971202+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:42:35.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.979756+0000","last_change":"2024-05-26T15:42:10.979756+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.979756+0000","last_undegraded":"2024-05-26T15:42:10.979756+0000","last_fullsized":"2024-05-26T15:42:10.979756+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975086+0000","last_change":"2024-05-26T15:42:10.975086+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975086+0000","last_undegraded":"2024-05-26T15:42:10.975086+0000","last_fullsized":"2024-05-26T15:42:10.975086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:16:26.570143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492503+0000","last_change":"2024-05-26T15:42:11.485998+0000","last_active":"2024-05-26T15:42:11.492503+0000","last_peered":"2024-05-26T15:42:11.492503+0000","last_clean":"2024-05-26T15:42:11.492503+0000","last_became_active":"2024-05-26T15:42:11.484349+0000","last_became_peered":"2024-05-26T15:42:11.484349+0000","last_unstale":"2024-05-26T15:42:11.492503+0000","last_undegraded":"2024-05-26T15:42:11.492503+0000","last_fullsized":"2024-05-26T15:42:11.492503+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.984759+0000","last_change":"2024-05-26T15:42:10.984759+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.984759+0000","last_undegraded":"2024-05-26T15:42:10.984759+0000","last_fullsized":"2024-05-26T15:42:10.984759+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999898+0000","last_change":"2024-05-26T15:42:10.994305+0000","last_active":"2024-05-26T15:42:10.999898+0000","last_peered":"2024-05-26T15:42:10.999898+0000","last_clean":"2024-05-26T15:42:10.999898+0000","last_became_active":"2024-05-26T15:42:10.992501+0000","last_became_peered":"2024-05-26T15:42:10.992501+0000","last_unstale":"2024-05-26T15:42:10.999898+0000","last_undegraded":"2024-05-26T15:42:10.999898+0000","last_fullsized":"2024-05-26T15:42:10.999898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.496238+0000","last_change":"2024-05-26T15:42:11.494994+0000","last_active":"2024-05-26T15:42:11.496238+0000","last_peered":"2024-05-26T15:42:11.496238+0000","last_clean":"2024-05-26T15:42:11.496238+0000","last_became_active":"2024-05-26T15:42:11.494663+0000","last_became_peered":"2024-05-26T15:42:11.494663+0000","last_unstale":"2024-05-26T15:42:11.496238+0000","last_undegraded":"2024-05-26T15:42:11.496238+0000","last_fullsized":"2024-05-26T15:42:11.496238+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.490230+0000","last_change":"2024-05-26T15:42:10.988783+0000","last_active":"2024-05-26T15:42:11.490230+0000","last_peered":"2024-05-26T15:42:11.490230+0000","last_clean":"2024-05-26T15:42:11.490230+0000","last_became_active":"2024-05-26T15:42:10.987904+0000","last_became_peered":"2024-05-26T15:42:10.987904+0000","last_unstale":"2024-05-26T15:42:11.490230+0000","last_undegraded":"2024-05-26T15:42:11.490230+0000","last_fullsized":"2024-05-26T15:42:11.490230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:28:20.962641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974455+0000","last_change":"2024-05-26T15:42:10.974455+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974455+0000","last_undegraded":"2024-05-26T15:42:10.974455+0000","last_fullsized":"2024-05-26T15:42:10.974455+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.502766+0000","last_change":"2024-05-26T15:42:10.990216+0000","last_active":"2024-05-26T15:42:11.502766+0000","last_peered":"2024-05-26T15:42:11.502766+0000","last_clean":"2024-05-26T15:42:11.502766+0000","last_became_active":"2024-05-26T15:42:10.988791+0000","last_became_peered":"2024-05-26T15:42:10.988791+0000","last_unstale":"2024-05-26T15:42:11.502766+0000","last_undegraded":"2024-05-26T15:42:11.502766+0000","last_fullsized":"2024-05-26T15:42:11.502766+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.487167+0000","last_change":"2024-05-26T15:42:11.484844+0000","last_active":"2024-05-26T15:42:11.487167+0000","last_peered":"2024-05-26T15:42:11.487167+0000","last_clean":"2024-05-26T15:42:11.487167+0000","last_became_active":"2024-05-26T15:42:11.484593+0000","last_became_peered":"2024-05-26T15:42:11.484593+0000","last_unstale":"2024-05-26T15:42:11.487167+0000","last_undegraded":"2024-05-26T15:42:11.487167+0000","last_fullsized":"2024-05-26T15:42:11.487167+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:54:37.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.485471+0000","last_change":"2024-05-26T15:42:10.993769+0000","last_active":"2024-05-26T15:42:11.485471+0000","last_peered":"2024-05-26T15:42:11.485471+0000","last_clean":"2024-05-26T15:42:11.485471+0000","last_became_active":"2024-05-26T15:42:10.993475+0000","last_became_peered":"2024-05-26T15:42:10.993475+0000","last_unstale":"2024-05-26T15:42:11.485471+0000","last_undegraded":"2024-05-26T15:42:11.485471+0000","last_fullsized":"2024-05-26T15:42:11.485471+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:42.382894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512009+0000","last_change":"2024-05-26T15:42:11.511184+0000","last_active":"2024-05-26T15:42:11.512009+0000","last_peered":"2024-05-26T15:42:11.512009+0000","last_clean":"2024-05-26T15:42:11.512009+0000","last_became_active":"2024-05-26T15:42:11.510627+0000","last_became_peered":"2024-05-26T15:42:11.510627+0000","last_unstale":"2024-05-26T15:42:11.512009+0000","last_undegraded":"2024-05-26T15:42:11.512009+0000","last_fullsized":"2024-05-26T15:42:11.512009+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.986886+0000","last_change":"2024-05-26T15:42:10.984163+0000","last_active":"2024-05-26T15:42:10.986886+0000","last_peered":"2024-05-26T15:42:10.986886+0000","last_clean":"2024-05-26T15:42:10.986886+0000","last_became_active":"2024-05-26T15:42:10.982899+0000","last_became_peered":"2024-05-26T15:42:10.982899+0000","last_unstale":"2024-05-26T15:42:10.986886+0000","last_undegraded":"2024-05-26T15:42:10.986886+0000","last_fullsized":"2024-05-26T15:42:10.986886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.986730+0000","last_change":"2024-05-26T15:42:10.986730+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.986730+0000","last_undegraded":"2024-05-26T15:42:10.986730+0000","last_fullsized":"2024-05-26T15:42:10.986730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486523+0000","last_change":"2024-05-26T15:42:10.990225+0000","last_active":"2024-05-26T15:42:11.486523+0000","last_peered":"2024-05-26T15:42:11.486523+0000","last_clean":"2024-05-26T15:42:11.486523+0000","last_became_active":"2024-05-26T15:42:10.989032+0000","last_became_peered":"2024-05-26T15:42:10.989032+0000","last_unstale":"2024-05-26T15:42:11.486523+0000","last_undegraded":"2024-05-26T15:42:11.486523+0000","last_fullsized":"2024-05-26T15:42:11.486523+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:04.490649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486284+0000","last_change":"2024-05-26T15:42:11.484249+0000","last_active":"2024-05-26T15:42:11.486284+0000","last_peered":"2024-05-26T15:42:11.486284+0000","last_clean":"2024-05-26T15:42:11.486284+0000","last_became_active":"2024-05-26T15:42:11.483933+0000","last_became_peered":"2024-05-26T15:42:11.483933+0000","last_unstale":"2024-05-26T15:42:11.486284+0000","last_undegraded":"2024-05-26T15:42:11.486284+0000","last_fullsized":"2024-05-26T15:42:11.486284+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999554+0000","last_change":"2024-05-26T15:42:10.993335+0000","last_active":"2024-05-26T15:42:10.999554+0000","last_peered":"2024-05-26T15:42:10.999554+0000","last_clean":"2024-05-26T15:42:10.999554+0000","last_became_active":"2024-05-26T15:42:10.992580+0000","last_became_peered":"2024-05-26T15:42:10.992580+0000","last_unstale":"2024-05-26T15:42:10.999554+0000","last_undegraded":"2024-05-26T15:42:10.999554+0000","last_fullsized":"2024-05-26T15:42:10.999554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:28:20.962641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988191+0000","last_change":"2024-05-26T15:42:10.988191+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988191+0000","last_undegraded":"2024-05-26T15:42:10.988191+0000","last_fullsized":"2024-05-26T15:42:10.988191+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.989009+0000","last_change":"2024-05-26T15:42:10.985611+0000","last_active":"2024-05-26T15:42:10.989009+0000","last_peered":"2024-05-26T15:42:10.989009+0000","last_clean":"2024-05-26T15:42:10.989009+0000","last_became_active":"2024-05-26T15:42:10.985306+0000","last_became_peered":"2024-05-26T15:42:10.985306+0000","last_unstale":"2024-05-26T15:42:10.989009+0000","last_undegraded":"2024-05-26T15:42:10.989009+0000","last_fullsized":"2024-05-26T15:42:10.989009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:42.382894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492395+0000","last_change":"2024-05-26T15:42:11.488874+0000","last_active":"2024-05-26T15:42:11.492395+0000","last_peered":"2024-05-26T15:42:11.492395+0000","last_clean":"2024-05-26T15:42:11.492395+0000","last_became_active":"2024-05-26T15:42:11.488482+0000","last_became_peered":"2024-05-26T15:42:11.488482+0000","last_unstale":"2024-05-26T15:42:11.492395+0000","last_undegraded":"2024-05-26T15:42:11.492395+0000","last_fullsized":"2024-05-26T15:42:11.492395+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001352+0000","last_change":"2024-05-26T15:42:11.000242+0000","last_active":"2024-05-26T15:42:11.001352+0000","last_peered":"2024-05-26T15:42:11.001352+0000","last_clean":"2024-05-26T15:42:11.001352+0000","last_became_active":"2024-05-26T15:42:10.999921+0000","last_became_peered":"2024-05-26T15:42:10.999921+0000","last_unstale":"2024-05-26T15:42:11.001352+0000","last_undegraded":"2024-05-26T15:42:11.001352+0000","last_fullsized":"2024-05-26T15:42:11.001352+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:47:33.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.491565+0000","last_change":"2024-05-26T15:42:11.483171+0000","last_active":"2024-05-26T15:42:11.491565+0000","last_peered":"2024-05-26T15:42:11.491565+0000","last_clean":"2024-05-26T15:42:11.491565+0000","last_became_active":"2024-05-26T15:42:11.482824+0000","last_became_peered":"2024-05-26T15:42:11.482824+0000","last_unstale":"2024-05-26T15:42:11.491565+0000","last_undegraded":"2024-05-26T15:42:11.491565+0000","last_fullsized":"2024-05-26T15:42:11.491565+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.481049+0000","last_change":"2024-05-26T15:42:10.988391+0000","last_active":"2024-05-26T15:42:11.481049+0000","last_peered":"2024-05-26T15:42:11.481049+0000","last_clean":"2024-05-26T15:42:11.481049+0000","last_became_active":"2024-05-26T15:42:10.987480+0000","last_became_peered":"2024-05-26T15:42:10.987480+0000","last_unstale":"2024-05-26T15:42:11.481049+0000","last_undegraded":"2024-05-26T15:42:11.481049+0000","last_fullsized":"2024-05-26T15:42:11.481049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.970692+0000","last_change":"2024-05-26T15:42:10.970692+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.970692+0000","last_undegraded":"2024-05-26T15:42:10.970692+0000","last_fullsized":"2024-05-26T15:42:10.970692+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:11:38.601829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001000+0000","last_change":"2024-05-26T15:42:10.998727+0000","last_active":"2024-05-26T15:42:11.001000+0000","last_peered":"2024-05-26T15:42:11.001000+0000","last_clean":"2024-05-26T15:42:11.001000+0000","last_became_active":"2024-05-26T15:42:10.998442+0000","last_became_peered":"2024-05-26T15:42:10.998442+0000","last_unstale":"2024-05-26T15:42:11.001000+0000","last_undegraded":"2024-05-26T15:42:11.001000+0000","last_fullsized":"2024-05-26T15:42:11.001000+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.505459+0000","last_change":"2024-05-26T15:42:11.504819+0000","last_active":"2024-05-26T15:42:11.505459+0000","last_peered":"2024-05-26T15:42:11.505459+0000","last_clean":"2024-05-26T15:42:11.505459+0000","last_became_active":"2024-05-26T15:42:11.504514+0000","last_became_peered":"2024-05-26T15:42:11.504514+0000","last_unstale":"2024-05-26T15:42:11.505459+0000","last_undegraded":"2024-05-26T15:42:11.505459+0000","last_fullsized":"2024-05-26T15:42:11.505459+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.514641+0000","last_change":"2024-05-26T15:42:10.992839+0000","last_active":"2024-05-26T15:42:11.514641+0000","last_peered":"2024-05-26T15:42:11.514641+0000","last_clean":"2024-05-26T15:42:11.514641+0000","last_became_active":"2024-05-26T15:42:10.992579+0000","last_became_peered":"2024-05-26T15:42:10.992579+0000","last_unstale":"2024-05-26T15:42:11.514641+0000","last_undegraded":"2024-05-26T15:42:11.514641+0000","last_fullsized":"2024-05-26T15:42:11.514641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:42.284507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.495824+0000","last_change":"2024-05-26T15:42:11.493992+0000","last_active":"2024-05-26T15:42:11.495824+0000","last_peered":"2024-05-26T15:42:11.495824+0000","last_clean":"2024-05-26T15:42:11.495824+0000","last_became_active":"2024-05-26T15:42:11.493723+0000","last_became_peered":"2024-05-26T15:42:11.493723+0000","last_unstale":"2024-05-26T15:42:11.495824+0000","last_undegraded":"2024-05-26T15:42:11.495824+0000","last_fullsized":"2024-05-26T15:42:11.495824+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999433+0000","last_change":"2024-05-26T15:42:10.997701+0000","last_active":"2024-05-26T15:42:10.999433+0000","last_peered":"2024-05-26T15:42:10.999433+0000","last_clean":"2024-05-26T15:42:10.999433+0000","last_became_active":"2024-05-26T15:42:10.997346+0000","last_became_peered":"2024-05-26T15:42:10.997346+0000","last_unstale":"2024-05-26T15:42:10.999433+0000","last_undegraded":"2024-05-26T15:42:10.999433+0000","last_fullsized":"2024-05-26T15:42:10.999433+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:33.637114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971101+0000","last_change":"2024-05-26T15:42:10.971101+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971101+0000","last_undegraded":"2024-05-26T15:42:10.971101+0000","last_fullsized":"2024-05-26T15:42:10.971101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:12:21.904002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997217+0000","last_change":"2024-05-26T15:42:10.991731+0000","last_active":"2024-05-26T15:42:10.997217+0000","last_peered":"2024-05-26T15:42:10.997217+0000","last_clean":"2024-05-26T15:42:10.997217+0000","last_became_active":"2024-05-26T15:42:10.991441+0000","last_became_peered":"2024-05-26T15:42:10.991441+0000","last_unstale":"2024-05-26T15:42:10.997217+0000","last_undegraded":"2024-05-26T15:42:10.997217+0000","last_fullsized":"2024-05-26T15:42:10.997217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:42:08.139990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.490386+0000","last_change":"2024-05-26T15:42:11.489521+0000","last_active":"2024-05-26T15:42:11.490386+0000","last_peered":"2024-05-26T15:42:11.490386+0000","last_clean":"2024-05-26T15:42:11.490386+0000","last_became_active":"2024-05-26T15:42:11.489213+0000","last_became_peered":"2024-05-26T15:42:11.489213+0000","last_unstale":"2024-05-26T15:42:11.490386+0000","last_undegraded":"2024-05-26T15:42:11.490386+0000","last_fullsized":"2024-05-26T15:42:11.490386+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:16:18.154776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000959+0000","last_change":"2024-05-26T15:42:10.998347+0000","last_active":"2024-05-26T15:42:11.000959+0000","last_peered":"2024-05-26T15:42:11.000959+0000","last_clean":"2024-05-26T15:42:11.000959+0000","last_became_active":"2024-05-26T15:42:10.998044+0000","last_became_peered":"2024-05-26T15:42:10.998044+0000","last_unstale":"2024-05-26T15:42:11.000959+0000","last_undegraded":"2024-05-26T15:42:11.000959+0000","last_fullsized":"2024-05-26T15:42:11.000959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:29:49.530204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974584+0000","last_change":"2024-05-26T15:42:10.974584+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974584+0000","last_undegraded":"2024-05-26T15:42:10.974584+0000","last_fullsized":"2024-05-26T15:42:10.974584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:04:06.159661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.503218+0000","last_change":"2024-05-26T15:42:10.986901+0000","last_active":"2024-05-26T15:42:11.503218+0000","last_peered":"2024-05-26T15:42:11.503218+0000","last_clean":"2024-05-26T15:42:11.503218+0000","last_became_active":"2024-05-26T15:42:10.986607+0000","last_became_peered":"2024-05-26T15:42:10.986607+0000","last_unstale":"2024-05-26T15:42:11.503218+0000","last_undegraded":"2024-05-26T15:42:11.503218+0000","last_fullsized":"2024-05-26T15:42:11.503218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:34:53.688146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486884+0000","last_change":"2024-05-26T15:42:11.480883+0000","last_active":"2024-05-26T15:42:11.486884+0000","last_peered":"2024-05-26T15:42:11.486884+0000","last_clean":"2024-05-26T15:42:11.486884+0000","last_became_active":"2024-05-26T15:42:11.480431+0000","last_became_peered":"2024-05-26T15:42:11.480431+0000","last_unstale":"2024-05-26T15:42:11.486884+0000","last_undegraded":"2024-05-26T15:42:11.486884+0000","last_fullsized":"2024-05-26T15:42:11.486884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:54:36.629232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001369+0000","last_change":"2024-05-26T15:42:10.998759+0000","last_active":"2024-05-26T15:42:11.001369+0000","last_peered":"2024-05-26T15:42:11.001369+0000","last_clean":"2024-05-26T15:42:11.001369+0000","last_became_active":"2024-05-26T15:42:10.997608+0000","last_became_peered":"2024-05-26T15:42:10.997608+0000","last_unstale":"2024-05-26T15:42:11.001369+0000","last_undegraded":"2024-05-26T15:42:11.001369+0000","last_fullsized":"2024-05-26T15:42:11.001369+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:02.353379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494353+0000","last_change":"2024-05-26T15:42:11.492971+0000","last_active":"2024-05-26T15:42:11.494353+0000","last_peered":"2024-05-26T15:42:11.494353+0000","last_clean":"2024-05-26T15:42:11.494353+0000","last_became_active":"2024-05-26T15:42:11.492712+0000","last_became_peered":"2024-05-26T15:42:11.492712+0000","last_unstale":"2024-05-26T15:42:11.494353+0000","last_undegraded":"2024-05-26T15:42:11.494353+0000","last_fullsized":"2024-05-26T15:42:11.494353+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:33:15.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.502779+0000","last_change":"2024-05-26T15:42:10.987809+0000","last_active":"2024-05-26T15:42:11.502779+0000","last_peered":"2024-05-26T15:42:11.502779+0000","last_clean":"2024-05-26T15:42:11.502779+0000","last_became_active":"2024-05-26T15:42:10.987533+0000","last_became_peered":"2024-05-26T15:42:10.987533+0000","last_unstale":"2024-05-26T15:42:11.502779+0000","last_undegraded":"2024-05-26T15:42:11.502779+0000","last_fullsized":"2024-05-26T15:42:11.502779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:23:08.480431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.510255+0000","last_change":"2024-05-26T15:42:11.509067+0000","last_active":"2024-05-26T15:42:11.510255+0000","last_peered":"2024-05-26T15:42:11.510255+0000","last_clean":"2024-05-26T15:42:11.510255+0000","last_became_active":"2024-05-26T15:42:11.508750+0000","last_became_peered":"2024-05-26T15:42:11.508750+0000","last_unstale":"2024-05-26T15:42:11.510255+0000","last_undegraded":"2024-05-26T15:42:11.510255+0000","last_fullsized":"2024-05-26T15:42:11.510255+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997174+0000","last_change":"2024-05-26T15:42:10.991160+0000","last_active":"2024-05-26T15:42:10.997174+0000","last_peered":"2024-05-26T15:42:10.997174+0000","last_clean":"2024-05-26T15:42:10.997174+0000","last_became_active":"2024-05-26T15:42:10.990470+0000","last_became_peered":"2024-05-26T15:42:10.990470+0000","last_unstale":"2024-05-26T15:42:10.997174+0000","last_undegraded":"2024-05-26T15:42:10.997174+0000","last_fullsized":"2024-05-26T15:42:10.997174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:52:01.513775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.480533+0000","last_change":"2024-05-26T15:42:11.474929+0000","last_active":"2024-05-26T15:42:11.480533+0000","last_peered":"2024-05-26T15:42:11.480533+0000","last_clean":"2024-05-26T15:42:11.480533+0000","last_became_active":"2024-05-26T15:42:11.474601+0000","last_became_peered":"2024-05-26T15:42:11.474601+0000","last_unstale":"2024-05-26T15:42:11.480533+0000","last_undegraded":"2024-05-26T15:42:11.480533+0000","last_fullsized":"2024-05-26T15:42:11.480533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000827+0000","last_change":"2024-05-26T15:42:10.996147+0000","last_active":"2024-05-26T15:42:11.000827+0000","last_peered":"2024-05-26T15:42:11.000827+0000","last_clean":"2024-05-26T15:42:11.000827+0000","last_became_active":"2024-05-26T15:42:10.995452+0000","last_became_peered":"2024-05-26T15:42:10.995452+0000","last_unstale":"2024-05-26T15:42:11.000827+0000","last_undegraded":"2024-05-26T15:42:11.000827+0000","last_fullsized":"2024-05-26T15:42:11.000827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:05:01.848852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500164+0000","last_change":"2024-05-26T15:42:11.495714+0000","last_active":"2024-05-26T15:42:11.500164+0000","last_peered":"2024-05-26T15:42:11.500164+0000","last_clean":"2024-05-26T15:42:11.500164+0000","last_became_active":"2024-05-26T15:42:11.495136+0000","last_became_peered":"2024-05-26T15:42:11.495136+0000","last_unstale":"2024-05-26T15:42:11.500164+0000","last_undegraded":"2024-05-26T15:42:11.500164+0000","last_fullsized":"2024-05-26T15:42:11.500164+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494221+0000","last_change":"2024-05-26T15:42:10.975898+0000","last_active":"2024-05-26T15:42:11.494221+0000","last_peered":"2024-05-26T15:42:11.494221+0000","last_clean":"2024-05-26T15:42:11.494221+0000","last_became_active":"2024-05-26T15:42:10.975600+0000","last_became_peered":"2024-05-26T15:42:10.975600+0000","last_unstale":"2024-05-26T15:42:11.494221+0000","last_undegraded":"2024-05-26T15:42:11.494221+0000","last_fullsized":"2024-05-26T15:42:11.494221+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.978558+0000","last_change":"2024-05-26T15:42:10.978558+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.978558+0000","last_undegraded":"2024-05-26T15:42:10.978558+0000","last_fullsized":"2024-05-26T15:42:10.978558+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.468936+0000","last_change":"2024-05-26T15:42:10.991079+0000","last_active":"2024-05-26T15:42:11.468936+0000","last_peered":"2024-05-26T15:42:11.468936+0000","last_clean":"2024-05-26T15:42:11.468936+0000","last_became_active":"2024-05-26T15:42:10.990406+0000","last_became_peered":"2024-05-26T15:42:10.990406+0000","last_unstale":"2024-05-26T15:42:11.468936+0000","last_undegraded":"2024-05-26T15:42:11.468936+0000","last_fullsized":"2024-05-26T15:42:11.468936+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:42:34.129309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974545+0000","last_change":"2024-05-26T15:42:10.974545+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974545+0000","last_undegraded":"2024-05-26T15:42:10.974545+0000","last_fullsized":"2024-05-26T15:42:10.974545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:08:18.416170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.991527+0000","last_change":"2024-05-26T15:42:10.989749+0000","last_active":"2024-05-26T15:42:10.991527+0000","last_peered":"2024-05-26T15:42:10.991527+0000","last_clean":"2024-05-26T15:42:10.991527+0000","last_became_active":"2024-05-26T15:42:10.989423+0000","last_became_peered":"2024-05-26T15:42:10.989423+0000","last_unstale":"2024-05-26T15:42:10.991527+0000","last_undegraded":"2024-05-26T15:42:10.991527+0000","last_fullsized":"2024-05-26T15:42:10.991527+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:40.916618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.493498+0000","last_change":"2024-05-26T15:42:11.484429+0000","last_active":"2024-05-26T15:42:11.493498+0000","last_peered":"2024-05-26T15:42:11.493498+0000","last_clean":"2024-05-26T15:42:11.493498+0000","last_became_active":"2024-05-26T15:42:11.484135+0000","last_became_peered":"2024-05-26T15:42:11.484135+0000","last_unstale":"2024-05-26T15:42:11.493498+0000","last_undegraded":"2024-05-26T15:42:11.493498+0000","last_fullsized":"2024-05-26T15:42:11.493498+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.473231+0000","last_change":"2024-05-26T15:42:10.991543+0000","last_active":"2024-05-26T15:42:11.473231+0000","last_peered":"2024-05-26T15:42:11.473231+0000","last_clean":"2024-05-26T15:42:11.473231+0000","last_became_active":"2024-05-26T15:42:10.991274+0000","last_became_peered":"2024-05-26T15:42:10.991274+0000","last_unstale":"2024-05-26T15:42:11.473231+0000","last_undegraded":"2024-05-26T15:42:11.473231+0000","last_fullsized":"2024-05-26T15:42:11.473231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:53:19.992334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492484+0000","last_change":"2024-05-26T15:42:11.485797+0000","last_active":"2024-05-26T15:42:11.492484+0000","last_peered":"2024-05-26T15:42:11.492484+0000","last_clean":"2024-05-26T15:42:11.492484+0000","last_became_active":"2024-05-26T15:42:11.483913+0000","last_became_peered":"2024-05-26T15:42:11.483913+0000","last_unstale":"2024-05-26T15:42:11.492484+0000","last_undegraded":"2024-05-26T15:42:11.492484+0000","last_fullsized":"2024-05-26T15:42:11.492484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:48:48.284704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997270+0000","last_change":"2024-05-26T15:42:10.991882+0000","last_active":"2024-05-26T15:42:10.997270+0000","last_peered":"2024-05-26T15:42:10.997270+0000","last_clean":"2024-05-26T15:42:10.997270+0000","last_became_active":"2024-05-26T15:42:10.991556+0000","last_became_peered":"2024-05-26T15:42:10.991556+0000","last_unstale":"2024-05-26T15:42:10.997270+0000","last_undegraded":"2024-05-26T15:42:10.997270+0000","last_fullsized":"2024-05-26T15:42:10.997270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494407+0000","last_change":"2024-05-26T15:42:11.487435+0000","last_active":"2024-05-26T15:42:11.494407+0000","last_peered":"2024-05-26T15:42:11.494407+0000","last_clean":"2024-05-26T15:42:11.494407+0000","last_became_active":"2024-05-26T15:42:11.487190+0000","last_became_peered":"2024-05-26T15:42:11.487190+0000","last_unstale":"2024-05-26T15:42:11.494407+0000","last_undegraded":"2024-05-26T15:42:11.494407+0000","last_fullsized":"2024-05-26T15:42:11.494407+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000286+0000","last_change":"2024-05-26T15:42:10.996454+0000","last_active":"2024-05-26T15:42:11.000286+0000","last_peered":"2024-05-26T15:42:11.000286+0000","last_clean":"2024-05-26T15:42:11.000286+0000","last_became_active":"2024-05-26T15:42:10.996007+0000","last_became_peered":"2024-05-26T15:42:10.996007+0000","last_unstale":"2024-05-26T15:42:11.000286+0000","last_undegraded":"2024-05-26T15:42:11.000286+0000","last_fullsized":"2024-05-26T15:42:11.000286+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:15:52.653657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494059+0000","last_change":"2024-05-26T15:42:11.493289+0000","last_active":"2024-05-26T15:42:11.494059+0000","last_peered":"2024-05-26T15:42:11.494059+0000","last_clean":"2024-05-26T15:42:11.494059+0000","last_became_active":"2024-05-26T15:42:11.493002+0000","last_became_peered":"2024-05-26T15:42:11.493002+0000","last_unstale":"2024-05-26T15:42:11.494059+0000","last_undegraded":"2024-05-26T15:42:11.494059+0000","last_fullsized":"2024-05-26T15:42:11.494059+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:10:12.251535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.998218+0000","last_change":"2024-05-26T15:42:10.994854+0000","last_active":"2024-05-26T15:42:10.998218+0000","last_peered":"2024-05-26T15:42:10.998218+0000","last_clean":"2024-05-26T15:42:10.998218+0000","last_became_active":"2024-05-26T15:42:10.994565+0000","last_became_peered":"2024-05-26T15:42:10.994565+0000","last_unstale":"2024-05-26T15:42:10.998218+0000","last_undegraded":"2024-05-26T15:42:10.998218+0000","last_fullsized":"2024-05-26T15:42:10.998218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:17.523734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.973797+0000","last_change":"2024-05-26T15:42:10.973797+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.973797+0000","last_undegraded":"2024-05-26T15:42:10.973797+0000","last_fullsized":"2024-05-26T15:42:10.973797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:56:54.463216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.470519+0000","last_change":"2024-05-26T15:42:10.995708+0000","last_active":"2024-05-26T15:42:11.470519+0000","last_peered":"2024-05-26T15:42:11.470519+0000","last_clean":"2024-05-26T15:42:11.470519+0000","last_became_active":"2024-05-26T15:42:10.994183+0000","last_became_peered":"2024-05-26T15:42:10.994183+0000","last_unstale":"2024-05-26T15:42:11.470519+0000","last_undegraded":"2024-05-26T15:42:11.470519+0000","last_fullsized":"2024-05-26T15:42:11.470519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:16:25.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494771+0000","last_change":"2024-05-26T15:42:11.493284+0000","last_active":"2024-05-26T15:42:11.494771+0000","last_peered":"2024-05-26T15:42:11.494771+0000","last_clean":"2024-05-26T15:42:11.494771+0000","last_became_active":"2024-05-26T15:42:11.492376+0000","last_became_peered":"2024-05-26T15:42:11.492376+0000","last_unstale":"2024-05-26T15:42:11.494771+0000","last_undegraded":"2024-05-26T15:42:11.494771+0000","last_fullsized":"2024-05-26T15:42:11.494771+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.469095+0000","last_change":"2024-05-26T15:42:10.996318+0000","last_active":"2024-05-26T15:42:11.469095+0000","last_peered":"2024-05-26T15:42:11.469095+0000","last_clean":"2024-05-26T15:42:11.469095+0000","last_became_active":"2024-05-26T15:42:10.996055+0000","last_became_peered":"2024-05-26T15:42:10.996055+0000","last_unstale":"2024-05-26T15:42:11.469095+0000","last_undegraded":"2024-05-26T15:42:11.469095+0000","last_fullsized":"2024-05-26T15:42:11.469095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:12:49.868345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977618+0000","last_change":"2024-05-26T15:42:10.977618+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977618+0000","last_undegraded":"2024-05-26T15:42:10.977618+0000","last_fullsized":"2024-05-26T15:42:10.977618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:12:02.298237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.477482+0000","last_change":"2024-05-26T15:42:10.988191+0000","last_active":"2024-05-26T15:42:11.477482+0000","last_peered":"2024-05-26T15:42:11.477482+0000","last_clean":"2024-05-26T15:42:11.477482+0000","last_became_active":"2024-05-26T15:42:10.987878+0000","last_became_peered":"2024-05-26T15:42:10.987878+0000","last_unstale":"2024-05-26T15:42:11.477482+0000","last_undegraded":"2024-05-26T15:42:11.477482+0000","last_fullsized":"2024-05-26T15:42:11.477482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499900+0000","last_change":"2024-05-26T15:42:11.498253+0000","last_active":"2024-05-26T15:42:11.499900+0000","last_peered":"2024-05-26T15:42:11.499900+0000","last_clean":"2024-05-26T15:42:11.499900+0000","last_became_active":"2024-05-26T15:42:11.497352+0000","last_became_peered":"2024-05-26T15:42:11.497352+0000","last_unstale":"2024-05-26T15:42:11.499900+0000","last_undegraded":"2024-05-26T15:42:11.499900+0000","last_fullsized":"2024-05-26T15:42:11.499900+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:58:56.943330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.466389+0000","last_change":"2024-05-26T15:42:10.984171+0000","last_active":"2024-05-26T15:42:11.466389+0000","last_peered":"2024-05-26T15:42:11.466389+0000","last_clean":"2024-05-26T15:42:11.466389+0000","last_became_active":"2024-05-26T15:42:10.983594+0000","last_became_peered":"2024-05-26T15:42:10.983594+0000","last_unstale":"2024-05-26T15:42:11.466389+0000","last_undegraded":"2024-05-26T15:42:11.466389+0000","last_fullsized":"2024-05-26T15:42:11.466389+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.972240+0000","last_change":"2024-05-26T15:42:10.972240+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.972240+0000","last_undegraded":"2024-05-26T15:42:10.972240+0000","last_fullsized":"2024-05-26T15:42:10.972240+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.998959+0000","last_change":"2024-05-26T15:42:10.997668+0000","last_active":"2024-05-26T15:42:10.998959+0000","last_peered":"2024-05-26T15:42:10.998959+0000","last_clean":"2024-05-26T15:42:10.998959+0000","last_became_active":"2024-05-26T15:42:10.997353+0000","last_became_peered":"2024-05-26T15:42:10.997353+0000","last_unstale":"2024-05-26T15:42:10.998959+0000","last_undegraded":"2024-05-26T15:42:10.998959+0000","last_fullsized":"2024-05-26T15:42:10.998959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:45.987751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-26T15:42:09.976056+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:42:09.976056+0000","last_peered":"2024-05-26T15:42:09.976056+0000","last_clean":"2024-05-26T15:42:09.976056+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:42:09.976056+0000","last_undegraded":"2024-05-26T15:42:09.976056+0000","last_fullsized":"2024-05-26T15:42:09.976056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1212416,"data_stored":863638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.643,"5min":1.802,"15min":1.802},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.84399999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.55,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2310000000000001,"15min":1.2330000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.204},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2669999999999999,"15min":1.2709999999999999},"min":{"1min":0.91000000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.601}]},{"osd":2,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3300000000000001,"15min":1.3240000000000001},"min":{"1min":0.92000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6870000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.137}]},{"osd":3,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":0.85999999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.946,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.498},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4830000000000001,"15min":1.484},"min":{"1min":1.0189999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.968,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.417}]},{"osd":4,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.448,"15min":1.446},"min":{"1min":0.873,"5min":0.87,"15min":0.87},"max":{"1min":2.0800000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.5640000000000001,"15min":1.5660000000000001},"min":{"1min":1.0589999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.0659999999999998,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.5489999999999999}]},{"osd":5,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.542,"15min":1.552},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.0409999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.25},{"interface":"front","average":{"1min":1.71,"5min":1.669,"15min":1.6619999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.2050000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.272}]},{"osd":6,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6819999999999999,"15min":1.6879999999999999},"min":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"max":{"1min":2.2480000000000002,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8240000000000001,"15min":1.8220000000000001},"min":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"max":{"1min":2.4609999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.3939999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":618496,"data_stored":273270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1599999999999999,"15min":1.1639999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5249999999999999,"5min":1.736,"15min":1.736},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.83599999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.96799999999999997}]},{"osd":1,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.202,"15min":1.1990000000000001},"min":{"1min":0.78700000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.024},{"interface":"front","average":{"1min":1.276,"5min":1.2410000000000001,"15min":1.2350000000000001},"min":{"1min":0.92500000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6859999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.4379999999999999}]},{"osd":2,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.85699999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6659999999999999,"5min":2.157,"15min":2.157},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.5029999999999999,"15min":1.516},"min":{"1min":0.998,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.032,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.81899999999999995}]},{"osd":3,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.403,"15min":1.4139999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.76,"5min":2.169,"15min":2.169},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.639,"15min":1.6830000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.9890000000000001,"5min":4.452,"15min":4.452},"last":1.1399999999999999}]},{"osd":4,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.637,"15min":1.657},"min":{"1min":0.82799999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.893,"5min":3.282,"15min":3.282},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.512,"15min":1.524},"min":{"1min":0.71499999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.931,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.476}]},{"osd":5,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.7130000000000001,"15min":1.7410000000000001},"min":{"1min":0.89600000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0219999999999998,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.399},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.615,"15min":1.645},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.1459999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.365}]},{"osd":7,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.7789999999999999,"15min":1.8109999999999999},"min":{"1min":1.1240000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.145,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.7889999999999999,"15min":1.8200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.2200000000000002,"5min":2.843,"15min":2.843},"last":1.24}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":651264,"data_stored":292561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.127,"15min":1.143},"min":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5489999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.0860000000000001,"15min":1.0700000000000001},"min":{"1min":0.81100000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.6180000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.627}]},{"osd":1,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.1220000000000001,"15min":1.089},"min":{"1min":0.89900000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.135},{"interface":"front","average":{"1min":1.232,"5min":1.1439999999999999,"15min":1.129},"min":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.268}]},{"osd":2,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.1879999999999999,"15min":1.181},"min":{"1min":0.92700000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4550000000000001,"5min":1.659,"15min":1.659},"last":1.006},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.2949999999999999,"15min":1.2829999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.3100000000000001}]},{"osd":3,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.337,"15min":1.3440000000000001},"min":{"1min":0.94299999999999995,"5min":0.871,"15min":0.871},"max":{"1min":1.7849999999999999,"5min":1.879,"15min":1.879},"last":1.806},{"interface":"front","average":{"1min":1.361,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.76,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.516}]},{"osd":4,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3440000000000001,"15min":1.3380000000000001},"min":{"1min":0.84799999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.736,"5min":2.077,"15min":2.077},"last":1.466},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5720000000000001,"15min":1.5820000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.9630000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.9470000000000001}]},{"osd":6,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.5269999999999999,"15min":1.538},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.47,"15min":1.462},"min":{"1min":1.1839999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.8939999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.75}]},{"osd":7,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.623,"15min":1.6299999999999999},"min":{"1min":1.173,"5min":1.036,"15min":1.036},"max":{"1min":2.3159999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.889},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.645,"15min":1.6499999999999999},"min":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.7030000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":659456,"data_stored":294162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.1479999999999999,"15min":1.1619999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7190000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.238,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.601,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.625}]},{"osd":1,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2470000000000001,"15min":1.2589999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.764,"5min":2.238,"15min":2.238},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.139,"15min":1.1299999999999999},"min":{"1min":0.86399999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.75,"15min":1.75},"last":1.1180000000000001}]},{"osd":2,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.86799999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6479999999999999,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.302,"15min":1.3049999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7490000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.92700000000000005}]},{"osd":3,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.292,"15min":1.28},"min":{"1min":1.077,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.6639999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.248},{"interface":"front","average":{"1min":1.411,"5min":1.4790000000000001,"15min":1.49},"min":{"1min":1.1579999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":1.7529999999999999,"5min":2.734,"15min":2.734},"last":1.554}]},{"osd":5,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.502,"15min":1.502},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":1.8759999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.069},{"interface":"front","average":{"1min":1.452,"5min":1.504,"15min":1.512},"min":{"1min":1.206,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":1.794,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3859999999999999}]},{"osd":6,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.5720000000000001,"15min":1.5860000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.879,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.653,"15min":1.6619999999999999},"min":{"1min":1.2889999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.917,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.1719999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.6559999999999999,"15min":1.6779999999999999},"min":{"1min":1.236,"5min":1.147,"15min":1.147},"max":{"1min":1.9490000000000001,"5min":4.008,"15min":4.008},"last":1.522},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.75,"15min":1.7709999999999999},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.9730000000000001,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.7010000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":671744,"data_stored":295166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90000000000000002,"15min":0.90500000000000003},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.508,"15min":1.508},"last":0.746},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94599999999999995,"15min":0.94699999999999995},"min":{"1min":0.56999999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.2929999999999999,"5min":1.659,"15min":1.659},"last":0.71999999999999997}]},{"osd":1,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.98899999999999999,"15min":1.0009999999999999},"min":{"1min":0.52800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3149999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.089,"5min":1.198,"15min":1.216},"min":{"1min":0.70399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6439999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.94399999999999995}]},{"osd":2,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.1419999999999999,"15min":1.1659999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.70499999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7789999999999999,"5min":1.954,"15min":1.954},"last":1.0389999999999999}]},{"osd":4,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.296,"15min":1.3009999999999999},"min":{"1min":0.97799999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.915,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.4219999999999999,"15min":1.4419999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8149999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.3500000000000001}]},{"osd":5,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.4750000000000001,"15min":1.492},"min":{"1min":0.96399999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.968,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.389},{"interface":"front","average":{"1min":1.429,"5min":1.4239999999999999,"15min":1.423},"min":{"1min":0.875,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.794,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.51,"15min":1.536},"min":{"1min":0.93000000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.9430000000000001,"5min":2.863,"15min":2.863},"last":1.657},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.593,"15min":1.605},"min":{"1min":1.105,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.0659999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.635}]},{"osd":7,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.5149999999999999,"15min":1.5109999999999999},"min":{"1min":1.224,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.0640000000000001,"5min":2.306,"15min":2.306},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.575,"15min":1.591},"min":{"1min":1.0069999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.145,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.556}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":294125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0129999999999999,"15min":1.026},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3260000000000001,"5min":1.47,"15min":1.47},"last":0.874},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52300000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.6339999999999999,"5min":1.748,"15min":1.748},"last":1.232}]},{"osd":1,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.04,"15min":1.056},"min":{"1min":0.626,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2170000000000001,"15min":1.1970000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":7.4770000000000003,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.98799999999999999}]},{"osd":3,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.04,"15min":1.0349999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":0.69199999999999995,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1789999999999998,"5min":2.903,"15min":2.903},"last":0.91500000000000004}]},{"osd":4,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":1.5549999999999999,"15min":1.502},"min":{"1min":0.93500000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":10.438000000000001,"5min":10.438000000000001,"15min":10.438000000000001},"last":1.151},{"interface":"front","average":{"1min":1.363,"5min":1.4610000000000001,"15min":1.4770000000000001},"min":{"1min":1.046,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.6930000000000001,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.1870000000000001}]},{"osd":5,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8220000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.7150000000000001,"15min":1.6699999999999999},"min":{"1min":1.105,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":10.798999999999999,"5min":10.798999999999999,"15min":10.798999999999999},"last":1.369}]},{"osd":6,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.6379999999999999,"15min":1.6040000000000001},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":7.851,"5min":7.851,"15min":7.851},"last":1.272},{"interface":"front","average":{"1min":1.962,"5min":1.6779999999999999,"15min":1.6299999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":10.672000000000001,"5min":10.672000000000001,"15min":10.672000000000001},"last":1.4399999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":2.0339999999999998,"5min":1.794,"15min":1.754},"min":{"1min":1.224,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":10.249000000000001,"5min":10.249000000000001,"15min":10.249000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.5980000000000001,"15min":1.607},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.3839999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":293740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.0529999999999999,"15min":1.0840000000000001},"min":{"1min":0.59999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.417,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.107,"15min":1.129},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.639,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.99399999999999999,"15min":1.0149999999999999},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.623,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.073},{"interface":"front","average":{"1min":1.054,"5min":1.266,"15min":1.302},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5349999999999999,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.012}]},{"osd":3,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.337,"15min":1.371},"min":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7809999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.171},{"interface":"front","average":{"1min":1.016,"5min":1.2350000000000001,"15min":1.2709999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.48,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.87}]},{"osd":4,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.369,"15min":1.3839999999999999},"min":{"1min":0.877,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7490000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.3879999999999999,"15min":1.4159999999999999},"min":{"1min":0.86099999999999999,"5min":0.75,"15min":0.75},"max":{"1min":1.8260000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.157}]},{"osd":5,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.468,"15min":1.508},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.7509999999999999,"5min":2.621,"15min":2.621},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6080000000000001,"15min":1.643},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.8660000000000001,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.3420000000000001}]},{"osd":6,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.522,"15min":1.544},"min":{"1min":0.82799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.704,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.631,"15min":1.6870000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.7130000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.401}]},{"osd":7,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.6910000000000001,"15min":1.73},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.877,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.6020000000000001,"15min":1.635},"min":{"1min":0.95499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8220000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.115}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1208320,"data_stored":862619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2470000000000001,"5min":1.454,"15min":1.454},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":1,"15min":1.014},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.6499999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0800000000000001,"15min":1.1080000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3759999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0329999999999999,"15min":1.0409999999999999},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.419,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.282,"15min":1.3120000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2570000000000001,"5min":4.024,"15min":4.024},"last":0.873},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.2450000000000001,"15min":1.2689999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.198,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":0.88400000000000001}]},{"osd":4,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.452,"15min":1.49},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6759999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.998},{"interface":"front","average":{"1min":1.133,"5min":1.1519999999999999,"15min":1.155},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.071}]},{"osd":5,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.516,"15min":1.552},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7030000000000001,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.514,"15min":1.54},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9119999999999999,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.22}]},{"osd":6,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.258,"15min":1.276},"min":{"1min":0.81100000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.6679999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.026},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.512,"15min":1.544},"min":{"1min":0.88600000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.0569999999999999,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.117}]},{"osd":7,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.6160000000000001,"15min":1.6459999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.835,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.335},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3740000000000001,"15min":1.381},"min":{"1min":0.82699999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1219999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.204}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:42:16.464 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:42:16.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.720+0000 7f33cd200640 1 Processor -- start 2024-05-26T15:42:16.719 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.720+0000 7f33cd200640 1 -- start start 2024-05-26T15:42:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.722+0000 7f33cd200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f33c8153c10 0x7f33c80c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.722+0000 7f33cd200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c80ca390 0x7f33c8069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.722+0000 7f33cd200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c80cebe0 con 0x7f33c80ce750 2024-05-26T15:42:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.722+0000 7f33cd200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c80cd6b0 con 0x7f33c8153c10 2024-05-26T15:42:16.721 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.722+0000 7f33cd200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80cd990 con 0x7f33c80ca390 2024-05-26T15:42:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.723+0000 7f33c7e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c80ca390 0x7f33c8069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.723+0000 7f33c7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f33c8153c10 0x7f33c80c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.723+0000 7f33c6a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f33c80ce750 0x7f33c80c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:33940/0 (socket says 172.21.15.8:33940) 2024-05-26T15:42:16.722 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.723+0000 7f33c6a00640 1 -- 172.21.15.8:0/3075361070 learned_addr learned my addr 172.21.15.8:0/3075361070 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:16.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.724+0000 7f33c6000640 1 -- 172.21.15.8:0/3075361070 <== mon.1 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129582959 0 0) 0x7f33c80cebe0 con 0x7f33c80ce750 2024-05-26T15:42:16.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.724+0000 7f33c6000640 1 -- 172.21.15.8:0/3075361070 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33ac003520 con 0x7f33c80ce750 2024-05-26T15:42:16.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.724+0000 7f33c7e00640 1 -- 172.21.15.8:0/3075361070 >> v2:172.21.15.47:3300/0 conn(0x7f33c8153c10 msgr2=0x7f33c80c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:16.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.724+0000 7f33c7e00640 1 --2- 172.21.15.8:0/3075361070 >> v2:172.21.15.47:3300/0 conn(0x7f33c8153c10 0x7f33c80c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.724+0000 7f33c7e00640 1 -- 172.21.15.8:0/3075361070 >> v1:172.21.15.47:6789/0 conn(0x7f33c80ce750 legacy=0x7f33c80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.724 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.724+0000 7f33c7e00640 1 -- 172.21.15.8:0/3075361070 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80cdc70 con 0x7f33c80ca390 2024-05-26T15:42:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.724+0000 7f33c7400640 1 --2- 172.21.15.8:0/3075361070 >> v2:172.21.15.47:3300/0 conn(0x7f33c8153c10 0x7f33c80c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:42:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.726+0000 7f33c7e00640 1 --2- 172.21.15.8:0/3075361070 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c80ca390 0x7f33c8069e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009d90 tx=0x7f33c002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e71620531f14219 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.727+0000 7f33c6000640 1 -- 172.21.15.8:0/3075361070 <== mon.2 v2:172.21.15.47:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0007740 con 0x7f33c80ca390 2024-05-26T15:42:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.727+0000 7f33c6000640 1 -- 172.21.15.8:0/3075361070 <== mon.2 v2:172.21.15.47:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c002d050 con 0x7f33c80ca390 2024-05-26T15:42:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.727+0000 7f33c6000640 1 -- 172.21.15.8:0/3075361070 <== mon.2 v2:172.21.15.47:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0007ac0 con 0x7f33c80ca390 2024-05-26T15:42:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.727+0000 7f33cd200640 1 -- 172.21.15.8:0/3075361070 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c80ca390 msgr2=0x7f33c8069e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.727+0000 7f33cd200640 1 --2- 172.21.15.8:0/3075361070 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c80ca390 0x7f33c8069e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33c0009d90 tx=0x7f33c002a660 comp rx=0 tx=0).stop 2024-05-26T15:42:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.727+0000 7f33cd200640 1 -- 172.21.15.8:0/3075361070 shutdown_connections 2024-05-26T15:42:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.727+0000 7f33cd200640 1 --2- 172.21.15.8:0/3075361070 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c80ca390 0x7f33c8069e70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.727+0000 7f33cd200640 1 --2- 172.21.15.8:0/3075361070 >> v2:172.21.15.47:3300/0 conn(0x7f33c8153c10 0x7f33c80c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.727+0000 7f33cd200640 1 -- 172.21.15.8:0/3075361070 >> 172.21.15.8:0/3075361070 conn(0x7f33c80cb8a0 msgr2=0x7f33c80cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.727+0000 7f33cd200640 1 -- 172.21.15.8:0/3075361070 shutdown_connections 2024-05-26T15:42:16.728 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.728+0000 7f33cd200640 1 -- 172.21.15.8:0/3075361070 wait complete. 2024-05-26T15:42:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.730+0000 7f33cd200640 1 Processor -- start 2024-05-26T15:42:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.730+0000 7f33cd200640 1 -- start start 2024-05-26T15:42:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.731+0000 7f33cd200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c80ca390 0x7f33c80b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.732+0000 7f33cd200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33c80ce750 0x7f33c806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.732+0000 7f33cd200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c8153c10 0x7f33c8151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.732+0000 7f33cd200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c806f380 con 0x7f33c80ce750 2024-05-26T15:42:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.732+0000 7f33cd200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c81f66b0 con 0x7f33c80ca390 2024-05-26T15:42:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.732+0000 7f33cd200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80b2260 con 0x7f33c8153c10 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.732+0000 7f33c6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33c80ce750 0x7f33c806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.732+0000 7f33c6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33c80ce750 0x7f33c806ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33068/0 (socket says 172.21.15.8:33068) 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.732+0000 7f33c6a00640 1 -- 172.21.15.8:0/3499926345 learned_addr learned my addr 172.21.15.8:0/3499926345 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.732+0000 7f33c7400640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c80ca390 0x7f33c80b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.732+0000 7f33c7e00640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c8153c10 0x7f33c8151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33c6a00640 1 -- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c8153c10 msgr2=0x7f33c8151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33c6a00640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c8153c10 0x7f33c8151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33c6a00640 1 -- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c80ca390 msgr2=0x7f33c80b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33c6a00640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c80ca390 0x7f33c80b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33c6a00640 1 -- 172.21.15.8:0/3499926345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b8009400 con 0x7f33c80ce750 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33c7e00640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c8153c10 0x7f33c8151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33c6a00640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33c80ce750 0x7f33c806ee40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f33b400c530 tx=0x7f33b400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33bf400640 1 -- 172.21.15.8:0/3499926345 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4005ce0 con 0x7f33c80ce750 2024-05-26T15:42:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33bf400640 1 -- 172.21.15.8:0/3499926345 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b4005e40 con 0x7f33c80ce750 2024-05-26T15:42:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33cd200640 1 -- 172.21.15.8:0/3499926345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c0009a70 con 0x7f33c80ce750 2024-05-26T15:42:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33bf400640 1 -- 172.21.15.8:0/3499926345 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b40072b0 con 0x7f33c80ce750 2024-05-26T15:42:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.733+0000 7f33cd200640 1 -- 172.21.15.8:0/3499926345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c81f6060 con 0x7f33c80ce750 2024-05-26T15:42:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.735+0000 7f33cd200640 1 -- 172.21.15.8:0/3499926345 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c81f6840 con 0x7f33c80ce750 2024-05-26T15:42:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.736+0000 7f33bf400640 1 -- 172.21.15.8:0/3499926345 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f33b4007410 con 0x7f33c80ce750 2024-05-26T15:42:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.737+0000 7f33bf400640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33a806ac00 0x7f33a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.737+0000 7f33bf400640 1 -- 172.21.15.8:0/3499926345 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f33b4088ac0 con 0x7f33c80ce750 2024-05-26T15:42:16.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.738+0000 7f33c7400640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33a806ac00 0x7f33a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:16.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.739+0000 7f33c7400640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33a806ac00 0x7f33a806d0c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009bc0 tx=0x7f33b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:16.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.741+0000 7f33bf400640 1 -- 172.21.15.8:0/3499926345 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f33b4053c10 con 0x7f33c80ce750 2024-05-26T15:42:16.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.943+0000 7f33cd200640 1 -- 172.21.15.8:0/3499926345 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33c80ce230 con 0x7f33a806ac00 2024-05-26T15:42:16.965 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.966+0000 7f33bf400640 1 -- 172.21.15.8:0/3499926345 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285320 (secure 0 0 0) 0x7f33b8011ac0 con 0x7f33a806ac00 2024-05-26T15:42:16.969 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:16.970 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:42:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.972+0000 7f33cd200640 1 -- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33a806ac00 msgr2=0x7f33a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.972+0000 7f33cd200640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33a806ac00 0x7f33a806d0c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009bc0 tx=0x7f33b8008040 comp rx=0 tx=0).stop 2024-05-26T15:42:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.972+0000 7f33cd200640 1 -- 172.21.15.8:0/3499926345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33c80ce750 msgr2=0x7f33c806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.972+0000 7f33cd200640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33c80ce750 0x7f33c806ee40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f33b400c530 tx=0x7f33b400c9f0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.973+0000 7f33cd200640 1 -- 172.21.15.8:0/3499926345 shutdown_connections 2024-05-26T15:42:16.972 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.973+0000 7f33cd200640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f33c8153c10 0x7f33c8151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.973+0000 7f33cd200640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f33c80ce750 0x7f33c806ee40 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.973+0000 7f33cd200640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f33a806ac00 0x7f33a806d0c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.973+0000 7f33cd200640 1 --2- 172.21.15.8:0/3499926345 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33c80ca390 0x7f33c80b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:16.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.973+0000 7f33cd200640 1 -- 172.21.15.8:0/3499926345 >> 172.21.15.8:0/3499926345 conn(0x7f33c80cb8a0 msgr2=0x7f33c815ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:16.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.973+0000 7f33cd200640 1 -- 172.21.15.8:0/3499926345 shutdown_connections 2024-05-26T15:42:16.973 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:16.973+0000 7f33cd200640 1 -- 172.21.15.8:0/3499926345 wait complete. 2024-05-26T15:42:16.992 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-05-26T15:42:16.221475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591932,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255168,"kb_used_data":6200,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754719552,"statfs":{"total":773094113280,"available":772832821248,"internally_reserved":0,"allocated":6348800,"data_stored":3469281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1564,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001727"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.478258+0000","last_change":"2024-05-26T15:42:11.475784+0000","last_active":"2024-05-26T15:42:11.478258+0000","last_peered":"2024-05-26T15:42:11.478258+0000","last_clean":"2024-05-26T15:42:11.478258+0000","last_became_active":"2024-05-26T15:42:11.474366+0000","last_became_peered":"2024-05-26T15:42:11.474366+0000","last_unstale":"2024-05-26T15:42:11.478258+0000","last_undegraded":"2024-05-26T15:42:11.478258+0000","last_fullsized":"2024-05-26T15:42:11.478258+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:14:28.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988946+0000","last_change":"2024-05-26T15:42:10.988946+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988946+0000","last_undegraded":"2024-05-26T15:42:10.988946+0000","last_fullsized":"2024-05-26T15:42:10.988946+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:03:47.944320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.976785+0000","last_change":"2024-05-26T15:42:10.976785+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.976785+0000","last_undegraded":"2024-05-26T15:42:10.976785+0000","last_fullsized":"2024-05-26T15:42:10.976785+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:26:52.879894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.987272+0000","last_change":"2024-05-26T15:42:10.987272+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.987272+0000","last_undegraded":"2024-05-26T15:42:10.987272+0000","last_fullsized":"2024-05-26T15:42:10.987272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500715+0000","last_change":"2024-05-26T15:42:11.497533+0000","last_active":"2024-05-26T15:42:11.500715+0000","last_peered":"2024-05-26T15:42:11.500715+0000","last_clean":"2024-05-26T15:42:11.500715+0000","last_became_active":"2024-05-26T15:42:11.496938+0000","last_became_peered":"2024-05-26T15:42:11.496938+0000","last_unstale":"2024-05-26T15:42:11.500715+0000","last_undegraded":"2024-05-26T15:42:11.500715+0000","last_fullsized":"2024-05-26T15:42:11.500715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499447+0000","last_change":"2024-05-26T15:42:11.494471+0000","last_active":"2024-05-26T15:42:11.499447+0000","last_peered":"2024-05-26T15:42:11.499447+0000","last_clean":"2024-05-26T15:42:11.499447+0000","last_became_active":"2024-05-26T15:42:11.494235+0000","last_became_peered":"2024-05-26T15:42:11.494235+0000","last_unstale":"2024-05-26T15:42:11.499447+0000","last_undegraded":"2024-05-26T15:42:11.499447+0000","last_fullsized":"2024-05-26T15:42:11.499447+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977844+0000","last_change":"2024-05-26T15:42:10.977844+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977844+0000","last_undegraded":"2024-05-26T15:42:10.977844+0000","last_fullsized":"2024-05-26T15:42:10.977844+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:47:58.290205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494005+0000","last_change":"2024-05-26T15:42:11.491743+0000","last_active":"2024-05-26T15:42:11.494005+0000","last_peered":"2024-05-26T15:42:11.494005+0000","last_clean":"2024-05-26T15:42:11.494005+0000","last_became_active":"2024-05-26T15:42:11.491512+0000","last_became_peered":"2024-05-26T15:42:11.491512+0000","last_unstale":"2024-05-26T15:42:11.494005+0000","last_undegraded":"2024-05-26T15:42:11.494005+0000","last_fullsized":"2024-05-26T15:42:11.494005+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:49.249092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494033+0000","last_change":"2024-05-26T15:42:11.492582+0000","last_active":"2024-05-26T15:42:11.494033+0000","last_peered":"2024-05-26T15:42:11.494033+0000","last_clean":"2024-05-26T15:42:11.494033+0000","last_became_active":"2024-05-26T15:42:11.492271+0000","last_became_peered":"2024-05-26T15:42:11.492271+0000","last_unstale":"2024-05-26T15:42:11.494033+0000","last_undegraded":"2024-05-26T15:42:11.494033+0000","last_fullsized":"2024-05-26T15:42:11.494033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:26:49.715010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499336+0000","last_change":"2024-05-26T15:42:11.496192+0000","last_active":"2024-05-26T15:42:11.499336+0000","last_peered":"2024-05-26T15:42:11.499336+0000","last_clean":"2024-05-26T15:42:11.499336+0000","last_became_active":"2024-05-26T15:42:11.495944+0000","last_became_peered":"2024-05-26T15:42:11.495944+0000","last_unstale":"2024-05-26T15:42:11.499336+0000","last_undegraded":"2024-05-26T15:42:11.499336+0000","last_fullsized":"2024-05-26T15:42:11.499336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:06:39.785296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.496073+0000","last_change":"2024-05-26T15:42:11.489235+0000","last_active":"2024-05-26T15:42:11.496073+0000","last_peered":"2024-05-26T15:42:11.496073+0000","last_clean":"2024-05-26T15:42:11.496073+0000","last_became_active":"2024-05-26T15:42:11.488907+0000","last_became_peered":"2024-05-26T15:42:11.488907+0000","last_unstale":"2024-05-26T15:42:11.496073+0000","last_undegraded":"2024-05-26T15:42:11.496073+0000","last_fullsized":"2024-05-26T15:42:11.496073+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:13:27.388279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.487693+0000","last_change":"2024-05-26T15:42:11.486461+0000","last_active":"2024-05-26T15:42:11.487693+0000","last_peered":"2024-05-26T15:42:11.487693+0000","last_clean":"2024-05-26T15:42:11.487693+0000","last_became_active":"2024-05-26T15:42:11.485854+0000","last_became_peered":"2024-05-26T15:42:11.485854+0000","last_unstale":"2024-05-26T15:42:11.487693+0000","last_undegraded":"2024-05-26T15:42:11.487693+0000","last_fullsized":"2024-05-26T15:42:11.487693+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:00:13.066137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499405+0000","last_change":"2024-05-26T15:42:11.496586+0000","last_active":"2024-05-26T15:42:11.499405+0000","last_peered":"2024-05-26T15:42:11.499405+0000","last_clean":"2024-05-26T15:42:11.499405+0000","last_became_active":"2024-05-26T15:42:11.496340+0000","last_became_peered":"2024-05-26T15:42:11.496340+0000","last_unstale":"2024-05-26T15:42:11.499405+0000","last_undegraded":"2024-05-26T15:42:11.499405+0000","last_fullsized":"2024-05-26T15:42:11.499405+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:48:48.284704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975266+0000","last_change":"2024-05-26T15:42:10.975266+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975266+0000","last_undegraded":"2024-05-26T15:42:10.975266+0000","last_fullsized":"2024-05-26T15:42:10.975266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:43.290565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.982157+0000","last_change":"2024-05-26T15:42:10.982157+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.982157+0000","last_undegraded":"2024-05-26T15:42:10.982157+0000","last_fullsized":"2024-05-26T15:42:10.982157+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499462+0000","last_change":"2024-05-26T15:42:11.497654+0000","last_active":"2024-05-26T15:42:11.499462+0000","last_peered":"2024-05-26T15:42:11.499462+0000","last_clean":"2024-05-26T15:42:11.499462+0000","last_became_active":"2024-05-26T15:42:11.495683+0000","last_became_peered":"2024-05-26T15:42:11.495683+0000","last_unstale":"2024-05-26T15:42:11.499462+0000","last_undegraded":"2024-05-26T15:42:11.499462+0000","last_fullsized":"2024-05-26T15:42:11.499462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.978129+0000","last_change":"2024-05-26T15:42:10.978129+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.978129+0000","last_undegraded":"2024-05-26T15:42:10.978129+0000","last_fullsized":"2024-05-26T15:42:10.978129+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:05:26.003496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988452+0000","last_change":"2024-05-26T15:42:10.988452+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988452+0000","last_undegraded":"2024-05-26T15:42:10.988452+0000","last_fullsized":"2024-05-26T15:42:10.988452+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.973475+0000","last_change":"2024-05-26T15:42:10.973475+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.973475+0000","last_undegraded":"2024-05-26T15:42:10.973475+0000","last_fullsized":"2024-05-26T15:42:10.973475+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:34:54.694204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.979922+0000","last_change":"2024-05-26T15:42:10.979922+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.979922+0000","last_undegraded":"2024-05-26T15:42:10.979922+0000","last_fullsized":"2024-05-26T15:42:10.979922+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.976550+0000","last_change":"2024-05-26T15:42:10.976550+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.976550+0000","last_undegraded":"2024-05-26T15:42:10.976550+0000","last_fullsized":"2024-05-26T15:42:10.976550+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.504687+0000","last_change":"2024-05-26T15:42:11.503856+0000","last_active":"2024-05-26T15:42:11.504687+0000","last_peered":"2024-05-26T15:42:11.504687+0000","last_clean":"2024-05-26T15:42:11.504687+0000","last_became_active":"2024-05-26T15:42:11.503619+0000","last_became_peered":"2024-05-26T15:42:11.503619+0000","last_unstale":"2024-05-26T15:42:11.504687+0000","last_undegraded":"2024-05-26T15:42:11.504687+0000","last_fullsized":"2024-05-26T15:42:11.504687+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:38:38.915738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.495384+0000","last_change":"2024-05-26T15:42:11.488723+0000","last_active":"2024-05-26T15:42:11.495384+0000","last_peered":"2024-05-26T15:42:11.495384+0000","last_clean":"2024-05-26T15:42:11.495384+0000","last_became_active":"2024-05-26T15:42:11.488410+0000","last_became_peered":"2024-05-26T15:42:11.488410+0000","last_unstale":"2024-05-26T15:42:11.495384+0000","last_undegraded":"2024-05-26T15:42:11.495384+0000","last_fullsized":"2024-05-26T15:42:11.495384+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:51:09.231165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.972288+0000","last_change":"2024-05-26T15:42:10.972288+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.972288+0000","last_undegraded":"2024-05-26T15:42:10.972288+0000","last_fullsized":"2024-05-26T15:42:10.972288+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:10:03.718462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975622+0000","last_change":"2024-05-26T15:42:10.975622+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975622+0000","last_undegraded":"2024-05-26T15:42:10.975622+0000","last_fullsized":"2024-05-26T15:42:10.975622+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486266+0000","last_change":"2024-05-26T15:42:11.482860+0000","last_active":"2024-05-26T15:42:11.486266+0000","last_peered":"2024-05-26T15:42:11.486266+0000","last_clean":"2024-05-26T15:42:11.486266+0000","last_became_active":"2024-05-26T15:42:11.482579+0000","last_became_peered":"2024-05-26T15:42:11.482579+0000","last_unstale":"2024-05-26T15:42:11.486266+0000","last_undegraded":"2024-05-26T15:42:11.486266+0000","last_fullsized":"2024-05-26T15:42:11.486266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:59.291291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494385+0000","last_change":"2024-05-26T15:42:11.491800+0000","last_active":"2024-05-26T15:42:11.494385+0000","last_peered":"2024-05-26T15:42:11.494385+0000","last_clean":"2024-05-26T15:42:11.494385+0000","last_became_active":"2024-05-26T15:42:11.491522+0000","last_became_peered":"2024-05-26T15:42:11.491522+0000","last_unstale":"2024-05-26T15:42:11.494385+0000","last_undegraded":"2024-05-26T15:42:11.494385+0000","last_fullsized":"2024-05-26T15:42:11.494385+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977942+0000","last_change":"2024-05-26T15:42:10.977942+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977942+0000","last_undegraded":"2024-05-26T15:42:10.977942+0000","last_fullsized":"2024-05-26T15:42:10.977942+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971202+0000","last_change":"2024-05-26T15:42:10.971202+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971202+0000","last_undegraded":"2024-05-26T15:42:10.971202+0000","last_fullsized":"2024-05-26T15:42:10.971202+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:42:35.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.979756+0000","last_change":"2024-05-26T15:42:10.979756+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.979756+0000","last_undegraded":"2024-05-26T15:42:10.979756+0000","last_fullsized":"2024-05-26T15:42:10.979756+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975086+0000","last_change":"2024-05-26T15:42:10.975086+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975086+0000","last_undegraded":"2024-05-26T15:42:10.975086+0000","last_fullsized":"2024-05-26T15:42:10.975086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:16:26.570143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492503+0000","last_change":"2024-05-26T15:42:11.485998+0000","last_active":"2024-05-26T15:42:11.492503+0000","last_peered":"2024-05-26T15:42:11.492503+0000","last_clean":"2024-05-26T15:42:11.492503+0000","last_became_active":"2024-05-26T15:42:11.484349+0000","last_became_peered":"2024-05-26T15:42:11.484349+0000","last_unstale":"2024-05-26T15:42:11.492503+0000","last_undegraded":"2024-05-26T15:42:11.492503+0000","last_fullsized":"2024-05-26T15:42:11.492503+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.984759+0000","last_change":"2024-05-26T15:42:10.984759+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.984759+0000","last_undegraded":"2024-05-26T15:42:10.984759+0000","last_fullsized":"2024-05-26T15:42:10.984759+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999898+0000","last_change":"2024-05-26T15:42:10.994305+0000","last_active":"2024-05-26T15:42:10.999898+0000","last_peered":"2024-05-26T15:42:10.999898+0000","last_clean":"2024-05-26T15:42:10.999898+0000","last_became_active":"2024-05-26T15:42:10.992501+0000","last_became_peered":"2024-05-26T15:42:10.992501+0000","last_unstale":"2024-05-26T15:42:10.999898+0000","last_undegraded":"2024-05-26T15:42:10.999898+0000","last_fullsized":"2024-05-26T15:42:10.999898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.496238+0000","last_change":"2024-05-26T15:42:11.494994+0000","last_active":"2024-05-26T15:42:11.496238+0000","last_peered":"2024-05-26T15:42:11.496238+0000","last_clean":"2024-05-26T15:42:11.496238+0000","last_became_active":"2024-05-26T15:42:11.494663+0000","last_became_peered":"2024-05-26T15:42:11.494663+0000","last_unstale":"2024-05-26T15:42:11.496238+0000","last_undegraded":"2024-05-26T15:42:11.496238+0000","last_fullsized":"2024-05-26T15:42:11.496238+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.490230+0000","last_change":"2024-05-26T15:42:10.988783+0000","last_active":"2024-05-26T15:42:11.490230+0000","last_peered":"2024-05-26T15:42:11.490230+0000","last_clean":"2024-05-26T15:42:11.490230+0000","last_became_active":"2024-05-26T15:42:10.987904+0000","last_became_peered":"2024-05-26T15:42:10.987904+0000","last_unstale":"2024-05-26T15:42:11.490230+0000","last_undegraded":"2024-05-26T15:42:11.490230+0000","last_fullsized":"2024-05-26T15:42:11.490230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:28:20.962641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974455+0000","last_change":"2024-05-26T15:42:10.974455+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974455+0000","last_undegraded":"2024-05-26T15:42:10.974455+0000","last_fullsized":"2024-05-26T15:42:10.974455+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.502766+0000","last_change":"2024-05-26T15:42:10.990216+0000","last_active":"2024-05-26T15:42:11.502766+0000","last_peered":"2024-05-26T15:42:11.502766+0000","last_clean":"2024-05-26T15:42:11.502766+0000","last_became_active":"2024-05-26T15:42:10.988791+0000","last_became_peered":"2024-05-26T15:42:10.988791+0000","last_unstale":"2024-05-26T15:42:11.502766+0000","last_undegraded":"2024-05-26T15:42:11.502766+0000","last_fullsized":"2024-05-26T15:42:11.502766+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.487167+0000","last_change":"2024-05-26T15:42:11.484844+0000","last_active":"2024-05-26T15:42:11.487167+0000","last_peered":"2024-05-26T15:42:11.487167+0000","last_clean":"2024-05-26T15:42:11.487167+0000","last_became_active":"2024-05-26T15:42:11.484593+0000","last_became_peered":"2024-05-26T15:42:11.484593+0000","last_unstale":"2024-05-26T15:42:11.487167+0000","last_undegraded":"2024-05-26T15:42:11.487167+0000","last_fullsized":"2024-05-26T15:42:11.487167+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:54:37.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.485471+0000","last_change":"2024-05-26T15:42:10.993769+0000","last_active":"2024-05-26T15:42:11.485471+0000","last_peered":"2024-05-26T15:42:11.485471+0000","last_clean":"2024-05-26T15:42:11.485471+0000","last_became_active":"2024-05-26T15:42:10.993475+0000","last_became_peered":"2024-05-26T15:42:10.993475+0000","last_unstale":"2024-05-26T15:42:11.485471+0000","last_undegraded":"2024-05-26T15:42:11.485471+0000","last_fullsized":"2024-05-26T15:42:11.485471+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:42.382894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512009+0000","last_change":"2024-05-26T15:42:11.511184+0000","last_active":"2024-05-26T15:42:11.512009+0000","last_peered":"2024-05-26T15:42:11.512009+0000","last_clean":"2024-05-26T15:42:11.512009+0000","last_became_active":"2024-05-26T15:42:11.510627+0000","last_became_peered":"2024-05-26T15:42:11.510627+0000","last_unstale":"2024-05-26T15:42:11.512009+0000","last_undegraded":"2024-05-26T15:42:11.512009+0000","last_fullsized":"2024-05-26T15:42:11.512009+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.986886+0000","last_change":"2024-05-26T15:42:10.984163+0000","last_active":"2024-05-26T15:42:10.986886+0000","last_peered":"2024-05-26T15:42:10.986886+0000","last_clean":"2024-05-26T15:42:10.986886+0000","last_became_active":"2024-05-26T15:42:10.982899+0000","last_became_peered":"2024-05-26T15:42:10.982899+0000","last_unstale":"2024-05-26T15:42:10.986886+0000","last_undegraded":"2024-05-26T15:42:10.986886+0000","last_fullsized":"2024-05-26T15:42:10.986886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.986730+0000","last_change":"2024-05-26T15:42:10.986730+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.986730+0000","last_undegraded":"2024-05-26T15:42:10.986730+0000","last_fullsized":"2024-05-26T15:42:10.986730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486523+0000","last_change":"2024-05-26T15:42:10.990225+0000","last_active":"2024-05-26T15:42:11.486523+0000","last_peered":"2024-05-26T15:42:11.486523+0000","last_clean":"2024-05-26T15:42:11.486523+0000","last_became_active":"2024-05-26T15:42:10.989032+0000","last_became_peered":"2024-05-26T15:42:10.989032+0000","last_unstale":"2024-05-26T15:42:11.486523+0000","last_undegraded":"2024-05-26T15:42:11.486523+0000","last_fullsized":"2024-05-26T15:42:11.486523+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:04.490649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486284+0000","last_change":"2024-05-26T15:42:11.484249+0000","last_active":"2024-05-26T15:42:11.486284+0000","last_peered":"2024-05-26T15:42:11.486284+0000","last_clean":"2024-05-26T15:42:11.486284+0000","last_became_active":"2024-05-26T15:42:11.483933+0000","last_became_peered":"2024-05-26T15:42:11.483933+0000","last_unstale":"2024-05-26T15:42:11.486284+0000","last_undegraded":"2024-05-26T15:42:11.486284+0000","last_fullsized":"2024-05-26T15:42:11.486284+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999554+0000","last_change":"2024-05-26T15:42:10.993335+0000","last_active":"2024-05-26T15:42:10.999554+0000","last_peered":"2024-05-26T15:42:10.999554+0000","last_clean":"2024-05-26T15:42:10.999554+0000","last_became_active":"2024-05-26T15:42:10.992580+0000","last_became_peered":"2024-05-26T15:42:10.992580+0000","last_unstale":"2024-05-26T15:42:10.999554+0000","last_undegraded":"2024-05-26T15:42:10.999554+0000","last_fullsized":"2024-05-26T15:42:10.999554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:28:20.962641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988191+0000","last_change":"2024-05-26T15:42:10.988191+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988191+0000","last_undegraded":"2024-05-26T15:42:10.988191+0000","last_fullsized":"2024-05-26T15:42:10.988191+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.989009+0000","last_change":"2024-05-26T15:42:10.985611+0000","last_active":"2024-05-26T15:42:10.989009+0000","last_peered":"2024-05-26T15:42:10.989009+0000","last_clean":"2024-05-26T15:42:10.989009+0000","last_became_active":"2024-05-26T15:42:10.985306+0000","last_became_peered":"2024-05-26T15:42:10.985306+0000","last_unstale":"2024-05-26T15:42:10.989009+0000","last_undegraded":"2024-05-26T15:42:10.989009+0000","last_fullsized":"2024-05-26T15:42:10.989009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:42.382894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492395+0000","last_change":"2024-05-26T15:42:11.488874+0000","last_active":"2024-05-26T15:42:11.492395+0000","last_peered":"2024-05-26T15:42:11.492395+0000","last_clean":"2024-05-26T15:42:11.492395+0000","last_became_active":"2024-05-26T15:42:11.488482+0000","last_became_peered":"2024-05-26T15:42:11.488482+0000","last_unstale":"2024-05-26T15:42:11.492395+0000","last_undegraded":"2024-05-26T15:42:11.492395+0000","last_fullsized":"2024-05-26T15:42:11.492395+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001352+0000","last_change":"2024-05-26T15:42:11.000242+0000","last_active":"2024-05-26T15:42:11.001352+0000","last_peered":"2024-05-26T15:42:11.001352+0000","last_clean":"2024-05-26T15:42:11.001352+0000","last_became_active":"2024-05-26T15:42:10.999921+0000","last_became_peered":"2024-05-26T15:42:10.999921+0000","last_unstale":"2024-05-26T15:42:11.001352+0000","last_undegraded":"2024-05-26T15:42:11.001352+0000","last_fullsized":"2024-05-26T15:42:11.001352+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:47:33.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.491565+0000","last_change":"2024-05-26T15:42:11.483171+0000","last_active":"2024-05-26T15:42:11.491565+0000","last_peered":"2024-05-26T15:42:11.491565+0000","last_clean":"2024-05-26T15:42:11.491565+0000","last_became_active":"2024-05-26T15:42:11.482824+0000","last_became_peered":"2024-05-26T15:42:11.482824+0000","last_unstale":"2024-05-26T15:42:11.491565+0000","last_undegraded":"2024-05-26T15:42:11.491565+0000","last_fullsized":"2024-05-26T15:42:11.491565+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.481049+0000","last_change":"2024-05-26T15:42:10.988391+0000","last_active":"2024-05-26T15:42:11.481049+0000","last_peered":"2024-05-26T15:42:11.481049+0000","last_clean":"2024-05-26T15:42:11.481049+0000","last_became_active":"2024-05-26T15:42:10.987480+0000","last_became_peered":"2024-05-26T15:42:10.987480+0000","last_unstale":"2024-05-26T15:42:11.481049+0000","last_undegraded":"2024-05-26T15:42:11.481049+0000","last_fullsized":"2024-05-26T15:42:11.481049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.970692+0000","last_change":"2024-05-26T15:42:10.970692+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.970692+0000","last_undegraded":"2024-05-26T15:42:10.970692+0000","last_fullsized":"2024-05-26T15:42:10.970692+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:11:38.601829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001000+0000","last_change":"2024-05-26T15:42:10.998727+0000","last_active":"2024-05-26T15:42:11.001000+0000","last_peered":"2024-05-26T15:42:11.001000+0000","last_clean":"2024-05-26T15:42:11.001000+0000","last_became_active":"2024-05-26T15:42:10.998442+0000","last_became_peered":"2024-05-26T15:42:10.998442+0000","last_unstale":"2024-05-26T15:42:11.001000+0000","last_undegraded":"2024-05-26T15:42:11.001000+0000","last_fullsized":"2024-05-26T15:42:11.001000+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.505459+0000","last_change":"2024-05-26T15:42:11.504819+0000","last_active":"2024-05-26T15:42:11.505459+0000","last_peered":"2024-05-26T15:42:11.505459+0000","last_clean":"2024-05-26T15:42:11.505459+0000","last_became_active":"2024-05-26T15:42:11.504514+0000","last_became_peered":"2024-05-26T15:42:11.504514+0000","last_unstale":"2024-05-26T15:42:11.505459+0000","last_undegraded":"2024-05-26T15:42:11.505459+0000","last_fullsized":"2024-05-26T15:42:11.505459+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.514641+0000","last_change":"2024-05-26T15:42:10.992839+0000","last_active":"2024-05-26T15:42:11.514641+0000","last_peered":"2024-05-26T15:42:11.514641+0000","last_clean":"2024-05-26T15:42:11.514641+0000","last_became_active":"2024-05-26T15:42:10.992579+0000","last_became_peered":"2024-05-26T15:42:10.992579+0000","last_unstale":"2024-05-26T15:42:11.514641+0000","last_undegraded":"2024-05-26T15:42:11.514641+0000","last_fullsized":"2024-05-26T15:42:11.514641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:42.284507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.495824+0000","last_change":"2024-05-26T15:42:11.493992+0000","last_active":"2024-05-26T15:42:11.495824+0000","last_peered":"2024-05-26T15:42:11.495824+0000","last_clean":"2024-05-26T15:42:11.495824+0000","last_became_active":"2024-05-26T15:42:11.493723+0000","last_became_peered":"2024-05-26T15:42:11.493723+0000","last_unstale":"2024-05-26T15:42:11.495824+0000","last_undegraded":"2024-05-26T15:42:11.495824+0000","last_fullsized":"2024-05-26T15:42:11.495824+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999433+0000","last_change":"2024-05-26T15:42:10.997701+0000","last_active":"2024-05-26T15:42:10.999433+0000","last_peered":"2024-05-26T15:42:10.999433+0000","last_clean":"2024-05-26T15:42:10.999433+0000","last_became_active":"2024-05-26T15:42:10.997346+0000","last_became_peered":"2024-05-26T15:42:10.997346+0000","last_unstale":"2024-05-26T15:42:10.999433+0000","last_undegraded":"2024-05-26T15:42:10.999433+0000","last_fullsized":"2024-05-26T15:42:10.999433+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:33.637114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971101+0000","last_change":"2024-05-26T15:42:10.971101+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971101+0000","last_undegraded":"2024-05-26T15:42:10.971101+0000","last_fullsized":"2024-05-26T15:42:10.971101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:12:21.904002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997217+0000","last_change":"2024-05-26T15:42:10.991731+0000","last_active":"2024-05-26T15:42:10.997217+0000","last_peered":"2024-05-26T15:42:10.997217+0000","last_clean":"2024-05-26T15:42:10.997217+0000","last_became_active":"2024-05-26T15:42:10.991441+0000","last_became_peered":"2024-05-26T15:42:10.991441+0000","last_unstale":"2024-05-26T15:42:10.997217+0000","last_undegraded":"2024-05-26T15:42:10.997217+0000","last_fullsized":"2024-05-26T15:42:10.997217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:42:08.139990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.490386+0000","last_change":"2024-05-26T15:42:11.489521+0000","last_active":"2024-05-26T15:42:11.490386+0000","last_peered":"2024-05-26T15:42:11.490386+0000","last_clean":"2024-05-26T15:42:11.490386+0000","last_became_active":"2024-05-26T15:42:11.489213+0000","last_became_peered":"2024-05-26T15:42:11.489213+0000","last_unstale":"2024-05-26T15:42:11.490386+0000","last_undegraded":"2024-05-26T15:42:11.490386+0000","last_fullsized":"2024-05-26T15:42:11.490386+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:16:18.154776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000959+0000","last_change":"2024-05-26T15:42:10.998347+0000","last_active":"2024-05-26T15:42:11.000959+0000","last_peered":"2024-05-26T15:42:11.000959+0000","last_clean":"2024-05-26T15:42:11.000959+0000","last_became_active":"2024-05-26T15:42:10.998044+0000","last_became_peered":"2024-05-26T15:42:10.998044+0000","last_unstale":"2024-05-26T15:42:11.000959+0000","last_undegraded":"2024-05-26T15:42:11.000959+0000","last_fullsized":"2024-05-26T15:42:11.000959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:29:49.530204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974584+0000","last_change":"2024-05-26T15:42:10.974584+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974584+0000","last_undegraded":"2024-05-26T15:42:10.974584+0000","last_fullsized":"2024-05-26T15:42:10.974584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:04:06.159661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.503218+0000","last_change":"2024-05-26T15:42:10.986901+0000","last_active":"2024-05-26T15:42:11.503218+0000","last_peered":"2024-05-26T15:42:11.503218+0000","last_clean":"2024-05-26T15:42:11.503218+0000","last_became_active":"2024-05-26T15:42:10.986607+0000","last_became_peered":"2024-05-26T15:42:10.986607+0000","last_unstale":"2024-05-26T15:42:11.503218+0000","last_undegraded":"2024-05-26T15:42:11.503218+0000","last_fullsized":"2024-05-26T15:42:11.503218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:34:53.688146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486884+0000","last_change":"2024-05-26T15:42:11.480883+0000","last_active":"2024-05-26T15:42:11.486884+0000","last_peered":"2024-05-26T15:42:11.486884+0000","last_clean":"2024-05-26T15:42:11.486884+0000","last_became_active":"2024-05-26T15:42:11.480431+0000","last_became_peered":"2024-05-26T15:42:11.480431+0000","last_unstale":"2024-05-26T15:42:11.486884+0000","last_undegraded":"2024-05-26T15:42:11.486884+0000","last_fullsized":"2024-05-26T15:42:11.486884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:54:36.629232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001369+0000","last_change":"2024-05-26T15:42:10.998759+0000","last_active":"2024-05-26T15:42:11.001369+0000","last_peered":"2024-05-26T15:42:11.001369+0000","last_clean":"2024-05-26T15:42:11.001369+0000","last_became_active":"2024-05-26T15:42:10.997608+0000","last_became_peered":"2024-05-26T15:42:10.997608+0000","last_unstale":"2024-05-26T15:42:11.001369+0000","last_undegraded":"2024-05-26T15:42:11.001369+0000","last_fullsized":"2024-05-26T15:42:11.001369+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:02.353379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494353+0000","last_change":"2024-05-26T15:42:11.492971+0000","last_active":"2024-05-26T15:42:11.494353+0000","last_peered":"2024-05-26T15:42:11.494353+0000","last_clean":"2024-05-26T15:42:11.494353+0000","last_became_active":"2024-05-26T15:42:11.492712+0000","last_became_peered":"2024-05-26T15:42:11.492712+0000","last_unstale":"2024-05-26T15:42:11.494353+0000","last_undegraded":"2024-05-26T15:42:11.494353+0000","last_fullsized":"2024-05-26T15:42:11.494353+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:33:15.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.502779+0000","last_change":"2024-05-26T15:42:10.987809+0000","last_active":"2024-05-26T15:42:11.502779+0000","last_peered":"2024-05-26T15:42:11.502779+0000","last_clean":"2024-05-26T15:42:11.502779+0000","last_became_active":"2024-05-26T15:42:10.987533+0000","last_became_peered":"2024-05-26T15:42:10.987533+0000","last_unstale":"2024-05-26T15:42:11.502779+0000","last_undegraded":"2024-05-26T15:42:11.502779+0000","last_fullsized":"2024-05-26T15:42:11.502779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:23:08.480431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.510255+0000","last_change":"2024-05-26T15:42:11.509067+0000","last_active":"2024-05-26T15:42:11.510255+0000","last_peered":"2024-05-26T15:42:11.510255+0000","last_clean":"2024-05-26T15:42:11.510255+0000","last_became_active":"2024-05-26T15:42:11.508750+0000","last_became_peered":"2024-05-26T15:42:11.508750+0000","last_unstale":"2024-05-26T15:42:11.510255+0000","last_undegraded":"2024-05-26T15:42:11.510255+0000","last_fullsized":"2024-05-26T15:42:11.510255+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997174+0000","last_change":"2024-05-26T15:42:10.991160+0000","last_active":"2024-05-26T15:42:10.997174+0000","last_peered":"2024-05-26T15:42:10.997174+0000","last_clean":"2024-05-26T15:42:10.997174+0000","last_became_active":"2024-05-26T15:42:10.990470+0000","last_became_peered":"2024-05-26T15:42:10.990470+0000","last_unstale":"2024-05-26T15:42:10.997174+0000","last_undegraded":"2024-05-26T15:42:10.997174+0000","last_fullsized":"2024-05-26T15:42:10.997174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:52:01.513775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.480533+0000","last_change":"2024-05-26T15:42:11.474929+0000","last_active":"2024-05-26T15:42:11.480533+0000","last_peered":"2024-05-26T15:42:11.480533+0000","last_clean":"2024-05-26T15:42:11.480533+0000","last_became_active":"2024-05-26T15:42:11.474601+0000","last_became_peered":"2024-05-26T15:42:11.474601+0000","last_unstale":"2024-05-26T15:42:11.480533+0000","last_undegraded":"2024-05-26T15:42:11.480533+0000","last_fullsized":"2024-05-26T15:42:11.480533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000827+0000","last_change":"2024-05-26T15:42:10.996147+0000","last_active":"2024-05-26T15:42:11.000827+0000","last_peered":"2024-05-26T15:42:11.000827+0000","last_clean":"2024-05-26T15:42:11.000827+0000","last_became_active":"2024-05-26T15:42:10.995452+0000","last_became_peered":"2024-05-26T15:42:10.995452+0000","last_unstale":"2024-05-26T15:42:11.000827+0000","last_undegraded":"2024-05-26T15:42:11.000827+0000","last_fullsized":"2024-05-26T15:42:11.000827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:05:01.848852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500164+0000","last_change":"2024-05-26T15:42:11.495714+0000","last_active":"2024-05-26T15:42:11.500164+0000","last_peered":"2024-05-26T15:42:11.500164+0000","last_clean":"2024-05-26T15:42:11.500164+0000","last_became_active":"2024-05-26T15:42:11.495136+0000","last_became_peered":"2024-05-26T15:42:11.495136+0000","last_unstale":"2024-05-26T15:42:11.500164+0000","last_undegraded":"2024-05-26T15:42:11.500164+0000","last_fullsized":"2024-05-26T15:42:11.500164+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494221+0000","last_change":"2024-05-26T15:42:10.975898+0000","last_active":"2024-05-26T15:42:11.494221+0000","last_peered":"2024-05-26T15:42:11.494221+0000","last_clean":"2024-05-26T15:42:11.494221+0000","last_became_active":"2024-05-26T15:42:10.975600+0000","last_became_peered":"2024-05-26T15:42:10.975600+0000","last_unstale":"2024-05-26T15:42:11.494221+0000","last_undegraded":"2024-05-26T15:42:11.494221+0000","last_fullsized":"2024-05-26T15:42:11.494221+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.978558+0000","last_change":"2024-05-26T15:42:10.978558+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.978558+0000","last_undegraded":"2024-05-26T15:42:10.978558+0000","last_fullsized":"2024-05-26T15:42:10.978558+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.468936+0000","last_change":"2024-05-26T15:42:10.991079+0000","last_active":"2024-05-26T15:42:11.468936+0000","last_peered":"2024-05-26T15:42:11.468936+0000","last_clean":"2024-05-26T15:42:11.468936+0000","last_became_active":"2024-05-26T15:42:10.990406+0000","last_became_peered":"2024-05-26T15:42:10.990406+0000","last_unstale":"2024-05-26T15:42:11.468936+0000","last_undegraded":"2024-05-26T15:42:11.468936+0000","last_fullsized":"2024-05-26T15:42:11.468936+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:42:34.129309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974545+0000","last_change":"2024-05-26T15:42:10.974545+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974545+0000","last_undegraded":"2024-05-26T15:42:10.974545+0000","last_fullsized":"2024-05-26T15:42:10.974545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:08:18.416170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.991527+0000","last_change":"2024-05-26T15:42:10.989749+0000","last_active":"2024-05-26T15:42:10.991527+0000","last_peered":"2024-05-26T15:42:10.991527+0000","last_clean":"2024-05-26T15:42:10.991527+0000","last_became_active":"2024-05-26T15:42:10.989423+0000","last_became_peered":"2024-05-26T15:42:10.989423+0000","last_unstale":"2024-05-26T15:42:10.991527+0000","last_undegraded":"2024-05-26T15:42:10.991527+0000","last_fullsized":"2024-05-26T15:42:10.991527+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:40.916618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.493498+0000","last_change":"2024-05-26T15:42:11.484429+0000","last_active":"2024-05-26T15:42:11.493498+0000","last_peered":"2024-05-26T15:42:11.493498+0000","last_clean":"2024-05-26T15:42:11.493498+0000","last_became_active":"2024-05-26T15:42:11.484135+0000","last_became_peered":"2024-05-26T15:42:11.484135+0000","last_unstale":"2024-05-26T15:42:11.493498+0000","last_undegraded":"2024-05-26T15:42:11.493498+0000","last_fullsized":"2024-05-26T15:42:11.493498+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.473231+0000","last_change":"2024-05-26T15:42:10.991543+0000","last_active":"2024-05-26T15:42:11.473231+0000","last_peered":"2024-05-26T15:42:11.473231+0000","last_clean":"2024-05-26T15:42:11.473231+0000","last_became_active":"2024-05-26T15:42:10.991274+0000","last_became_peered":"2024-05-26T15:42:10.991274+0000","last_unstale":"2024-05-26T15:42:11.473231+0000","last_undegraded":"2024-05-26T15:42:11.473231+0000","last_fullsized":"2024-05-26T15:42:11.473231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:53:19.992334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492484+0000","last_change":"2024-05-26T15:42:11.485797+0000","last_active":"2024-05-26T15:42:11.492484+0000","last_peered":"2024-05-26T15:42:11.492484+0000","last_clean":"2024-05-26T15:42:11.492484+0000","last_became_active":"2024-05-26T15:42:11.483913+0000","last_became_peered":"2024-05-26T15:42:11.483913+0000","last_unstale":"2024-05-26T15:42:11.492484+0000","last_undegraded":"2024-05-26T15:42:11.492484+0000","last_fullsized":"2024-05-26T15:42:11.492484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:48:48.284704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997270+0000","last_change":"2024-05-26T15:42:10.991882+0000","last_active":"2024-05-26T15:42:10.997270+0000","last_peered":"2024-05-26T15:42:10.997270+0000","last_clean":"2024-05-26T15:42:10.997270+0000","last_became_active":"2024-05-26T15:42:10.991556+0000","last_became_peered":"2024-05-26T15:42:10.991556+0000","last_unstale":"2024-05-26T15:42:10.997270+0000","last_undegraded":"2024-05-26T15:42:10.997270+0000","last_fullsized":"2024-05-26T15:42:10.997270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494407+0000","last_change":"2024-05-26T15:42:11.487435+0000","last_active":"2024-05-26T15:42:11.494407+0000","last_peered":"2024-05-26T15:42:11.494407+0000","last_clean":"2024-05-26T15:42:11.494407+0000","last_became_active":"2024-05-26T15:42:11.487190+0000","last_became_peered":"2024-05-26T15:42:11.487190+0000","last_unstale":"2024-05-26T15:42:11.494407+0000","last_undegraded":"2024-05-26T15:42:11.494407+0000","last_fullsized":"2024-05-26T15:42:11.494407+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000286+0000","last_change":"2024-05-26T15:42:10.996454+0000","last_active":"2024-05-26T15:42:11.000286+0000","last_peered":"2024-05-26T15:42:11.000286+0000","last_clean":"2024-05-26T15:42:11.000286+0000","last_became_active":"2024-05-26T15:42:10.996007+0000","last_became_peered":"2024-05-26T15:42:10.996007+0000","last_unstale":"2024-05-26T15:42:11.000286+0000","last_undegraded":"2024-05-26T15:42:11.000286+0000","last_fullsized":"2024-05-26T15:42:11.000286+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:15:52.653657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494059+0000","last_change":"2024-05-26T15:42:11.493289+0000","last_active":"2024-05-26T15:42:11.494059+0000","last_peered":"2024-05-26T15:42:11.494059+0000","last_clean":"2024-05-26T15:42:11.494059+0000","last_became_active":"2024-05-26T15:42:11.493002+0000","last_became_peered":"2024-05-26T15:42:11.493002+0000","last_unstale":"2024-05-26T15:42:11.494059+0000","last_undegraded":"2024-05-26T15:42:11.494059+0000","last_fullsized":"2024-05-26T15:42:11.494059+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:10:12.251535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.998218+0000","last_change":"2024-05-26T15:42:10.994854+0000","last_active":"2024-05-26T15:42:10.998218+0000","last_peered":"2024-05-26T15:42:10.998218+0000","last_clean":"2024-05-26T15:42:10.998218+0000","last_became_active":"2024-05-26T15:42:10.994565+0000","last_became_peered":"2024-05-26T15:42:10.994565+0000","last_unstale":"2024-05-26T15:42:10.998218+0000","last_undegraded":"2024-05-26T15:42:10.998218+0000","last_fullsized":"2024-05-26T15:42:10.998218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:17.523734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.973797+0000","last_change":"2024-05-26T15:42:10.973797+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.973797+0000","last_undegraded":"2024-05-26T15:42:10.973797+0000","last_fullsized":"2024-05-26T15:42:10.973797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:56:54.463216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.470519+0000","last_change":"2024-05-26T15:42:10.995708+0000","last_active":"2024-05-26T15:42:11.470519+0000","last_peered":"2024-05-26T15:42:11.470519+0000","last_clean":"2024-05-26T15:42:11.470519+0000","last_became_active":"2024-05-26T15:42:10.994183+0000","last_became_peered":"2024-05-26T15:42:10.994183+0000","last_unstale":"2024-05-26T15:42:11.470519+0000","last_undegraded":"2024-05-26T15:42:11.470519+0000","last_fullsized":"2024-05-26T15:42:11.470519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:16:25.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494771+0000","last_change":"2024-05-26T15:42:11.493284+0000","last_active":"2024-05-26T15:42:11.494771+0000","last_peered":"2024-05-26T15:42:11.494771+0000","last_clean":"2024-05-26T15:42:11.494771+0000","last_became_active":"2024-05-26T15:42:11.492376+0000","last_became_peered":"2024-05-26T15:42:11.492376+0000","last_unstale":"2024-05-26T15:42:11.494771+0000","last_undegraded":"2024-05-26T15:42:11.494771+0000","last_fullsized":"2024-05-26T15:42:11.494771+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.469095+0000","last_change":"2024-05-26T15:42:10.996318+0000","last_active":"2024-05-26T15:42:11.469095+0000","last_peered":"2024-05-26T15:42:11.469095+0000","last_clean":"2024-05-26T15:42:11.469095+0000","last_became_active":"2024-05-26T15:42:10.996055+0000","last_became_peered":"2024-05-26T15:42:10.996055+0000","last_unstale":"2024-05-26T15:42:11.469095+0000","last_undegraded":"2024-05-26T15:42:11.469095+0000","last_fullsized":"2024-05-26T15:42:11.469095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:12:49.868345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977618+0000","last_change":"2024-05-26T15:42:10.977618+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977618+0000","last_undegraded":"2024-05-26T15:42:10.977618+0000","last_fullsized":"2024-05-26T15:42:10.977618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:12:02.298237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.477482+0000","last_change":"2024-05-26T15:42:10.988191+0000","last_active":"2024-05-26T15:42:11.477482+0000","last_peered":"2024-05-26T15:42:11.477482+0000","last_clean":"2024-05-26T15:42:11.477482+0000","last_became_active":"2024-05-26T15:42:10.987878+0000","last_became_peered":"2024-05-26T15:42:10.987878+0000","last_unstale":"2024-05-26T15:42:11.477482+0000","last_undegraded":"2024-05-26T15:42:11.477482+0000","last_fullsized":"2024-05-26T15:42:11.477482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499900+0000","last_change":"2024-05-26T15:42:11.498253+0000","last_active":"2024-05-26T15:42:11.499900+0000","last_peered":"2024-05-26T15:42:11.499900+0000","last_clean":"2024-05-26T15:42:11.499900+0000","last_became_active":"2024-05-26T15:42:11.497352+0000","last_became_peered":"2024-05-26T15:42:11.497352+0000","last_unstale":"2024-05-26T15:42:11.499900+0000","last_undegraded":"2024-05-26T15:42:11.499900+0000","last_fullsized":"2024-05-26T15:42:11.499900+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:58:56.943330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.466389+0000","last_change":"2024-05-26T15:42:10.984171+0000","last_active":"2024-05-26T15:42:11.466389+0000","last_peered":"2024-05-26T15:42:11.466389+0000","last_clean":"2024-05-26T15:42:11.466389+0000","last_became_active":"2024-05-26T15:42:10.983594+0000","last_became_peered":"2024-05-26T15:42:10.983594+0000","last_unstale":"2024-05-26T15:42:11.466389+0000","last_undegraded":"2024-05-26T15:42:11.466389+0000","last_fullsized":"2024-05-26T15:42:11.466389+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.972240+0000","last_change":"2024-05-26T15:42:10.972240+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.972240+0000","last_undegraded":"2024-05-26T15:42:10.972240+0000","last_fullsized":"2024-05-26T15:42:10.972240+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.998959+0000","last_change":"2024-05-26T15:42:10.997668+0000","last_active":"2024-05-26T15:42:10.998959+0000","last_peered":"2024-05-26T15:42:10.998959+0000","last_clean":"2024-05-26T15:42:10.998959+0000","last_became_active":"2024-05-26T15:42:10.997353+0000","last_became_peered":"2024-05-26T15:42:10.997353+0000","last_unstale":"2024-05-26T15:42:10.998959+0000","last_undegraded":"2024-05-26T15:42:10.998959+0000","last_fullsized":"2024-05-26T15:42:10.998959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:45.987751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-26T15:42:09.976056+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:42:09.976056+0000","last_peered":"2024-05-26T15:42:09.976056+0000","last_clean":"2024-05-26T15:42:09.976056+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:42:09.976056+0000","last_undegraded":"2024-05-26T15:42:09.976056+0000","last_fullsized":"2024-05-26T15:42:09.976056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1212416,"data_stored":863638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.643,"5min":1.802,"15min":1.802},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.84399999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.55,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2310000000000001,"15min":1.2330000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.204},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2669999999999999,"15min":1.2709999999999999},"min":{"1min":0.91000000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.601}]},{"osd":2,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3300000000000001,"15min":1.3240000000000001},"min":{"1min":0.92000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6870000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.137}]},{"osd":3,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":0.85999999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.946,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.498},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4830000000000001,"15min":1.484},"min":{"1min":1.0189999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.968,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.417}]},{"osd":4,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.448,"15min":1.446},"min":{"1min":0.873,"5min":0.87,"15min":0.87},"max":{"1min":2.0800000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.5640000000000001,"15min":1.5660000000000001},"min":{"1min":1.0589999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.0659999999999998,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.5489999999999999}]},{"osd":5,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.542,"15min":1.552},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.0409999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.25},{"interface":"front","average":{"1min":1.71,"5min":1.669,"15min":1.6619999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.2050000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.272}]},{"osd":6,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6819999999999999,"15min":1.6879999999999999},"min":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"max":{"1min":2.2480000000000002,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8240000000000001,"15min":1.8220000000000001},"min":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"max":{"1min":2.4609999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.3939999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":618496,"data_stored":273270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1599999999999999,"15min":1.1639999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5249999999999999,"5min":1.736,"15min":1.736},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.83599999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.96799999999999997}]},{"osd":1,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.202,"15min":1.1990000000000001},"min":{"1min":0.78700000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.024},{"interface":"front","average":{"1min":1.276,"5min":1.2410000000000001,"15min":1.2350000000000001},"min":{"1min":0.92500000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6859999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.4379999999999999}]},{"osd":2,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.85699999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6659999999999999,"5min":2.157,"15min":2.157},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.5029999999999999,"15min":1.516},"min":{"1min":0.998,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.032,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.81899999999999995}]},{"osd":3,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.403,"15min":1.4139999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.76,"5min":2.169,"15min":2.169},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.639,"15min":1.6830000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.9890000000000001,"5min":4.452,"15min":4.452},"last":1.1399999999999999}]},{"osd":4,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.637,"15min":1.657},"min":{"1min":0.82799999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.893,"5min":3.282,"15min":3.282},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.512,"15min":1.524},"min":{"1min":0.71499999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.931,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.476}]},{"osd":5,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.7130000000000001,"15min":1.7410000000000001},"min":{"1min":0.89600000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0219999999999998,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.399},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.615,"15min":1.645},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.1459999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.365}]},{"osd":7,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.7789999999999999,"15min":1.8109999999999999},"min":{"1min":1.1240000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.145,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.7889999999999999,"15min":1.8200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.2200000000000002,"5min":2.843,"15min":2.843},"last":1.24}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":651264,"data_stored":292561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.127,"15min":1.143},"min":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5489999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.0860000000000001,"15min":1.0700000000000001},"min":{"1min":0.81100000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.6180000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.627}]},{"osd":1,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.1220000000000001,"15min":1.089},"min":{"1min":0.89900000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.135},{"interface":"front","average":{"1min":1.232,"5min":1.1439999999999999,"15min":1.129},"min":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.268}]},{"osd":2,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.1879999999999999,"15min":1.181},"min":{"1min":0.92700000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4550000000000001,"5min":1.659,"15min":1.659},"last":1.006},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.2949999999999999,"15min":1.2829999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.3100000000000001}]},{"osd":3,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.337,"15min":1.3440000000000001},"min":{"1min":0.94299999999999995,"5min":0.871,"15min":0.871},"max":{"1min":1.7849999999999999,"5min":1.879,"15min":1.879},"last":1.806},{"interface":"front","average":{"1min":1.361,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.76,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.516}]},{"osd":4,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3440000000000001,"15min":1.3380000000000001},"min":{"1min":0.84799999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.736,"5min":2.077,"15min":2.077},"last":1.466},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5720000000000001,"15min":1.5820000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.9630000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.9470000000000001}]},{"osd":6,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.5269999999999999,"15min":1.538},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.47,"15min":1.462},"min":{"1min":1.1839999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.8939999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.75}]},{"osd":7,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.623,"15min":1.6299999999999999},"min":{"1min":1.173,"5min":1.036,"15min":1.036},"max":{"1min":2.3159999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.889},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.645,"15min":1.6499999999999999},"min":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.7030000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":659456,"data_stored":294162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.1479999999999999,"15min":1.1619999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7190000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.238,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.601,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.625}]},{"osd":1,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2470000000000001,"15min":1.2589999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.764,"5min":2.238,"15min":2.238},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.139,"15min":1.1299999999999999},"min":{"1min":0.86399999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.75,"15min":1.75},"last":1.1180000000000001}]},{"osd":2,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.86799999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6479999999999999,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.302,"15min":1.3049999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7490000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.92700000000000005}]},{"osd":3,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.292,"15min":1.28},"min":{"1min":1.077,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.6639999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.248},{"interface":"front","average":{"1min":1.411,"5min":1.4790000000000001,"15min":1.49},"min":{"1min":1.1579999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":1.7529999999999999,"5min":2.734,"15min":2.734},"last":1.554}]},{"osd":5,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.502,"15min":1.502},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":1.8759999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.069},{"interface":"front","average":{"1min":1.452,"5min":1.504,"15min":1.512},"min":{"1min":1.206,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":1.794,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3859999999999999}]},{"osd":6,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.5720000000000001,"15min":1.5860000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.879,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.653,"15min":1.6619999999999999},"min":{"1min":1.2889999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.917,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.1719999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.6559999999999999,"15min":1.6779999999999999},"min":{"1min":1.236,"5min":1.147,"15min":1.147},"max":{"1min":1.9490000000000001,"5min":4.008,"15min":4.008},"last":1.522},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.75,"15min":1.7709999999999999},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.9730000000000001,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.7010000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":671744,"data_stored":295166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90000000000000002,"15min":0.90500000000000003},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.508,"15min":1.508},"last":0.746},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94599999999999995,"15min":0.94699999999999995},"min":{"1min":0.56999999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.2929999999999999,"5min":1.659,"15min":1.659},"last":0.71999999999999997}]},{"osd":1,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.98899999999999999,"15min":1.0009999999999999},"min":{"1min":0.52800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3149999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.089,"5min":1.198,"15min":1.216},"min":{"1min":0.70399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6439999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.94399999999999995}]},{"osd":2,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.1419999999999999,"15min":1.1659999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.70499999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7789999999999999,"5min":1.954,"15min":1.954},"last":1.0389999999999999}]},{"osd":4,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.296,"15min":1.3009999999999999},"min":{"1min":0.97799999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.915,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.4219999999999999,"15min":1.4419999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8149999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.3500000000000001}]},{"osd":5,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.4750000000000001,"15min":1.492},"min":{"1min":0.96399999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.968,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.389},{"interface":"front","average":{"1min":1.429,"5min":1.4239999999999999,"15min":1.423},"min":{"1min":0.875,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.794,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.51,"15min":1.536},"min":{"1min":0.93000000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.9430000000000001,"5min":2.863,"15min":2.863},"last":1.657},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.593,"15min":1.605},"min":{"1min":1.105,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.0659999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.635}]},{"osd":7,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.5149999999999999,"15min":1.5109999999999999},"min":{"1min":1.224,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.0640000000000001,"5min":2.306,"15min":2.306},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.575,"15min":1.591},"min":{"1min":1.0069999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.145,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.556}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":294125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0129999999999999,"15min":1.026},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3260000000000001,"5min":1.47,"15min":1.47},"last":0.874},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52300000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.6339999999999999,"5min":1.748,"15min":1.748},"last":1.232}]},{"osd":1,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.04,"15min":1.056},"min":{"1min":0.626,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2170000000000001,"15min":1.1970000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":7.4770000000000003,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.98799999999999999}]},{"osd":3,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.04,"15min":1.0349999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":0.69199999999999995,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1789999999999998,"5min":2.903,"15min":2.903},"last":0.91500000000000004}]},{"osd":4,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":1.5549999999999999,"15min":1.502},"min":{"1min":0.93500000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":10.438000000000001,"5min":10.438000000000001,"15min":10.438000000000001},"last":1.151},{"interface":"front","average":{"1min":1.363,"5min":1.4610000000000001,"15min":1.4770000000000001},"min":{"1min":1.046,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.6930000000000001,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.1870000000000001}]},{"osd":5,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8220000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.7150000000000001,"15min":1.6699999999999999},"min":{"1min":1.105,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":10.798999999999999,"5min":10.798999999999999,"15min":10.798999999999999},"last":1.369}]},{"osd":6,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.6379999999999999,"15min":1.6040000000000001},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":7.851,"5min":7.851,"15min":7.851},"last":1.272},{"interface":"front","average":{"1min":1.962,"5min":1.6779999999999999,"15min":1.6299999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":10.672000000000001,"5min":10.672000000000001,"15min":10.672000000000001},"last":1.4399999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":2.0339999999999998,"5min":1.794,"15min":1.754},"min":{"1min":1.224,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":10.249000000000001,"5min":10.249000000000001,"15min":10.249000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.5980000000000001,"15min":1.607},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.3839999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":293740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.0529999999999999,"15min":1.0840000000000001},"min":{"1min":0.59999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.417,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.107,"15min":1.129},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.639,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.99399999999999999,"15min":1.0149999999999999},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.623,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.073},{"interface":"front","average":{"1min":1.054,"5min":1.266,"15min":1.302},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5349999999999999,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.012}]},{"osd":3,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.337,"15min":1.371},"min":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7809999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.171},{"interface":"front","average":{"1min":1.016,"5min":1.2350000000000001,"15min":1.2709999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.48,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.87}]},{"osd":4,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.369,"15min":1.3839999999999999},"min":{"1min":0.877,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7490000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.3879999999999999,"15min":1.4159999999999999},"min":{"1min":0.86099999999999999,"5min":0.75,"15min":0.75},"max":{"1min":1.8260000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.157}]},{"osd":5,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.468,"15min":1.508},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.7509999999999999,"5min":2.621,"15min":2.621},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6080000000000001,"15min":1.643},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.8660000000000001,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.3420000000000001}]},{"osd":6,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.522,"15min":1.544},"min":{"1min":0.82799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.704,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.631,"15min":1.6870000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.7130000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.401}]},{"osd":7,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.6910000000000001,"15min":1.73},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.877,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.6020000000000001,"15min":1.635},"min":{"1min":0.95499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8220000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.115}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1208320,"data_stored":862619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2470000000000001,"5min":1.454,"15min":1.454},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":1,"15min":1.014},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.6499999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0800000000000001,"15min":1.1080000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3759999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0329999999999999,"15min":1.0409999999999999},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.419,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.282,"15min":1.3120000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2570000000000001,"5min":4.024,"15min":4.024},"last":0.873},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.2450000000000001,"15min":1.2689999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.198,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":0.88400000000000001}]},{"osd":4,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.452,"15min":1.49},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6759999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.998},{"interface":"front","average":{"1min":1.133,"5min":1.1519999999999999,"15min":1.155},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.071}]},{"osd":5,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.516,"15min":1.552},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7030000000000001,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.514,"15min":1.54},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9119999999999999,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.22}]},{"osd":6,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.258,"15min":1.276},"min":{"1min":0.81100000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.6679999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.026},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.512,"15min":1.544},"min":{"1min":0.88600000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.0569999999999999,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.117}]},{"osd":7,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.6160000000000001,"15min":1.6459999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.835,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.335},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3740000000000001,"15min":1.381},"min":{"1min":0.82699999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1219999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.204}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:42:16.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2024-05-26T15:42:16.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.988946+0000', 'last_change': '2024-05-26T15:42:10.988946+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.988946+0000', 'last_undegraded': '2024-05-26T15:42:10.988946+0000', 'last_fullsized': '2024-05-26T15:42:10.988946+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T19:03:47.944320+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-26T15:42:16.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2024-05-26T15:42:16.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.976785+0000', 'last_change': '2024-05-26T15:42:10.976785+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.976785+0000', 'last_undegraded': '2024-05-26T15:42:10.976785+0000', 'last_fullsized': '2024-05-26T15:42:10.976785+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T16:26:52.879894+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:16.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2024-05-26T15:42:16.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.987272+0000', 'last_change': '2024-05-26T15:42:10.987272+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.987272+0000', 'last_undegraded': '2024-05-26T15:42:10.987272+0000', 'last_fullsized': '2024-05-26T15:42:10.987272+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.977844+0000', 'last_change': '2024-05-26T15:42:10.977844+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.977844+0000', 'last_undegraded': '2024-05-26T15:42:10.977844+0000', 'last_fullsized': '2024-05-26T15:42:10.977844+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-28T01:47:58.290205+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.975266+0000', 'last_change': '2024-05-26T15:42:10.975266+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.975266+0000', 'last_undegraded': '2024-05-26T15:42:10.975266+0000', 'last_fullsized': '2024-05-26T15:42:10.975266+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-28T01:31:43.290565+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.982157+0000', 'last_change': '2024-05-26T15:42:10.982157+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.982157+0000', 'last_undegraded': '2024-05-26T15:42:10.982157+0000', 'last_fullsized': '2024-05-26T15:42:10.982157+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.978129+0000', 'last_change': '2024-05-26T15:42:10.978129+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.978129+0000', 'last_undegraded': '2024-05-26T15:42:10.978129+0000', 'last_fullsized': '2024-05-26T15:42:10.978129+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-28T00:05:26.003496+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.988452+0000', 'last_change': '2024-05-26T15:42:10.988452+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.988452+0000', 'last_undegraded': '2024-05-26T15:42:10.988452+0000', 'last_fullsized': '2024-05-26T15:42:10.988452+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2024-05-26T15:42:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.973475+0000', 'last_change': '2024-05-26T15:42:10.973475+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.973475+0000', 'last_undegraded': '2024-05-26T15:42:10.973475+0000', 'last_fullsized': '2024-05-26T15:42:10.973475+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T19:34:54.694204+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.979922+0000', 'last_change': '2024-05-26T15:42:10.979922+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.979922+0000', 'last_undegraded': '2024-05-26T15:42:10.979922+0000', 'last_fullsized': '2024-05-26T15:42:10.979922+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.976550+0000', 'last_change': '2024-05-26T15:42:10.976550+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.976550+0000', 'last_undegraded': '2024-05-26T15:42:10.976550+0000', 'last_fullsized': '2024-05-26T15:42:10.976550+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.972288+0000', 'last_change': '2024-05-26T15:42:10.972288+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.972288+0000', 'last_undegraded': '2024-05-26T15:42:10.972288+0000', 'last_fullsized': '2024-05-26T15:42:10.972288+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-28T02:10:03.718462+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.975622+0000', 'last_change': '2024-05-26T15:42:10.975622+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.975622+0000', 'last_undegraded': '2024-05-26T15:42:10.975622+0000', 'last_fullsized': '2024-05-26T15:42:10.975622+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.977942+0000', 'last_change': '2024-05-26T15:42:10.977942+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.977942+0000', 'last_undegraded': '2024-05-26T15:42:10.977942+0000', 'last_fullsized': '2024-05-26T15:42:10.977942+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2024-05-26T15:42:16.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.971202+0000', 'last_change': '2024-05-26T15:42:10.971202+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.971202+0000', 'last_undegraded': '2024-05-26T15:42:10.971202+0000', 'last_fullsized': '2024-05-26T15:42:10.971202+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T15:42:35.135367+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.979756+0000', 'last_change': '2024-05-26T15:42:10.979756+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.979756+0000', 'last_undegraded': '2024-05-26T15:42:10.979756+0000', 'last_fullsized': '2024-05-26T15:42:10.979756+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.975086+0000', 'last_change': '2024-05-26T15:42:10.975086+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.975086+0000', 'last_undegraded': '2024-05-26T15:42:10.975086+0000', 'last_fullsized': '2024-05-26T15:42:10.975086+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T17:16:26.570143+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.984759+0000', 'last_change': '2024-05-26T15:42:10.984759+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.984759+0000', 'last_undegraded': '2024-05-26T15:42:10.984759+0000', 'last_fullsized': '2024-05-26T15:42:10.984759+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.974455+0000', 'last_change': '2024-05-26T15:42:10.974455+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.974455+0000', 'last_undegraded': '2024-05-26T15:42:10.974455+0000', 'last_fullsized': '2024-05-26T15:42:10.974455+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.986730+0000', 'last_change': '2024-05-26T15:42:10.986730+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.986730+0000', 'last_undegraded': '2024-05-26T15:42:10.986730+0000', 'last_fullsized': '2024-05-26T15:42:10.986730+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-26T15:42:16.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.988191+0000', 'last_change': '2024-05-26T15:42:10.988191+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.988191+0000', 'last_undegraded': '2024-05-26T15:42:10.988191+0000', 'last_fullsized': '2024-05-26T15:42:10.988191+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.970692+0000', 'last_change': '2024-05-26T15:42:10.970692+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.970692+0000', 'last_undegraded': '2024-05-26T15:42:10.970692+0000', 'last_fullsized': '2024-05-26T15:42:10.970692+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T23:11:38.601829+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.971101+0000', 'last_change': '2024-05-26T15:42:10.971101+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.971101+0000', 'last_undegraded': '2024-05-26T15:42:10.971101+0000', 'last_fullsized': '2024-05-26T15:42:10.971101+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-28T03:12:21.904002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.974584+0000', 'last_change': '2024-05-26T15:42:10.974584+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.974584+0000', 'last_undegraded': '2024-05-26T15:42:10.974584+0000', 'last_fullsized': '2024-05-26T15:42:10.974584+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-28T01:04:06.159661+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.978558+0000', 'last_change': '2024-05-26T15:42:10.978558+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.978558+0000', 'last_undegraded': '2024-05-26T15:42:10.978558+0000', 'last_fullsized': '2024-05-26T15:42:10.978558+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-05-26T15:42:17.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.974545+0000', 'last_change': '2024-05-26T15:42:10.974545+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.974545+0000', 'last_undegraded': '2024-05-26T15:42:10.974545+0000', 'last_fullsized': '2024-05-26T15:42:10.974545+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T18:08:18.416170+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:17.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-05-26T15:42:17.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.973797+0000', 'last_change': '2024-05-26T15:42:10.973797+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.973797+0000', 'last_undegraded': '2024-05-26T15:42:10.973797+0000', 'last_fullsized': '2024-05-26T15:42:10.973797+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-27T20:56:54.463216+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:17.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-05-26T15:42:17.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.977618+0000', 'last_change': '2024-05-26T15:42:10.977618+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.977618+0000', 'last_undegraded': '2024-05-26T15:42:10.977618+0000', 'last_fullsized': '2024-05-26T15:42:10.977618+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-28T01:12:02.298237+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-26T15:42:17.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-05-26T15:42:17.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 53, 'state': 'creating+peering', 'last_fresh': '2024-05-26T15:42:10.972240+0000', 'last_change': '2024-05-26T15:42:10.972240+0000', 'last_active': '2024-05-26T15:42:10.946763+0000', 'last_peered': '2024-05-26T15:42:10.946763+0000', 'last_clean': '2024-05-26T15:42:10.946763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-26T15:42:10.972240+0000', 'last_undegraded': '2024-05-26T15:42:10.972240+0000', 'last_fullsized': '2024-05-26T15:42:10.972240+0000', 'mapping_epoch': 53, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 53, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'last_clean_scrub_stamp': '2024-05-26T15:42:10.946763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-26T15:42:17.002 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-26T15:42:17.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.248+0000 7f9c4a200640 1 Processor -- start 2024-05-26T15:42:17.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.248+0000 7f9c4a200640 1 -- start start 2024-05-26T15:42:17.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.250+0000 7f9c4a200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c44154f50 0x7f9c440b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.250+0000 7f9c4a200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4415b640 con 0x7f9c4415ae70 2024-05-26T15:42:17.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.250+0000 7f9c4a200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4415b920 con 0x7f9c440c36c0 2024-05-26T15:42:17.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.250+0000 7f9c4a200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4415bee0 con 0x7f9c44154f50 2024-05-26T15:42:17.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.250+0000 7f9c3be00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9c4415ae70 0x7f9c4415eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51094/0 (socket says 172.21.15.8:51094) 2024-05-26T15:42:17.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.250+0000 7f9c3be00640 1 -- 172.21.15.8:0/3656259670 learned_addr learned my addr 172.21.15.8:0/3656259670 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:17.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c48e00640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c44154f50 0x7f9c440b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69825877 0 0) 0x7f9c4415b640 con 0x7f9c4415ae70 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c28003520 con 0x7f9c4415ae70 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 68287504 0 0) 0x7f9c28003520 con 0x7f9c4415ae70 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c44154f50 msgr2=0x7f9c440b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c44154f50 0x7f9c440b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 >> v1:172.21.15.47:6789/0 conn(0x7f9c440c36c0 legacy=0x7f9c440cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4415bc00 con 0x7f9c4415ae70 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f9c2c001670 con 0x7f9c4415ae70 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 >> v1:172.21.15.8:6789/0 conn(0x7f9c4415ae70 legacy=0x7f9c4415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c44154f50 0x7f9c280039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c28003f20 0x7f9c280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.251+0000 7f9c43e00640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c28004d00 0x7f9c28005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4415bee0 con 0x7f9c28004d00 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2800ba60 con 0x7f9c28003f20 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2800bc20 con 0x7f9c44154f50 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c49800640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c28004d00 0x7f9c28005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c3be00640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c28003f20 0x7f9c280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c48e00640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c44154f50 0x7f9c280039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c49800640 1 -- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c44154f50 msgr2=0x7f9c280039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c49800640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c44154f50 0x7f9c280039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c49800640 1 -- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c28003f20 msgr2=0x7f9c280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c49800640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c28003f20 0x7f9c280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c49800640 1 -- 172.21.15.8:0/3656259670 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28003520 con 0x7f9c28004d00 2024-05-26T15:42:17.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.252+0000 7f9c48e00640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c44154f50 0x7f9c280039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:17.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.253+0000 7f9c49800640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c28004d00 0x7f9c28005180 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c001e50 tx=0x7f9c280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe2181e89b348bb server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:17.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.253+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c02ae70 con 0x7f9c28004d00 2024-05-26T15:42:17.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.254+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c003970 con 0x7f9c28004d00 2024-05-26T15:42:17.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.254+0000 7f9c43e00640 1 -- 172.21.15.8:0/3656259670 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c003d20 con 0x7f9c28004d00 2024-05-26T15:42:17.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.254+0000 7f9c4a200640 1 -- 172.21.15.8:0/3656259670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c28004d00 msgr2=0x7f9c28005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:17.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.254+0000 7f9c4a200640 1 --2- 172.21.15.8:0/3656259670 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c28004d00 0x7f9c28005180 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c001e50 tx=0x7f9c280057f0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.254+0000 7f9c49800640 1 -- 172.21.15.8:0/3656259670 reap_dead start 2024-05-26T15:42:17.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.254+0000 7f9c4a200640 1 -- 172.21.15.8:0/3656259670 shutdown_connections 2024-05-26T15:42:17.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.254+0000 7f9c4a200640 1 -- 172.21.15.8:0/3656259670 >> 172.21.15.8:0/3656259670 conn(0x7f9c44070480 msgr2=0x7f9c44070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:17.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.254+0000 7f9c4a200640 1 -- 172.21.15.8:0/3656259670 shutdown_connections 2024-05-26T15:42:17.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.254+0000 7f9c4a200640 1 -- 172.21.15.8:0/3656259670 wait complete. 2024-05-26T15:42:17.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.256+0000 7f9c4a200640 1 Processor -- start 2024-05-26T15:42:17.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.256+0000 7f9c4a200640 1 -- start start 2024-05-26T15:42:17.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.257+0000 7f9c4a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c28004d00 0x7f9c440b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.257+0000 7f9c4a200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c441430d0 0x7f9c4414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.257+0000 7f9c4a200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c4414d7b0 0x7f9c4414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.257+0000 7f9c4a200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4414ec90 con 0x7f9c4414d7b0 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.257+0000 7f9c4a200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4414fdc0 con 0x7f9c28004d00 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.257+0000 7f9c4a200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44143550 con 0x7f9c441430d0 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.257+0000 7f9c49800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c4414d7b0 0x7f9c4414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.258+0000 7f9c49800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c4414d7b0 0x7f9c4414dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33088/0 (socket says 172.21.15.8:33088) 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.258+0000 7f9c49800640 1 -- 172.21.15.8:0/2054357110 learned_addr learned my addr 172.21.15.8:0/2054357110 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.258+0000 7f9c3be00640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c441430d0 0x7f9c4414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.258+0000 7f9c48e00640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c28004d00 0x7f9c440b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.258+0000 7f9c49800640 1 -- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c441430d0 msgr2=0x7f9c4414d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.258+0000 7f9c49800640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c441430d0 0x7f9c4414d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.258+0000 7f9c49800640 1 -- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c28004d00 msgr2=0x7f9c440b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:17.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.258+0000 7f9c49800640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c28004d00 0x7f9c440b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.258+0000 7f9c49800640 1 -- 172.21.15.8:0/2054357110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c441f0360 con 0x7f9c4414d7b0 2024-05-26T15:42:17.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.258+0000 7f9c49800640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c4414d7b0 0x7f9c4414dc30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c001f70 tx=0x7f9c3c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:17.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.259+0000 7f9c41600640 1 -- 172.21.15.8:0/2054357110 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c03f070 con 0x7f9c4414d7b0 2024-05-26T15:42:17.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.259+0000 7f9c41600640 1 -- 172.21.15.8:0/2054357110 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c007db0 con 0x7f9c4414d7b0 2024-05-26T15:42:17.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.259+0000 7f9c41600640 1 -- 172.21.15.8:0/2054357110 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0052f0 con 0x7f9c4414d7b0 2024-05-26T15:42:17.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.259+0000 7f9c4a200640 1 -- 172.21.15.8:0/2054357110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c44150010 con 0x7f9c4414d7b0 2024-05-26T15:42:17.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.259+0000 7f9c4a200640 1 -- 172.21.15.8:0/2054357110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4414f180 con 0x7f9c4414d7b0 2024-05-26T15:42:17.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.260+0000 7f9c4a200640 1 -- 172.21.15.8:0/2054357110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4404e280 con 0x7f9c4414d7b0 2024-05-26T15:42:17.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.261+0000 7f9c41600640 1 -- 172.21.15.8:0/2054357110 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9c3c005450 con 0x7f9c4414d7b0 2024-05-26T15:42:17.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.262+0000 7f9c41600640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9c2006ac50 0x7f9c2006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.262+0000 7f9c41600640 1 -- 172.21.15.8:0/2054357110 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9c3c0a8d70 con 0x7f9c4414d7b0 2024-05-26T15:42:17.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.263+0000 7f9c48e00640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9c2006ac50 0x7f9c2006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.264+0000 7f9c48e00640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9c2006ac50 0x7f9c2006d110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c340099c0 tx=0x7f9c34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:17.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.266+0000 7f9c41600640 1 -- 172.21.15.8:0/2054357110 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9c3c073d60 con 0x7f9c4414d7b0 2024-05-26T15:42:17.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.539+0000 7f9c4a200640 1 -- 172.21.15.8:0/2054357110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9c4404e280 con 0x7f9c4414d7b0 2024-05-26T15:42:17.538 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.540+0000 7f9c41600640 1 -- 172.21.15.8:0/2054357110 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1097 (secure 0 0 0) 0x7f9c3c077380 con 0x7f9c4414d7b0 2024-05-26T15:42:17.539 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:17.539 INFO:teuthology.orchestra.run.smithi008.stdout:{"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":188,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":55,"num_osds":8,"num_up_osds":8,"osd_up_since":1716737960,"num_in_osds":8,"osd_in_since":1716737952,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":68},{"state_name":"creating+peering","count":29}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":591932,"bytes_used":261292032,"bytes_avail":772832821248,"bytes_total":773094113280,"inactive_pgs_ratio":0.29896906018257141,"write_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":32,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5787}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-05-26T15:40:40.181352+0000","services":{}},"progress_events":{}} 2024-05-26T15:42:17.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 -- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9c2006ac50 msgr2=0x7f9c2006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:17.541 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9c2006ac50 0x7f9c2006d110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c340099c0 tx=0x7f9c34008040 comp rx=0 tx=0).stop 2024-05-26T15:42:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 -- 172.21.15.8:0/2054357110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c4414d7b0 msgr2=0x7f9c4414dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c4414d7b0 0x7f9c4414dc30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c001f70 tx=0x7f9c3c0014a0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 -- 172.21.15.8:0/2054357110 shutdown_connections 2024-05-26T15:42:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c4414d7b0 0x7f9c4414dc30 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9c441430d0 0x7f9c4414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9c2006ac50 0x7f9c2006d110 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 --2- 172.21.15.8:0/2054357110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c28004d00 0x7f9c440b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 -- 172.21.15.8:0/2054357110 >> 172.21.15.8:0/2054357110 conn(0x7f9c44070480 msgr2=0x7f9c440cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:17.542 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 -- 172.21.15.8:0/2054357110 shutdown_connections 2024-05-26T15:42:17.543 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.543+0000 7f9c4a200640 1 -- 172.21.15.8:0/2054357110 wait complete. 2024-05-26T15:42:17.562 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-26T15:42:17.562 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:42:17.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.768+0000 7f8ef3e00640 1 Processor -- start 2024-05-26T15:42:17.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.768+0000 7f8ef3e00640 1 -- start start 2024-05-26T15:42:17.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.770+0000 7f8ef3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8ef4154f50 0x7f8ef40b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.770+0000 7f8ef3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8ef40c36c0 0x7f8ef40c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.770+0000 7f8ef3e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef415b640 con 0x7f8ef415ae70 2024-05-26T15:42:17.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.770+0000 7f8ef3e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef415bee0 con 0x7f8ef40c36c0 2024-05-26T15:42:17.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.770+0000 7f8ef3e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40b0ba0 con 0x7f8ef4154f50 2024-05-26T15:42:17.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.770+0000 7f8ef3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8ef40c36c0 0x7f8ef40c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.770+0000 7f8ef3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8ef40c36c0 0x7f8ef40c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33094/0 (socket says 172.21.15.8:33094) 2024-05-26T15:42:17.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.770+0000 7f8ef3400640 1 -- 172.21.15.8:0/2386956397 learned_addr learned my addr 172.21.15.8:0/2386956397 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:17.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.771+0000 7f8ef2a00640 1 --2- 172.21.15.8:0/2386956397 >> v2:172.21.15.47:3300/0 conn(0x7f8ef4154f50 0x7f8ef40b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.771+0000 7f8ef3400640 1 -- 172.21.15.8:0/2386956397 >> v2:172.21.15.47:3300/0 conn(0x7f8ef4154f50 msgr2=0x7f8ef40b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:17.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.771+0000 7f8ef3400640 1 --2- 172.21.15.8:0/2386956397 >> v2:172.21.15.47:3300/0 conn(0x7f8ef4154f50 0x7f8ef40b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.771+0000 7f8ef3400640 1 -- 172.21.15.8:0/2386956397 >> v1:172.21.15.47:6789/0 conn(0x7f8ef415ae70 legacy=0x7f8ef415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:17.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.771+0000 7f8ef3400640 1 -- 172.21.15.8:0/2386956397 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef415b920 con 0x7f8ef40c36c0 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.772+0000 7f8ef3400640 1 --2- 172.21.15.8:0/2386956397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef40c36c0 0x7f8ef40c3af0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40ce600 tx=0x7f8eec02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1240c3d2eaede85e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.772+0000 7f8ef1600640 1 -- 172.21.15.8:0/2386956397 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec031600 con 0x7f8ef40c36c0 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.773+0000 7f8ef1600640 1 -- 172.21.15.8:0/2386956397 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec02d050 con 0x7f8ef40c36c0 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.773+0000 7f8ef1600640 1 -- 172.21.15.8:0/2386956397 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec031980 con 0x7f8ef40c36c0 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.773+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2386956397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef40c36c0 msgr2=0x7f8ef40c3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.773+0000 7f8ef3e00640 1 --2- 172.21.15.8:0/2386956397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef40c36c0 0x7f8ef40c3af0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8ef40ce600 tx=0x7f8eec02a6f0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.773+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2386956397 shutdown_connections 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.773+0000 7f8ef3e00640 1 --2- 172.21.15.8:0/2386956397 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef40c36c0 0x7f8ef40c3af0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.773+0000 7f8ef3e00640 1 --2- 172.21.15.8:0/2386956397 >> v2:172.21.15.47:3300/0 conn(0x7f8ef4154f50 0x7f8ef40b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.773+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2386956397 >> 172.21.15.8:0/2386956397 conn(0x7f8ef4070480 msgr2=0x7f8ef4070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:17.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.773+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2386956397 shutdown_connections 2024-05-26T15:42:17.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.773+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2386956397 wait complete. 2024-05-26T15:42:17.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.775+0000 7f8ef3e00640 1 Processor -- start 2024-05-26T15:42:17.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.775+0000 7f8ef3e00640 1 -- start start 2024-05-26T15:42:17.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.776+0000 7f8ef3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef40c36c0 0x7f8ef41f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.776+0000 7f8ef3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8ef4154f50 0x7f8ef40a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.776+0000 7f8ef3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef415ae70 0x7f8ef4151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.776+0000 7f8ef3e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef41f2ad0 con 0x7f8ef415ae70 2024-05-26T15:42:17.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.776+0000 7f8ef3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40a7d00 con 0x7f8ef40c36c0 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.776+0000 7f8ef3e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40cb340 con 0x7f8ef4154f50 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef415ae70 0x7f8ef4151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef415ae70 0x7f8ef4151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33104/0 (socket says 172.21.15.8:33104) 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef3400640 1 -- 172.21.15.8:0/2429756185 learned_addr learned my addr 172.21.15.8:0/2429756185 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef2a00640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef40c36c0 0x7f8ef41f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef2000640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8ef4154f50 0x7f8ef40a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef3400640 1 -- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8ef4154f50 msgr2=0x7f8ef40a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef3400640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8ef4154f50 0x7f8ef40a74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef3400640 1 -- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef40c36c0 msgr2=0x7f8ef41f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef3400640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef40c36c0 0x7f8ef41f2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef3400640 1 -- 172.21.15.8:0/2429756185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec009b30 con 0x7f8ef415ae70 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef2a00640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef40c36c0 0x7f8ef41f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:17.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.777+0000 7f8ef3400640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef415ae70 0x7f8ef4151ce0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8eec02ace0 tx=0x7f8eec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:17.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.778+0000 7f8eeb400640 1 -- 172.21.15.8:0/2429756185 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec03b820 con 0x7f8ef415ae70 2024-05-26T15:42:17.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.778+0000 7f8eeb400640 1 -- 172.21.15.8:0/2429756185 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec03b980 con 0x7f8ef415ae70 2024-05-26T15:42:17.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.778+0000 7f8eeb400640 1 -- 172.21.15.8:0/2429756185 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec03bd10 con 0x7f8ef415ae70 2024-05-26T15:42:17.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.778+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2429756185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef40cb620 con 0x7f8ef415ae70 2024-05-26T15:42:17.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.778+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2429756185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef40cbbe0 con 0x7f8ef415ae70 2024-05-26T15:42:17.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.779+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2429756185 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef40cbda0 con 0x7f8ef415ae70 2024-05-26T15:42:17.778 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.780+0000 7f8eeb400640 1 -- 172.21.15.8:0/2429756185 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8eec038050 con 0x7f8ef415ae70 2024-05-26T15:42:17.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.781+0000 7f8eeb400640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8ed406ac00 0x7f8ed406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:17.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.781+0000 7f8eeb400640 1 -- 172.21.15.8:0/2429756185 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8eec0a9f20 con 0x7f8ef415ae70 2024-05-26T15:42:17.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.782+0000 7f8ef2a00640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8ed406ac00 0x7f8ed406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:17.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.783+0000 7f8ef2a00640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8ed406ac00 0x7f8ed406d0c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4006fd0 tx=0x7f8ee4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:17.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.785+0000 7f8eeb400640 1 -- 172.21.15.8:0/2429756185 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8eec075050 con 0x7f8ef415ae70 2024-05-26T15:42:17.981 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:17.983+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2429756185 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ef4155330 con 0x7f8ed406ac00 2024-05-26T15:42:18.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.006+0000 7f8eeb400640 1 -- 172.21.15.8:0/2429756185 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285320 (secure 0 0 0) 0x7f8ee4009e10 con 0x7f8ed406ac00 2024-05-26T15:42:18.008 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:18.010 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:42:18.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.011+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8ed406ac00 msgr2=0x7f8ed406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:18.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8ed406ac00 0x7f8ed406d0c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4006fd0 tx=0x7f8ee4008040 comp rx=0 tx=0).stop 2024-05-26T15:42:18.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2429756185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef415ae70 msgr2=0x7f8ef4151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:18.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef415ae70 0x7f8ef4151ce0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8eec02ace0 tx=0x7f8eec004a40 comp rx=0 tx=0).stop 2024-05-26T15:42:18.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2429756185 shutdown_connections 2024-05-26T15:42:18.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8ef415ae70 0x7f8ef4151ce0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:18.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f8ef4154f50 0x7f8ef40a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:18.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f8ed406ac00 0x7f8ed406d0c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:18.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 --2- 172.21.15.8:0/2429756185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8ef40c36c0 0x7f8ef41f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:18.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2429756185 >> 172.21.15.8:0/2429756185 conn(0x7f8ef4070480 msgr2=0x7f8ef40b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:18.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2429756185 shutdown_connections 2024-05-26T15:42:18.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:18.012+0000 7f8ef3e00640 1 -- 172.21.15.8:0/2429756185 wait complete. 2024-05-26T15:42:18.031 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-05-26T15:42:16.221475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591932,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255168,"kb_used_data":6200,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754719552,"statfs":{"total":773094113280,"available":772832821248,"internally_reserved":0,"allocated":6348800,"data_stored":3469281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1564,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001727"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.478258+0000","last_change":"2024-05-26T15:42:11.475784+0000","last_active":"2024-05-26T15:42:11.478258+0000","last_peered":"2024-05-26T15:42:11.478258+0000","last_clean":"2024-05-26T15:42:11.478258+0000","last_became_active":"2024-05-26T15:42:11.474366+0000","last_became_peered":"2024-05-26T15:42:11.474366+0000","last_unstale":"2024-05-26T15:42:11.478258+0000","last_undegraded":"2024-05-26T15:42:11.478258+0000","last_fullsized":"2024-05-26T15:42:11.478258+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:14:28.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988946+0000","last_change":"2024-05-26T15:42:10.988946+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988946+0000","last_undegraded":"2024-05-26T15:42:10.988946+0000","last_fullsized":"2024-05-26T15:42:10.988946+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:03:47.944320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.976785+0000","last_change":"2024-05-26T15:42:10.976785+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.976785+0000","last_undegraded":"2024-05-26T15:42:10.976785+0000","last_fullsized":"2024-05-26T15:42:10.976785+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:26:52.879894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.987272+0000","last_change":"2024-05-26T15:42:10.987272+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.987272+0000","last_undegraded":"2024-05-26T15:42:10.987272+0000","last_fullsized":"2024-05-26T15:42:10.987272+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500715+0000","last_change":"2024-05-26T15:42:11.497533+0000","last_active":"2024-05-26T15:42:11.500715+0000","last_peered":"2024-05-26T15:42:11.500715+0000","last_clean":"2024-05-26T15:42:11.500715+0000","last_became_active":"2024-05-26T15:42:11.496938+0000","last_became_peered":"2024-05-26T15:42:11.496938+0000","last_unstale":"2024-05-26T15:42:11.500715+0000","last_undegraded":"2024-05-26T15:42:11.500715+0000","last_fullsized":"2024-05-26T15:42:11.500715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499447+0000","last_change":"2024-05-26T15:42:11.494471+0000","last_active":"2024-05-26T15:42:11.499447+0000","last_peered":"2024-05-26T15:42:11.499447+0000","last_clean":"2024-05-26T15:42:11.499447+0000","last_became_active":"2024-05-26T15:42:11.494235+0000","last_became_peered":"2024-05-26T15:42:11.494235+0000","last_unstale":"2024-05-26T15:42:11.499447+0000","last_undegraded":"2024-05-26T15:42:11.499447+0000","last_fullsized":"2024-05-26T15:42:11.499447+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977844+0000","last_change":"2024-05-26T15:42:10.977844+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977844+0000","last_undegraded":"2024-05-26T15:42:10.977844+0000","last_fullsized":"2024-05-26T15:42:10.977844+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:47:58.290205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494005+0000","last_change":"2024-05-26T15:42:11.491743+0000","last_active":"2024-05-26T15:42:11.494005+0000","last_peered":"2024-05-26T15:42:11.494005+0000","last_clean":"2024-05-26T15:42:11.494005+0000","last_became_active":"2024-05-26T15:42:11.491512+0000","last_became_peered":"2024-05-26T15:42:11.491512+0000","last_unstale":"2024-05-26T15:42:11.494005+0000","last_undegraded":"2024-05-26T15:42:11.494005+0000","last_fullsized":"2024-05-26T15:42:11.494005+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:49.249092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494033+0000","last_change":"2024-05-26T15:42:11.492582+0000","last_active":"2024-05-26T15:42:11.494033+0000","last_peered":"2024-05-26T15:42:11.494033+0000","last_clean":"2024-05-26T15:42:11.494033+0000","last_became_active":"2024-05-26T15:42:11.492271+0000","last_became_peered":"2024-05-26T15:42:11.492271+0000","last_unstale":"2024-05-26T15:42:11.494033+0000","last_undegraded":"2024-05-26T15:42:11.494033+0000","last_fullsized":"2024-05-26T15:42:11.494033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:26:49.715010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499336+0000","last_change":"2024-05-26T15:42:11.496192+0000","last_active":"2024-05-26T15:42:11.499336+0000","last_peered":"2024-05-26T15:42:11.499336+0000","last_clean":"2024-05-26T15:42:11.499336+0000","last_became_active":"2024-05-26T15:42:11.495944+0000","last_became_peered":"2024-05-26T15:42:11.495944+0000","last_unstale":"2024-05-26T15:42:11.499336+0000","last_undegraded":"2024-05-26T15:42:11.499336+0000","last_fullsized":"2024-05-26T15:42:11.499336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:06:39.785296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.496073+0000","last_change":"2024-05-26T15:42:11.489235+0000","last_active":"2024-05-26T15:42:11.496073+0000","last_peered":"2024-05-26T15:42:11.496073+0000","last_clean":"2024-05-26T15:42:11.496073+0000","last_became_active":"2024-05-26T15:42:11.488907+0000","last_became_peered":"2024-05-26T15:42:11.488907+0000","last_unstale":"2024-05-26T15:42:11.496073+0000","last_undegraded":"2024-05-26T15:42:11.496073+0000","last_fullsized":"2024-05-26T15:42:11.496073+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:13:27.388279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.487693+0000","last_change":"2024-05-26T15:42:11.486461+0000","last_active":"2024-05-26T15:42:11.487693+0000","last_peered":"2024-05-26T15:42:11.487693+0000","last_clean":"2024-05-26T15:42:11.487693+0000","last_became_active":"2024-05-26T15:42:11.485854+0000","last_became_peered":"2024-05-26T15:42:11.485854+0000","last_unstale":"2024-05-26T15:42:11.487693+0000","last_undegraded":"2024-05-26T15:42:11.487693+0000","last_fullsized":"2024-05-26T15:42:11.487693+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:00:13.066137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499405+0000","last_change":"2024-05-26T15:42:11.496586+0000","last_active":"2024-05-26T15:42:11.499405+0000","last_peered":"2024-05-26T15:42:11.499405+0000","last_clean":"2024-05-26T15:42:11.499405+0000","last_became_active":"2024-05-26T15:42:11.496340+0000","last_became_peered":"2024-05-26T15:42:11.496340+0000","last_unstale":"2024-05-26T15:42:11.499405+0000","last_undegraded":"2024-05-26T15:42:11.499405+0000","last_fullsized":"2024-05-26T15:42:11.499405+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:48:48.284704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975266+0000","last_change":"2024-05-26T15:42:10.975266+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975266+0000","last_undegraded":"2024-05-26T15:42:10.975266+0000","last_fullsized":"2024-05-26T15:42:10.975266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:43.290565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.982157+0000","last_change":"2024-05-26T15:42:10.982157+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.982157+0000","last_undegraded":"2024-05-26T15:42:10.982157+0000","last_fullsized":"2024-05-26T15:42:10.982157+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499462+0000","last_change":"2024-05-26T15:42:11.497654+0000","last_active":"2024-05-26T15:42:11.499462+0000","last_peered":"2024-05-26T15:42:11.499462+0000","last_clean":"2024-05-26T15:42:11.499462+0000","last_became_active":"2024-05-26T15:42:11.495683+0000","last_became_peered":"2024-05-26T15:42:11.495683+0000","last_unstale":"2024-05-26T15:42:11.499462+0000","last_undegraded":"2024-05-26T15:42:11.499462+0000","last_fullsized":"2024-05-26T15:42:11.499462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.978129+0000","last_change":"2024-05-26T15:42:10.978129+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.978129+0000","last_undegraded":"2024-05-26T15:42:10.978129+0000","last_fullsized":"2024-05-26T15:42:10.978129+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:05:26.003496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988452+0000","last_change":"2024-05-26T15:42:10.988452+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988452+0000","last_undegraded":"2024-05-26T15:42:10.988452+0000","last_fullsized":"2024-05-26T15:42:10.988452+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.973475+0000","last_change":"2024-05-26T15:42:10.973475+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.973475+0000","last_undegraded":"2024-05-26T15:42:10.973475+0000","last_fullsized":"2024-05-26T15:42:10.973475+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:34:54.694204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.979922+0000","last_change":"2024-05-26T15:42:10.979922+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.979922+0000","last_undegraded":"2024-05-26T15:42:10.979922+0000","last_fullsized":"2024-05-26T15:42:10.979922+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.976550+0000","last_change":"2024-05-26T15:42:10.976550+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.976550+0000","last_undegraded":"2024-05-26T15:42:10.976550+0000","last_fullsized":"2024-05-26T15:42:10.976550+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.504687+0000","last_change":"2024-05-26T15:42:11.503856+0000","last_active":"2024-05-26T15:42:11.504687+0000","last_peered":"2024-05-26T15:42:11.504687+0000","last_clean":"2024-05-26T15:42:11.504687+0000","last_became_active":"2024-05-26T15:42:11.503619+0000","last_became_peered":"2024-05-26T15:42:11.503619+0000","last_unstale":"2024-05-26T15:42:11.504687+0000","last_undegraded":"2024-05-26T15:42:11.504687+0000","last_fullsized":"2024-05-26T15:42:11.504687+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:38:38.915738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.495384+0000","last_change":"2024-05-26T15:42:11.488723+0000","last_active":"2024-05-26T15:42:11.495384+0000","last_peered":"2024-05-26T15:42:11.495384+0000","last_clean":"2024-05-26T15:42:11.495384+0000","last_became_active":"2024-05-26T15:42:11.488410+0000","last_became_peered":"2024-05-26T15:42:11.488410+0000","last_unstale":"2024-05-26T15:42:11.495384+0000","last_undegraded":"2024-05-26T15:42:11.495384+0000","last_fullsized":"2024-05-26T15:42:11.495384+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:51:09.231165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.972288+0000","last_change":"2024-05-26T15:42:10.972288+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.972288+0000","last_undegraded":"2024-05-26T15:42:10.972288+0000","last_fullsized":"2024-05-26T15:42:10.972288+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:10:03.718462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975622+0000","last_change":"2024-05-26T15:42:10.975622+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975622+0000","last_undegraded":"2024-05-26T15:42:10.975622+0000","last_fullsized":"2024-05-26T15:42:10.975622+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486266+0000","last_change":"2024-05-26T15:42:11.482860+0000","last_active":"2024-05-26T15:42:11.486266+0000","last_peered":"2024-05-26T15:42:11.486266+0000","last_clean":"2024-05-26T15:42:11.486266+0000","last_became_active":"2024-05-26T15:42:11.482579+0000","last_became_peered":"2024-05-26T15:42:11.482579+0000","last_unstale":"2024-05-26T15:42:11.486266+0000","last_undegraded":"2024-05-26T15:42:11.486266+0000","last_fullsized":"2024-05-26T15:42:11.486266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:59.291291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494385+0000","last_change":"2024-05-26T15:42:11.491800+0000","last_active":"2024-05-26T15:42:11.494385+0000","last_peered":"2024-05-26T15:42:11.494385+0000","last_clean":"2024-05-26T15:42:11.494385+0000","last_became_active":"2024-05-26T15:42:11.491522+0000","last_became_peered":"2024-05-26T15:42:11.491522+0000","last_unstale":"2024-05-26T15:42:11.494385+0000","last_undegraded":"2024-05-26T15:42:11.494385+0000","last_fullsized":"2024-05-26T15:42:11.494385+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977942+0000","last_change":"2024-05-26T15:42:10.977942+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977942+0000","last_undegraded":"2024-05-26T15:42:10.977942+0000","last_fullsized":"2024-05-26T15:42:10.977942+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971202+0000","last_change":"2024-05-26T15:42:10.971202+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971202+0000","last_undegraded":"2024-05-26T15:42:10.971202+0000","last_fullsized":"2024-05-26T15:42:10.971202+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:42:35.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.979756+0000","last_change":"2024-05-26T15:42:10.979756+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.979756+0000","last_undegraded":"2024-05-26T15:42:10.979756+0000","last_fullsized":"2024-05-26T15:42:10.979756+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.975086+0000","last_change":"2024-05-26T15:42:10.975086+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.975086+0000","last_undegraded":"2024-05-26T15:42:10.975086+0000","last_fullsized":"2024-05-26T15:42:10.975086+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:16:26.570143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492503+0000","last_change":"2024-05-26T15:42:11.485998+0000","last_active":"2024-05-26T15:42:11.492503+0000","last_peered":"2024-05-26T15:42:11.492503+0000","last_clean":"2024-05-26T15:42:11.492503+0000","last_became_active":"2024-05-26T15:42:11.484349+0000","last_became_peered":"2024-05-26T15:42:11.484349+0000","last_unstale":"2024-05-26T15:42:11.492503+0000","last_undegraded":"2024-05-26T15:42:11.492503+0000","last_fullsized":"2024-05-26T15:42:11.492503+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.984759+0000","last_change":"2024-05-26T15:42:10.984759+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.984759+0000","last_undegraded":"2024-05-26T15:42:10.984759+0000","last_fullsized":"2024-05-26T15:42:10.984759+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999898+0000","last_change":"2024-05-26T15:42:10.994305+0000","last_active":"2024-05-26T15:42:10.999898+0000","last_peered":"2024-05-26T15:42:10.999898+0000","last_clean":"2024-05-26T15:42:10.999898+0000","last_became_active":"2024-05-26T15:42:10.992501+0000","last_became_peered":"2024-05-26T15:42:10.992501+0000","last_unstale":"2024-05-26T15:42:10.999898+0000","last_undegraded":"2024-05-26T15:42:10.999898+0000","last_fullsized":"2024-05-26T15:42:10.999898+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.496238+0000","last_change":"2024-05-26T15:42:11.494994+0000","last_active":"2024-05-26T15:42:11.496238+0000","last_peered":"2024-05-26T15:42:11.496238+0000","last_clean":"2024-05-26T15:42:11.496238+0000","last_became_active":"2024-05-26T15:42:11.494663+0000","last_became_peered":"2024-05-26T15:42:11.494663+0000","last_unstale":"2024-05-26T15:42:11.496238+0000","last_undegraded":"2024-05-26T15:42:11.496238+0000","last_fullsized":"2024-05-26T15:42:11.496238+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.490230+0000","last_change":"2024-05-26T15:42:10.988783+0000","last_active":"2024-05-26T15:42:11.490230+0000","last_peered":"2024-05-26T15:42:11.490230+0000","last_clean":"2024-05-26T15:42:11.490230+0000","last_became_active":"2024-05-26T15:42:10.987904+0000","last_became_peered":"2024-05-26T15:42:10.987904+0000","last_unstale":"2024-05-26T15:42:11.490230+0000","last_undegraded":"2024-05-26T15:42:11.490230+0000","last_fullsized":"2024-05-26T15:42:11.490230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:28:20.962641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974455+0000","last_change":"2024-05-26T15:42:10.974455+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974455+0000","last_undegraded":"2024-05-26T15:42:10.974455+0000","last_fullsized":"2024-05-26T15:42:10.974455+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.502766+0000","last_change":"2024-05-26T15:42:10.990216+0000","last_active":"2024-05-26T15:42:11.502766+0000","last_peered":"2024-05-26T15:42:11.502766+0000","last_clean":"2024-05-26T15:42:11.502766+0000","last_became_active":"2024-05-26T15:42:10.988791+0000","last_became_peered":"2024-05-26T15:42:10.988791+0000","last_unstale":"2024-05-26T15:42:11.502766+0000","last_undegraded":"2024-05-26T15:42:11.502766+0000","last_fullsized":"2024-05-26T15:42:11.502766+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.487167+0000","last_change":"2024-05-26T15:42:11.484844+0000","last_active":"2024-05-26T15:42:11.487167+0000","last_peered":"2024-05-26T15:42:11.487167+0000","last_clean":"2024-05-26T15:42:11.487167+0000","last_became_active":"2024-05-26T15:42:11.484593+0000","last_became_peered":"2024-05-26T15:42:11.484593+0000","last_unstale":"2024-05-26T15:42:11.487167+0000","last_undegraded":"2024-05-26T15:42:11.487167+0000","last_fullsized":"2024-05-26T15:42:11.487167+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:54:37.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.485471+0000","last_change":"2024-05-26T15:42:10.993769+0000","last_active":"2024-05-26T15:42:11.485471+0000","last_peered":"2024-05-26T15:42:11.485471+0000","last_clean":"2024-05-26T15:42:11.485471+0000","last_became_active":"2024-05-26T15:42:10.993475+0000","last_became_peered":"2024-05-26T15:42:10.993475+0000","last_unstale":"2024-05-26T15:42:11.485471+0000","last_undegraded":"2024-05-26T15:42:11.485471+0000","last_fullsized":"2024-05-26T15:42:11.485471+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:42.382894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512009+0000","last_change":"2024-05-26T15:42:11.511184+0000","last_active":"2024-05-26T15:42:11.512009+0000","last_peered":"2024-05-26T15:42:11.512009+0000","last_clean":"2024-05-26T15:42:11.512009+0000","last_became_active":"2024-05-26T15:42:11.510627+0000","last_became_peered":"2024-05-26T15:42:11.510627+0000","last_unstale":"2024-05-26T15:42:11.512009+0000","last_undegraded":"2024-05-26T15:42:11.512009+0000","last_fullsized":"2024-05-26T15:42:11.512009+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.986886+0000","last_change":"2024-05-26T15:42:10.984163+0000","last_active":"2024-05-26T15:42:10.986886+0000","last_peered":"2024-05-26T15:42:10.986886+0000","last_clean":"2024-05-26T15:42:10.986886+0000","last_became_active":"2024-05-26T15:42:10.982899+0000","last_became_peered":"2024-05-26T15:42:10.982899+0000","last_unstale":"2024-05-26T15:42:10.986886+0000","last_undegraded":"2024-05-26T15:42:10.986886+0000","last_fullsized":"2024-05-26T15:42:10.986886+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.986730+0000","last_change":"2024-05-26T15:42:10.986730+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.986730+0000","last_undegraded":"2024-05-26T15:42:10.986730+0000","last_fullsized":"2024-05-26T15:42:10.986730+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486523+0000","last_change":"2024-05-26T15:42:10.990225+0000","last_active":"2024-05-26T15:42:11.486523+0000","last_peered":"2024-05-26T15:42:11.486523+0000","last_clean":"2024-05-26T15:42:11.486523+0000","last_became_active":"2024-05-26T15:42:10.989032+0000","last_became_peered":"2024-05-26T15:42:10.989032+0000","last_unstale":"2024-05-26T15:42:11.486523+0000","last_undegraded":"2024-05-26T15:42:11.486523+0000","last_fullsized":"2024-05-26T15:42:11.486523+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:04.490649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486284+0000","last_change":"2024-05-26T15:42:11.484249+0000","last_active":"2024-05-26T15:42:11.486284+0000","last_peered":"2024-05-26T15:42:11.486284+0000","last_clean":"2024-05-26T15:42:11.486284+0000","last_became_active":"2024-05-26T15:42:11.483933+0000","last_became_peered":"2024-05-26T15:42:11.483933+0000","last_unstale":"2024-05-26T15:42:11.486284+0000","last_undegraded":"2024-05-26T15:42:11.486284+0000","last_fullsized":"2024-05-26T15:42:11.486284+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999554+0000","last_change":"2024-05-26T15:42:10.993335+0000","last_active":"2024-05-26T15:42:10.999554+0000","last_peered":"2024-05-26T15:42:10.999554+0000","last_clean":"2024-05-26T15:42:10.999554+0000","last_became_active":"2024-05-26T15:42:10.992580+0000","last_became_peered":"2024-05-26T15:42:10.992580+0000","last_unstale":"2024-05-26T15:42:10.999554+0000","last_undegraded":"2024-05-26T15:42:10.999554+0000","last_fullsized":"2024-05-26T15:42:10.999554+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:28:20.962641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.988191+0000","last_change":"2024-05-26T15:42:10.988191+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.988191+0000","last_undegraded":"2024-05-26T15:42:10.988191+0000","last_fullsized":"2024-05-26T15:42:10.988191+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.989009+0000","last_change":"2024-05-26T15:42:10.985611+0000","last_active":"2024-05-26T15:42:10.989009+0000","last_peered":"2024-05-26T15:42:10.989009+0000","last_clean":"2024-05-26T15:42:10.989009+0000","last_became_active":"2024-05-26T15:42:10.985306+0000","last_became_peered":"2024-05-26T15:42:10.985306+0000","last_unstale":"2024-05-26T15:42:10.989009+0000","last_undegraded":"2024-05-26T15:42:10.989009+0000","last_fullsized":"2024-05-26T15:42:10.989009+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:42.382894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492395+0000","last_change":"2024-05-26T15:42:11.488874+0000","last_active":"2024-05-26T15:42:11.492395+0000","last_peered":"2024-05-26T15:42:11.492395+0000","last_clean":"2024-05-26T15:42:11.492395+0000","last_became_active":"2024-05-26T15:42:11.488482+0000","last_became_peered":"2024-05-26T15:42:11.488482+0000","last_unstale":"2024-05-26T15:42:11.492395+0000","last_undegraded":"2024-05-26T15:42:11.492395+0000","last_fullsized":"2024-05-26T15:42:11.492395+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001352+0000","last_change":"2024-05-26T15:42:11.000242+0000","last_active":"2024-05-26T15:42:11.001352+0000","last_peered":"2024-05-26T15:42:11.001352+0000","last_clean":"2024-05-26T15:42:11.001352+0000","last_became_active":"2024-05-26T15:42:10.999921+0000","last_became_peered":"2024-05-26T15:42:10.999921+0000","last_unstale":"2024-05-26T15:42:11.001352+0000","last_undegraded":"2024-05-26T15:42:11.001352+0000","last_fullsized":"2024-05-26T15:42:11.001352+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:47:33.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.491565+0000","last_change":"2024-05-26T15:42:11.483171+0000","last_active":"2024-05-26T15:42:11.491565+0000","last_peered":"2024-05-26T15:42:11.491565+0000","last_clean":"2024-05-26T15:42:11.491565+0000","last_became_active":"2024-05-26T15:42:11.482824+0000","last_became_peered":"2024-05-26T15:42:11.482824+0000","last_unstale":"2024-05-26T15:42:11.491565+0000","last_undegraded":"2024-05-26T15:42:11.491565+0000","last_fullsized":"2024-05-26T15:42:11.491565+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.481049+0000","last_change":"2024-05-26T15:42:10.988391+0000","last_active":"2024-05-26T15:42:11.481049+0000","last_peered":"2024-05-26T15:42:11.481049+0000","last_clean":"2024-05-26T15:42:11.481049+0000","last_became_active":"2024-05-26T15:42:10.987480+0000","last_became_peered":"2024-05-26T15:42:10.987480+0000","last_unstale":"2024-05-26T15:42:11.481049+0000","last_undegraded":"2024-05-26T15:42:11.481049+0000","last_fullsized":"2024-05-26T15:42:11.481049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.970692+0000","last_change":"2024-05-26T15:42:10.970692+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.970692+0000","last_undegraded":"2024-05-26T15:42:10.970692+0000","last_fullsized":"2024-05-26T15:42:10.970692+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:11:38.601829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001000+0000","last_change":"2024-05-26T15:42:10.998727+0000","last_active":"2024-05-26T15:42:11.001000+0000","last_peered":"2024-05-26T15:42:11.001000+0000","last_clean":"2024-05-26T15:42:11.001000+0000","last_became_active":"2024-05-26T15:42:10.998442+0000","last_became_peered":"2024-05-26T15:42:10.998442+0000","last_unstale":"2024-05-26T15:42:11.001000+0000","last_undegraded":"2024-05-26T15:42:11.001000+0000","last_fullsized":"2024-05-26T15:42:11.001000+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.505459+0000","last_change":"2024-05-26T15:42:11.504819+0000","last_active":"2024-05-26T15:42:11.505459+0000","last_peered":"2024-05-26T15:42:11.505459+0000","last_clean":"2024-05-26T15:42:11.505459+0000","last_became_active":"2024-05-26T15:42:11.504514+0000","last_became_peered":"2024-05-26T15:42:11.504514+0000","last_unstale":"2024-05-26T15:42:11.505459+0000","last_undegraded":"2024-05-26T15:42:11.505459+0000","last_fullsized":"2024-05-26T15:42:11.505459+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.514641+0000","last_change":"2024-05-26T15:42:10.992839+0000","last_active":"2024-05-26T15:42:11.514641+0000","last_peered":"2024-05-26T15:42:11.514641+0000","last_clean":"2024-05-26T15:42:11.514641+0000","last_became_active":"2024-05-26T15:42:10.992579+0000","last_became_peered":"2024-05-26T15:42:10.992579+0000","last_unstale":"2024-05-26T15:42:11.514641+0000","last_undegraded":"2024-05-26T15:42:11.514641+0000","last_fullsized":"2024-05-26T15:42:11.514641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:42.284507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.495824+0000","last_change":"2024-05-26T15:42:11.493992+0000","last_active":"2024-05-26T15:42:11.495824+0000","last_peered":"2024-05-26T15:42:11.495824+0000","last_clean":"2024-05-26T15:42:11.495824+0000","last_became_active":"2024-05-26T15:42:11.493723+0000","last_became_peered":"2024-05-26T15:42:11.493723+0000","last_unstale":"2024-05-26T15:42:11.495824+0000","last_undegraded":"2024-05-26T15:42:11.495824+0000","last_fullsized":"2024-05-26T15:42:11.495824+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.999433+0000","last_change":"2024-05-26T15:42:10.997701+0000","last_active":"2024-05-26T15:42:10.999433+0000","last_peered":"2024-05-26T15:42:10.999433+0000","last_clean":"2024-05-26T15:42:10.999433+0000","last_became_active":"2024-05-26T15:42:10.997346+0000","last_became_peered":"2024-05-26T15:42:10.997346+0000","last_unstale":"2024-05-26T15:42:10.999433+0000","last_undegraded":"2024-05-26T15:42:10.999433+0000","last_fullsized":"2024-05-26T15:42:10.999433+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:33.637114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.971101+0000","last_change":"2024-05-26T15:42:10.971101+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.971101+0000","last_undegraded":"2024-05-26T15:42:10.971101+0000","last_fullsized":"2024-05-26T15:42:10.971101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:12:21.904002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997217+0000","last_change":"2024-05-26T15:42:10.991731+0000","last_active":"2024-05-26T15:42:10.997217+0000","last_peered":"2024-05-26T15:42:10.997217+0000","last_clean":"2024-05-26T15:42:10.997217+0000","last_became_active":"2024-05-26T15:42:10.991441+0000","last_became_peered":"2024-05-26T15:42:10.991441+0000","last_unstale":"2024-05-26T15:42:10.997217+0000","last_undegraded":"2024-05-26T15:42:10.997217+0000","last_fullsized":"2024-05-26T15:42:10.997217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:42:08.139990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.490386+0000","last_change":"2024-05-26T15:42:11.489521+0000","last_active":"2024-05-26T15:42:11.490386+0000","last_peered":"2024-05-26T15:42:11.490386+0000","last_clean":"2024-05-26T15:42:11.490386+0000","last_became_active":"2024-05-26T15:42:11.489213+0000","last_became_peered":"2024-05-26T15:42:11.489213+0000","last_unstale":"2024-05-26T15:42:11.490386+0000","last_undegraded":"2024-05-26T15:42:11.490386+0000","last_fullsized":"2024-05-26T15:42:11.490386+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:16:18.154776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000959+0000","last_change":"2024-05-26T15:42:10.998347+0000","last_active":"2024-05-26T15:42:11.000959+0000","last_peered":"2024-05-26T15:42:11.000959+0000","last_clean":"2024-05-26T15:42:11.000959+0000","last_became_active":"2024-05-26T15:42:10.998044+0000","last_became_peered":"2024-05-26T15:42:10.998044+0000","last_unstale":"2024-05-26T15:42:11.000959+0000","last_undegraded":"2024-05-26T15:42:11.000959+0000","last_fullsized":"2024-05-26T15:42:11.000959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:29:49.530204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974584+0000","last_change":"2024-05-26T15:42:10.974584+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974584+0000","last_undegraded":"2024-05-26T15:42:10.974584+0000","last_fullsized":"2024-05-26T15:42:10.974584+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:04:06.159661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.503218+0000","last_change":"2024-05-26T15:42:10.986901+0000","last_active":"2024-05-26T15:42:11.503218+0000","last_peered":"2024-05-26T15:42:11.503218+0000","last_clean":"2024-05-26T15:42:11.503218+0000","last_became_active":"2024-05-26T15:42:10.986607+0000","last_became_peered":"2024-05-26T15:42:10.986607+0000","last_unstale":"2024-05-26T15:42:11.503218+0000","last_undegraded":"2024-05-26T15:42:11.503218+0000","last_fullsized":"2024-05-26T15:42:11.503218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:34:53.688146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486884+0000","last_change":"2024-05-26T15:42:11.480883+0000","last_active":"2024-05-26T15:42:11.486884+0000","last_peered":"2024-05-26T15:42:11.486884+0000","last_clean":"2024-05-26T15:42:11.486884+0000","last_became_active":"2024-05-26T15:42:11.480431+0000","last_became_peered":"2024-05-26T15:42:11.480431+0000","last_unstale":"2024-05-26T15:42:11.486884+0000","last_undegraded":"2024-05-26T15:42:11.486884+0000","last_fullsized":"2024-05-26T15:42:11.486884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:54:36.629232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.001369+0000","last_change":"2024-05-26T15:42:10.998759+0000","last_active":"2024-05-26T15:42:11.001369+0000","last_peered":"2024-05-26T15:42:11.001369+0000","last_clean":"2024-05-26T15:42:11.001369+0000","last_became_active":"2024-05-26T15:42:10.997608+0000","last_became_peered":"2024-05-26T15:42:10.997608+0000","last_unstale":"2024-05-26T15:42:11.001369+0000","last_undegraded":"2024-05-26T15:42:11.001369+0000","last_fullsized":"2024-05-26T15:42:11.001369+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:02.353379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494353+0000","last_change":"2024-05-26T15:42:11.492971+0000","last_active":"2024-05-26T15:42:11.494353+0000","last_peered":"2024-05-26T15:42:11.494353+0000","last_clean":"2024-05-26T15:42:11.494353+0000","last_became_active":"2024-05-26T15:42:11.492712+0000","last_became_peered":"2024-05-26T15:42:11.492712+0000","last_unstale":"2024-05-26T15:42:11.494353+0000","last_undegraded":"2024-05-26T15:42:11.494353+0000","last_fullsized":"2024-05-26T15:42:11.494353+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:33:15.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.502779+0000","last_change":"2024-05-26T15:42:10.987809+0000","last_active":"2024-05-26T15:42:11.502779+0000","last_peered":"2024-05-26T15:42:11.502779+0000","last_clean":"2024-05-26T15:42:11.502779+0000","last_became_active":"2024-05-26T15:42:10.987533+0000","last_became_peered":"2024-05-26T15:42:10.987533+0000","last_unstale":"2024-05-26T15:42:11.502779+0000","last_undegraded":"2024-05-26T15:42:11.502779+0000","last_fullsized":"2024-05-26T15:42:11.502779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:23:08.480431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.510255+0000","last_change":"2024-05-26T15:42:11.509067+0000","last_active":"2024-05-26T15:42:11.510255+0000","last_peered":"2024-05-26T15:42:11.510255+0000","last_clean":"2024-05-26T15:42:11.510255+0000","last_became_active":"2024-05-26T15:42:11.508750+0000","last_became_peered":"2024-05-26T15:42:11.508750+0000","last_unstale":"2024-05-26T15:42:11.510255+0000","last_undegraded":"2024-05-26T15:42:11.510255+0000","last_fullsized":"2024-05-26T15:42:11.510255+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997174+0000","last_change":"2024-05-26T15:42:10.991160+0000","last_active":"2024-05-26T15:42:10.997174+0000","last_peered":"2024-05-26T15:42:10.997174+0000","last_clean":"2024-05-26T15:42:10.997174+0000","last_became_active":"2024-05-26T15:42:10.990470+0000","last_became_peered":"2024-05-26T15:42:10.990470+0000","last_unstale":"2024-05-26T15:42:10.997174+0000","last_undegraded":"2024-05-26T15:42:10.997174+0000","last_fullsized":"2024-05-26T15:42:10.997174+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:52:01.513775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.480533+0000","last_change":"2024-05-26T15:42:11.474929+0000","last_active":"2024-05-26T15:42:11.480533+0000","last_peered":"2024-05-26T15:42:11.480533+0000","last_clean":"2024-05-26T15:42:11.480533+0000","last_became_active":"2024-05-26T15:42:11.474601+0000","last_became_peered":"2024-05-26T15:42:11.474601+0000","last_unstale":"2024-05-26T15:42:11.480533+0000","last_undegraded":"2024-05-26T15:42:11.480533+0000","last_fullsized":"2024-05-26T15:42:11.480533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000827+0000","last_change":"2024-05-26T15:42:10.996147+0000","last_active":"2024-05-26T15:42:11.000827+0000","last_peered":"2024-05-26T15:42:11.000827+0000","last_clean":"2024-05-26T15:42:11.000827+0000","last_became_active":"2024-05-26T15:42:10.995452+0000","last_became_peered":"2024-05-26T15:42:10.995452+0000","last_unstale":"2024-05-26T15:42:11.000827+0000","last_undegraded":"2024-05-26T15:42:11.000827+0000","last_fullsized":"2024-05-26T15:42:11.000827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:05:01.848852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500164+0000","last_change":"2024-05-26T15:42:11.495714+0000","last_active":"2024-05-26T15:42:11.500164+0000","last_peered":"2024-05-26T15:42:11.500164+0000","last_clean":"2024-05-26T15:42:11.500164+0000","last_became_active":"2024-05-26T15:42:11.495136+0000","last_became_peered":"2024-05-26T15:42:11.495136+0000","last_unstale":"2024-05-26T15:42:11.500164+0000","last_undegraded":"2024-05-26T15:42:11.500164+0000","last_fullsized":"2024-05-26T15:42:11.500164+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494221+0000","last_change":"2024-05-26T15:42:10.975898+0000","last_active":"2024-05-26T15:42:11.494221+0000","last_peered":"2024-05-26T15:42:11.494221+0000","last_clean":"2024-05-26T15:42:11.494221+0000","last_became_active":"2024-05-26T15:42:10.975600+0000","last_became_peered":"2024-05-26T15:42:10.975600+0000","last_unstale":"2024-05-26T15:42:11.494221+0000","last_undegraded":"2024-05-26T15:42:11.494221+0000","last_fullsized":"2024-05-26T15:42:11.494221+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.978558+0000","last_change":"2024-05-26T15:42:10.978558+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.978558+0000","last_undegraded":"2024-05-26T15:42:10.978558+0000","last_fullsized":"2024-05-26T15:42:10.978558+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.468936+0000","last_change":"2024-05-26T15:42:10.991079+0000","last_active":"2024-05-26T15:42:11.468936+0000","last_peered":"2024-05-26T15:42:11.468936+0000","last_clean":"2024-05-26T15:42:11.468936+0000","last_became_active":"2024-05-26T15:42:10.990406+0000","last_became_peered":"2024-05-26T15:42:10.990406+0000","last_unstale":"2024-05-26T15:42:11.468936+0000","last_undegraded":"2024-05-26T15:42:11.468936+0000","last_fullsized":"2024-05-26T15:42:11.468936+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:42:34.129309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.974545+0000","last_change":"2024-05-26T15:42:10.974545+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.974545+0000","last_undegraded":"2024-05-26T15:42:10.974545+0000","last_fullsized":"2024-05-26T15:42:10.974545+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:08:18.416170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.991527+0000","last_change":"2024-05-26T15:42:10.989749+0000","last_active":"2024-05-26T15:42:10.991527+0000","last_peered":"2024-05-26T15:42:10.991527+0000","last_clean":"2024-05-26T15:42:10.991527+0000","last_became_active":"2024-05-26T15:42:10.989423+0000","last_became_peered":"2024-05-26T15:42:10.989423+0000","last_unstale":"2024-05-26T15:42:10.991527+0000","last_undegraded":"2024-05-26T15:42:10.991527+0000","last_fullsized":"2024-05-26T15:42:10.991527+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:40.916618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.493498+0000","last_change":"2024-05-26T15:42:11.484429+0000","last_active":"2024-05-26T15:42:11.493498+0000","last_peered":"2024-05-26T15:42:11.493498+0000","last_clean":"2024-05-26T15:42:11.493498+0000","last_became_active":"2024-05-26T15:42:11.484135+0000","last_became_peered":"2024-05-26T15:42:11.484135+0000","last_unstale":"2024-05-26T15:42:11.493498+0000","last_undegraded":"2024-05-26T15:42:11.493498+0000","last_fullsized":"2024-05-26T15:42:11.493498+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.473231+0000","last_change":"2024-05-26T15:42:10.991543+0000","last_active":"2024-05-26T15:42:11.473231+0000","last_peered":"2024-05-26T15:42:11.473231+0000","last_clean":"2024-05-26T15:42:11.473231+0000","last_became_active":"2024-05-26T15:42:10.991274+0000","last_became_peered":"2024-05-26T15:42:10.991274+0000","last_unstale":"2024-05-26T15:42:11.473231+0000","last_undegraded":"2024-05-26T15:42:11.473231+0000","last_fullsized":"2024-05-26T15:42:11.473231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:53:19.992334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492484+0000","last_change":"2024-05-26T15:42:11.485797+0000","last_active":"2024-05-26T15:42:11.492484+0000","last_peered":"2024-05-26T15:42:11.492484+0000","last_clean":"2024-05-26T15:42:11.492484+0000","last_became_active":"2024-05-26T15:42:11.483913+0000","last_became_peered":"2024-05-26T15:42:11.483913+0000","last_unstale":"2024-05-26T15:42:11.492484+0000","last_undegraded":"2024-05-26T15:42:11.492484+0000","last_fullsized":"2024-05-26T15:42:11.492484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:48:48.284704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.997270+0000","last_change":"2024-05-26T15:42:10.991882+0000","last_active":"2024-05-26T15:42:10.997270+0000","last_peered":"2024-05-26T15:42:10.997270+0000","last_clean":"2024-05-26T15:42:10.997270+0000","last_became_active":"2024-05-26T15:42:10.991556+0000","last_became_peered":"2024-05-26T15:42:10.991556+0000","last_unstale":"2024-05-26T15:42:10.997270+0000","last_undegraded":"2024-05-26T15:42:10.997270+0000","last_fullsized":"2024-05-26T15:42:10.997270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494407+0000","last_change":"2024-05-26T15:42:11.487435+0000","last_active":"2024-05-26T15:42:11.494407+0000","last_peered":"2024-05-26T15:42:11.494407+0000","last_clean":"2024-05-26T15:42:11.494407+0000","last_became_active":"2024-05-26T15:42:11.487190+0000","last_became_peered":"2024-05-26T15:42:11.487190+0000","last_unstale":"2024-05-26T15:42:11.494407+0000","last_undegraded":"2024-05-26T15:42:11.494407+0000","last_fullsized":"2024-05-26T15:42:11.494407+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.000286+0000","last_change":"2024-05-26T15:42:10.996454+0000","last_active":"2024-05-26T15:42:11.000286+0000","last_peered":"2024-05-26T15:42:11.000286+0000","last_clean":"2024-05-26T15:42:11.000286+0000","last_became_active":"2024-05-26T15:42:10.996007+0000","last_became_peered":"2024-05-26T15:42:10.996007+0000","last_unstale":"2024-05-26T15:42:11.000286+0000","last_undegraded":"2024-05-26T15:42:11.000286+0000","last_fullsized":"2024-05-26T15:42:11.000286+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:15:52.653657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494059+0000","last_change":"2024-05-26T15:42:11.493289+0000","last_active":"2024-05-26T15:42:11.494059+0000","last_peered":"2024-05-26T15:42:11.494059+0000","last_clean":"2024-05-26T15:42:11.494059+0000","last_became_active":"2024-05-26T15:42:11.493002+0000","last_became_peered":"2024-05-26T15:42:11.493002+0000","last_unstale":"2024-05-26T15:42:11.494059+0000","last_undegraded":"2024-05-26T15:42:11.494059+0000","last_fullsized":"2024-05-26T15:42:11.494059+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:10:12.251535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.998218+0000","last_change":"2024-05-26T15:42:10.994854+0000","last_active":"2024-05-26T15:42:10.998218+0000","last_peered":"2024-05-26T15:42:10.998218+0000","last_clean":"2024-05-26T15:42:10.998218+0000","last_became_active":"2024-05-26T15:42:10.994565+0000","last_became_peered":"2024-05-26T15:42:10.994565+0000","last_unstale":"2024-05-26T15:42:10.998218+0000","last_undegraded":"2024-05-26T15:42:10.998218+0000","last_fullsized":"2024-05-26T15:42:10.998218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:17.523734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.973797+0000","last_change":"2024-05-26T15:42:10.973797+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.973797+0000","last_undegraded":"2024-05-26T15:42:10.973797+0000","last_fullsized":"2024-05-26T15:42:10.973797+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:56:54.463216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.470519+0000","last_change":"2024-05-26T15:42:10.995708+0000","last_active":"2024-05-26T15:42:11.470519+0000","last_peered":"2024-05-26T15:42:11.470519+0000","last_clean":"2024-05-26T15:42:11.470519+0000","last_became_active":"2024-05-26T15:42:10.994183+0000","last_became_peered":"2024-05-26T15:42:10.994183+0000","last_unstale":"2024-05-26T15:42:11.470519+0000","last_undegraded":"2024-05-26T15:42:11.470519+0000","last_fullsized":"2024-05-26T15:42:11.470519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:16:25.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494771+0000","last_change":"2024-05-26T15:42:11.493284+0000","last_active":"2024-05-26T15:42:11.494771+0000","last_peered":"2024-05-26T15:42:11.494771+0000","last_clean":"2024-05-26T15:42:11.494771+0000","last_became_active":"2024-05-26T15:42:11.492376+0000","last_became_peered":"2024-05-26T15:42:11.492376+0000","last_unstale":"2024-05-26T15:42:11.494771+0000","last_undegraded":"2024-05-26T15:42:11.494771+0000","last_fullsized":"2024-05-26T15:42:11.494771+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.469095+0000","last_change":"2024-05-26T15:42:10.996318+0000","last_active":"2024-05-26T15:42:11.469095+0000","last_peered":"2024-05-26T15:42:11.469095+0000","last_clean":"2024-05-26T15:42:11.469095+0000","last_became_active":"2024-05-26T15:42:10.996055+0000","last_became_peered":"2024-05-26T15:42:10.996055+0000","last_unstale":"2024-05-26T15:42:11.469095+0000","last_undegraded":"2024-05-26T15:42:11.469095+0000","last_fullsized":"2024-05-26T15:42:11.469095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:12:49.868345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.977618+0000","last_change":"2024-05-26T15:42:10.977618+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.977618+0000","last_undegraded":"2024-05-26T15:42:10.977618+0000","last_fullsized":"2024-05-26T15:42:10.977618+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:12:02.298237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.477482+0000","last_change":"2024-05-26T15:42:10.988191+0000","last_active":"2024-05-26T15:42:11.477482+0000","last_peered":"2024-05-26T15:42:11.477482+0000","last_clean":"2024-05-26T15:42:11.477482+0000","last_became_active":"2024-05-26T15:42:10.987878+0000","last_became_peered":"2024-05-26T15:42:10.987878+0000","last_unstale":"2024-05-26T15:42:11.477482+0000","last_undegraded":"2024-05-26T15:42:11.477482+0000","last_fullsized":"2024-05-26T15:42:11.477482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499900+0000","last_change":"2024-05-26T15:42:11.498253+0000","last_active":"2024-05-26T15:42:11.499900+0000","last_peered":"2024-05-26T15:42:11.499900+0000","last_clean":"2024-05-26T15:42:11.499900+0000","last_became_active":"2024-05-26T15:42:11.497352+0000","last_became_peered":"2024-05-26T15:42:11.497352+0000","last_unstale":"2024-05-26T15:42:11.499900+0000","last_undegraded":"2024-05-26T15:42:11.499900+0000","last_fullsized":"2024-05-26T15:42:11.499900+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:58:56.943330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.466389+0000","last_change":"2024-05-26T15:42:10.984171+0000","last_active":"2024-05-26T15:42:11.466389+0000","last_peered":"2024-05-26T15:42:11.466389+0000","last_clean":"2024-05-26T15:42:11.466389+0000","last_became_active":"2024-05-26T15:42:10.983594+0000","last_became_peered":"2024-05-26T15:42:10.983594+0000","last_unstale":"2024-05-26T15:42:11.466389+0000","last_undegraded":"2024-05-26T15:42:11.466389+0000","last_fullsized":"2024-05-26T15:42:11.466389+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-05-26T15:42:10.972240+0000","last_change":"2024-05-26T15:42:10.972240+0000","last_active":"2024-05-26T15:42:10.946763+0000","last_peered":"2024-05-26T15:42:10.946763+0000","last_clean":"2024-05-26T15:42:10.946763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-26T15:42:10.972240+0000","last_undegraded":"2024-05-26T15:42:10.972240+0000","last_fullsized":"2024-05-26T15:42:10.972240+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-05-26T15:42:10.998959+0000","last_change":"2024-05-26T15:42:10.997668+0000","last_active":"2024-05-26T15:42:10.998959+0000","last_peered":"2024-05-26T15:42:10.998959+0000","last_clean":"2024-05-26T15:42:10.998959+0000","last_became_active":"2024-05-26T15:42:10.997353+0000","last_became_peered":"2024-05-26T15:42:10.997353+0000","last_unstale":"2024-05-26T15:42:10.998959+0000","last_undegraded":"2024-05-26T15:42:10.998959+0000","last_fullsized":"2024-05-26T15:42:10.998959+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:45.987751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-05-26T15:42:09.976056+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:42:09.976056+0000","last_peered":"2024-05-26T15:42:09.976056+0000","last_clean":"2024-05-26T15:42:09.976056+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:42:09.976056+0000","last_undegraded":"2024-05-26T15:42:09.976056+0000","last_fullsized":"2024-05-26T15:42:09.976056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1564,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1212416,"data_stored":863638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.643,"5min":1.802,"15min":1.802},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.84399999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.55,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2310000000000001,"15min":1.2330000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.204},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2669999999999999,"15min":1.2709999999999999},"min":{"1min":0.91000000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.601}]},{"osd":2,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3300000000000001,"15min":1.3240000000000001},"min":{"1min":0.92000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6870000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.137}]},{"osd":3,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":0.85999999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.946,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.498},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4830000000000001,"15min":1.484},"min":{"1min":1.0189999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.968,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.417}]},{"osd":4,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.448,"15min":1.446},"min":{"1min":0.873,"5min":0.87,"15min":0.87},"max":{"1min":2.0800000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.5640000000000001,"15min":1.5660000000000001},"min":{"1min":1.0589999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.0659999999999998,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.5489999999999999}]},{"osd":5,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.542,"15min":1.552},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.0409999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.25},{"interface":"front","average":{"1min":1.71,"5min":1.669,"15min":1.6619999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.2050000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.272}]},{"osd":6,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6819999999999999,"15min":1.6879999999999999},"min":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"max":{"1min":2.2480000000000002,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8240000000000001,"15min":1.8220000000000001},"min":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"max":{"1min":2.4609999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.3939999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":618496,"data_stored":273270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1599999999999999,"15min":1.1639999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5249999999999999,"5min":1.736,"15min":1.736},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.83599999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.96799999999999997}]},{"osd":1,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.202,"15min":1.1990000000000001},"min":{"1min":0.78700000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":1.024},{"interface":"front","average":{"1min":1.276,"5min":1.2410000000000001,"15min":1.2350000000000001},"min":{"1min":0.92500000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6859999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.4379999999999999}]},{"osd":2,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.85699999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6659999999999999,"5min":2.157,"15min":2.157},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.425,"5min":1.5029999999999999,"15min":1.516},"min":{"1min":0.998,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.032,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":0.81899999999999995}]},{"osd":3,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.403,"15min":1.4139999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.76,"5min":2.169,"15min":2.169},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.639,"15min":1.6830000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.9890000000000001,"5min":4.452,"15min":4.452},"last":1.1399999999999999}]},{"osd":4,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.637,"15min":1.657},"min":{"1min":0.82799999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.893,"5min":3.282,"15min":3.282},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.512,"15min":1.524},"min":{"1min":0.71499999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.931,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.476}]},{"osd":5,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.7130000000000001,"15min":1.7410000000000001},"min":{"1min":0.89600000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0219999999999998,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.399},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.615,"15min":1.645},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.1459999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.365}]},{"osd":7,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.7789999999999999,"15min":1.8109999999999999},"min":{"1min":1.1240000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.145,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.7889999999999999,"15min":1.8200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.2200000000000002,"5min":2.843,"15min":2.843},"last":1.24}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":651264,"data_stored":292561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.127,"15min":1.143},"min":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5489999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.0860000000000001,"15min":1.0700000000000001},"min":{"1min":0.81100000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.6180000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.627}]},{"osd":1,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.1220000000000001,"15min":1.089},"min":{"1min":0.89900000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.135},{"interface":"front","average":{"1min":1.232,"5min":1.1439999999999999,"15min":1.129},"min":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.268}]},{"osd":2,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.1879999999999999,"15min":1.181},"min":{"1min":0.92700000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4550000000000001,"5min":1.659,"15min":1.659},"last":1.006},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.2949999999999999,"15min":1.2829999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.3100000000000001}]},{"osd":3,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.337,"15min":1.3440000000000001},"min":{"1min":0.94299999999999995,"5min":0.871,"15min":0.871},"max":{"1min":1.7849999999999999,"5min":1.879,"15min":1.879},"last":1.806},{"interface":"front","average":{"1min":1.361,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.76,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.516}]},{"osd":4,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3440000000000001,"15min":1.3380000000000001},"min":{"1min":0.84799999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.736,"5min":2.077,"15min":2.077},"last":1.466},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5720000000000001,"15min":1.5820000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.9630000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.9470000000000001}]},{"osd":6,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.5269999999999999,"15min":1.538},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.47,"15min":1.462},"min":{"1min":1.1839999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.8939999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.75}]},{"osd":7,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.623,"15min":1.6299999999999999},"min":{"1min":1.173,"5min":1.036,"15min":1.036},"max":{"1min":2.3159999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.889},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.645,"15min":1.6499999999999999},"min":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.7030000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":659456,"data_stored":294162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.1479999999999999,"15min":1.1619999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7190000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.238,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.601,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.625}]},{"osd":1,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2470000000000001,"15min":1.2589999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.764,"5min":2.238,"15min":2.238},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.139,"15min":1.1299999999999999},"min":{"1min":0.86399999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.75,"15min":1.75},"last":1.1180000000000001}]},{"osd":2,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.86799999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6479999999999999,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.302,"15min":1.3049999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7490000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.92700000000000005}]},{"osd":3,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.292,"15min":1.28},"min":{"1min":1.077,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.6639999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.248},{"interface":"front","average":{"1min":1.411,"5min":1.4790000000000001,"15min":1.49},"min":{"1min":1.1579999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":1.7529999999999999,"5min":2.734,"15min":2.734},"last":1.554}]},{"osd":5,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.502,"15min":1.502},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":1.8759999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.069},{"interface":"front","average":{"1min":1.452,"5min":1.504,"15min":1.512},"min":{"1min":1.206,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":1.794,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3859999999999999}]},{"osd":6,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.5720000000000001,"15min":1.5860000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.879,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.653,"15min":1.6619999999999999},"min":{"1min":1.2889999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.917,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.1719999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.6559999999999999,"15min":1.6779999999999999},"min":{"1min":1.236,"5min":1.147,"15min":1.147},"max":{"1min":1.9490000000000001,"5min":4.008,"15min":4.008},"last":1.522},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.75,"15min":1.7709999999999999},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.9730000000000001,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.7010000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":671744,"data_stored":295166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90000000000000002,"15min":0.90500000000000003},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.508,"15min":1.508},"last":0.746},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94599999999999995,"15min":0.94699999999999995},"min":{"1min":0.56999999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.2929999999999999,"5min":1.659,"15min":1.659},"last":0.71999999999999997}]},{"osd":1,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.98899999999999999,"15min":1.0009999999999999},"min":{"1min":0.52800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3149999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.089,"5min":1.198,"15min":1.216},"min":{"1min":0.70399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6439999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.94399999999999995}]},{"osd":2,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.1419999999999999,"15min":1.1659999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.70499999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7789999999999999,"5min":1.954,"15min":1.954},"last":1.0389999999999999}]},{"osd":4,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.296,"15min":1.3009999999999999},"min":{"1min":0.97799999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.915,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.4219999999999999,"15min":1.4419999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8149999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.3500000000000001}]},{"osd":5,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.4750000000000001,"15min":1.492},"min":{"1min":0.96399999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.968,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.389},{"interface":"front","average":{"1min":1.429,"5min":1.4239999999999999,"15min":1.423},"min":{"1min":0.875,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.794,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.51,"15min":1.536},"min":{"1min":0.93000000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.9430000000000001,"5min":2.863,"15min":2.863},"last":1.657},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.593,"15min":1.605},"min":{"1min":1.105,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.0659999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.635}]},{"osd":7,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.5149999999999999,"15min":1.5109999999999999},"min":{"1min":1.224,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.0640000000000001,"5min":2.306,"15min":2.306},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.575,"15min":1.591},"min":{"1min":1.0069999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.145,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.556}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":294125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0129999999999999,"15min":1.026},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3260000000000001,"5min":1.47,"15min":1.47},"last":0.874},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52300000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.6339999999999999,"5min":1.748,"15min":1.748},"last":1.232}]},{"osd":1,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.04,"15min":1.056},"min":{"1min":0.626,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2170000000000001,"15min":1.1970000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":7.4770000000000003,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.98799999999999999}]},{"osd":3,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.04,"15min":1.0349999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":0.69199999999999995,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1789999999999998,"5min":2.903,"15min":2.903},"last":0.91500000000000004}]},{"osd":4,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":1.5549999999999999,"15min":1.502},"min":{"1min":0.93500000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":10.438000000000001,"5min":10.438000000000001,"15min":10.438000000000001},"last":1.151},{"interface":"front","average":{"1min":1.363,"5min":1.4610000000000001,"15min":1.4770000000000001},"min":{"1min":1.046,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.6930000000000001,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.1870000000000001}]},{"osd":5,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8220000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.7150000000000001,"15min":1.6699999999999999},"min":{"1min":1.105,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":10.798999999999999,"5min":10.798999999999999,"15min":10.798999999999999},"last":1.369}]},{"osd":6,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.6379999999999999,"15min":1.6040000000000001},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":7.851,"5min":7.851,"15min":7.851},"last":1.272},{"interface":"front","average":{"1min":1.962,"5min":1.6779999999999999,"15min":1.6299999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":10.672000000000001,"5min":10.672000000000001,"15min":10.672000000000001},"last":1.4399999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":2.0339999999999998,"5min":1.794,"15min":1.754},"min":{"1min":1.224,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":10.249000000000001,"5min":10.249000000000001,"15min":10.249000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.5980000000000001,"15min":1.607},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.3839999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":293740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.0529999999999999,"15min":1.0840000000000001},"min":{"1min":0.59999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.417,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.107,"15min":1.129},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.639,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.99399999999999999,"15min":1.0149999999999999},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.623,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.073},{"interface":"front","average":{"1min":1.054,"5min":1.266,"15min":1.302},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5349999999999999,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.012}]},{"osd":3,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.337,"15min":1.371},"min":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7809999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.171},{"interface":"front","average":{"1min":1.016,"5min":1.2350000000000001,"15min":1.2709999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.48,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.87}]},{"osd":4,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.369,"15min":1.3839999999999999},"min":{"1min":0.877,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7490000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.3879999999999999,"15min":1.4159999999999999},"min":{"1min":0.86099999999999999,"5min":0.75,"15min":0.75},"max":{"1min":1.8260000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.157}]},{"osd":5,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.468,"15min":1.508},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.7509999999999999,"5min":2.621,"15min":2.621},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6080000000000001,"15min":1.643},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.8660000000000001,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.3420000000000001}]},{"osd":6,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.522,"15min":1.544},"min":{"1min":0.82799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.704,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.631,"15min":1.6870000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.7130000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.401}]},{"osd":7,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.6910000000000001,"15min":1.73},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.877,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.6020000000000001,"15min":1.635},"min":{"1min":0.95499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8220000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.115}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1208320,"data_stored":862619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2470000000000001,"5min":1.454,"15min":1.454},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.91600000000000004,"5min":1,"15min":1.014},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.6499999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0800000000000001,"15min":1.1080000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3759999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0329999999999999,"15min":1.0409999999999999},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.419,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.282,"15min":1.3120000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2570000000000001,"5min":4.024,"15min":4.024},"last":0.873},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.2450000000000001,"15min":1.2689999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.198,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":0.88400000000000001}]},{"osd":4,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.452,"15min":1.49},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6759999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.998},{"interface":"front","average":{"1min":1.133,"5min":1.1519999999999999,"15min":1.155},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.071}]},{"osd":5,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.516,"15min":1.552},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7030000000000001,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.514,"15min":1.54},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9119999999999999,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.22}]},{"osd":6,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.258,"15min":1.276},"min":{"1min":0.81100000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.6679999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.026},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.512,"15min":1.544},"min":{"1min":0.88600000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.0569999999999999,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.117}]},{"osd":7,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.6160000000000001,"15min":1.6459999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.835,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.335},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3740000000000001,"15min":1.381},"min":{"1min":0.82699999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1219999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.204}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:42:21.035 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:42:21.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.257+0000 7fb09b200640 1 Processor -- start 2024-05-26T15:42:21.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.257+0000 7fb09b200640 1 -- start start 2024-05-26T15:42:21.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.259+0000 7fb09b200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb09c154f50 0x7fb09c0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.259+0000 7fb09b200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb09c15ae70 0x7fb09c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.259+0000 7fb09b200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c15b640 con 0x7fb09c15f0c0 2024-05-26T15:42:21.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.259+0000 7fb09b200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c15bee0 con 0x7fb09c154f50 2024-05-26T15:42:21.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.259+0000 7fb09b200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0b0ba0 con 0x7fb09c15ae70 2024-05-26T15:42:21.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.259+0000 7fb099e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fb09c154f50 0x7fb09c0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.259+0000 7fb09a800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb09c15f0c0 0x7fb09c0c36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59520/0 (socket says 172.21.15.8:59520) 2024-05-26T15:42:21.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.259+0000 7fb09a800640 1 -- 172.21.15.8:0/2687317508 learned_addr learned my addr 172.21.15.8:0/2687317508 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:21.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.260+0000 7fb093e00640 1 --2- 172.21.15.8:0/2687317508 >> v2:172.21.15.47:3300/0 conn(0x7fb09c15ae70 0x7fb09c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.260+0000 7fb099e00640 1 -- 172.21.15.8:0/2687317508 >> v2:172.21.15.47:3300/0 conn(0x7fb09c15ae70 msgr2=0x7fb09c15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:21.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.260+0000 7fb099e00640 1 --2- 172.21.15.8:0/2687317508 >> v2:172.21.15.47:3300/0 conn(0x7fb09c15ae70 0x7fb09c15eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.260+0000 7fb099e00640 1 -- 172.21.15.8:0/2687317508 >> v1:172.21.15.8:6789/0 conn(0x7fb09c15f0c0 legacy=0x7fb09c0c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:21.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.260+0000 7fb099e00640 1 -- 172.21.15.8:0/2687317508 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c15b920 con 0x7fb09c154f50 2024-05-26T15:42:21.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.260+0000 7fb099400640 1 -- 172.21.15.8:0/2687317508 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556524164 0 0) 0x7fb09c15b640 con 0x7fb09c15f0c0 2024-05-26T15:42:21.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.261+0000 7fb099e00640 1 --2- 172.21.15.8:0/2687317508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c154f50 0x7fb09c0b0f60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb09c067880 tx=0x7fb08c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9b8bb2a774615c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:21.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.261+0000 7fb099400640 1 -- 172.21.15.8:0/2687317508 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c032440 con 0x7fb09c154f50 2024-05-26T15:42:21.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.261+0000 7fb099400640 1 -- 172.21.15.8:0/2687317508 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c0325a0 con 0x7fb09c154f50 2024-05-26T15:42:21.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.261+0000 7fb099400640 1 -- 172.21.15.8:0/2687317508 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c032930 con 0x7fb09c154f50 2024-05-26T15:42:21.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.262+0000 7fb09b200640 1 -- 172.21.15.8:0/2687317508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c154f50 msgr2=0x7fb09c0b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:21.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.262+0000 7fb09b200640 1 --2- 172.21.15.8:0/2687317508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c154f50 0x7fb09c0b0f60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb09c067880 tx=0x7fb08c02a1a0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.262+0000 7fb09b200640 1 -- 172.21.15.8:0/2687317508 shutdown_connections 2024-05-26T15:42:21.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.262+0000 7fb09b200640 1 --2- 172.21.15.8:0/2687317508 >> v2:172.21.15.47:3300/0 conn(0x7fb09c15ae70 0x7fb09c15eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.262+0000 7fb09b200640 1 --2- 172.21.15.8:0/2687317508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c154f50 0x7fb09c0b0f60 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.262+0000 7fb09b200640 1 -- 172.21.15.8:0/2687317508 >> 172.21.15.8:0/2687317508 conn(0x7fb09c070480 msgr2=0x7fb09c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:21.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.262+0000 7fb09b200640 1 -- 172.21.15.8:0/2687317508 shutdown_connections 2024-05-26T15:42:21.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.262+0000 7fb09b200640 1 -- 172.21.15.8:0/2687317508 wait complete. 2024-05-26T15:42:21.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.264+0000 7fb09b200640 1 Processor -- start 2024-05-26T15:42:21.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.264+0000 7fb09b200640 1 -- start start 2024-05-26T15:42:21.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.265+0000 7fb09b200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c15ae70 0x7fb09c1ef870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.265+0000 7fb09b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb09c15f0c0 0x7fb09c1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.265+0000 7fb09b200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb09c159e00 0x7fb09c1f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.265+0000 7fb09b200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c1462a0 con 0x7fb09c15ae70 2024-05-26T15:42:21.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.265+0000 7fb09b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c15a2b0 con 0x7fb09c15f0c0 2024-05-26T15:42:21.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.265+0000 7fb09b200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c1456c0 con 0x7fb09c159e00 2024-05-26T15:42:21.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.265+0000 7fb099e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c15ae70 0x7fb09c1ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.265+0000 7fb099e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c15ae70 0x7fb09c1ef870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51278/0 (socket says 172.21.15.8:51278) 2024-05-26T15:42:21.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.265+0000 7fb099e00640 1 -- 172.21.15.8:0/442119245 learned_addr learned my addr 172.21.15.8:0/442119245 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:21.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb093e00640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb09c15f0c0 0x7fb09c1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb099e00640 1 -- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb09c159e00 msgr2=0x7fb09c1f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:21.265 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb09a800640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb09c159e00 0x7fb09c1f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb099e00640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb09c159e00 0x7fb09c1f5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb099e00640 1 -- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb09c15f0c0 msgr2=0x7fb09c1598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb099e00640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb09c15f0c0 0x7fb09c1598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb099e00640 1 -- 172.21.15.8:0/442119245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c009400 con 0x7fb09c15ae70 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb093e00640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb09c15f0c0 0x7fb09c1598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb099e00640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c15ae70 0x7fb09c1ef870 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009890 tx=0x7fb08c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb092000640 1 -- 172.21.15.8:0/442119245 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c032440 con 0x7fb09c15ae70 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.266+0000 7fb092000640 1 -- 172.21.15.8:0/442119245 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c030ba0 con 0x7fb09c15ae70 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.267+0000 7fb09b200640 1 -- 172.21.15.8:0/442119245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c145900 con 0x7fb09c15ae70 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.267+0000 7fb092000640 1 -- 172.21.15.8:0/442119245 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c006e10 con 0x7fb09c15ae70 2024-05-26T15:42:21.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.267+0000 7fb09b200640 1 -- 172.21.15.8:0/442119245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c145ec0 con 0x7fb09c15ae70 2024-05-26T15:42:21.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.268+0000 7fb09b200640 1 -- 172.21.15.8:0/442119245 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09c04e280 con 0x7fb09c15ae70 2024-05-26T15:42:21.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.269+0000 7fb092000640 1 -- 172.21.15.8:0/442119245 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb08c039040 con 0x7fb09c15ae70 2024-05-26T15:42:21.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.270+0000 7fb092000640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07806ac00 0x7fb07806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.270+0000 7fb092000640 1 -- 172.21.15.8:0/442119245 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb08c0a9f90 con 0x7fb09c15ae70 2024-05-26T15:42:21.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.270+0000 7fb093e00640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07806ac00 0x7fb07806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.271+0000 7fb093e00640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07806ac00 0x7fb07806d0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb09c152890 tx=0x7fb084008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:21.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.274+0000 7fb092000640 1 -- 172.21.15.8:0/442119245 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb08c075050 con 0x7fb09c15ae70 2024-05-26T15:42:21.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.468+0000 7fb09b200640 1 -- 172.21.15.8:0/442119245 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb09c155330 con 0x7fb07806ac00 2024-05-26T15:42:21.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.492+0000 7fb092000640 1 -- 172.21.15.8:0/442119245 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286662 (secure 0 0 0) 0x7fb084009e10 con 0x7fb07806ac00 2024-05-26T15:42:21.494 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:21.495 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 -- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07806ac00 msgr2=0x7fb07806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07806ac00 0x7fb07806d0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb09c152890 tx=0x7fb084008040 comp rx=0 tx=0).stop 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 -- 172.21.15.8:0/442119245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c15ae70 msgr2=0x7fb09c1ef870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c15ae70 0x7fb09c1ef870 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009890 tx=0x7fb08c0046c0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 -- 172.21.15.8:0/442119245 shutdown_connections 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb09c159e00 0x7fb09c1f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb07806ac00 0x7fb07806d0c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb09c15f0c0 0x7fb09c1598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 --2- 172.21.15.8:0/442119245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb09c15ae70 0x7fb09c1ef870 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 -- 172.21.15.8:0/442119245 >> 172.21.15.8:0/442119245 conn(0x7fb09c070480 msgr2=0x7fb09c0c4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 -- 172.21.15.8:0/442119245 shutdown_connections 2024-05-26T15:42:21.497 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.497+0000 7fb09b200640 1 -- 172.21.15.8:0/442119245 wait complete. 2024-05-26T15:42:21.514 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-05-26T15:42:20.223517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255308,"kb_used_data":6332,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754719412,"statfs":{"total":773094113280,"available":772832677888,"internally_reserved":0,"allocated":6483968,"data_stored":3531043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.763609"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.478258+0000","last_change":"2024-05-26T15:42:11.475784+0000","last_active":"2024-05-26T15:42:11.478258+0000","last_peered":"2024-05-26T15:42:11.478258+0000","last_clean":"2024-05-26T15:42:11.478258+0000","last_became_active":"2024-05-26T15:42:11.474366+0000","last_became_peered":"2024-05-26T15:42:11.474366+0000","last_unstale":"2024-05-26T15:42:11.478258+0000","last_undegraded":"2024-05-26T15:42:11.478258+0000","last_fullsized":"2024-05-26T15:42:11.478258+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:14:28.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500521+0000","last_change":"2024-05-26T15:42:11.495570+0000","last_active":"2024-05-26T15:42:11.500521+0000","last_peered":"2024-05-26T15:42:11.500521+0000","last_clean":"2024-05-26T15:42:11.500521+0000","last_became_active":"2024-05-26T15:42:11.494905+0000","last_became_peered":"2024-05-26T15:42:11.494905+0000","last_unstale":"2024-05-26T15:42:11.500521+0000","last_undegraded":"2024-05-26T15:42:11.500521+0000","last_fullsized":"2024-05-26T15:42:11.500521+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:03:47.944320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512434+0000","last_change":"2024-05-26T15:42:11.502643+0000","last_active":"2024-05-26T15:42:11.512434+0000","last_peered":"2024-05-26T15:42:11.512434+0000","last_clean":"2024-05-26T15:42:11.512434+0000","last_became_active":"2024-05-26T15:42:11.502199+0000","last_became_peered":"2024-05-26T15:42:11.502199+0000","last_unstale":"2024-05-26T15:42:11.512434+0000","last_undegraded":"2024-05-26T15:42:11.512434+0000","last_fullsized":"2024-05-26T15:42:11.512434+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:26:52.879894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.491742+0000","last_change":"2024-05-26T15:42:11.488521+0000","last_active":"2024-05-26T15:42:11.491742+0000","last_peered":"2024-05-26T15:42:11.491742+0000","last_clean":"2024-05-26T15:42:11.491742+0000","last_became_active":"2024-05-26T15:42:11.488201+0000","last_became_peered":"2024-05-26T15:42:11.488201+0000","last_unstale":"2024-05-26T15:42:11.491742+0000","last_undegraded":"2024-05-26T15:42:11.491742+0000","last_fullsized":"2024-05-26T15:42:11.491742+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500715+0000","last_change":"2024-05-26T15:42:11.497533+0000","last_active":"2024-05-26T15:42:11.500715+0000","last_peered":"2024-05-26T15:42:11.500715+0000","last_clean":"2024-05-26T15:42:11.500715+0000","last_became_active":"2024-05-26T15:42:11.496938+0000","last_became_peered":"2024-05-26T15:42:11.496938+0000","last_unstale":"2024-05-26T15:42:11.500715+0000","last_undegraded":"2024-05-26T15:42:11.500715+0000","last_fullsized":"2024-05-26T15:42:11.500715+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499447+0000","last_change":"2024-05-26T15:42:11.494471+0000","last_active":"2024-05-26T15:42:11.499447+0000","last_peered":"2024-05-26T15:42:11.499447+0000","last_clean":"2024-05-26T15:42:11.499447+0000","last_became_active":"2024-05-26T15:42:11.494235+0000","last_became_peered":"2024-05-26T15:42:11.494235+0000","last_unstale":"2024-05-26T15:42:11.499447+0000","last_undegraded":"2024-05-26T15:42:11.499447+0000","last_fullsized":"2024-05-26T15:42:11.499447+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512593+0000","last_change":"2024-05-26T15:42:11.509408+0000","last_active":"2024-05-26T15:42:11.512593+0000","last_peered":"2024-05-26T15:42:11.512593+0000","last_clean":"2024-05-26T15:42:11.512593+0000","last_became_active":"2024-05-26T15:42:11.508832+0000","last_became_peered":"2024-05-26T15:42:11.508832+0000","last_unstale":"2024-05-26T15:42:11.512593+0000","last_undegraded":"2024-05-26T15:42:11.512593+0000","last_fullsized":"2024-05-26T15:42:11.512593+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:47:58.290205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494005+0000","last_change":"2024-05-26T15:42:11.491743+0000","last_active":"2024-05-26T15:42:11.494005+0000","last_peered":"2024-05-26T15:42:11.494005+0000","last_clean":"2024-05-26T15:42:11.494005+0000","last_became_active":"2024-05-26T15:42:11.491512+0000","last_became_peered":"2024-05-26T15:42:11.491512+0000","last_unstale":"2024-05-26T15:42:11.494005+0000","last_undegraded":"2024-05-26T15:42:11.494005+0000","last_fullsized":"2024-05-26T15:42:11.494005+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:49.249092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494033+0000","last_change":"2024-05-26T15:42:11.492582+0000","last_active":"2024-05-26T15:42:11.494033+0000","last_peered":"2024-05-26T15:42:11.494033+0000","last_clean":"2024-05-26T15:42:11.494033+0000","last_became_active":"2024-05-26T15:42:11.492271+0000","last_became_peered":"2024-05-26T15:42:11.492271+0000","last_unstale":"2024-05-26T15:42:11.494033+0000","last_undegraded":"2024-05-26T15:42:11.494033+0000","last_fullsized":"2024-05-26T15:42:11.494033+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:26:49.715010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499336+0000","last_change":"2024-05-26T15:42:11.496192+0000","last_active":"2024-05-26T15:42:11.499336+0000","last_peered":"2024-05-26T15:42:11.499336+0000","last_clean":"2024-05-26T15:42:11.499336+0000","last_became_active":"2024-05-26T15:42:11.495944+0000","last_became_peered":"2024-05-26T15:42:11.495944+0000","last_unstale":"2024-05-26T15:42:11.499336+0000","last_undegraded":"2024-05-26T15:42:11.499336+0000","last_fullsized":"2024-05-26T15:42:11.499336+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:06:39.785296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.496073+0000","last_change":"2024-05-26T15:42:11.489235+0000","last_active":"2024-05-26T15:42:11.496073+0000","last_peered":"2024-05-26T15:42:11.496073+0000","last_clean":"2024-05-26T15:42:11.496073+0000","last_became_active":"2024-05-26T15:42:11.488907+0000","last_became_peered":"2024-05-26T15:42:11.488907+0000","last_unstale":"2024-05-26T15:42:11.496073+0000","last_undegraded":"2024-05-26T15:42:11.496073+0000","last_fullsized":"2024-05-26T15:42:11.496073+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:13:27.388279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.487693+0000","last_change":"2024-05-26T15:42:11.486461+0000","last_active":"2024-05-26T15:42:11.487693+0000","last_peered":"2024-05-26T15:42:11.487693+0000","last_clean":"2024-05-26T15:42:11.487693+0000","last_became_active":"2024-05-26T15:42:11.485854+0000","last_became_peered":"2024-05-26T15:42:11.485854+0000","last_unstale":"2024-05-26T15:42:11.487693+0000","last_undegraded":"2024-05-26T15:42:11.487693+0000","last_fullsized":"2024-05-26T15:42:11.487693+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:00:13.066137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499405+0000","last_change":"2024-05-26T15:42:11.496586+0000","last_active":"2024-05-26T15:42:11.499405+0000","last_peered":"2024-05-26T15:42:11.499405+0000","last_clean":"2024-05-26T15:42:11.499405+0000","last_became_active":"2024-05-26T15:42:11.496340+0000","last_became_peered":"2024-05-26T15:42:11.496340+0000","last_unstale":"2024-05-26T15:42:11.499405+0000","last_undegraded":"2024-05-26T15:42:11.499405+0000","last_fullsized":"2024-05-26T15:42:11.499405+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:48:48.284704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.510101+0000","last_change":"2024-05-26T15:42:11.502024+0000","last_active":"2024-05-26T15:42:11.510101+0000","last_peered":"2024-05-26T15:42:11.510101+0000","last_clean":"2024-05-26T15:42:11.510101+0000","last_became_active":"2024-05-26T15:42:11.501727+0000","last_became_peered":"2024-05-26T15:42:11.501727+0000","last_unstale":"2024-05-26T15:42:11.510101+0000","last_undegraded":"2024-05-26T15:42:11.510101+0000","last_fullsized":"2024-05-26T15:42:11.510101+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:43.290565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.493460+0000","last_change":"2024-05-26T15:42:11.489164+0000","last_active":"2024-05-26T15:42:11.493460+0000","last_peered":"2024-05-26T15:42:11.493460+0000","last_clean":"2024-05-26T15:42:11.493460+0000","last_became_active":"2024-05-26T15:42:11.488391+0000","last_became_peered":"2024-05-26T15:42:11.488391+0000","last_unstale":"2024-05-26T15:42:11.493460+0000","last_undegraded":"2024-05-26T15:42:11.493460+0000","last_fullsized":"2024-05-26T15:42:11.493460+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499462+0000","last_change":"2024-05-26T15:42:11.497654+0000","last_active":"2024-05-26T15:42:11.499462+0000","last_peered":"2024-05-26T15:42:11.499462+0000","last_clean":"2024-05-26T15:42:11.499462+0000","last_became_active":"2024-05-26T15:42:11.495683+0000","last_became_peered":"2024-05-26T15:42:11.495683+0000","last_unstale":"2024-05-26T15:42:11.499462+0000","last_undegraded":"2024-05-26T15:42:11.499462+0000","last_fullsized":"2024-05-26T15:42:11.499462+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512018+0000","last_change":"2024-05-26T15:42:11.502501+0000","last_active":"2024-05-26T15:42:11.512018+0000","last_peered":"2024-05-26T15:42:11.512018+0000","last_clean":"2024-05-26T15:42:11.512018+0000","last_became_active":"2024-05-26T15:42:11.502250+0000","last_became_peered":"2024-05-26T15:42:11.502250+0000","last_unstale":"2024-05-26T15:42:11.512018+0000","last_undegraded":"2024-05-26T15:42:11.512018+0000","last_fullsized":"2024-05-26T15:42:11.512018+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:05:26.003496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500544+0000","last_change":"2024-05-26T15:42:11.495581+0000","last_active":"2024-05-26T15:42:11.500544+0000","last_peered":"2024-05-26T15:42:11.500544+0000","last_clean":"2024-05-26T15:42:11.500544+0000","last_became_active":"2024-05-26T15:42:11.495306+0000","last_became_peered":"2024-05-26T15:42:11.495306+0000","last_unstale":"2024-05-26T15:42:11.500544+0000","last_undegraded":"2024-05-26T15:42:11.500544+0000","last_fullsized":"2024-05-26T15:42:11.500544+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512451+0000","last_change":"2024-05-26T15:42:11.506182+0000","last_active":"2024-05-26T15:42:11.512451+0000","last_peered":"2024-05-26T15:42:11.512451+0000","last_clean":"2024-05-26T15:42:11.512451+0000","last_became_active":"2024-05-26T15:42:11.505414+0000","last_became_peered":"2024-05-26T15:42:11.505414+0000","last_unstale":"2024-05-26T15:42:11.512451+0000","last_undegraded":"2024-05-26T15:42:11.512451+0000","last_fullsized":"2024-05-26T15:42:11.512451+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:34:54.694204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500495+0000","last_change":"2024-05-26T15:42:11.490870+0000","last_active":"2024-05-26T15:42:11.500495+0000","last_peered":"2024-05-26T15:42:11.500495+0000","last_clean":"2024-05-26T15:42:11.500495+0000","last_became_active":"2024-05-26T15:42:11.490400+0000","last_became_peered":"2024-05-26T15:42:11.490400+0000","last_unstale":"2024-05-26T15:42:11.500495+0000","last_undegraded":"2024-05-26T15:42:11.500495+0000","last_fullsized":"2024-05-26T15:42:11.500495+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500017+0000","last_change":"2024-05-26T15:42:11.489845+0000","last_active":"2024-05-26T15:42:11.500017+0000","last_peered":"2024-05-26T15:42:11.500017+0000","last_clean":"2024-05-26T15:42:11.500017+0000","last_became_active":"2024-05-26T15:42:11.489578+0000","last_became_peered":"2024-05-26T15:42:11.489578+0000","last_unstale":"2024-05-26T15:42:11.500017+0000","last_undegraded":"2024-05-26T15:42:11.500017+0000","last_fullsized":"2024-05-26T15:42:11.500017+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.504687+0000","last_change":"2024-05-26T15:42:11.503856+0000","last_active":"2024-05-26T15:42:11.504687+0000","last_peered":"2024-05-26T15:42:11.504687+0000","last_clean":"2024-05-26T15:42:11.504687+0000","last_became_active":"2024-05-26T15:42:11.503619+0000","last_became_peered":"2024-05-26T15:42:11.503619+0000","last_unstale":"2024-05-26T15:42:11.504687+0000","last_undegraded":"2024-05-26T15:42:11.504687+0000","last_fullsized":"2024-05-26T15:42:11.504687+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:38:38.915738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.495384+0000","last_change":"2024-05-26T15:42:11.488723+0000","last_active":"2024-05-26T15:42:11.495384+0000","last_peered":"2024-05-26T15:42:11.495384+0000","last_clean":"2024-05-26T15:42:11.495384+0000","last_became_active":"2024-05-26T15:42:11.488410+0000","last_became_peered":"2024-05-26T15:42:11.488410+0000","last_unstale":"2024-05-26T15:42:11.495384+0000","last_undegraded":"2024-05-26T15:42:11.495384+0000","last_fullsized":"2024-05-26T15:42:11.495384+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:51:09.231165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.490672+0000","last_change":"2024-05-26T15:42:11.483270+0000","last_active":"2024-05-26T15:42:11.490672+0000","last_peered":"2024-05-26T15:42:11.490672+0000","last_clean":"2024-05-26T15:42:11.490672+0000","last_became_active":"2024-05-26T15:42:11.482939+0000","last_became_peered":"2024-05-26T15:42:11.482939+0000","last_unstale":"2024-05-26T15:42:11.490672+0000","last_undegraded":"2024-05-26T15:42:11.490672+0000","last_fullsized":"2024-05-26T15:42:11.490672+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:10:03.718462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512205+0000","last_change":"2024-05-26T15:42:11.506390+0000","last_active":"2024-05-26T15:42:11.512205+0000","last_peered":"2024-05-26T15:42:11.512205+0000","last_clean":"2024-05-26T15:42:11.512205+0000","last_became_active":"2024-05-26T15:42:11.505942+0000","last_became_peered":"2024-05-26T15:42:11.505942+0000","last_unstale":"2024-05-26T15:42:11.512205+0000","last_undegraded":"2024-05-26T15:42:11.512205+0000","last_fullsized":"2024-05-26T15:42:11.512205+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486266+0000","last_change":"2024-05-26T15:42:11.482860+0000","last_active":"2024-05-26T15:42:11.486266+0000","last_peered":"2024-05-26T15:42:11.486266+0000","last_clean":"2024-05-26T15:42:11.486266+0000","last_became_active":"2024-05-26T15:42:11.482579+0000","last_became_peered":"2024-05-26T15:42:11.482579+0000","last_unstale":"2024-05-26T15:42:11.486266+0000","last_undegraded":"2024-05-26T15:42:11.486266+0000","last_fullsized":"2024-05-26T15:42:11.486266+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:59.291291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494385+0000","last_change":"2024-05-26T15:42:11.491800+0000","last_active":"2024-05-26T15:42:11.494385+0000","last_peered":"2024-05-26T15:42:11.494385+0000","last_clean":"2024-05-26T15:42:11.494385+0000","last_became_active":"2024-05-26T15:42:11.491522+0000","last_became_peered":"2024-05-26T15:42:11.491522+0000","last_unstale":"2024-05-26T15:42:11.494385+0000","last_undegraded":"2024-05-26T15:42:11.494385+0000","last_fullsized":"2024-05-26T15:42:11.494385+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.483590+0000","last_change":"2024-05-26T15:42:11.480824+0000","last_active":"2024-05-26T15:42:11.483590+0000","last_peered":"2024-05-26T15:42:11.483590+0000","last_clean":"2024-05-26T15:42:11.483590+0000","last_became_active":"2024-05-26T15:42:11.480541+0000","last_became_peered":"2024-05-26T15:42:11.480541+0000","last_unstale":"2024-05-26T15:42:11.483590+0000","last_undegraded":"2024-05-26T15:42:11.483590+0000","last_fullsized":"2024-05-26T15:42:11.483590+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512341+0000","last_change":"2024-05-26T15:42:11.508572+0000","last_active":"2024-05-26T15:42:11.512341+0000","last_peered":"2024-05-26T15:42:11.512341+0000","last_clean":"2024-05-26T15:42:11.512341+0000","last_became_active":"2024-05-26T15:42:11.508260+0000","last_became_peered":"2024-05-26T15:42:11.508260+0000","last_unstale":"2024-05-26T15:42:11.512341+0000","last_undegraded":"2024-05-26T15:42:11.512341+0000","last_fullsized":"2024-05-26T15:42:11.512341+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:42:35.135367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500607+0000","last_change":"2024-05-26T15:42:11.496507+0000","last_active":"2024-05-26T15:42:11.500607+0000","last_peered":"2024-05-26T15:42:11.500607+0000","last_clean":"2024-05-26T15:42:11.500607+0000","last_became_active":"2024-05-26T15:42:11.496083+0000","last_became_peered":"2024-05-26T15:42:11.496083+0000","last_unstale":"2024-05-26T15:42:11.500607+0000","last_undegraded":"2024-05-26T15:42:11.500607+0000","last_fullsized":"2024-05-26T15:42:11.500607+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512573+0000","last_change":"2024-05-26T15:42:11.509190+0000","last_active":"2024-05-26T15:42:11.512573+0000","last_peered":"2024-05-26T15:42:11.512573+0000","last_clean":"2024-05-26T15:42:11.512573+0000","last_became_active":"2024-05-26T15:42:11.508428+0000","last_became_peered":"2024-05-26T15:42:11.508428+0000","last_unstale":"2024-05-26T15:42:11.512573+0000","last_undegraded":"2024-05-26T15:42:11.512573+0000","last_fullsized":"2024-05-26T15:42:11.512573+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:16:26.570143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492503+0000","last_change":"2024-05-26T15:42:11.485998+0000","last_active":"2024-05-26T15:42:11.492503+0000","last_peered":"2024-05-26T15:42:11.492503+0000","last_clean":"2024-05-26T15:42:11.492503+0000","last_became_active":"2024-05-26T15:42:11.484349+0000","last_became_peered":"2024-05-26T15:42:11.484349+0000","last_unstale":"2024-05-26T15:42:11.492503+0000","last_undegraded":"2024-05-26T15:42:11.492503+0000","last_fullsized":"2024-05-26T15:42:11.492503+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.491642+0000","last_change":"2024-05-26T15:42:11.487731+0000","last_active":"2024-05-26T15:42:11.491642+0000","last_peered":"2024-05-26T15:42:11.491642+0000","last_clean":"2024-05-26T15:42:11.491642+0000","last_became_active":"2024-05-26T15:42:11.487448+0000","last_became_peered":"2024-05-26T15:42:11.487448+0000","last_unstale":"2024-05-26T15:42:11.491642+0000","last_undegraded":"2024-05-26T15:42:11.491642+0000","last_fullsized":"2024-05-26T15:42:11.491642+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:46.993809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"54'4","reported_seq":15,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.498676+0000","last_change":"2024-05-26T15:42:10.994305+0000","last_active":"2024-05-26T15:42:11.498676+0000","last_peered":"2024-05-26T15:42:11.498676+0000","last_clean":"2024-05-26T15:42:11.498676+0000","last_became_active":"2024-05-26T15:42:10.992501+0000","last_became_peered":"2024-05-26T15:42:10.992501+0000","last_unstale":"2024-05-26T15:42:11.498676+0000","last_undegraded":"2024-05-26T15:42:11.498676+0000","last_fullsized":"2024-05-26T15:42:11.498676+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.496238+0000","last_change":"2024-05-26T15:42:11.494994+0000","last_active":"2024-05-26T15:42:11.496238+0000","last_peered":"2024-05-26T15:42:11.496238+0000","last_clean":"2024-05-26T15:42:11.496238+0000","last_became_active":"2024-05-26T15:42:11.494663+0000","last_became_peered":"2024-05-26T15:42:11.494663+0000","last_unstale":"2024-05-26T15:42:11.496238+0000","last_undegraded":"2024-05-26T15:42:11.496238+0000","last_fullsized":"2024-05-26T15:42:11.496238+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.490230+0000","last_change":"2024-05-26T15:42:10.988783+0000","last_active":"2024-05-26T15:42:11.490230+0000","last_peered":"2024-05-26T15:42:11.490230+0000","last_clean":"2024-05-26T15:42:11.490230+0000","last_became_active":"2024-05-26T15:42:10.987904+0000","last_became_peered":"2024-05-26T15:42:10.987904+0000","last_unstale":"2024-05-26T15:42:11.490230+0000","last_undegraded":"2024-05-26T15:42:11.490230+0000","last_fullsized":"2024-05-26T15:42:11.490230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:28:20.962641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500541+0000","last_change":"2024-05-26T15:42:11.490560+0000","last_active":"2024-05-26T15:42:11.500541+0000","last_peered":"2024-05-26T15:42:11.500541+0000","last_clean":"2024-05-26T15:42:11.500541+0000","last_became_active":"2024-05-26T15:42:11.490269+0000","last_became_peered":"2024-05-26T15:42:11.490269+0000","last_unstale":"2024-05-26T15:42:11.500541+0000","last_undegraded":"2024-05-26T15:42:11.500541+0000","last_fullsized":"2024-05-26T15:42:11.500541+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.502766+0000","last_change":"2024-05-26T15:42:10.990216+0000","last_active":"2024-05-26T15:42:11.502766+0000","last_peered":"2024-05-26T15:42:11.502766+0000","last_clean":"2024-05-26T15:42:11.502766+0000","last_became_active":"2024-05-26T15:42:10.988791+0000","last_became_peered":"2024-05-26T15:42:10.988791+0000","last_unstale":"2024-05-26T15:42:11.502766+0000","last_undegraded":"2024-05-26T15:42:11.502766+0000","last_fullsized":"2024-05-26T15:42:11.502766+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.487167+0000","last_change":"2024-05-26T15:42:11.484844+0000","last_active":"2024-05-26T15:42:11.487167+0000","last_peered":"2024-05-26T15:42:11.487167+0000","last_clean":"2024-05-26T15:42:11.487167+0000","last_became_active":"2024-05-26T15:42:11.484593+0000","last_became_peered":"2024-05-26T15:42:11.484593+0000","last_unstale":"2024-05-26T15:42:11.487167+0000","last_undegraded":"2024-05-26T15:42:11.487167+0000","last_fullsized":"2024-05-26T15:42:11.487167+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:54:37.361110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.485471+0000","last_change":"2024-05-26T15:42:10.993769+0000","last_active":"2024-05-26T15:42:11.485471+0000","last_peered":"2024-05-26T15:42:11.485471+0000","last_clean":"2024-05-26T15:42:11.485471+0000","last_became_active":"2024-05-26T15:42:10.993475+0000","last_became_peered":"2024-05-26T15:42:10.993475+0000","last_unstale":"2024-05-26T15:42:11.485471+0000","last_undegraded":"2024-05-26T15:42:11.485471+0000","last_fullsized":"2024-05-26T15:42:11.485471+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:42.382894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512009+0000","last_change":"2024-05-26T15:42:11.511184+0000","last_active":"2024-05-26T15:42:11.512009+0000","last_peered":"2024-05-26T15:42:11.512009+0000","last_clean":"2024-05-26T15:42:11.512009+0000","last_became_active":"2024-05-26T15:42:11.510627+0000","last_became_peered":"2024-05-26T15:42:11.510627+0000","last_unstale":"2024-05-26T15:42:11.512009+0000","last_undegraded":"2024-05-26T15:42:11.512009+0000","last_fullsized":"2024-05-26T15:42:11.512009+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:41.922675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512984+0000","last_change":"2024-05-26T15:42:10.984163+0000","last_active":"2024-05-26T15:42:11.512984+0000","last_peered":"2024-05-26T15:42:11.512984+0000","last_clean":"2024-05-26T15:42:11.512984+0000","last_became_active":"2024-05-26T15:42:10.982899+0000","last_became_peered":"2024-05-26T15:42:10.982899+0000","last_unstale":"2024-05-26T15:42:11.512984+0000","last_undegraded":"2024-05-26T15:42:11.512984+0000","last_fullsized":"2024-05-26T15:42:11.512984+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.501903+0000","last_change":"2024-05-26T15:42:11.498285+0000","last_active":"2024-05-26T15:42:11.501903+0000","last_peered":"2024-05-26T15:42:11.501903+0000","last_clean":"2024-05-26T15:42:11.501903+0000","last_became_active":"2024-05-26T15:42:11.495895+0000","last_became_peered":"2024-05-26T15:42:11.495895+0000","last_unstale":"2024-05-26T15:42:11.501903+0000","last_undegraded":"2024-05-26T15:42:11.501903+0000","last_fullsized":"2024-05-26T15:42:11.501903+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486523+0000","last_change":"2024-05-26T15:42:10.990225+0000","last_active":"2024-05-26T15:42:11.486523+0000","last_peered":"2024-05-26T15:42:11.486523+0000","last_clean":"2024-05-26T15:42:11.486523+0000","last_became_active":"2024-05-26T15:42:10.989032+0000","last_became_peered":"2024-05-26T15:42:10.989032+0000","last_unstale":"2024-05-26T15:42:11.486523+0000","last_undegraded":"2024-05-26T15:42:11.486523+0000","last_fullsized":"2024-05-26T15:42:11.486523+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:48:04.490649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486284+0000","last_change":"2024-05-26T15:42:11.484249+0000","last_active":"2024-05-26T15:42:11.486284+0000","last_peered":"2024-05-26T15:42:11.486284+0000","last_clean":"2024-05-26T15:42:11.486284+0000","last_became_active":"2024-05-26T15:42:11.483933+0000","last_became_peered":"2024-05-26T15:42:11.483933+0000","last_unstale":"2024-05-26T15:42:11.486284+0000","last_undegraded":"2024-05-26T15:42:11.486284+0000","last_fullsized":"2024-05-26T15:42:11.486284+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:48:00.462942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.469433+0000","last_change":"2024-05-26T15:42:10.993335+0000","last_active":"2024-05-26T15:42:11.469433+0000","last_peered":"2024-05-26T15:42:11.469433+0000","last_clean":"2024-05-26T15:42:11.469433+0000","last_became_active":"2024-05-26T15:42:10.992580+0000","last_became_peered":"2024-05-26T15:42:10.992580+0000","last_unstale":"2024-05-26T15:42:11.469433+0000","last_undegraded":"2024-05-26T15:42:11.469433+0000","last_fullsized":"2024-05-26T15:42:11.469433+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:28:20.962641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512070+0000","last_change":"2024-05-26T15:42:11.511050+0000","last_active":"2024-05-26T15:42:11.512070+0000","last_peered":"2024-05-26T15:42:11.512070+0000","last_clean":"2024-05-26T15:42:11.512070+0000","last_became_active":"2024-05-26T15:42:11.510655+0000","last_became_peered":"2024-05-26T15:42:11.510655+0000","last_unstale":"2024-05-26T15:42:11.512070+0000","last_undegraded":"2024-05-26T15:42:11.512070+0000","last_fullsized":"2024-05-26T15:42:11.512070+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.484749+0000","last_change":"2024-05-26T15:42:10.985611+0000","last_active":"2024-05-26T15:42:11.484749+0000","last_peered":"2024-05-26T15:42:11.484749+0000","last_clean":"2024-05-26T15:42:11.484749+0000","last_became_active":"2024-05-26T15:42:10.985306+0000","last_became_peered":"2024-05-26T15:42:10.985306+0000","last_unstale":"2024-05-26T15:42:11.484749+0000","last_undegraded":"2024-05-26T15:42:11.484749+0000","last_fullsized":"2024-05-26T15:42:11.484749+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:42.382894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492395+0000","last_change":"2024-05-26T15:42:11.488874+0000","last_active":"2024-05-26T15:42:11.492395+0000","last_peered":"2024-05-26T15:42:11.492395+0000","last_clean":"2024-05-26T15:42:11.492395+0000","last_became_active":"2024-05-26T15:42:11.488482+0000","last_became_peered":"2024-05-26T15:42:11.488482+0000","last_unstale":"2024-05-26T15:42:11.492395+0000","last_undegraded":"2024-05-26T15:42:11.492395+0000","last_fullsized":"2024-05-26T15:42:11.492395+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.481270+0000","last_change":"2024-05-26T15:42:11.000242+0000","last_active":"2024-05-26T15:42:11.481270+0000","last_peered":"2024-05-26T15:42:11.481270+0000","last_clean":"2024-05-26T15:42:11.481270+0000","last_became_active":"2024-05-26T15:42:10.999921+0000","last_became_peered":"2024-05-26T15:42:10.999921+0000","last_unstale":"2024-05-26T15:42:11.481270+0000","last_undegraded":"2024-05-26T15:42:11.481270+0000","last_fullsized":"2024-05-26T15:42:11.481270+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:47:33.095545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.491565+0000","last_change":"2024-05-26T15:42:11.483171+0000","last_active":"2024-05-26T15:42:11.491565+0000","last_peered":"2024-05-26T15:42:11.491565+0000","last_clean":"2024-05-26T15:42:11.491565+0000","last_became_active":"2024-05-26T15:42:11.482824+0000","last_became_peered":"2024-05-26T15:42:11.482824+0000","last_unstale":"2024-05-26T15:42:11.491565+0000","last_undegraded":"2024-05-26T15:42:11.491565+0000","last_fullsized":"2024-05-26T15:42:11.491565+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:47:38.325002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.481049+0000","last_change":"2024-05-26T15:42:10.988391+0000","last_active":"2024-05-26T15:42:11.481049+0000","last_peered":"2024-05-26T15:42:11.481049+0000","last_clean":"2024-05-26T15:42:11.481049+0000","last_became_active":"2024-05-26T15:42:10.987480+0000","last_became_peered":"2024-05-26T15:42:10.987480+0000","last_unstale":"2024-05-26T15:42:11.481049+0000","last_undegraded":"2024-05-26T15:42:11.481049+0000","last_fullsized":"2024-05-26T15:42:11.481049+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:56:29.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.509762+0000","last_change":"2024-05-26T15:42:11.498702+0000","last_active":"2024-05-26T15:42:11.509762+0000","last_peered":"2024-05-26T15:42:11.509762+0000","last_clean":"2024-05-26T15:42:11.509762+0000","last_became_active":"2024-05-26T15:42:11.498420+0000","last_became_peered":"2024-05-26T15:42:11.498420+0000","last_unstale":"2024-05-26T15:42:11.509762+0000","last_undegraded":"2024-05-26T15:42:11.509762+0000","last_fullsized":"2024-05-26T15:42:11.509762+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:11:38.601829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"54'3","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500804+0000","last_change":"2024-05-26T15:42:10.998727+0000","last_active":"2024-05-26T15:42:11.500804+0000","last_peered":"2024-05-26T15:42:11.500804+0000","last_clean":"2024-05-26T15:42:11.500804+0000","last_became_active":"2024-05-26T15:42:10.998442+0000","last_became_peered":"2024-05-26T15:42:10.998442+0000","last_unstale":"2024-05-26T15:42:11.500804+0000","last_undegraded":"2024-05-26T15:42:11.500804+0000","last_fullsized":"2024-05-26T15:42:11.500804+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.505459+0000","last_change":"2024-05-26T15:42:11.504819+0000","last_active":"2024-05-26T15:42:11.505459+0000","last_peered":"2024-05-26T15:42:11.505459+0000","last_clean":"2024-05-26T15:42:11.505459+0000","last_became_active":"2024-05-26T15:42:11.504514+0000","last_became_peered":"2024-05-26T15:42:11.504514+0000","last_unstale":"2024-05-26T15:42:11.505459+0000","last_undegraded":"2024-05-26T15:42:11.505459+0000","last_fullsized":"2024-05-26T15:42:11.505459+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"54'6","reported_seq":17,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.514641+0000","last_change":"2024-05-26T15:42:10.992839+0000","last_active":"2024-05-26T15:42:11.514641+0000","last_peered":"2024-05-26T15:42:11.514641+0000","last_clean":"2024-05-26T15:42:11.514641+0000","last_became_active":"2024-05-26T15:42:10.992579+0000","last_became_peered":"2024-05-26T15:42:10.992579+0000","last_unstale":"2024-05-26T15:42:11.514641+0000","last_undegraded":"2024-05-26T15:42:11.514641+0000","last_fullsized":"2024-05-26T15:42:11.514641+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:31:42.284507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.495824+0000","last_change":"2024-05-26T15:42:11.493992+0000","last_active":"2024-05-26T15:42:11.495824+0000","last_peered":"2024-05-26T15:42:11.495824+0000","last_clean":"2024-05-26T15:42:11.495824+0000","last_became_active":"2024-05-26T15:42:11.493723+0000","last_became_peered":"2024-05-26T15:42:11.493723+0000","last_unstale":"2024-05-26T15:42:11.495824+0000","last_undegraded":"2024-05-26T15:42:11.495824+0000","last_fullsized":"2024-05-26T15:42:11.495824+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:00:12.145394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512288+0000","last_change":"2024-05-26T15:42:10.997701+0000","last_active":"2024-05-26T15:42:11.512288+0000","last_peered":"2024-05-26T15:42:11.512288+0000","last_clean":"2024-05-26T15:42:11.512288+0000","last_became_active":"2024-05-26T15:42:10.997346+0000","last_became_peered":"2024-05-26T15:42:10.997346+0000","last_unstale":"2024-05-26T15:42:11.512288+0000","last_undegraded":"2024-05-26T15:42:11.512288+0000","last_fullsized":"2024-05-26T15:42:11.512288+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:33.637114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512416+0000","last_change":"2024-05-26T15:42:11.502468+0000","last_active":"2024-05-26T15:42:11.512416+0000","last_peered":"2024-05-26T15:42:11.512416+0000","last_clean":"2024-05-26T15:42:11.512416+0000","last_became_active":"2024-05-26T15:42:11.498759+0000","last_became_peered":"2024-05-26T15:42:11.498759+0000","last_unstale":"2024-05-26T15:42:11.512416+0000","last_undegraded":"2024-05-26T15:42:11.512416+0000","last_fullsized":"2024-05-26T15:42:11.512416+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:12:21.904002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.470208+0000","last_change":"2024-05-26T15:42:10.991731+0000","last_active":"2024-05-26T15:42:11.470208+0000","last_peered":"2024-05-26T15:42:11.470208+0000","last_clean":"2024-05-26T15:42:11.470208+0000","last_became_active":"2024-05-26T15:42:10.991441+0000","last_became_peered":"2024-05-26T15:42:10.991441+0000","last_unstale":"2024-05-26T15:42:11.470208+0000","last_undegraded":"2024-05-26T15:42:11.470208+0000","last_fullsized":"2024-05-26T15:42:11.470208+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:42:08.139990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.490386+0000","last_change":"2024-05-26T15:42:11.489521+0000","last_active":"2024-05-26T15:42:11.490386+0000","last_peered":"2024-05-26T15:42:11.490386+0000","last_clean":"2024-05-26T15:42:11.490386+0000","last_became_active":"2024-05-26T15:42:11.489213+0000","last_became_peered":"2024-05-26T15:42:11.489213+0000","last_unstale":"2024-05-26T15:42:11.490386+0000","last_undegraded":"2024-05-26T15:42:11.490386+0000","last_fullsized":"2024-05-26T15:42:11.490386+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:16:18.154776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.476198+0000","last_change":"2024-05-26T15:42:10.998347+0000","last_active":"2024-05-26T15:42:11.476198+0000","last_peered":"2024-05-26T15:42:11.476198+0000","last_clean":"2024-05-26T15:42:11.476198+0000","last_became_active":"2024-05-26T15:42:10.998044+0000","last_became_peered":"2024-05-26T15:42:10.998044+0000","last_unstale":"2024-05-26T15:42:11.476198+0000","last_undegraded":"2024-05-26T15:42:11.476198+0000","last_fullsized":"2024-05-26T15:42:11.476198+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:29:49.530204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512188+0000","last_change":"2024-05-26T15:42:11.506189+0000","last_active":"2024-05-26T15:42:11.512188+0000","last_peered":"2024-05-26T15:42:11.512188+0000","last_clean":"2024-05-26T15:42:11.512188+0000","last_became_active":"2024-05-26T15:42:11.505216+0000","last_became_peered":"2024-05-26T15:42:11.505216+0000","last_unstale":"2024-05-26T15:42:11.512188+0000","last_undegraded":"2024-05-26T15:42:11.512188+0000","last_fullsized":"2024-05-26T15:42:11.512188+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:04:06.159661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"54'8","reported_seq":19,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.503218+0000","last_change":"2024-05-26T15:42:10.986901+0000","last_active":"2024-05-26T15:42:11.503218+0000","last_peered":"2024-05-26T15:42:11.503218+0000","last_clean":"2024-05-26T15:42:11.503218+0000","last_became_active":"2024-05-26T15:42:10.986607+0000","last_became_peered":"2024-05-26T15:42:10.986607+0000","last_unstale":"2024-05-26T15:42:11.503218+0000","last_undegraded":"2024-05-26T15:42:11.503218+0000","last_fullsized":"2024-05-26T15:42:11.503218+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:34:53.688146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.486884+0000","last_change":"2024-05-26T15:42:11.480883+0000","last_active":"2024-05-26T15:42:11.486884+0000","last_peered":"2024-05-26T15:42:11.486884+0000","last_clean":"2024-05-26T15:42:11.486884+0000","last_became_active":"2024-05-26T15:42:11.480431+0000","last_became_peered":"2024-05-26T15:42:11.480431+0000","last_unstale":"2024-05-26T15:42:11.486884+0000","last_undegraded":"2024-05-26T15:42:11.486884+0000","last_fullsized":"2024-05-26T15:42:11.486884+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:54:36.629232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512288+0000","last_change":"2024-05-26T15:42:10.998759+0000","last_active":"2024-05-26T15:42:11.512288+0000","last_peered":"2024-05-26T15:42:11.512288+0000","last_clean":"2024-05-26T15:42:11.512288+0000","last_became_active":"2024-05-26T15:42:10.997608+0000","last_became_peered":"2024-05-26T15:42:10.997608+0000","last_unstale":"2024-05-26T15:42:11.512288+0000","last_undegraded":"2024-05-26T15:42:11.512288+0000","last_fullsized":"2024-05-26T15:42:11.512288+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:02.353379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494353+0000","last_change":"2024-05-26T15:42:11.492971+0000","last_active":"2024-05-26T15:42:11.494353+0000","last_peered":"2024-05-26T15:42:11.494353+0000","last_clean":"2024-05-26T15:42:11.494353+0000","last_became_active":"2024-05-26T15:42:11.492712+0000","last_became_peered":"2024-05-26T15:42:11.492712+0000","last_unstale":"2024-05-26T15:42:11.494353+0000","last_undegraded":"2024-05-26T15:42:11.494353+0000","last_fullsized":"2024-05-26T15:42:11.494353+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T23:33:15.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.502779+0000","last_change":"2024-05-26T15:42:10.987809+0000","last_active":"2024-05-26T15:42:11.502779+0000","last_peered":"2024-05-26T15:42:11.502779+0000","last_clean":"2024-05-26T15:42:11.502779+0000","last_became_active":"2024-05-26T15:42:10.987533+0000","last_became_peered":"2024-05-26T15:42:10.987533+0000","last_unstale":"2024-05-26T15:42:11.502779+0000","last_undegraded":"2024-05-26T15:42:11.502779+0000","last_fullsized":"2024-05-26T15:42:11.502779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:23:08.480431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.510255+0000","last_change":"2024-05-26T15:42:11.509067+0000","last_active":"2024-05-26T15:42:11.510255+0000","last_peered":"2024-05-26T15:42:11.510255+0000","last_clean":"2024-05-26T15:42:11.510255+0000","last_became_active":"2024-05-26T15:42:11.508750+0000","last_became_peered":"2024-05-26T15:42:11.508750+0000","last_unstale":"2024-05-26T15:42:11.510255+0000","last_undegraded":"2024-05-26T15:42:11.510255+0000","last_fullsized":"2024-05-26T15:42:11.510255+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:45:03.359437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"54'1","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499891+0000","last_change":"2024-05-26T15:42:10.991160+0000","last_active":"2024-05-26T15:42:11.499891+0000","last_peered":"2024-05-26T15:42:11.499891+0000","last_clean":"2024-05-26T15:42:11.499891+0000","last_became_active":"2024-05-26T15:42:10.990470+0000","last_became_peered":"2024-05-26T15:42:10.990470+0000","last_unstale":"2024-05-26T15:42:11.499891+0000","last_undegraded":"2024-05-26T15:42:11.499891+0000","last_fullsized":"2024-05-26T15:42:11.499891+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:52:01.513775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.480533+0000","last_change":"2024-05-26T15:42:11.474929+0000","last_active":"2024-05-26T15:42:11.480533+0000","last_peered":"2024-05-26T15:42:11.480533+0000","last_clean":"2024-05-26T15:42:11.480533+0000","last_became_active":"2024-05-26T15:42:11.474601+0000","last_became_peered":"2024-05-26T15:42:11.474601+0000","last_unstale":"2024-05-26T15:42:11.480533+0000","last_undegraded":"2024-05-26T15:42:11.480533+0000","last_fullsized":"2024-05-26T15:42:11.480533+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:18.529791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.469892+0000","last_change":"2024-05-26T15:42:10.996147+0000","last_active":"2024-05-26T15:42:11.469892+0000","last_peered":"2024-05-26T15:42:11.469892+0000","last_clean":"2024-05-26T15:42:11.469892+0000","last_became_active":"2024-05-26T15:42:10.995452+0000","last_became_peered":"2024-05-26T15:42:10.995452+0000","last_unstale":"2024-05-26T15:42:11.469892+0000","last_undegraded":"2024-05-26T15:42:11.469892+0000","last_fullsized":"2024-05-26T15:42:11.469892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:05:01.848852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.500164+0000","last_change":"2024-05-26T15:42:11.495714+0000","last_active":"2024-05-26T15:42:11.500164+0000","last_peered":"2024-05-26T15:42:11.500164+0000","last_clean":"2024-05-26T15:42:11.500164+0000","last_became_active":"2024-05-26T15:42:11.495136+0000","last_became_peered":"2024-05-26T15:42:11.495136+0000","last_unstale":"2024-05-26T15:42:11.500164+0000","last_undegraded":"2024-05-26T15:42:11.500164+0000","last_fullsized":"2024-05-26T15:42:11.500164+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T03:41:08.176454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494221+0000","last_change":"2024-05-26T15:42:10.975898+0000","last_active":"2024-05-26T15:42:11.494221+0000","last_peered":"2024-05-26T15:42:11.494221+0000","last_clean":"2024-05-26T15:42:11.494221+0000","last_became_active":"2024-05-26T15:42:10.975600+0000","last_became_peered":"2024-05-26T15:42:10.975600+0000","last_unstale":"2024-05-26T15:42:11.494221+0000","last_undegraded":"2024-05-26T15:42:11.494221+0000","last_fullsized":"2024-05-26T15:42:11.494221+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.501155+0000","last_change":"2024-05-26T15:42:11.486376+0000","last_active":"2024-05-26T15:42:11.501155+0000","last_peered":"2024-05-26T15:42:11.501155+0000","last_clean":"2024-05-26T15:42:11.501155+0000","last_became_active":"2024-05-26T15:42:11.486096+0000","last_became_peered":"2024-05-26T15:42:11.486096+0000","last_unstale":"2024-05-26T15:42:11.501155+0000","last_undegraded":"2024-05-26T15:42:11.501155+0000","last_fullsized":"2024-05-26T15:42:11.501155+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:42:34.643171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.468936+0000","last_change":"2024-05-26T15:42:10.991079+0000","last_active":"2024-05-26T15:42:11.468936+0000","last_peered":"2024-05-26T15:42:11.468936+0000","last_clean":"2024-05-26T15:42:11.468936+0000","last_became_active":"2024-05-26T15:42:10.990406+0000","last_became_peered":"2024-05-26T15:42:10.990406+0000","last_unstale":"2024-05-26T15:42:11.468936+0000","last_undegraded":"2024-05-26T15:42:11.468936+0000","last_fullsized":"2024-05-26T15:42:11.468936+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T15:42:34.129309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.512616+0000","last_change":"2024-05-26T15:42:11.509515+0000","last_active":"2024-05-26T15:42:11.512616+0000","last_peered":"2024-05-26T15:42:11.512616+0000","last_clean":"2024-05-26T15:42:11.512616+0000","last_became_active":"2024-05-26T15:42:11.509241+0000","last_became_peered":"2024-05-26T15:42:11.509241+0000","last_unstale":"2024-05-26T15:42:11.512616+0000","last_undegraded":"2024-05-26T15:42:11.512616+0000","last_fullsized":"2024-05-26T15:42:11.512616+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:08:18.416170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.484955+0000","last_change":"2024-05-26T15:42:10.989749+0000","last_active":"2024-05-26T15:42:11.484955+0000","last_peered":"2024-05-26T15:42:11.484955+0000","last_clean":"2024-05-26T15:42:11.484955+0000","last_became_active":"2024-05-26T15:42:10.989423+0000","last_became_peered":"2024-05-26T15:42:10.989423+0000","last_unstale":"2024-05-26T15:42:11.484955+0000","last_undegraded":"2024-05-26T15:42:11.484955+0000","last_fullsized":"2024-05-26T15:42:11.484955+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:56:40.916618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.493498+0000","last_change":"2024-05-26T15:42:11.484429+0000","last_active":"2024-05-26T15:42:11.493498+0000","last_peered":"2024-05-26T15:42:11.493498+0000","last_clean":"2024-05-26T15:42:11.493498+0000","last_became_active":"2024-05-26T15:42:11.484135+0000","last_became_peered":"2024-05-26T15:42:11.484135+0000","last_unstale":"2024-05-26T15:42:11.493498+0000","last_undegraded":"2024-05-26T15:42:11.493498+0000","last_fullsized":"2024-05-26T15:42:11.493498+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:57:46.569086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.473231+0000","last_change":"2024-05-26T15:42:10.991543+0000","last_active":"2024-05-26T15:42:11.473231+0000","last_peered":"2024-05-26T15:42:11.473231+0000","last_clean":"2024-05-26T15:42:11.473231+0000","last_became_active":"2024-05-26T15:42:10.991274+0000","last_became_peered":"2024-05-26T15:42:10.991274+0000","last_unstale":"2024-05-26T15:42:11.473231+0000","last_undegraded":"2024-05-26T15:42:11.473231+0000","last_fullsized":"2024-05-26T15:42:11.473231+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:53:19.992334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.492484+0000","last_change":"2024-05-26T15:42:11.485797+0000","last_active":"2024-05-26T15:42:11.492484+0000","last_peered":"2024-05-26T15:42:11.492484+0000","last_clean":"2024-05-26T15:42:11.492484+0000","last_became_active":"2024-05-26T15:42:11.483913+0000","last_became_peered":"2024-05-26T15:42:11.483913+0000","last_unstale":"2024-05-26T15:42:11.492484+0000","last_undegraded":"2024-05-26T15:42:11.492484+0000","last_fullsized":"2024-05-26T15:42:11.492484+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:48:48.284704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"54'2","reported_seq":13,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.508583+0000","last_change":"2024-05-26T15:42:10.991882+0000","last_active":"2024-05-26T15:42:11.508583+0000","last_peered":"2024-05-26T15:42:11.508583+0000","last_clean":"2024-05-26T15:42:11.508583+0000","last_became_active":"2024-05-26T15:42:10.991556+0000","last_became_peered":"2024-05-26T15:42:10.991556+0000","last_unstale":"2024-05-26T15:42:11.508583+0000","last_undegraded":"2024-05-26T15:42:11.508583+0000","last_fullsized":"2024-05-26T15:42:11.508583+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494407+0000","last_change":"2024-05-26T15:42:11.487435+0000","last_active":"2024-05-26T15:42:11.494407+0000","last_peered":"2024-05-26T15:42:11.494407+0000","last_clean":"2024-05-26T15:42:11.494407+0000","last_became_active":"2024-05-26T15:42:11.487190+0000","last_became_peered":"2024-05-26T15:42:11.487190+0000","last_unstale":"2024-05-26T15:42:11.494407+0000","last_undegraded":"2024-05-26T15:42:11.494407+0000","last_fullsized":"2024-05-26T15:42:11.494407+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T00:16:30.210294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.478463+0000","last_change":"2024-05-26T15:42:10.996454+0000","last_active":"2024-05-26T15:42:11.478463+0000","last_peered":"2024-05-26T15:42:11.478463+0000","last_clean":"2024-05-26T15:42:11.478463+0000","last_became_active":"2024-05-26T15:42:10.996007+0000","last_became_peered":"2024-05-26T15:42:10.996007+0000","last_unstale":"2024-05-26T15:42:11.478463+0000","last_undegraded":"2024-05-26T15:42:11.478463+0000","last_fullsized":"2024-05-26T15:42:11.478463+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:15:52.653657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494059+0000","last_change":"2024-05-26T15:42:11.493289+0000","last_active":"2024-05-26T15:42:11.494059+0000","last_peered":"2024-05-26T15:42:11.494059+0000","last_clean":"2024-05-26T15:42:11.494059+0000","last_became_active":"2024-05-26T15:42:11.493002+0000","last_became_peered":"2024-05-26T15:42:11.493002+0000","last_unstale":"2024-05-26T15:42:11.494059+0000","last_undegraded":"2024-05-26T15:42:11.494059+0000","last_fullsized":"2024-05-26T15:42:11.494059+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T22:10:12.251535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.497291+0000","last_change":"2024-05-26T15:42:10.994854+0000","last_active":"2024-05-26T15:42:11.497291+0000","last_peered":"2024-05-26T15:42:11.497291+0000","last_clean":"2024-05-26T15:42:11.497291+0000","last_became_active":"2024-05-26T15:42:10.994565+0000","last_became_peered":"2024-05-26T15:42:10.994565+0000","last_unstale":"2024-05-26T15:42:11.497291+0000","last_undegraded":"2024-05-26T15:42:11.497291+0000","last_fullsized":"2024-05-26T15:42:11.497291+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T21:03:17.523734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.501274+0000","last_change":"2024-05-26T15:42:11.497772+0000","last_active":"2024-05-26T15:42:11.501274+0000","last_peered":"2024-05-26T15:42:11.501274+0000","last_clean":"2024-05-26T15:42:11.501274+0000","last_became_active":"2024-05-26T15:42:11.497498+0000","last_became_peered":"2024-05-26T15:42:11.497498+0000","last_unstale":"2024-05-26T15:42:11.501274+0000","last_undegraded":"2024-05-26T15:42:11.501274+0000","last_fullsized":"2024-05-26T15:42:11.501274+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:56:54.463216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.470519+0000","last_change":"2024-05-26T15:42:10.995708+0000","last_active":"2024-05-26T15:42:11.470519+0000","last_peered":"2024-05-26T15:42:11.470519+0000","last_clean":"2024-05-26T15:42:11.470519+0000","last_became_active":"2024-05-26T15:42:10.994183+0000","last_became_peered":"2024-05-26T15:42:10.994183+0000","last_unstale":"2024-05-26T15:42:11.470519+0000","last_undegraded":"2024-05-26T15:42:11.470519+0000","last_fullsized":"2024-05-26T15:42:11.470519+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:16:25.564085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.494771+0000","last_change":"2024-05-26T15:42:11.493284+0000","last_active":"2024-05-26T15:42:11.494771+0000","last_peered":"2024-05-26T15:42:11.494771+0000","last_clean":"2024-05-26T15:42:11.494771+0000","last_became_active":"2024-05-26T15:42:11.492376+0000","last_became_peered":"2024-05-26T15:42:11.492376+0000","last_unstale":"2024-05-26T15:42:11.494771+0000","last_undegraded":"2024-05-26T15:42:11.494771+0000","last_fullsized":"2024-05-26T15:42:11.494771+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:47:46.651790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.469095+0000","last_change":"2024-05-26T15:42:10.996318+0000","last_active":"2024-05-26T15:42:11.469095+0000","last_peered":"2024-05-26T15:42:11.469095+0000","last_clean":"2024-05-26T15:42:11.469095+0000","last_became_active":"2024-05-26T15:42:10.996055+0000","last_became_peered":"2024-05-26T15:42:10.996055+0000","last_unstale":"2024-05-26T15:42:11.469095+0000","last_undegraded":"2024-05-26T15:42:11.469095+0000","last_fullsized":"2024-05-26T15:42:11.469095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T16:12:49.868345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.510158+0000","last_change":"2024-05-26T15:42:11.501906+0000","last_active":"2024-05-26T15:42:11.510158+0000","last_peered":"2024-05-26T15:42:11.510158+0000","last_clean":"2024-05-26T15:42:11.510158+0000","last_became_active":"2024-05-26T15:42:11.501631+0000","last_became_peered":"2024-05-26T15:42:11.501631+0000","last_unstale":"2024-05-26T15:42:11.510158+0000","last_undegraded":"2024-05-26T15:42:11.510158+0000","last_fullsized":"2024-05-26T15:42:11.510158+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:12:02.298237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.477482+0000","last_change":"2024-05-26T15:42:10.988191+0000","last_active":"2024-05-26T15:42:11.477482+0000","last_peered":"2024-05-26T15:42:11.477482+0000","last_clean":"2024-05-26T15:42:11.477482+0000","last_became_active":"2024-05-26T15:42:10.987878+0000","last_became_peered":"2024-05-26T15:42:10.987878+0000","last_unstale":"2024-05-26T15:42:11.477482+0000","last_undegraded":"2024-05-26T15:42:11.477482+0000","last_fullsized":"2024-05-26T15:42:11.477482+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:08:46.807707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.499900+0000","last_change":"2024-05-26T15:42:11.498253+0000","last_active":"2024-05-26T15:42:11.499900+0000","last_peered":"2024-05-26T15:42:11.499900+0000","last_clean":"2024-05-26T15:42:11.499900+0000","last_became_active":"2024-05-26T15:42:11.497352+0000","last_became_peered":"2024-05-26T15:42:11.497352+0000","last_unstale":"2024-05-26T15:42:11.499900+0000","last_undegraded":"2024-05-26T15:42:11.499900+0000","last_fullsized":"2024-05-26T15:42:11.499900+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T02:58:56.943330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.466389+0000","last_change":"2024-05-26T15:42:10.984171+0000","last_active":"2024-05-26T15:42:11.466389+0000","last_peered":"2024-05-26T15:42:11.466389+0000","last_clean":"2024-05-26T15:42:11.466389+0000","last_became_active":"2024-05-26T15:42:10.983594+0000","last_became_peered":"2024-05-26T15:42:10.983594+0000","last_unstale":"2024-05-26T15:42:11.466389+0000","last_undegraded":"2024-05-26T15:42:11.466389+0000","last_fullsized":"2024-05-26T15:42:11.466389+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T17:06:33.554502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.483615+0000","last_change":"2024-05-26T15:42:11.476691+0000","last_active":"2024-05-26T15:42:11.483615+0000","last_peered":"2024-05-26T15:42:11.483615+0000","last_clean":"2024-05-26T15:42:11.483615+0000","last_became_active":"2024-05-26T15:42:11.476367+0000","last_became_peered":"2024-05-26T15:42:11.476367+0000","last_unstale":"2024-05-26T15:42:11.483615+0000","last_undegraded":"2024-05-26T15:42:11.483615+0000","last_fullsized":"2024-05-26T15:42:11.483615+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:10.946763+0000","last_clean_scrub_stamp":"2024-05-26T15:42:10.946763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-28T01:49:43.388951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"55'1","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-05-26T15:42:12.494220+0000","last_change":"2024-05-26T15:42:10.997668+0000","last_active":"2024-05-26T15:42:12.494220+0000","last_peered":"2024-05-26T15:42:12.494220+0000","last_clean":"2024-05-26T15:42:12.494220+0000","last_became_active":"2024-05-26T15:42:10.997353+0000","last_became_peered":"2024-05-26T15:42:10.997353+0000","last_unstale":"2024-05-26T15:42:12.494220+0000","last_undegraded":"2024-05-26T15:42:12.494220+0000","last_fullsized":"2024-05-26T15:42:12.494220+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:42:09.940706+0000","last_clean_scrub_stamp":"2024-05-26T15:42:09.940706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T18:30:45.987751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-05-26T15:42:11.474361+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:42:11.474361+0000","last_peered":"2024-05-26T15:42:11.474361+0000","last_clean":"2024-05-26T15:42:11.474361+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:42:11.474361+0000","last_undegraded":"2024-05-26T15:42:11.474361+0000","last_fullsized":"2024-05-26T15:42:11.474361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1257472,"data_stored":884072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.155,"15min":1.1519999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.643,"5min":1.802,"15min":1.802},"last":1.262},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1279999999999999,"15min":1.1240000000000001},"min":{"1min":0.84399999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.55,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.331}]},{"osd":1,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2310000000000001,"15min":1.2330000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2669999999999999,"15min":1.2709999999999999},"min":{"1min":0.91000000000000003,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.96599999999999997}]},{"osd":2,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3300000000000001,"15min":1.3240000000000001},"min":{"1min":0.92000000000000004,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.3260000000000001,"15min":1.3320000000000001},"min":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6870000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.1479999999999999}]},{"osd":3,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3300000000000001,"15min":1.3140000000000001},"min":{"1min":0.85999999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.946,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.296},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4830000000000001,"15min":1.484},"min":{"1min":1.0189999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.968,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.5589999999999999}]},{"osd":4,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.448,"15min":1.446},"min":{"1min":0.873,"5min":0.87,"15min":0.87},"max":{"1min":2.0800000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.5640000000000001,"15min":1.5660000000000001},"min":{"1min":1.0589999999999999,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.0659999999999998,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":2.04}]},{"osd":5,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.542,"15min":1.552},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":2.0409999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.71,"5min":1.669,"15min":1.6619999999999999},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.2050000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.6479999999999999}]},{"osd":6,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.6819999999999999,"15min":1.6879999999999999},"min":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"max":{"1min":2.2480000000000002,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.772},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8240000000000001,"15min":1.8220000000000001},"min":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"max":{"1min":2.4609999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.8740000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":294232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.1599999999999999,"15min":1.1639999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5249999999999999,"5min":1.736,"15min":1.736},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.242,"5min":1.1180000000000001,"15min":1.0980000000000001},"min":{"1min":0.83599999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.72299999999999998}]},{"osd":1,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.202,"15min":1.1990000000000001},"min":{"1min":0.78700000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.276,"5min":1.2410000000000001,"15min":1.2350000000000001},"min":{"1min":0.92500000000000004,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6859999999999999,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.4530000000000001}]},{"osd":2,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.304,"15min":1.3129999999999999},"min":{"1min":0.85699999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6659999999999999,"5min":2.157,"15min":2.157},"last":1.028},{"interface":"front","average":{"1min":1.425,"5min":1.5029999999999999,"15min":1.516},"min":{"1min":0.998,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.032,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.127}]},{"osd":3,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.403,"15min":1.4139999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.76,"5min":2.169,"15min":2.169},"last":1.075},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.639,"15min":1.6830000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.9890000000000001,"5min":4.452,"15min":4.452},"last":1.605}]},{"osd":4,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.637,"15min":1.657},"min":{"1min":0.82799999999999996,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.893,"5min":3.282,"15min":3.282},"last":1.663},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.512,"15min":1.524},"min":{"1min":0.71499999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.931,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.5589999999999999}]},{"osd":5,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.7130000000000001,"15min":1.7410000000000001},"min":{"1min":0.89600000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0219999999999998,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.615,"15min":1.645},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.1459999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.75}]},{"osd":7,"last update":"Sun May 26 15:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.7789999999999999,"15min":1.8109999999999999},"min":{"1min":1.1240000000000001,"5min":0.755,"15min":0.755},"max":{"1min":2.145,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.7969999999999999},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.7889999999999999,"15min":1.8200000000000001},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.2200000000000002,"5min":2.843,"15min":2.843},"last":1.863}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":651264,"data_stored":292561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.127,"15min":1.143},"min":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.5489999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.0860000000000001,"15min":1.0700000000000001},"min":{"1min":0.81100000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.6180000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.627}]},{"osd":1,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.1220000000000001,"15min":1.089},"min":{"1min":0.89900000000000002,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.135},{"interface":"front","average":{"1min":1.232,"5min":1.1439999999999999,"15min":1.129},"min":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.268}]},{"osd":2,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.1879999999999999,"15min":1.181},"min":{"1min":0.92700000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.4550000000000001,"5min":1.659,"15min":1.659},"last":1.006},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.2949999999999999,"15min":1.2829999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.3100000000000001}]},{"osd":3,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.337,"15min":1.3440000000000001},"min":{"1min":0.94299999999999995,"5min":0.871,"15min":0.871},"max":{"1min":1.7849999999999999,"5min":1.879,"15min":1.879},"last":1.806},{"interface":"front","average":{"1min":1.361,"5min":1.4179999999999999,"15min":1.4279999999999999},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.76,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.516}]},{"osd":4,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3440000000000001,"15min":1.3380000000000001},"min":{"1min":0.84799999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.736,"5min":2.077,"15min":2.077},"last":1.466},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.5720000000000001,"15min":1.5820000000000001},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.9630000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.9470000000000001}]},{"osd":6,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.5269999999999999,"15min":1.538},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.47,"15min":1.462},"min":{"1min":1.1839999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.8939999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.75}]},{"osd":7,"last update":"Sun May 26 15:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.623,"15min":1.6299999999999999},"min":{"1min":1.173,"5min":1.036,"15min":1.036},"max":{"1min":2.3159999999999998,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.889},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.645,"15min":1.6499999999999999},"min":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.7030000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":659456,"data_stored":294162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.1479999999999999,"15min":1.1619999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.7190000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.238,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.601,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":0.625}]},{"osd":1,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2470000000000001,"15min":1.2589999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.764,"5min":2.238,"15min":2.238},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.139,"15min":1.1299999999999999},"min":{"1min":0.86399999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.5489999999999999,"5min":1.75,"15min":1.75},"last":1.1180000000000001}]},{"osd":2,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2649999999999999,"15min":1.2629999999999999},"min":{"1min":0.86799999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.6479999999999999,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.284,"5min":1.302,"15min":1.3049999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7490000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.92700000000000005}]},{"osd":3,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.292,"15min":1.28},"min":{"1min":1.077,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.6639999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.248},{"interface":"front","average":{"1min":1.411,"5min":1.4790000000000001,"15min":1.49},"min":{"1min":1.1579999999999999,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":1.7529999999999999,"5min":2.734,"15min":2.734},"last":1.554}]},{"osd":5,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.502,"15min":1.502},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":1.8759999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.069},{"interface":"front","average":{"1min":1.452,"5min":1.504,"15min":1.512},"min":{"1min":1.206,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":1.794,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3859999999999999}]},{"osd":6,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.5720000000000001,"15min":1.5860000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.879,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.653,"15min":1.6619999999999999},"min":{"1min":1.2889999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.917,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.1719999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.6559999999999999,"15min":1.6779999999999999},"min":{"1min":1.236,"5min":1.147,"15min":1.147},"max":{"1min":1.9490000000000001,"5min":4.008,"15min":4.008},"last":1.522},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.75,"15min":1.7709999999999999},"min":{"1min":1.109,"5min":1.109,"15min":1.109},"max":{"1min":1.9730000000000001,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.7010000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":671744,"data_stored":295166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90000000000000002,"15min":0.90500000000000003},"min":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.401,"5min":1.508,"15min":1.508},"last":0.746},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94599999999999995,"15min":0.94699999999999995},"min":{"1min":0.56999999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.2929999999999999,"5min":1.659,"15min":1.659},"last":0.71999999999999997}]},{"osd":1,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.98899999999999999,"15min":1.0009999999999999},"min":{"1min":0.52800000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3149999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.089,"5min":1.198,"15min":1.216},"min":{"1min":0.70399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6439999999999999,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.94399999999999995}]},{"osd":2,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.1419999999999999,"15min":1.1659999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.226,"5min":1.2130000000000001,"15min":1.2110000000000001},"min":{"1min":0.70499999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.7789999999999999,"5min":1.954,"15min":1.954},"last":1.0389999999999999}]},{"osd":4,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.296,"15min":1.3009999999999999},"min":{"1min":0.97799999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.915,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.306,"5min":1.4219999999999999,"15min":1.4419999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8149999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.3500000000000001}]},{"osd":5,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.4750000000000001,"15min":1.492},"min":{"1min":0.96399999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.968,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.389},{"interface":"front","average":{"1min":1.429,"5min":1.4239999999999999,"15min":1.423},"min":{"1min":0.875,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.794,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.51,"15min":1.536},"min":{"1min":0.93000000000000005,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.9430000000000001,"5min":2.863,"15min":2.863},"last":1.657},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.593,"15min":1.605},"min":{"1min":1.105,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.0659999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.635}]},{"osd":7,"last update":"Sun May 26 15:41:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.5149999999999999,"15min":1.5109999999999999},"min":{"1min":1.224,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.0640000000000001,"5min":2.306,"15min":2.306},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.575,"15min":1.591},"min":{"1min":1.0069999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.145,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.556}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":294125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.0129999999999999,"15min":1.026},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3260000000000001,"5min":1.47,"15min":1.47},"last":0.874},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.52300000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.6339999999999999,"5min":1.748,"15min":1.748},"last":1.232}]},{"osd":1,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.04,"15min":1.056},"min":{"1min":0.626,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.2170000000000001,"15min":1.1970000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":7.4770000000000003,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.98799999999999999}]},{"osd":3,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.04,"15min":1.0349999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":0.69199999999999995,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.1789999999999998,"5min":2.903,"15min":2.903},"last":0.91500000000000004}]},{"osd":4,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":1.5549999999999999,"15min":1.502},"min":{"1min":0.93500000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":10.438000000000001,"5min":10.438000000000001,"15min":10.438000000000001},"last":1.151},{"interface":"front","average":{"1min":1.363,"5min":1.4610000000000001,"15min":1.4770000000000001},"min":{"1min":1.046,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.6930000000000001,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.1870000000000001}]},{"osd":5,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.4870000000000001,"15min":1.5129999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.8220000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.7150000000000001,"15min":1.6699999999999999},"min":{"1min":1.105,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":10.798999999999999,"5min":10.798999999999999,"15min":10.798999999999999},"last":1.369}]},{"osd":6,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.6379999999999999,"15min":1.6040000000000001},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":7.851,"5min":7.851,"15min":7.851},"last":1.272},{"interface":"front","average":{"1min":1.962,"5min":1.6779999999999999,"15min":1.6299999999999999},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":10.672000000000001,"5min":10.672000000000001,"15min":10.672000000000001},"last":1.4399999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:28 2024","interfaces":[{"interface":"back","average":{"1min":2.0339999999999998,"5min":1.794,"15min":1.754},"min":{"1min":1.224,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":10.249000000000001,"5min":10.249000000000001,"15min":10.249000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.5980000000000001,"15min":1.607},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.121,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.3839999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31772,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":663552,"data_stored":293740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.0529999999999999,"15min":1.0840000000000001},"min":{"1min":0.59999999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.417,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.107,"15min":1.129},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.639,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.99399999999999999,"15min":1.0149999999999999},"min":{"1min":0.48299999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.623,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.073},{"interface":"front","average":{"1min":1.054,"5min":1.266,"15min":1.302},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5349999999999999,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.012}]},{"osd":3,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.337,"15min":1.371},"min":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.7809999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.171},{"interface":"front","average":{"1min":1.016,"5min":1.2350000000000001,"15min":1.2709999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.48,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.87}]},{"osd":4,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.369,"15min":1.3839999999999999},"min":{"1min":0.877,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7490000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.3879999999999999,"15min":1.4159999999999999},"min":{"1min":0.86099999999999999,"5min":0.75,"15min":0.75},"max":{"1min":1.8260000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.157}]},{"osd":5,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.468,"15min":1.508},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.7509999999999999,"5min":2.621,"15min":2.621},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.6080000000000001,"15min":1.643},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.8660000000000001,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.3420000000000001}]},{"osd":6,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.522,"15min":1.544},"min":{"1min":0.82799999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.704,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.631,"15min":1.6870000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.7130000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.401}]},{"osd":7,"last update":"Sun May 26 15:41:21 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.6910000000000001,"15min":1.73},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.877,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.6020000000000001,"15min":1.635},"min":{"1min":0.95499999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8220000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.115}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1253376,"data_stored":882985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.2470000000000001,"5min":1.454,"15min":1.454},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.91600000000000004,"5min":1,"15min":1.014},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.6499999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.80100000000000005}]},{"osd":2,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.0800000000000001,"15min":1.1080000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3759999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.878},{"interface":"front","average":{"1min":0.98499999999999999,"5min":1.0329999999999999,"15min":1.0409999999999999},"min":{"1min":0.54200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.419,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.0669999999999999}]},{"osd":3,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.282,"15min":1.3120000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2570000000000001,"5min":4.024,"15min":4.024},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.2450000000000001,"15min":1.2689999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.198,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":1.266}]},{"osd":4,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.452,"15min":1.49},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6759999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.1519999999999999,"15min":1.155},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.96499999999999997}]},{"osd":5,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.516,"15min":1.552},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.7030000000000001,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.456},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.514,"15min":1.54},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9119999999999999,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.484}]},{"osd":6,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.258,"15min":1.276},"min":{"1min":0.81100000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.6679999999999999,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.02},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.512,"15min":1.544},"min":{"1min":0.88600000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.0569999999999999,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.3779999999999999}]},{"osd":7,"last update":"Sun May 26 15:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.6160000000000001,"15min":1.6459999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.835,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.623},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3740000000000001,"15min":1.381},"min":{"1min":0.82699999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.1219999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.113}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:42:21.518 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-26T15:42:21.519 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-26T15:42:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.778+0000 7f02bbe00640 1 Processor -- start 2024-05-26T15:42:21.777 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.779+0000 7f02bbe00640 1 -- start start 2024-05-26T15:42:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.780+0000 7f02bbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f02bc15cb70 0x7f02bc161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.780+0000 7f02bbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cd1c0 0x7f02bc0cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.780+0000 7f02bbe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc161690 con 0x7f02bc0cf830 2024-05-26T15:42:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.780+0000 7f02bbe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc0cfca0 con 0x7f02bc15cb70 2024-05-26T15:42:21.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.780+0000 7f02bbe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0ce270 con 0x7f02bc0cd1c0 2024-05-26T15:42:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.781+0000 7f02ba000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cd1c0 0x7f02bc0cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.781+0000 7f02bb400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f02bc0cf830 0x7f02bc0b43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:53134/0 (socket says 172.21.15.8:53134) 2024-05-26T15:42:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.781+0000 7f02bb400640 1 -- 172.21.15.8:0/3282954748 learned_addr learned my addr 172.21.15.8:0/3282954748 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.781+0000 7f02ba000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cd1c0 0x7f02bc0cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:56054/0 (socket says 172.21.15.8:56054) 2024-05-26T15:42:21.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.781+0000 7f02baa00640 1 --2- 172.21.15.8:0/3282954748 >> v2:172.21.15.47:3300/0 conn(0x7f02bc15cb70 0x7f02bc161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.782+0000 7f02baa00640 1 -- 172.21.15.8:0/3282954748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cd1c0 msgr2=0x7f02bc0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.782+0000 7f02baa00640 1 --2- 172.21.15.8:0/3282954748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cd1c0 0x7f02bc0cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.782+0000 7f02baa00640 1 -- 172.21.15.8:0/3282954748 >> v1:172.21.15.47:6789/0 conn(0x7f02bc0cf830 legacy=0x7f02bc0b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:21.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.782+0000 7f02baa00640 1 -- 172.21.15.8:0/3282954748 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0b1fa0 con 0x7f02bc15cb70 2024-05-26T15:42:21.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.784+0000 7f02baa00640 1 --2- 172.21.15.8:0/3282954748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02bc15cb70 0x7f02bc161150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0097a0 tx=0x7f02ac02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e5aac988c8a4b25 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.784+0000 7f02b9600640 1 -- 172.21.15.8:0/3282954748 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac032440 con 0x7f02bc15cb70 2024-05-26T15:42:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.785+0000 7f02b9600640 1 -- 172.21.15.8:0/3282954748 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac0325a0 con 0x7f02bc15cb70 2024-05-26T15:42:21.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.785+0000 7f02b9600640 1 -- 172.21.15.8:0/3282954748 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac032930 con 0x7f02bc15cb70 2024-05-26T15:42:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.785+0000 7f02bbe00640 1 -- 172.21.15.8:0/3282954748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02bc15cb70 msgr2=0x7f02bc161150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.785+0000 7f02bbe00640 1 --2- 172.21.15.8:0/3282954748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02bc15cb70 0x7f02bc161150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0097a0 tx=0x7f02ac02a180 comp rx=0 tx=0).stop 2024-05-26T15:42:21.784 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.785+0000 7f02bbe00640 1 -- 172.21.15.8:0/3282954748 shutdown_connections 2024-05-26T15:42:21.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.785+0000 7f02bbe00640 1 --2- 172.21.15.8:0/3282954748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cd1c0 0x7f02bc0cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.785+0000 7f02bbe00640 1 --2- 172.21.15.8:0/3282954748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02bc15cb70 0x7f02bc161150 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.785+0000 7f02bbe00640 1 -- 172.21.15.8:0/3282954748 >> 172.21.15.8:0/3282954748 conn(0x7f02bc06b1a0 msgr2=0x7f02bc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:21.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.786+0000 7f02bbe00640 1 -- 172.21.15.8:0/3282954748 shutdown_connections 2024-05-26T15:42:21.785 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.786+0000 7f02bbe00640 1 -- 172.21.15.8:0/3282954748 wait complete. 2024-05-26T15:42:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.788+0000 7f02bbe00640 1 Processor -- start 2024-05-26T15:42:21.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.788+0000 7f02bbe00640 1 -- start start 2024-05-26T15:42:21.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.789+0000 7f02bbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02bc0cd1c0 0x7f02bc14acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.789+0000 7f02bbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cf830 0x7f02bc0a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.789+0000 7f02bbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc15cb70 0x7f02bc0aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.789+0000 7f02bbe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0c9250 con 0x7f02bc15cb70 2024-05-26T15:42:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.789+0000 7f02bbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0a98c0 con 0x7f02bc0cd1c0 2024-05-26T15:42:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.789+0000 7f02bbe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0a9ba0 con 0x7f02bc0cf830 2024-05-26T15:42:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.789+0000 7f02bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc15cb70 0x7f02bc0aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.789+0000 7f02bb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc15cb70 0x7f02bc0aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51292/0 (socket says 172.21.15.8:51292) 2024-05-26T15:42:21.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.789+0000 7f02bb400640 1 -- 172.21.15.8:0/149060143 learned_addr learned my addr 172.21.15.8:0/149060143 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:21.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.790+0000 7f02ba000640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cf830 0x7f02bc0a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.790+0000 7f02baa00640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02bc0cd1c0 0x7f02bc14acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.790+0000 7f02bb400640 1 -- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cf830 msgr2=0x7f02bc0a9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:21.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.790+0000 7f02bb400640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cf830 0x7f02bc0a9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.790+0000 7f02bb400640 1 -- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02bc0cd1c0 msgr2=0x7f02bc14acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:21.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.790+0000 7f02bb400640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02bc0cd1c0 0x7f02bc14acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:21.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.790+0000 7f02bb400640 1 -- 172.21.15.8:0/149060143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac009400 con 0x7f02bc15cb70 2024-05-26T15:42:21.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.790+0000 7f02bb400640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc15cb70 0x7f02bc0aa960 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f02b400c3c0 tx=0x7f02b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:21.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.791+0000 7f02b2a00640 1 -- 172.21.15.8:0/149060143 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4005ce0 con 0x7f02bc15cb70 2024-05-26T15:42:21.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.791+0000 7f02b2a00640 1 -- 172.21.15.8:0/149060143 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b4005e40 con 0x7f02bc15cb70 2024-05-26T15:42:21.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.791+0000 7f02bbe00640 1 -- 172.21.15.8:0/149060143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc0a9e80 con 0x7f02bc15cb70 2024-05-26T15:42:21.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.791+0000 7f02b2a00640 1 -- 172.21.15.8:0/149060143 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b40072f0 con 0x7f02bc15cb70 2024-05-26T15:42:21.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.791+0000 7f02bbe00640 1 -- 172.21.15.8:0/149060143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc0aa440 con 0x7f02bc15cb70 2024-05-26T15:42:21.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.792+0000 7f02bbe00640 1 -- 172.21.15.8:0/149060143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc0aa630 con 0x7f02bc15cb70 2024-05-26T15:42:21.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.793+0000 7f02b2a00640 1 -- 172.21.15.8:0/149060143 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f02b4007450 con 0x7f02bc15cb70 2024-05-26T15:42:21.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.794+0000 7f02b2a00640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f029806ac00 0x7f029806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:21.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.794+0000 7f02b2a00640 1 -- 172.21.15.8:0/149060143 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f02b40887f0 con 0x7f02bc15cb70 2024-05-26T15:42:21.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.795+0000 7f02baa00640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f029806ac00 0x7f029806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:21.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.796+0000 7f02baa00640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f029806ac00 0x7f029806d0c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f02ac034000 tx=0x7f02ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:21.797 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:21.799+0000 7f02b2a00640 1 -- 172.21.15.8:0/149060143 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f02b40537f0 con 0x7f02bc15cb70 2024-05-26T15:42:22.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.069+0000 7f02bbe00640 1 -- 172.21.15.8:0/149060143 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f02bc161690 con 0x7f02bc15cb70 2024-05-26T15:42:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.076+0000 7f02b2a00640 1 -- 172.21.15.8:0/149060143 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f02bc161690 con 0x7f02bc15cb70 2024-05-26T15:42:22.075 INFO:teuthology.orchestra.run.smithi008.stderr:updated caps for client.0 2024-05-26T15:42:22.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.079+0000 7f02bbe00640 1 -- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f029806ac00 msgr2=0x7f029806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:22.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.079+0000 7f02bbe00640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f029806ac00 0x7f029806d0c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f02ac034000 tx=0x7f02ac02e000 comp rx=0 tx=0).stop 2024-05-26T15:42:22.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.079+0000 7f02bbe00640 1 -- 172.21.15.8:0/149060143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc15cb70 msgr2=0x7f02bc0aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:22.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.079+0000 7f02bbe00640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc15cb70 0x7f02bc0aa960 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f02b400c3c0 tx=0x7f02b400c880 comp rx=0 tx=0).stop 2024-05-26T15:42:22.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.079+0000 7f02bbe00640 1 -- 172.21.15.8:0/149060143 shutdown_connections 2024-05-26T15:42:22.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.079+0000 7f02bbe00640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f02bc15cb70 0x7f02bc0aa960 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.079+0000 7f02bbe00640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02bc0cf830 0x7f02bc0a9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.079+0000 7f02bbe00640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f029806ac00 0x7f029806d0c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.079+0000 7f02bbe00640 1 --2- 172.21.15.8:0/149060143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f02bc0cd1c0 0x7f02bc14acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.079+0000 7f02bbe00640 1 -- 172.21.15.8:0/149060143 >> 172.21.15.8:0/149060143 conn(0x7f02bc06b1a0 msgr2=0x7f02bc160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:22.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.080+0000 7f02bbe00640 1 -- 172.21.15.8:0/149060143 shutdown_connections 2024-05-26T15:42:22.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.080+0000 7f02bbe00640 1 -- 172.21.15.8:0/149060143 wait complete. 2024-05-26T15:42:22.095 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:22.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.293+0000 7f06d3000640 1 Processor -- start 2024-05-26T15:42:22.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.293+0000 7f06d3000640 1 -- start start 2024-05-26T15:42:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.295+0000 7f06d3000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0cdde0 0x7f06cc167710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.295+0000 7f06d3000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06cc0d11e0 con 0x7f06cc0b8470 2024-05-26T15:42:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.295+0000 7f06d3000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06cc0d1440 con 0x7f06cc15cb60 2024-05-26T15:42:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.295+0000 7f06d3000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc0d1720 con 0x7f06cc0cdde0 2024-05-26T15:42:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.295+0000 7f06d1200640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f06cc0b8470 0x7f06cc0cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59536/0 (socket says 172.21.15.8:59536) 2024-05-26T15:42:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.295+0000 7f06d1200640 1 -- 172.21.15.8:0/1935150141 learned_addr learned my addr 172.21.15.8:0/1935150141 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.295+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923630799 0 0) 0x7f06cc0d11e0 con 0x7f06cc0b8470 2024-05-26T15:42:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.295+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06b4003520 con 0x7f06cc0b8470 2024-05-26T15:42:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.295+0000 7f06d2600640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0cdde0 0x7f06cc167710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4268035566 0 0) 0x7f06b4003520 con 0x7f06cc0b8470 2024-05-26T15:42:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0cdde0 msgr2=0x7f06cc167710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0cdde0 0x7f06cc167710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 >> v1:172.21.15.47:6789/0 conn(0x7f06cc15cb60 legacy=0x7f06cc0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc0d1a00 con 0x7f06cc0b8470 2024-05-26T15:42:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f06b8001690 con 0x7f06cc0b8470 2024-05-26T15:42:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 >> v1:172.21.15.8:6789/0 conn(0x7f06cc0b8470 legacy=0x7f06cc0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b40039a0 0x7f06b4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0cdde0 0x7f06b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06b4004d00 0x7f06b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc0d1720 con 0x7f06b40039a0 2024-05-26T15:42:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b400bb10 con 0x7f06b4004d00 2024-05-26T15:42:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b400bcd0 con 0x7f06cc0cdde0 2024-05-26T15:42:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.296+0000 7f06d1c00640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b40039a0 0x7f06b4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.297+0000 7f06d1200640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0cdde0 0x7f06b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:22.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.297+0000 7f06d1c00640 1 -- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0cdde0 msgr2=0x7f06b40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:22.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.297+0000 7f06d1c00640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0cdde0 0x7f06b40047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.297+0000 7f06d1c00640 1 -- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06b4004d00 msgr2=0x7f06b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:22.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.297+0000 7f06d2600640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06b4004d00 0x7f06b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:22.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.297+0000 7f06d1c00640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06b4004d00 0x7f06b4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.297+0000 7f06d1c00640 1 -- 172.21.15.8:0/1935150141 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b4003520 con 0x7f06b40039a0 2024-05-26T15:42:22.298 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.297+0000 7f06d2600640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06b4004d00 0x7f06b4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:22.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.298+0000 7f06d1c00640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b40039a0 0x7f06b4003dc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f06c0001750 tx=0x7f06b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c6e12a86b89c68 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:22.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.298+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00052d0 con 0x7f06b40039a0 2024-05-26T15:42:22.302 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.298+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c0005430 con 0x7f06b40039a0 2024-05-26T15:42:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.298+0000 7f06cbe00640 1 -- 172.21.15.8:0/1935150141 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c002abe0 con 0x7f06b40039a0 2024-05-26T15:42:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.299+0000 7f06d3000640 1 -- 172.21.15.8:0/1935150141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b40039a0 msgr2=0x7f06b4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.299+0000 7f06d3000640 1 --2- 172.21.15.8:0/1935150141 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06b40039a0 0x7f06b4003dc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f06c0001750 tx=0x7f06b40057f0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.299+0000 7f06d2600640 1 -- 172.21.15.8:0/1935150141 reap_dead start 2024-05-26T15:42:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.299+0000 7f06d3000640 1 -- 172.21.15.8:0/1935150141 shutdown_connections 2024-05-26T15:42:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.299+0000 7f06d3000640 1 -- 172.21.15.8:0/1935150141 >> 172.21.15.8:0/1935150141 conn(0x7f06cc0cf480 msgr2=0x7f06cc0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:22.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.299+0000 7f06d3000640 1 -- 172.21.15.8:0/1935150141 shutdown_connections 2024-05-26T15:42:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.299+0000 7f06d3000640 1 -- 172.21.15.8:0/1935150141 wait complete. 2024-05-26T15:42:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.301+0000 7f06d3000640 1 Processor -- start 2024-05-26T15:42:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.301+0000 7f06d3000640 1 -- start start 2024-05-26T15:42:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d3000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06b40039a0 0x7f06cc151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d3000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0c7cc0 0x7f06cc15e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d3000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06cc15e920 0x7f06cc0b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d3000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc0c81c0 con 0x7f06cc15e920 2024-05-26T15:42:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d3000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc0c84a0 con 0x7f06b40039a0 2024-05-26T15:42:22.304 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d3000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc0c8780 con 0x7f06cc0c7cc0 2024-05-26T15:42:22.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d2600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06cc15e920 0x7f06cc0b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:22.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d2600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06cc15e920 0x7f06cc0b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51312/0 (socket says 172.21.15.8:51312) 2024-05-26T15:42:22.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d2600640 1 -- 172.21.15.8:0/81682 learned_addr learned my addr 172.21.15.8:0/81682 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:22.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d1c00640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06b40039a0 0x7f06cc151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:22.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d1200640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0c7cc0 0x7f06cc15e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:22.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d2600640 1 -- 172.21.15.8:0/81682 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0c7cc0 msgr2=0x7f06cc15e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:22.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.302+0000 7f06d2600640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0c7cc0 0x7f06cc15e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.303+0000 7f06d2600640 1 -- 172.21.15.8:0/81682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06b40039a0 msgr2=0x7f06cc151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.303+0000 7f06d2600640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06b40039a0 0x7f06cc151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.303+0000 7f06d2600640 1 -- 172.21.15.8:0/81682 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc0c8a60 con 0x7f06cc15e920 2024-05-26T15:42:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.303+0000 7f06d2600640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06cc15e920 0x7f06cc0b5f50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0d04b0 tx=0x7f06c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.303+0000 7f06c9600640 1 -- 172.21.15.8:0/81682 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4007cf0 con 0x7f06cc15e920 2024-05-26T15:42:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.303+0000 7f06c9600640 1 -- 172.21.15.8:0/81682 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c4007e70 con 0x7f06cc15e920 2024-05-26T15:42:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.303+0000 7f06c9600640 1 -- 172.21.15.8:0/81682 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4014620 con 0x7f06cc15e920 2024-05-26T15:42:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.303+0000 7f06d3000640 1 -- 172.21.15.8:0/81682 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc0c8d40 con 0x7f06cc15e920 2024-05-26T15:42:22.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.303+0000 7f06d3000640 1 -- 172.21.15.8:0/81682 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc0c9260 con 0x7f06cc15e920 2024-05-26T15:42:22.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.305+0000 7f06d3000640 1 -- 172.21.15.8:0/81682 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06cc0c8f30 con 0x7f06cc15e920 2024-05-26T15:42:22.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.306+0000 7f06c9600640 1 -- 172.21.15.8:0/81682 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f06c401d3b0 con 0x7f06cc15e920 2024-05-26T15:42:22.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.307+0000 7f06c9600640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06ac06ac00 0x7f06ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:22.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.307+0000 7f06c9600640 1 -- 172.21.15.8:0/81682 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f06c4089280 con 0x7f06cc15e920 2024-05-26T15:42:22.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.308+0000 7f06d1c00640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06ac06ac00 0x7f06ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:22.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.309+0000 7f06d1c00640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06ac06ac00 0x7f06ac06d0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f06c0001750 tx=0x7f06c002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:22.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.312+0000 7f06c9600640 1 -- 172.21.15.8:0/81682 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f06c4054280 con 0x7f06cc15e920 2024-05-26T15:42:22.553 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.555+0000 7f06d3000640 1 -- 172.21.15.8:0/81682 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06cc04e280 con 0x7f06cc15e920 2024-05-26T15:42:22.554 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.556+0000 7f06c9600640 1 -- 172.21.15.8:0/81682 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4728 (secure 0 0 0) 0x7f06c40578a0 con 0x7f06cc15e920 2024-05-26T15:42:22.554 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:22.555 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":32,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4973,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/3587572492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6835","nonce":3587572492},{"type":"v1","addr":"172.21.15.47:6837","nonce":3587572492}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5775,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6833/1256296404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1256296404},{"type":"v1","addr":"172.21.15.8:6833","nonce":1256296404}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5781,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2317627606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2317627606},{"type":"v1","addr":"172.21.15.8:6835","nonce":2317627606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:14.468139+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5787},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5787":{"gid":5787,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6836/3388176100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3388176100},{"type":"v1","addr":"172.21.15.47:6836","nonce":3388176100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:22.555 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 32 2024-05-26T15:42:22.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.558+0000 7f06d3000640 1 -- 172.21.15.8:0/81682 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06ac06ac00 msgr2=0x7f06ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:22.557 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.558+0000 7f06d3000640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06ac06ac00 0x7f06ac06d0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f06c0001750 tx=0x7f06c002e000 comp rx=0 tx=0).stop 2024-05-26T15:42:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.558+0000 7f06d3000640 1 -- 172.21.15.8:0/81682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06cc15e920 msgr2=0x7f06cc0b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.558+0000 7f06d3000640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06cc15e920 0x7f06cc0b5f50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0d04b0 tx=0x7f06c4009da0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.559+0000 7f06d3000640 1 -- 172.21.15.8:0/81682 shutdown_connections 2024-05-26T15:42:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.559+0000 7f06d3000640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f06cc15e920 0x7f06cc0b5f50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.559+0000 7f06d3000640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f06cc0c7cc0 0x7f06cc15e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.559+0000 7f06d3000640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f06ac06ac00 0x7f06ac06d0c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.559+0000 7f06d3000640 1 --2- 172.21.15.8:0/81682 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06b40039a0 0x7f06cc151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.559+0000 7f06d3000640 1 -- 172.21.15.8:0/81682 >> 172.21.15.8:0/81682 conn(0x7f06cc0cf480 msgr2=0x7f06cc159820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.559+0000 7f06d3000640 1 -- 172.21.15.8:0/81682 shutdown_connections 2024-05-26T15:42:22.558 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:22.559+0000 7f06d3000640 1 -- 172.21.15.8:0/81682 wait complete. 2024-05-26T15:42:22.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-26T15:42:11.450547+0000', 'modified': '2024-05-26T15:42:14.468139+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5787}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5787': {'gid': 5787, 'name': 'b', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.47:6836/3388176100', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6834', 'nonce': 3388176100}, {'type': 'v1', 'addr': '172.21.15.47:6836', 'nonce': 3388176100}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-26T15:42:22.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-26T15:42:22.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-26T15:42:23.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.203+0000 7f6e39600640 1 Processor -- start 2024-05-26T15:42:23.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.204+0000 7f6e39600640 1 -- start start 2024-05-26T15:42:23.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.205+0000 7f6e39600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e3415cb30 0x7f6e340b8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.205+0000 7f6e39600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6e340d0050 0x7f6e340b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.205+0000 7f6e39600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e340d14a0 con 0x7f6e340d0d30 2024-05-26T15:42:23.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.205+0000 7f6e39600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e340d2120 con 0x7f6e3415cb30 2024-05-26T15:42:23.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.205+0000 7f6e39600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e340d1780 con 0x7f6e340d0050 2024-05-26T15:42:23.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.206+0000 7f6e33e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e3415cb30 0x7f6e340b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.206+0000 7f6e33e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6e3415cb30 0x7f6e340b8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51326/0 (socket says 172.21.15.8:51326) 2024-05-26T15:42:23.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.206+0000 7f6e33e00640 1 -- 172.21.15.8:0/2023537118 learned_addr learned my addr 172.21.15.8:0/2023537118 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:23.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.206+0000 7f6e33e00640 1 -- 172.21.15.8:0/2023537118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6e340d0050 msgr2=0x7f6e340b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.206+0000 7f6e33e00640 1 --2- 172.21.15.8:0/2023537118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6e340d0050 0x7f6e340b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.206+0000 7f6e33e00640 1 -- 172.21.15.8:0/2023537118 >> v1:172.21.15.47:6789/0 conn(0x7f6e340d0d30 legacy=0x7f6e340cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.206+0000 7f6e33e00640 1 -- 172.21.15.8:0/2023537118 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340d1a60 con 0x7f6e3415cb30 2024-05-26T15:42:23.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.207+0000 7f6e33e00640 1 --2- 172.21.15.8:0/2023537118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e3415cb30 0x7f6e340b8560 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009870 tx=0x7f6e2402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ebe22d52f02a16 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:23.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e32a00640 1 -- 172.21.15.8:0/2023537118 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2402ae90 con 0x7f6e3415cb30 2024-05-26T15:42:23.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e32a00640 1 -- 172.21.15.8:0/2023537118 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e24032440 con 0x7f6e3415cb30 2024-05-26T15:42:23.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e32a00640 1 -- 172.21.15.8:0/2023537118 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240327d0 con 0x7f6e3415cb30 2024-05-26T15:42:23.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e39600640 1 -- 172.21.15.8:0/2023537118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e3415cb30 msgr2=0x7f6e340b8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e39600640 1 --2- 172.21.15.8:0/2023537118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e3415cb30 0x7f6e340b8560 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009870 tx=0x7f6e2402a180 comp rx=0 tx=0).stop 2024-05-26T15:42:23.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e39600640 1 -- 172.21.15.8:0/2023537118 shutdown_connections 2024-05-26T15:42:23.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e39600640 1 --2- 172.21.15.8:0/2023537118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6e340d0050 0x7f6e340b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e39600640 1 --2- 172.21.15.8:0/2023537118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e3415cb30 0x7f6e340b8560 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e39600640 1 -- 172.21.15.8:0/2023537118 >> 172.21.15.8:0/2023537118 conn(0x7f6e3406b720 msgr2=0x7f6e3406bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:23.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e39600640 1 -- 172.21.15.8:0/2023537118 shutdown_connections 2024-05-26T15:42:23.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.208+0000 7f6e39600640 1 -- 172.21.15.8:0/2023537118 wait complete. 2024-05-26T15:42:23.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.210+0000 7f6e39600640 1 Processor -- start 2024-05-26T15:42:23.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.210+0000 7f6e39600640 1 -- start start 2024-05-26T15:42:23.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.211+0000 7f6e39600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e340d0050 0x7f6e340c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.211+0000 7f6e39600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e340d0d30 0x7f6e34149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.211+0000 7f6e39600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6e3415cb30 0x7f6e3415ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.211+0000 7f6e39600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e341f6c40 con 0x7f6e340d0d30 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.211+0000 7f6e39600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e341f2a50 con 0x7f6e340d0050 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.211+0000 7f6e39600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e341f5fc0 con 0x7f6e3415cb30 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e33400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e340d0d30 0x7f6e34149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e33400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e340d0d30 0x7f6e34149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51338/0 (socket says 172.21.15.8:51338) 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e33400640 1 -- 172.21.15.8:0/3240098261 learned_addr learned my addr 172.21.15.8:0/3240098261 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e33e00640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e340d0050 0x7f6e340c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e38c00640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6e3415cb30 0x7f6e3415ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e33400640 1 -- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6e3415cb30 msgr2=0x7f6e3415ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e33400640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6e3415cb30 0x7f6e3415ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e33400640 1 -- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e340d0050 msgr2=0x7f6e340c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e33400640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e340d0050 0x7f6e340c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e33400640 1 -- 172.21.15.8:0/3240098261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e240094d0 con 0x7f6e340d0d30 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.212+0000 7f6e38c00640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6e3415cb30 0x7f6e3415ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.213+0000 7f6e33400640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e340d0d30 0x7f6e34149d50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00c460 tx=0x7f6e1c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:23.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.213+0000 7f6e2be00640 1 -- 172.21.15.8:0/3240098261 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c012830 con 0x7f6e340d0d30 2024-05-26T15:42:23.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.213+0000 7f6e2be00640 1 -- 172.21.15.8:0/3240098261 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0129d0 con 0x7f6e340d0d30 2024-05-26T15:42:23.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.213+0000 7f6e2be00640 1 -- 172.21.15.8:0/3240098261 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c012d80 con 0x7f6e340d0d30 2024-05-26T15:42:23.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.213+0000 7f6e39600640 1 -- 172.21.15.8:0/3240098261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e340d26c0 con 0x7f6e340d0d30 2024-05-26T15:42:23.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.213+0000 7f6e39600640 1 -- 172.21.15.8:0/3240098261 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e341f6580 con 0x7f6e340d0d30 2024-05-26T15:42:23.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.215+0000 7f6e2be00640 1 -- 172.21.15.8:0/3240098261 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e1c01a3b0 con 0x7f6e340d0d30 2024-05-26T15:42:23.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.216+0000 7f6e2be00640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6e1006ac00 0x7f6e1006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.216+0000 7f6e2be00640 1 -- 172.21.15.8:0/3240098261 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e1c0890c0 con 0x7f6e340d0d30 2024-05-26T15:42:23.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.217+0000 7f6e33e00640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6e1006ac00 0x7f6e1006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.217+0000 7f6e3d9ee740 1 Processor -- start 2024-05-26T15:42:23.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.218+0000 7f6e3d9ee740 1 -- start start 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.218+0000 7f6e33e00640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6e1006ac00 0x7f6e1006d0c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6e24034000 tx=0x7f6e2402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.218+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501fad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.218+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b910 0x5558501d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.218+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5558501d1ae0 0x5558501d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.218+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55585013ca70 con 0x55585021b910 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.218+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x55585013a200 con 0x55585021b300 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.218+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x555850135af0 con 0x5558501d1ae0 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.219+0000 7f6e33400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b910 0x5558501d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.219+0000 7f6e33400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b910 0x5558501d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51346/0 (socket says 172.21.15.8:51346) 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.219+0000 7f6e33400640 1 -- 172.21.15.8:0/3152873136 learned_addr learned my addr 172.21.15.8:0/3152873136 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.219+0000 7f6e33e00640 1 --2- 172.21.15.8:0/3152873136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501fad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.219+0000 7f6e33400640 1 -- 172.21.15.8:0/3152873136 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5558501d1ae0 msgr2=0x5558501d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.219+0000 7f6e33400640 1 --2- 172.21.15.8:0/3152873136 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5558501d1ae0 0x5558501d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.219+0000 7f6e33400640 1 -- 172.21.15.8:0/3152873136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 msgr2=0x5558501fad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.219+0000 7f6e33400640 1 --2- 172.21.15.8:0/3152873136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501fad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.219+0000 7f6e33400640 1 -- 172.21.15.8:0/3152873136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555850100b90 con 0x55585021b910 2024-05-26T15:42:23.219 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.220+0000 7f6e33400640 1 --2- 172.21.15.8:0/3152873136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b910 0x5558501d15a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0543b0 tx=0x7f6e1c0585b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4447923ddc870ae9 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:23.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.220+0000 7f6e28c00640 1 -- 172.21.15.8:0/3152873136 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c05bce0 con 0x55585021b910 2024-05-26T15:42:23.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.220+0000 7f6e28c00640 1 -- 172.21.15.8:0/3152873136 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0602a0 con 0x55585021b910 2024-05-26T15:42:23.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.220+0000 7f6e28c00640 1 -- 172.21.15.8:0/3152873136 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0545c0 con 0x55585021b910 2024-05-26T15:42:23.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.220+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/3152873136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b910 msgr2=0x5558501d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.220+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/3152873136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b910 0x5558501d15a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c0543b0 tx=0x7f6e1c0585b0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.221+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/3152873136 shutdown_connections 2024-05-26T15:42:23.220 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.221+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/3152873136 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5558501d1ae0 0x5558501d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.221+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/3152873136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b910 0x5558501d15a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.221+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/3152873136 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501fad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.221+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/3152873136 >> 172.21.15.8:0/3152873136 conn(0x5558501d0000 msgr2=0x5558502188a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:23.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.221+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/3152873136 shutdown_connections 2024-05-26T15:42:23.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.221+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/3152873136 wait complete. 2024-05-26T15:42:23.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.221+0000 7f6e3d9ee740 1 -- start start 2024-05-26T15:42:23.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.222+0000 7f6e3d9ee740 1 Processor -- start 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501e7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 0x555850200c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501f1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558500d7220 con 0x5558501f13d0 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558500d6ec0 con 0x55585021b300 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55584fe9cf20 con 0x55585021b910 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e3d9ee740 10 client.0 _ll_register_callbacks cb 0x55585012f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e38c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e38c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501f1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51360/0 (socket says 172.21.15.8:51360) 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e38c00640 1 -- 172.21.15.8:0/2553079547 learned_addr learned my addr 172.21.15.8:0/2553079547 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.223+0000 7f6e33e00640 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501e7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.223 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e38c00640 1 -- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 msgr2=0x555850200c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e38c00640 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 0x555850200c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e38c00640 1 -- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 msgr2=0x5558501e7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e38c00640 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501e7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e38c00640 1 -- 172.21.15.8:0/2553079547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e341f6580 con 0x5558501f13d0 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e33e00640 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e38c00640 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501f1850 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c9c0 tx=0x7f6e2c00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464e82177f44f002 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e21600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e21600640 1 -- 172.21.15.8:0/2553079547 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c00abd0 con 0x5558501f13d0 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e21600640 1 -- 172.21.15.8:0/2553079547 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e2c00ad30 con 0x5558501f13d0 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/2553079547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55585015fc90 con 0x5558501f13d0 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e21600640 1 -- 172.21.15.8:0/2553079547 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e2c00f440 con 0x5558501f13d0 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.224+0000 7f6e3d9ee740 10 client.5931 fetch_fsmap learned FSMap version 32 2024-05-26T15:42:23.224 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.225+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/2553079547 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x555850134170 con 0x5558501f13d0 2024-05-26T15:42:23.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.225+0000 7f6e21600640 1 -- 172.21.15.8:0/2553079547 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55585015fc90 con 0x5558501f13d0 2024-05-26T15:42:23.225 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.225+0000 7f6e21600640 1 -- 172.21.15.8:0/2553079547 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f6e2c016020 con 0x5558501f13d0 2024-05-26T15:42:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.225+0000 7f6e3d9ee740 10 client.5931 fetch_fsmap finished waiting for FSMap version 32 2024-05-26T15:42:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.225+0000 7f6e3d9ee740 10 client.5931 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-26T15:42:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.225+0000 7f6e3d9ee740 20 client.5931 populate_metadata read hostname 'smithi008' 2024-05-26T15:42:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.225+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:6834/3388176100,v1:172.21.15.47:6836/3388176100] conn(0x5558501efc50 0x5558501f0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.225+0000 7f6e3d9ee740 4 client.5931 mds_command: new command op to 5787 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-26T15:42:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.225+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/2553079547 --> [v2:172.21.15.47:6834/3388176100,v1:172.21.15.47:6836/3388176100] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55584fe293c0 con 0x5558501efc50 2024-05-26T15:42:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.226+0000 7f6e33e00640 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:6834/3388176100,v1:172.21.15.47:6836/3388176100] conn(0x5558501efc50 0x5558501f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.227+0000 7f6e33e00640 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:6834/3388176100,v1:172.21.15.47:6836/3388176100] conn(0x5558501efc50 0x5558501f0030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c6bf94137c76d2 server_cookie=27b8952b6fb10d1e in_seq=0 out_seq=0 2024-05-26T15:42:23.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.227+0000 7f6e21600640 10 client.5931 ms_handle_connect on v2:172.21.15.47:6834/3388176100 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e21600640 1 -- 172.21.15.8:0/2553079547 <== mds.0 v2:172.21.15.47:6834/3388176100 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55584fe293c0 con 0x5558501efc50 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e21600640 10 client.5931 handle_command_reply: tid=0 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e3d9ee740 1 client.5931 shutdown 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/2553079547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 msgr2=0x5558501f1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501f1850 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c9c0 tx=0x7f6e2c00ce80 comp rx=0 tx=0).stop 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/2553079547 shutdown_connections 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501f1850 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 0x555850200c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:6834/3388176100,v1:172.21.15.47:6836/3388176100] conn(0x5558501efc50 0x5558501f0030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/2553079547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.228 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/2553079547 >> 172.21.15.8:0/2553079547 conn(0x5558501d1ae0 msgr2=0x55585021be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:23.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.229+0000 7f6e21600640 0 client.5931 ms_handle_reset on v2:172.21.15.47:6834/3388176100 2024-05-26T15:42:23.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.230+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/2553079547 shutdown_connections 2024-05-26T15:42:23.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.230+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/2553079547 wait complete. 2024-05-26T15:42:23.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.230+0000 7f6e3d9ee740 20 client.5931 trim_cache size 0 max 16384 2024-05-26T15:42:23.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.247+0000 7f6e3d9ee740 1 Processor -- start 2024-05-26T15:42:23.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.247+0000 7f6e3d9ee740 1 -- start start 2024-05-26T15:42:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.248+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.248+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.248+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 0x5558501f0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.248+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558501d19a0 con 0x5558501f13d0 2024-05-26T15:42:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.248+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558501fa5c0 con 0x55585021b300 2024-05-26T15:42:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.248+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x55585012eab0 con 0x55585021b910 2024-05-26T15:42:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.248+0000 7f6e33e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.248+0000 7f6e33e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51368/0 (socket says 172.21.15.8:51368) 2024-05-26T15:42:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.248+0000 7f6e33e00640 1 -- 172.21.15.8:0/619039729 learned_addr learned my addr 172.21.15.8:0/619039729 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:23.247 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.248+0000 7f6e33e00640 1 -- 172.21.15.8:0/619039729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 msgr2=0x5558501f0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.249+0000 7f6e33e00640 1 --2- 172.21.15.8:0/619039729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 0x5558501f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.249+0000 7f6e33e00640 1 -- 172.21.15.8:0/619039729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 msgr2=0x5558501cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.249+0000 7f6e33e00640 1 --2- 172.21.15.8:0/619039729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.248 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.249+0000 7f6e33e00640 1 -- 172.21.15.8:0/619039729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555850200190 con 0x5558501f13d0 2024-05-26T15:42:23.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.249+0000 7f6e33e00640 1 --2- 172.21.15.8:0/619039729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501ccdb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009990 tx=0x7f6e24008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5319e0de438e37a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:23.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.249+0000 7f6e29600640 1 -- 172.21.15.8:0/619039729 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2404f590 con 0x5558501f13d0 2024-05-26T15:42:23.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.249+0000 7f6e29600640 1 -- 172.21.15.8:0/619039729 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2404f6f0 con 0x5558501f13d0 2024-05-26T15:42:23.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.249+0000 7f6e29600640 1 -- 172.21.15.8:0/619039729 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2403c440 con 0x5558501f13d0 2024-05-26T15:42:23.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.250+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/619039729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 msgr2=0x5558501ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.249 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.250+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/619039729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501ccdb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009990 tx=0x7f6e24008030 comp rx=0 tx=0).stop 2024-05-26T15:42:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.250+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/619039729 shutdown_connections 2024-05-26T15:42:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.250+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/619039729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 0x5558501f0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.250+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/619039729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55585021b300 0x5558501cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.250+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/619039729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5558501f13d0 0x5558501ccdb0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.250+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/619039729 >> 172.21.15.8:0/619039729 conn(0x5558501d1ae0 msgr2=0x5558501f17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.250+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/619039729 shutdown_connections 2024-05-26T15:42:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.250+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/619039729 wait complete. 2024-05-26T15:42:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.251+0000 7f6e3d9ee740 1 -- start start 2024-05-26T15:42:23.250 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.251+0000 7f6e3d9ee740 1 Processor -- start 2024-05-26T15:42:23.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.252+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558501f13d0 0x5558502174f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.252+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b300 0x5558501f0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.252+0000 7f6e3d9ee740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 0x5558501ed690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.252+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x555850217fe0 con 0x55585021b300 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.252+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558501eea80 con 0x5558501f13d0 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.252+0000 7f6e3d9ee740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558501eecc0 con 0x55585021b910 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.252+0000 7f6e3d9ee740 10 client.0 _ll_register_callbacks cb 0x7f6e2c0075b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.252+0000 7f6e33400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b300 0x5558501f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.252+0000 7f6e33400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b300 0x5558501f0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51384/0 (socket says 172.21.15.8:51384) 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.252+0000 7f6e33400640 1 -- 172.21.15.8:0/749341057 learned_addr learned my addr 172.21.15.8:0/749341057 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e33e00640 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558501f13d0 0x5558502174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e33400640 1 -- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 msgr2=0x5558501ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e33400640 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 0x5558501ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e33400640 1 -- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558501f13d0 msgr2=0x5558502174f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e33400640 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558501f13d0 0x5558502174f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e33400640 1 -- 172.21.15.8:0/749341057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e340d1a60 con 0x55585021b300 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e33400640 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b300 0x5558501f0510 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c054360 tx=0x7f6e1c003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e4a4a5f25a4e3c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e21600640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e21600640 1 -- 172.21.15.8:0/749341057 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c05bce0 con 0x55585021b300 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e21600640 1 -- 172.21.15.8:0/749341057 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e1c05fe10 con 0x55585021b300 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/749341057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e1c0602a0 con 0x55585021b300 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e21600640 1 -- 172.21.15.8:0/749341057 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e1c0811f0 con 0x55585021b300 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e3d9ee740 10 client.5937 fetch_fsmap learned FSMap version 32 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.253+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/749341057 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x555850169130 con 0x55585021b300 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.254+0000 7f6e21600640 1 -- 172.21.15.8:0/749341057 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0602a0 con 0x55585021b300 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.254+0000 7f6e21600640 1 -- 172.21.15.8:0/749341057 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f6e1c053ca0 con 0x55585021b300 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.254+0000 7f6e3d9ee740 10 client.5937 fetch_fsmap finished waiting for FSMap version 32 2024-05-26T15:42:23.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.254+0000 7f6e3d9ee740 10 client.5937 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-26T15:42:23.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.254+0000 7f6e3d9ee740 20 client.5937 populate_metadata read hostname 'smithi008' 2024-05-26T15:42:23.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.254+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:6834/3388176100,v1:172.21.15.47:6836/3388176100] conn(0x555850283110 0x5558501edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.254+0000 7f6e3d9ee740 4 client.5937 mds_command: new command op to 5787 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-26T15:42:23.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.254+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/749341057 --> [v2:172.21.15.47:6834/3388176100,v1:172.21.15.47:6836/3388176100] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55584fe3a6c0 con 0x555850283110 2024-05-26T15:42:23.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.254+0000 7f6e33e00640 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:6834/3388176100,v1:172.21.15.47:6836/3388176100] conn(0x555850283110 0x5558501edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.256+0000 7f6e33e00640 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:6834/3388176100,v1:172.21.15.47:6836/3388176100] conn(0x555850283110 0x5558501edbd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c34c9c26280fedcd server_cookie=130c8cf36dc1ae14 in_seq=0 out_seq=0 2024-05-26T15:42:23.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.256+0000 7f6e21600640 10 client.5937 ms_handle_connect on v2:172.21.15.47:6834/3388176100 2024-05-26T15:42:23.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.256+0000 7f6e21600640 1 -- 172.21.15.8:0/749341057 <== mds.0 v2:172.21.15.47:6834/3388176100 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55584fe3a6c0 con 0x555850283110 2024-05-26T15:42:23.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.256+0000 7f6e21600640 10 client.5937 handle_command_reply: tid=0 2024-05-26T15:42:23.256 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.256+0000 7f6e3d9ee740 1 client.5937 shutdown 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.256+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/749341057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b300 msgr2=0x5558501f0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.256+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b300 0x5558501f0510 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c054360 tx=0x7f6e1c003990 comp rx=0 tx=0).stop 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/749341057 shutdown_connections 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x55585021b910 0x5558501ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55585021b300 0x5558501f0510 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:6834/3388176100,v1:172.21.15.47:6836/3388176100] conn(0x555850283110 0x5558501edbd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e3d9ee740 1 --2- 172.21.15.8:0/749341057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5558501f13d0 0x5558502174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/749341057 >> 172.21.15.8:0/749341057 conn(0x5558501d1ae0 msgr2=0x55585023add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e21600640 0 client.5937 ms_handle_reset on v2:172.21.15.47:6834/3388176100 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/749341057 shutdown_connections 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e3d9ee740 1 -- 172.21.15.8:0/749341057 wait complete. 2024-05-26T15:42:23.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e3d9ee740 20 client.5937 trim_cache size 0 max 16384 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "03132396-4584-4cf0-b2e0-b5ae6040045e", 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5787, 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 11.800299881999999, 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 32, 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 55, 2024-05-26T15:42:23.258 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 55, 2024-05-26T15:42:23.259 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 17.662683771000001 2024-05-26T15:42:23.259 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:42:23.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e39600640 1 -- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6e1006ac00 msgr2=0x7f6e1006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e39600640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6e1006ac00 0x7f6e1006d0c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6e24034000 tx=0x7f6e2402e000 comp rx=0 tx=0).stop 2024-05-26T15:42:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e39600640 1 -- 172.21.15.8:0/3240098261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e340d0d30 msgr2=0x7f6e34149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.257+0000 7f6e39600640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e340d0d30 0x7f6e34149d50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00c460 tx=0x7f6e1c00c920 comp rx=0 tx=0).stop 2024-05-26T15:42:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.258+0000 7f6e39600640 1 -- 172.21.15.8:0/3240098261 shutdown_connections 2024-05-26T15:42:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.258+0000 7f6e39600640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6e3415cb30 0x7f6e3415ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.258+0000 7f6e39600640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6e340d0d30 0x7f6e34149d50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.258+0000 7f6e39600640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6e1006ac00 0x7f6e1006d0c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.258+0000 7f6e39600640 1 --2- 172.21.15.8:0/3240098261 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e340d0050 0x7f6e340c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.258+0000 7f6e39600640 1 -- 172.21.15.8:0/3240098261 >> 172.21.15.8:0/3240098261 conn(0x7f6e3406b720 msgr2=0x7f6e340c9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.258+0000 7f6e39600640 1 -- 172.21.15.8:0/3240098261 shutdown_connections 2024-05-26T15:42:23.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.258+0000 7f6e39600640 1 -- 172.21.15.8:0/3240098261 wait complete. 2024-05-26T15:42:23.274 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-26T15:42:23.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.472+0000 7fba7f200640 1 Processor -- start 2024-05-26T15:42:23.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.472+0000 7fba7f200640 1 -- start start 2024-05-26T15:42:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.474+0000 7fba7f200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba78154f50 0x7fba780b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.474+0000 7fba7f200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fba7815ae70 0x7fba7815eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.474+0000 7fba7f200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fba7815f0c0 0x7fba780c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.474+0000 7fba7f200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7815bee0 con 0x7fba7815ae70 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.474+0000 7fba7f200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba780b0ba0 con 0x7fba78154f50 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.474+0000 7fba7f200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7815b640 con 0x7fba7815f0c0 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.474+0000 7fba7d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fba7815ae70 0x7fba7815eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.474+0000 7fba7d400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fba7815ae70 0x7fba7815eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51390/0 (socket says 172.21.15.8:51390) 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.474+0000 7fba7d400640 1 -- 172.21.15.8:0/4007327044 learned_addr learned my addr 172.21.15.8:0/4007327044 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.475+0000 7fba7de00640 1 --2- 172.21.15.8:0/4007327044 >> v2:172.21.15.47:3300/0 conn(0x7fba78154f50 0x7fba780b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.475+0000 7fba7e800640 1 --2- 172.21.15.8:0/4007327044 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fba7815f0c0 0x7fba780c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.475+0000 7fba7d400640 1 -- 172.21.15.8:0/4007327044 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fba7815f0c0 msgr2=0x7fba780c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.475+0000 7fba7d400640 1 --2- 172.21.15.8:0/4007327044 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fba7815f0c0 0x7fba780c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.475+0000 7fba7d400640 1 -- 172.21.15.8:0/4007327044 >> v2:172.21.15.47:3300/0 conn(0x7fba78154f50 msgr2=0x7fba780b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.475+0000 7fba7d400640 1 --2- 172.21.15.8:0/4007327044 >> v2:172.21.15.47:3300/0 conn(0x7fba78154f50 0x7fba780b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.475+0000 7fba7d400640 1 -- 172.21.15.8:0/4007327044 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7815b920 con 0x7fba7815ae70 2024-05-26T15:42:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.475+0000 7fba7de00640 1 --2- 172.21.15.8:0/4007327044 >> v2:172.21.15.47:3300/0 conn(0x7fba78154f50 0x7fba780b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:42:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.476+0000 7fba7d400640 1 --2- 172.21.15.8:0/4007327044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba7815ae70 0x7fba7815eb80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fba780ce600 tx=0x7fba6802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91e97edca99d1f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.476+0000 7fba7ca00640 1 -- 172.21.15.8:0/4007327044 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6802ae90 con 0x7fba7815ae70 2024-05-26T15:42:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.477+0000 7fba7ca00640 1 -- 172.21.15.8:0/4007327044 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba68032440 con 0x7fba7815ae70 2024-05-26T15:42:23.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.477+0000 7fba7ca00640 1 -- 172.21.15.8:0/4007327044 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba680327d0 con 0x7fba7815ae70 2024-05-26T15:42:23.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.477+0000 7fba7f200640 1 -- 172.21.15.8:0/4007327044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba7815ae70 msgr2=0x7fba7815eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.477+0000 7fba7f200640 1 --2- 172.21.15.8:0/4007327044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba7815ae70 0x7fba7815eb80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fba780ce600 tx=0x7fba6802a140 comp rx=0 tx=0).stop 2024-05-26T15:42:23.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.477+0000 7fba7f200640 1 -- 172.21.15.8:0/4007327044 shutdown_connections 2024-05-26T15:42:23.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.477+0000 7fba7f200640 1 --2- 172.21.15.8:0/4007327044 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fba7815f0c0 0x7fba780c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.477+0000 7fba7f200640 1 --2- 172.21.15.8:0/4007327044 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba7815ae70 0x7fba7815eb80 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.477+0000 7fba7f200640 1 --2- 172.21.15.8:0/4007327044 >> v2:172.21.15.47:3300/0 conn(0x7fba78154f50 0x7fba780b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.477+0000 7fba7f200640 1 -- 172.21.15.8:0/4007327044 >> 172.21.15.8:0/4007327044 conn(0x7fba78070480 msgr2=0x7fba78070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.477+0000 7fba7f200640 1 -- 172.21.15.8:0/4007327044 shutdown_connections 2024-05-26T15:42:23.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.478+0000 7fba7f200640 1 -- 172.21.15.8:0/4007327044 wait complete. 2024-05-26T15:42:23.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.479+0000 7fba7f200640 1 Processor -- start 2024-05-26T15:42:23.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.480+0000 7fba7f200640 1 -- start start 2024-05-26T15:42:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.480+0000 7fba7f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba78154f50 0x7fba780b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.480+0000 7fba7f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba7815ae70 0x7fba781f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.480+0000 7fba7f200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fba7815f0c0 0x7fba780c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.480+0000 7fba7f200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780c85a0 con 0x7fba78154f50 2024-05-26T15:42:23.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.480+0000 7fba7f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba780b4800 con 0x7fba7815ae70 2024-05-26T15:42:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.480+0000 7fba7f200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba781497c0 con 0x7fba7815f0c0 2024-05-26T15:42:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.481+0000 7fba7de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba78154f50 0x7fba780b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.481+0000 7fba7de00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba78154f50 0x7fba780b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51402/0 (socket says 172.21.15.8:51402) 2024-05-26T15:42:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.481+0000 7fba7de00640 1 -- 172.21.15.8:0/4199778214 learned_addr learned my addr 172.21.15.8:0/4199778214 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.481+0000 7fba7d400640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba7815ae70 0x7fba781f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.481+0000 7fba7e800640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fba7815f0c0 0x7fba780c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.481+0000 7fba7de00640 1 -- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fba7815f0c0 msgr2=0x7fba780c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.481+0000 7fba7de00640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fba7815f0c0 0x7fba780c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.481+0000 7fba7de00640 1 -- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba7815ae70 msgr2=0x7fba781f1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.481+0000 7fba7de00640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba7815ae70 0x7fba781f1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.481+0000 7fba7de00640 1 -- 172.21.15.8:0/4199778214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680094d0 con 0x7fba78154f50 2024-05-26T15:42:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.482+0000 7fba7de00640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba78154f50 0x7fba780b4170 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00d800 tx=0x7fba6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.482+0000 7fba72000640 1 -- 172.21.15.8:0/4199778214 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c004030 con 0x7fba78154f50 2024-05-26T15:42:23.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.482+0000 7fba72000640 1 -- 172.21.15.8:0/4199778214 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c004190 con 0x7fba78154f50 2024-05-26T15:42:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.482+0000 7fba72000640 1 -- 172.21.15.8:0/4199778214 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c004520 con 0x7fba78154f50 2024-05-26T15:42:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.482+0000 7fba7f200640 1 -- 172.21.15.8:0/4199778214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba780c7c00 con 0x7fba78154f50 2024-05-26T15:42:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.482+0000 7fba7f200640 1 -- 172.21.15.8:0/4199778214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba780c81c0 con 0x7fba78154f50 2024-05-26T15:42:23.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.484+0000 7fba7f200640 1 -- 172.21.15.8:0/4199778214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7804e280 con 0x7fba78154f50 2024-05-26T15:42:23.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.485+0000 7fba72000640 1 -- 172.21.15.8:0/4199778214 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fba6c0096a0 con 0x7fba78154f50 2024-05-26T15:42:23.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.485+0000 7fba72000640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fba5c06ac00 0x7fba5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:23.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.486+0000 7fba72000640 1 -- 172.21.15.8:0/4199778214 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fba6c089660 con 0x7fba78154f50 2024-05-26T15:42:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.486+0000 7fba7d400640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fba5c06ac00 0x7fba5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:23.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.487+0000 7fba7d400640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fba5c06ac00 0x7fba5c06d0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fba68034000 tx=0x7fba6802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:23.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.490+0000 7fba72000640 1 -- 172.21.15.8:0/4199778214 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fba6c0547b0 con 0x7fba78154f50 2024-05-26T15:42:23.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.734+0000 7fba7f200640 1 -- 172.21.15.8:0/4199778214 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fba780714a0 con 0x7fba78154f50 2024-05-26T15:42:23.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.735+0000 7fba72000640 1 -- 172.21.15.8:0/4199778214 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fba6c057dd0 con 0x7fba78154f50 2024-05-26T15:42:23.734 INFO:teuthology.orchestra.run.smithi008.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 -- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fba5c06ac00 msgr2=0x7fba5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fba5c06ac00 0x7fba5c06d0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fba68034000 tx=0x7fba6802e000 comp rx=0 tx=0).stop 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 -- 172.21.15.8:0/4199778214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba78154f50 msgr2=0x7fba780b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba78154f50 0x7fba780b4170 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00d800 tx=0x7fba6c00dcc0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 -- 172.21.15.8:0/4199778214 shutdown_connections 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fba7815f0c0 0x7fba780c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fba5c06ac00 0x7fba5c06d0c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba7815ae70 0x7fba781f1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 --2- 172.21.15.8:0/4199778214 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba78154f50 0x7fba780b4170 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 -- 172.21.15.8:0/4199778214 >> 172.21.15.8:0/4199778214 conn(0x7fba78070480 msgr2=0x7fba780ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:23.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 -- 172.21.15.8:0/4199778214 shutdown_connections 2024-05-26T15:42:23.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:23.738+0000 7fba7f200640 1 -- 172.21.15.8:0/4199778214 wait complete. 2024-05-26T15:42:23.756 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-26T15:42:23.757 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-26T15:42:23.757 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi008.front.sepia.ceph.com 2024-05-26T15:42:23.757 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-26T15:42:23.757 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-26T15:42:23.757 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-26T15:42:23.757 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-26T15:42:23.757 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-26T15:42:23.757 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-26T15:42:23.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:42:23.757 DEBUG:teuthology.orchestra.run.smithi008:> ip addr 2024-05-26T15:42:23.812 INFO:teuthology.orchestra.run.smithi008.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-26T15:42:23.812 INFO:teuthology.orchestra.run.smithi008.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-26T15:42:23.812 INFO:teuthology.orchestra.run.smithi008.stdout: inet 127.0.0.1/8 scope host lo 2024-05-26T15:42:23.812 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:42:23.812 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 ::1/128 scope host 2024-05-26T15:42:23.812 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:42:23.812 INFO:teuthology.orchestra.run.smithi008.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:42:23.812 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2e brd ff:ff:ff:ff:ff:ff 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f0 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 0c:c4:7a:6b:fe:2f brd ff:ff:ff:ff:ff:ff 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp7s0f1 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:fe brd ff:ff:ff:ff:ff:ff 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f0 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: inet 172.21.15.8/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft 42456sec preferred_lft 42456sec 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link noprefixroute 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-26T15:42:23.813 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether ac:1f:6b:f8:25:ff brd ff:ff:ff:ff:ff:ff 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout: altname enp1s0f1 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 66:ad:5c:c4:13:98 brd ff:ff:ff:ff:ff:ff 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::10c6:16ff:feae:cd5d/64 scope link 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether f6:a8:54:01:f3:ce brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::f4a8:54ff:fe01:f3ce/64 scope link 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-26T15:42:23.814 INFO:teuthology.orchestra.run.smithi008.stdout: link/ether 66:ad:5c:c4:13:98 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-26T15:42:23.815 INFO:teuthology.orchestra.run.smithi008.stdout: inet6 fe80::64ad:5cff:fec4:1398/64 scope link 2024-05-26T15:42:23.815 INFO:teuthology.orchestra.run.smithi008.stdout: valid_lft forever preferred_lft forever 2024-05-26T15:42:23.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:42:23.816 DEBUG:teuthology.orchestra.run.smithi008:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-26T15:42:23.902 INFO:teuthology.orchestra.run.smithi008.stdout:1 2024-05-26T15:42:23.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:42:23.906 DEBUG:teuthology.orchestra.run.smithi008:> route 2024-05-26T15:42:23.963 INFO:teuthology.orchestra.run.smithi008.stdout:Kernel IP routing table 2024-05-26T15:42:23.963 INFO:teuthology.orchestra.run.smithi008.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-26T15:42:23.963 INFO:teuthology.orchestra.run.smithi008.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-26T15:42:23.964 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-26T15:42:23.964 INFO:teuthology.orchestra.run.smithi008.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-26T15:42:23.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:42:23.965 DEBUG:teuthology.orchestra.run.smithi008:> (cd / && exec bash -c ' 2024-05-26T15:42:23.965 DEBUG:teuthology.orchestra.run.smithi008:> set -e 2024-05-26T15:42:23.965 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-26T15:42:23.965 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-26T15:42:23.965 DEBUG:teuthology.orchestra.run.smithi008:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-26T15:42:23.965 DEBUG:teuthology.orchestra.run.smithi008:> ') 2024-05-26T15:42:24.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:42:24.129 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-05-26T15:42:24.182 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-26T15:42:24.182 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-26T15:42:24.183 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-26T15:42:24.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:42:24.183 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link set brx.0 up 2024-05-26T15:42:24.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:42:24.269 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-26T15:42:24.324 INFO:teuthology.orchestra.run.smithi008.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-26T15:42:24.324 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-26T15:42:24.324 DEBUG:teuthology.orchestra.run.smithi008:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-26T15:42:24.377 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-26T15:42:24.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:42:24.377 DEBUG:teuthology.orchestra.run.smithi008:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:42:24.514 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:42:24.514 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-26T15:42:24.514 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:42:24.539 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:42:24.539 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-26T15:42:24.539 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:42:24.539 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:42:24.539 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:42:24.566 INFO:teuthology.orchestra.run.smithi008.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-26T15:42:24.567 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-26T15:42:24.567 INFO:teuthology.orchestra.run.smithi008.stdout:invalid new device string format 2024-05-26T15:42:24.567 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:3300,172.21.15.47:3300,172.21.15.47:3301" 2024-05-26T15:42:24.567 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-26T15:42:24.567 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: resolved to: "172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790" 2024-05-26T15:42:24.567 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.8:6789,172.21.15.47:6789,172.21.15.47:6790:/ 2024-05-26T15:42:24.567 INFO:teuthology.orchestra.run.smithi008.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=03132396-4584-4cf0-b2e0-b5ae6040045e" will pass to kernel 2024-05-26T15:42:24.569 INFO:teuthology.orchestra.run.smithi008.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-26T15:42:24.569 INFO:teuthology.orchestra.run.smithi008.stdout: You just mounted a file system that supports labels which does not 2024-05-26T15:42:24.569 INFO:teuthology.orchestra.run.smithi008.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-26T15:42:24.569 INFO:teuthology.orchestra.run.smithi008.stdout: applications will generate AVC messages and not be allowed access to 2024-05-26T15:42:24.570 INFO:teuthology.orchestra.run.smithi008.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-26T15:42:24.575 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-26T15:42:24.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:42:24.575 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-26T15:42:24.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:42:24.653 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-26T15:42:24.732 INFO:teuthology.orchestra.run.smithi008.stdout:client5048 2024-05-26T15:42:24.732 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:42:24.732 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:42:24.793 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-26T15:42:24.801 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-26T15:42:24.947 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2024-05-26T15:42:24.947 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2024-05-26T15:42:24.947 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-26T15:42:24.947 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2024-05-26T15:42:24.947 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2024-05-26T15:42:24.948 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2024-05-26T15:42:24.949 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2024-05-26T15:42:24.950 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2024-05-26T15:42:24.951 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2024-05-26T15:42:24.952 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.953 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2024-05-26T15:42:24.953 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2024-05-26T15:42:24.953 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.953 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2024-05-26T15:42:24.953 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2024-05-26T15:42:24.953 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2024-05-26T15:42:24.953 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2024-05-26T15:42:24.953 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 20 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 20 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 10 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2024-05-26T15:42:24.954 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-05-26T15:42:24.955 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-26T15:42:24.956 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2024-05-26T15:42:24.957 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = "" 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2024-05-26T15:42:24.958 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds balancer = 20 2024-05-26T15:42:24.959 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:42:24.959 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2024-05-26T15:42:24.959 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2024-05-26T15:42:24.959 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2024-05-26T15:42:24.959 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2024-05-26T15:42:24.959 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-05-26T15:42:24.959 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-05-26T15:42:24.959 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-05-26T15:42:24.959 INFO:teuthology.orchestra.run.smithi008.stdout: osd_deep_scrub_large_omap_object_key_threshold = 1 2024-05-26T15:42:24.960 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-05-26T15:42:24.960 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-05-26T15:42:24.960 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-26T15:42:24.960 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-05-26T15:42:24.960 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.960 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-05-26T15:42:24.960 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.960 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-05-26T15:42:24.960 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.960 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.961 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-05-26T15:42:24.962 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on skipped message = False 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-05-26T15:42:24.963 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-05-26T15:42:24.964 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 20 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 20 2024-05-26T15:42:24.965 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 10 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-26T15:42:24.966 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-05-26T15:42:24.967 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.968 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = "" 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-26T15:42:24.969 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-05-26T15:42:24.970 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:42:24.971 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-05-26T15:42:24.971 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-05-26T15:42:24.971 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-05-26T15:42:24.971 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-05-26T15:42:24.971 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-26T15:42:24.971 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-26T15:42:24.971 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-26T15:42:24.971 INFO:teuthology.orchestra.run.smithi047.stdout: osd_deep_scrub_large_omap_object_key_threshold = 1 2024-05-26T15:42:24.989 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-26T15:42:24.989 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-26T15:42:24.989 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-26T15:42:24.989 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:42:24.989 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-26T15:42:24.989 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-26T15:42:24.990 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-26T15:42:24.990 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:42:24.990 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-26T15:42:24.990 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-26T15:42:24.990 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-26T15:42:24.990 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:42:24.990 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-26T15:42:24.990 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-26T15:42:24.991 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-26T15:42:24.991 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:42:25.008 INFO:tasks.ceph.mds.d:Stopped 2024-05-26T15:42:25.008 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-26T15:42:25.010 INFO:tasks.ceph.mds.b:Stopped 2024-05-26T15:42:25.010 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-26T15:42:25.012 INFO:tasks.ceph.mds.c:Stopped 2024-05-26T15:42:25.012 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-26T15:42:25.013 INFO:tasks.ceph.mds.a:Stopped 2024-05-26T15:42:25.014 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-26T15:42:25.057 INFO:tasks.ceph.mds.d:Started 2024-05-26T15:42:25.058 DEBUG:teuthology.parallel:result is None 2024-05-26T15:42:25.060 INFO:tasks.ceph.mds.c:Started 2024-05-26T15:42:25.060 DEBUG:teuthology.parallel:result is None 2024-05-26T15:42:25.063 INFO:tasks.ceph.mds.b:Started 2024-05-26T15:42:25.063 DEBUG:teuthology.parallel:result is None 2024-05-26T15:42:25.064 INFO:tasks.ceph.mds.a:Started 2024-05-26T15:42:25.064 DEBUG:teuthology.parallel:result is None 2024-05-26T15:42:25.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:25.212 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2024-05-26T15:42:25.212 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2024-05-26T15:42:25.217 INFO:tasks.ceph.mds.d.smithi047.stdout:starting mds.d at 2024-05-26T15:42:25.231 INFO:tasks.ceph.mds.b.smithi047.stdout:starting mds.b at 2024-05-26T15:42:25.243 INFO:tasks.ceph.mon.a.smithi008.stderr:2024-05-26T15:42:25.245+0000 7f3e01a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-26T15:42:25.257 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.258+0000 7fbf2a400640 1 Processor -- start 2024-05-26T15:42:25.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.259+0000 7fbf2a400640 1 -- start start 2024-05-26T15:42:25.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.261+0000 7fbf2a400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbf240c37a0 0x7fbf24161f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:25.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.261+0000 7fbf2a400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf240ce3a0 0x7fbf240ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:25.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.261+0000 7fbf2a400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf24162480 con 0x7fbf240c3b80 2024-05-26T15:42:25.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.261+0000 7fbf2a400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2415ef70 con 0x7fbf240c37a0 2024-05-26T15:42:25.259 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.261+0000 7fbf2a400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2406ec20 con 0x7fbf240ce3a0 2024-05-26T15:42:25.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.261+0000 7fbf29000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbf240c37a0 0x7fbf24161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:25.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.261+0000 7fbf29000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbf240c37a0 0x7fbf24161f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51436/0 (socket says 172.21.15.8:51436) 2024-05-26T15:42:25.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.261+0000 7fbf29000640 1 -- 172.21.15.8:0/2935313110 learned_addr learned my addr 172.21.15.8:0/2935313110 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:25.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.261+0000 7fbf23e00640 1 --1- 172.21.15.8:0/2935313110 >> v1:172.21.15.47:6789/0 conn(0x7fbf240c3b80 0x7fbf24099710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:53170/0 (socket says 172.21.15.8:53170) 2024-05-26T15:42:25.260 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.262+0000 7fbf29000640 1 -- 172.21.15.8:0/2935313110 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf240ce3a0 msgr2=0x7fbf240ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:25.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.262+0000 7fbf29000640 1 --2- 172.21.15.8:0/2935313110 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf240ce3a0 0x7fbf240ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:25.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.262+0000 7fbf29000640 1 -- 172.21.15.8:0/2935313110 >> v1:172.21.15.47:6789/0 conn(0x7fbf240c3b80 legacy=0x7fbf24099710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:25.261 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.262+0000 7fbf29000640 1 -- 172.21.15.8:0/2935313110 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf24098c30 con 0x7fbf240c37a0 2024-05-26T15:42:25.262 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.264+0000 7fbf29000640 1 --2- 172.21.15.8:0/2935313110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf240c37a0 0x7fbf24161f40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009870 tx=0x7fbf1802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606c00cb23a1c6d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:25.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.264+0000 7fbf23400640 1 -- 172.21.15.8:0/2935313110 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18032440 con 0x7fbf240c37a0 2024-05-26T15:42:25.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.264+0000 7fbf23400640 1 -- 172.21.15.8:0/2935313110 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf180325a0 con 0x7fbf240c37a0 2024-05-26T15:42:25.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.264+0000 7fbf23400640 1 -- 172.21.15.8:0/2935313110 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18032930 con 0x7fbf240c37a0 2024-05-26T15:42:25.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.265+0000 7fbf2a400640 1 -- 172.21.15.8:0/2935313110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf240c37a0 msgr2=0x7fbf24161f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:25.263 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.265+0000 7fbf2a400640 1 --2- 172.21.15.8:0/2935313110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf240c37a0 0x7fbf24161f40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009870 tx=0x7fbf1802a250 comp rx=0 tx=0).stop 2024-05-26T15:42:25.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.265+0000 7fbf2a400640 1 -- 172.21.15.8:0/2935313110 shutdown_connections 2024-05-26T15:42:25.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.265+0000 7fbf2a400640 1 --2- 172.21.15.8:0/2935313110 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf240ce3a0 0x7fbf240ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:25.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.265+0000 7fbf2a400640 1 --2- 172.21.15.8:0/2935313110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf240c37a0 0x7fbf24161f40 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:25.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.265+0000 7fbf2a400640 1 -- 172.21.15.8:0/2935313110 >> 172.21.15.8:0/2935313110 conn(0x7fbf240d07d0 msgr2=0x7fbf240d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:25.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.265+0000 7fbf2a400640 1 -- 172.21.15.8:0/2935313110 shutdown_connections 2024-05-26T15:42:25.264 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.266+0000 7fbf2a400640 1 -- 172.21.15.8:0/2935313110 wait complete. 2024-05-26T15:42:25.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.268+0000 7fbf2a400640 1 Processor -- start 2024-05-26T15:42:25.266 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.268+0000 7fbf2a400640 1 -- start start 2024-05-26T15:42:25.267 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.269+0000 7fbf2a400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf240c37a0 0x7fbf24164d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:25.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.269+0000 7fbf2a400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf240c3b80 0x7fbf2406bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:25.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.269+0000 7fbf2a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf240ce3a0 0x7fbf24162d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:25.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.269+0000 7fbf2a400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf240b3f60 con 0x7fbf240c3b80 2024-05-26T15:42:25.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.269+0000 7fbf2a400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2406c4a0 con 0x7fbf240ce3a0 2024-05-26T15:42:25.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.269+0000 7fbf2a400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2406c780 con 0x7fbf240c37a0 2024-05-26T15:42:25.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.270+0000 7fbf29000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf240c37a0 0x7fbf24164d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:25.268 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.270+0000 7fbf29a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf240ce3a0 0x7fbf24162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:25.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.270+0000 7fbf23e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf240c3b80 0x7fbf2406bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:25.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.270+0000 7fbf29a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf240ce3a0 0x7fbf24162d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:43608/0 (socket says 172.21.15.8:43608) 2024-05-26T15:42:25.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.270+0000 7fbf29a00640 1 -- 172.21.15.8:0/1912925137 learned_addr learned my addr 172.21.15.8:0/1912925137 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:25.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.270+0000 7fbf29a00640 1 -- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf240c37a0 msgr2=0x7fbf24164d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:25.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.271+0000 7fbf29a00640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf240c37a0 0x7fbf24164d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:25.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.271+0000 7fbf29a00640 1 -- 172.21.15.8:0/1912925137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf240c3b80 msgr2=0x7fbf2406bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:25.269 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.271+0000 7fbf29a00640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf240c3b80 0x7fbf2406bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:25.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.271+0000 7fbf29a00640 1 -- 172.21.15.8:0/1912925137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180094d0 con 0x7fbf240ce3a0 2024-05-26T15:42:25.270 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.272+0000 7fbf29a00640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf240ce3a0 0x7fbf24162d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00b9a0 tx=0x7fbf1c00be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:25.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.273+0000 7fbf20c00640 1 -- 172.21.15.8:0/1912925137 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c00cba0 con 0x7fbf240ce3a0 2024-05-26T15:42:25.271 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.273+0000 7fbf20c00640 1 -- 172.21.15.8:0/1912925137 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1c00cd20 con 0x7fbf240ce3a0 2024-05-26T15:42:25.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.273+0000 7fbf2a400640 1 -- 172.21.15.8:0/1912925137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2406ca60 con 0x7fbf240ce3a0 2024-05-26T15:42:25.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.273+0000 7fbf20c00640 1 -- 172.21.15.8:0/1912925137 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c014680 con 0x7fbf240ce3a0 2024-05-26T15:42:25.272 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.273+0000 7fbf2a400640 1 -- 172.21.15.8:0/1912925137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2406c130 con 0x7fbf240ce3a0 2024-05-26T15:42:25.273 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.275+0000 7fbf2a400640 1 -- 172.21.15.8:0/1912925137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2406cca0 con 0x7fbf240ce3a0 2024-05-26T15:42:25.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.276+0000 7fbf20c00640 1 -- 172.21.15.8:0/1912925137 <== mon.1 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbf1c01d3b0 con 0x7fbf240ce3a0 2024-05-26T15:42:25.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.277+0000 7fbf20c00640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf0406ac50 0x7fbf0406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:25.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.277+0000 7fbf20c00640 1 -- 172.21.15.8:0/1912925137 <== mon.1 v2:172.21.15.47:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fbf1c0894a0 con 0x7fbf240ce3a0 2024-05-26T15:42:25.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.277+0000 7fbf29000640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf0406ac50 0x7fbf0406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:25.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.279+0000 7fbf29000640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf0406ac50 0x7fbf0406d110 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbf18034000 tx=0x7fbf1802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:25.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.284+0000 7fbf20c00640 1 -- 172.21.15.8:0/1912925137 <== mon.1 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbf2406cca0 con 0x7fbf240ce3a0 2024-05-26T15:42:25.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.523+0000 7fbf2a400640 1 -- 172.21.15.8:0/1912925137 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf240b4380 con 0x7fbf240ce3a0 2024-05-26T15:42:25.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.524+0000 7fbf20c00640 1 -- 172.21.15.8:0/1912925137 <== mon.1 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4729 (secure 0 0 0) 0x7fbf240b4380 con 0x7fbf240ce3a0 2024-05-26T15:42:25.523 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:25.523 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":34,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:25.257070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:replay","state_seq":1,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:25.524 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 34 2024-05-26T15:42:25.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 -- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf0406ac50 msgr2=0x7fbf0406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:25.525 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf0406ac50 0x7fbf0406d110 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbf18034000 tx=0x7fbf1802e000 comp rx=0 tx=0).stop 2024-05-26T15:42:25.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 -- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf240ce3a0 msgr2=0x7fbf24162d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:25.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf240ce3a0 0x7fbf24162d90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00b9a0 tx=0x7fbf1c00be60 comp rx=0 tx=0).stop 2024-05-26T15:42:25.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 -- 172.21.15.8:0/1912925137 shutdown_connections 2024-05-26T15:42:25.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbf0406ac50 0x7fbf0406d110 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:25.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf240ce3a0 0x7fbf24162d90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:25.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbf240c3b80 0x7fbf2406bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:25.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 --2- 172.21.15.8:0/1912925137 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbf240c37a0 0x7fbf24164d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:25.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 -- 172.21.15.8:0/1912925137 >> 172.21.15.8:0/1912925137 conn(0x7fbf240d07d0 msgr2=0x7fbf240d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:25.526 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 -- 172.21.15.8:0/1912925137 shutdown_connections 2024-05-26T15:42:25.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:25.527+0000 7fbf2a400640 1 -- 172.21.15.8:0/1912925137 wait complete. 2024-05-26T15:42:25.950 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-26T15:42:11.450547+0000', 'modified': '2024-05-26T15:42:25.257070+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 59, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5952}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5952': {'gid': 5952, 'name': 'a', 'rank': 0, 'incarnation': 34, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.8:6834/3351700355', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6832', 'nonce': 3351700355}, {'type': 'v1', 'addr': '172.21.15.8:6834', 'nonce': 3351700355}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-26T15:42:25.950 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5952:up:replay 2024-05-26T15:42:26.951 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.173+0000 7fec30400640 1 Processor -- start 2024-05-26T15:42:27.172 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.173+0000 7fec30400640 1 -- start start 2024-05-26T15:42:27.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.175+0000 7fec30400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fec281445d0 0x7fec2806e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:27.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.175+0000 7fec30400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fec2815f230 0x7fec2815e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:27.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.175+0000 7fec30400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2815ef60 con 0x7fec2815eb60 2024-05-26T15:42:27.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.175+0000 7fec30400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2806d380 con 0x7fec281445d0 2024-05-26T15:42:27.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.175+0000 7fec30400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2806d660 con 0x7fec2815f230 2024-05-26T15:42:27.174 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.176+0000 7fec2da00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fec281445d0 0x7fec2806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:27.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.176+0000 7fec2da00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fec281445d0 0x7fec2806e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51450/0 (socket says 172.21.15.8:51450) 2024-05-26T15:42:27.175 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.176+0000 7fec2da00640 1 -- 172.21.15.8:0/2550351824 learned_addr learned my addr 172.21.15.8:0/2550351824 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.176+0000 7fec2d000640 1 --2- 172.21.15.8:0/2550351824 >> v2:172.21.15.47:3300/0 conn(0x7fec2815f230 0x7fec2815e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.176+0000 7fec2da00640 1 -- 172.21.15.8:0/2550351824 >> v2:172.21.15.47:3300/0 conn(0x7fec2815f230 msgr2=0x7fec2815e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.176+0000 7fec2da00640 1 --2- 172.21.15.8:0/2550351824 >> v2:172.21.15.47:3300/0 conn(0x7fec2815f230 0x7fec2815e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.176+0000 7fec2da00640 1 -- 172.21.15.8:0/2550351824 >> v1:172.21.15.47:6789/0 conn(0x7fec2815eb60 legacy=0x7fec2815aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.176+0000 7fec2da00640 1 -- 172.21.15.8:0/2550351824 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2806d940 con 0x7fec281445d0 2024-05-26T15:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.176+0000 7fec2d000640 1 --2- 172.21.15.8:0/2550351824 >> v2:172.21.15.47:3300/0 conn(0x7fec2815f230 0x7fec2815e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:27.176 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.177+0000 7fec2da00640 1 --2- 172.21.15.8:0/2550351824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec281445d0 0x7fec2806e630 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fec28070410 tx=0x7fec1c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde6e9410e1fc803 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.178+0000 7fec27e00640 1 -- 172.21.15.8:0/2550351824 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c031600 con 0x7fec281445d0 2024-05-26T15:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.178+0000 7fec27e00640 1 -- 172.21.15.8:0/2550351824 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c02d050 con 0x7fec281445d0 2024-05-26T15:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.178+0000 7fec27e00640 1 -- 172.21.15.8:0/2550351824 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c031980 con 0x7fec281445d0 2024-05-26T15:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.179+0000 7fec30400640 1 -- 172.21.15.8:0/2550351824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec281445d0 msgr2=0x7fec2806e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:27.177 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.179+0000 7fec30400640 1 --2- 172.21.15.8:0/2550351824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec281445d0 0x7fec2806e630 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fec28070410 tx=0x7fec1c02a660 comp rx=0 tx=0).stop 2024-05-26T15:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.179+0000 7fec30400640 1 -- 172.21.15.8:0/2550351824 shutdown_connections 2024-05-26T15:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.179+0000 7fec30400640 1 --2- 172.21.15.8:0/2550351824 >> v2:172.21.15.47:3300/0 conn(0x7fec2815f230 0x7fec2815e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.179+0000 7fec30400640 1 --2- 172.21.15.8:0/2550351824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec281445d0 0x7fec2806e630 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.179+0000 7fec30400640 1 -- 172.21.15.8:0/2550351824 >> 172.21.15.8:0/2550351824 conn(0x7fec280b0720 msgr2=0x7fec280b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.179+0000 7fec30400640 1 -- 172.21.15.8:0/2550351824 shutdown_connections 2024-05-26T15:42:27.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.179+0000 7fec30400640 1 -- 172.21.15.8:0/2550351824 wait complete. 2024-05-26T15:42:27.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.181+0000 7fec30400640 1 Processor -- start 2024-05-26T15:42:27.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.181+0000 7fec30400640 1 -- start start 2024-05-26T15:42:27.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.182+0000 7fec30400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec281445d0 0x7fec2815c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.182+0000 7fec30400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fec2815eb60 0x7fec2813db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.182+0000 7fec30400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2815f230 0x7fec280b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.182+0000 7fec30400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2815cfe0 con 0x7fec2815f230 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.182+0000 7fec30400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2813e140 con 0x7fec281445d0 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.182+0000 7fec30400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec280b3410 con 0x7fec2815eb60 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.182+0000 7fec2e400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2815f230 0x7fec280b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.182+0000 7fec2e400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2815f230 0x7fec280b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51452/0 (socket says 172.21.15.8:51452) 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.182+0000 7fec2e400640 1 -- 172.21.15.8:0/4235258983 learned_addr learned my addr 172.21.15.8:0/4235258983 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.183+0000 7fec2da00640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec281445d0 0x7fec2815c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.183+0000 7fec2d000640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fec2815eb60 0x7fec2813db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.183+0000 7fec2e400640 1 -- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fec2815eb60 msgr2=0x7fec2813db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.183+0000 7fec2e400640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fec2815eb60 0x7fec2813db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:27.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.183+0000 7fec2e400640 1 -- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec281445d0 msgr2=0x7fec2815c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.183+0000 7fec2e400640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec281445d0 0x7fec2815c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.183+0000 7fec2e400640 1 -- 172.21.15.8:0/4235258983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c009b30 con 0x7fec2815f230 2024-05-26T15:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.183+0000 7fec2d000640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fec2815eb60 0x7fec2813db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.183+0000 7fec2e400640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2815f230 0x7fec280b2d10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fec2000c410 tx=0x7fec2000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.184+0000 7fec25600640 1 -- 172.21.15.8:0/4235258983 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20011790 con 0x7fec2815f230 2024-05-26T15:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.184+0000 7fec25600640 1 -- 172.21.15.8:0/4235258983 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec200118f0 con 0x7fec2815f230 2024-05-26T15:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.184+0000 7fec25600640 1 -- 172.21.15.8:0/4235258983 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20011ce0 con 0x7fec2815f230 2024-05-26T15:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.184+0000 7fec30400640 1 -- 172.21.15.8:0/4235258983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec280b36f0 con 0x7fec2815f230 2024-05-26T15:42:27.184 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.184+0000 7fec30400640 1 -- 172.21.15.8:0/4235258983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2813e630 con 0x7fec2815f230 2024-05-26T15:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.185+0000 7fec30400640 1 -- 172.21.15.8:0/4235258983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2804e210 con 0x7fec2815f230 2024-05-26T15:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.186+0000 7fec25600640 1 -- 172.21.15.8:0/4235258983 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec2001c460 con 0x7fec2815f230 2024-05-26T15:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.187+0000 7fec25600640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fec0806ac00 0x7fec0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:27.185 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.187+0000 7fec25600640 1 -- 172.21.15.8:0/4235258983 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fec20089240 con 0x7fec2815f230 2024-05-26T15:42:27.186 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.188+0000 7fec2da00640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fec0806ac00 0x7fec0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:27.187 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.189+0000 7fec2da00640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fec0806ac00 0x7fec0806d0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fec1c033000 tx=0x7fec1c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:27.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.192+0000 7fec25600640 1 -- 172.21.15.8:0/4235258983 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fec200541e0 con 0x7fec2815f230 2024-05-26T15:42:27.429 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.431+0000 7fec30400640 1 -- 172.21.15.8:0/4235258983 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec280b1480 con 0x7fec2815f230 2024-05-26T15:42:27.430 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.432+0000 7fec25600640 1 -- 172.21.15.8:0/4235258983 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4729 (secure 0 0 0) 0x7fec20057800 con 0x7fec2815f230 2024-05-26T15:42:27.431 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:27.431 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:27.262743+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:27.431 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 36 2024-05-26T15:42:27.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.434+0000 7fec30400640 1 -- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fec0806ac00 msgr2=0x7fec0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:27.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.434+0000 7fec30400640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fec0806ac00 0x7fec0806d0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fec1c033000 tx=0x7fec1c009000 comp rx=0 tx=0).stop 2024-05-26T15:42:27.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.434+0000 7fec30400640 1 -- 172.21.15.8:0/4235258983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2815f230 msgr2=0x7fec280b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:27.433 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.434+0000 7fec30400640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2815f230 0x7fec280b2d10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fec2000c410 tx=0x7fec2000c8d0 comp rx=0 tx=0).stop 2024-05-26T15:42:27.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.435+0000 7fec30400640 1 -- 172.21.15.8:0/4235258983 shutdown_connections 2024-05-26T15:42:27.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.435+0000 7fec30400640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec2815f230 0x7fec280b2d10 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:27.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.435+0000 7fec30400640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fec2815eb60 0x7fec2813db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:27.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.435+0000 7fec30400640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fec0806ac00 0x7fec0806d0c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:27.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.435+0000 7fec30400640 1 --2- 172.21.15.8:0/4235258983 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec281445d0 0x7fec2815c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:27.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.435+0000 7fec30400640 1 -- 172.21.15.8:0/4235258983 >> 172.21.15.8:0/4235258983 conn(0x7fec280b0720 msgr2=0x7fec280ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:27.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.435+0000 7fec30400640 1 -- 172.21.15.8:0/4235258983 shutdown_connections 2024-05-26T15:42:27.434 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:27.435+0000 7fec30400640 1 -- 172.21.15.8:0/4235258983 wait complete. 2024-05-26T15:42:27.854 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-26T15:42:11.450547+0000', 'modified': '2024-05-26T15:42:27.262743+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 59, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5952}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5952': {'gid': 5952, 'name': 'a', 'rank': 0, 'incarnation': 34, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.8:6834/3351700355', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6832', 'nonce': 3351700355}, {'type': 'v1', 'addr': '172.21.15.8:6834', 'nonce': 3351700355}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-26T15:42:27.854 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5952:up:rejoin 2024-05-26T15:42:28.744 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:42:28.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:42:28.855 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.072+0000 7f32cee00640 1 Processor -- start 2024-05-26T15:42:29.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.072+0000 7f32cee00640 1 -- start start 2024-05-26T15:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.074+0000 7f32cee00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f32c81500d0 0x7f32c80adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.074+0000 7f32cee00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 0x7f32c80cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.074+0000 7f32cee00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c80cbd90 con 0x7f32c80cb940 2024-05-26T15:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.074+0000 7f32cee00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c80ce2f0 con 0x7f32c81500d0 2024-05-26T15:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.074+0000 7f32cee00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80ce780 con 0x7f32c80ae0d0 2024-05-26T15:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.074+0000 7f32c7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f32c81500d0 0x7f32c80adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.074+0000 7f32c7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f32c81500d0 0x7f32c80adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51468/0 (socket says 172.21.15.8:51468) 2024-05-26T15:42:29.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.074+0000 7f32c7e00640 1 -- 172.21.15.8:0/416686919 learned_addr learned my addr 172.21.15.8:0/416686919 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.075+0000 7f32c7e00640 1 -- 172.21.15.8:0/416686919 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 msgr2=0x7f32c80cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:29.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.075+0000 7f32c7400640 1 --2- 172.21.15.8:0/416686919 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 0x7f32c80cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.075+0000 7f32c7e00640 1 --2- 172.21.15.8:0/416686919 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 0x7f32c80cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.075+0000 7f32c7e00640 1 -- 172.21.15.8:0/416686919 >> v1:172.21.15.47:6789/0 conn(0x7f32c80cb940 legacy=0x7f32c815cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.075+0000 7f32c7e00640 1 -- 172.21.15.8:0/416686919 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c80cd420 con 0x7f32c81500d0 2024-05-26T15:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.075+0000 7f32c7400640 1 --2- 172.21.15.8:0/416686919 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 0x7f32c80cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:29.075 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.076+0000 7f32c7e00640 1 --2- 172.21.15.8:0/416686919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 0x7f32c80adb90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009e50 tx=0x7f32b802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfcc8901bb605c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:29.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.076+0000 7f32c6a00640 1 -- 172.21.15.8:0/416686919 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8031600 con 0x7f32c81500d0 2024-05-26T15:42:29.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.076+0000 7f32c6a00640 1 -- 172.21.15.8:0/416686919 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b802d050 con 0x7f32c81500d0 2024-05-26T15:42:29.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.076+0000 7f32c6a00640 1 -- 172.21.15.8:0/416686919 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8031980 con 0x7f32c81500d0 2024-05-26T15:42:29.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.077+0000 7f32cee00640 1 -- 172.21.15.8:0/416686919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 msgr2=0x7f32c80adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:29.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.077+0000 7f32cee00640 1 --2- 172.21.15.8:0/416686919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 0x7f32c80adb90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009e50 tx=0x7f32b802a6d0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.077+0000 7f32cee00640 1 -- 172.21.15.8:0/416686919 shutdown_connections 2024-05-26T15:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.077+0000 7f32cee00640 1 --2- 172.21.15.8:0/416686919 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 0x7f32c80cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.077+0000 7f32cee00640 1 --2- 172.21.15.8:0/416686919 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 0x7f32c80adb90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.077+0000 7f32cee00640 1 -- 172.21.15.8:0/416686919 >> 172.21.15.8:0/416686919 conn(0x7f32c80b0720 msgr2=0x7f32c80b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.078+0000 7f32cee00640 1 -- 172.21.15.8:0/416686919 shutdown_connections 2024-05-26T15:42:29.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.078+0000 7f32cee00640 1 -- 172.21.15.8:0/416686919 wait complete. 2024-05-26T15:42:29.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.079+0000 7f32cee00640 1 Processor -- start 2024-05-26T15:42:29.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.080+0000 7f32cee00640 1 -- start start 2024-05-26T15:42:29.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32cee00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 0x7f32c80afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32cee00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c80cb940 0x7f32c80aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32cee00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 0x7f32c8142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32cee00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c806c620 con 0x7f32c81500d0 2024-05-26T15:42:29.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32cee00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c81419c0 con 0x7f32c80cb940 2024-05-26T15:42:29.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32cee00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c806c830 con 0x7f32c80ae0d0 2024-05-26T15:42:29.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32cce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 0x7f32c8142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32cce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 0x7f32c8142be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51480/0 (socket says 172.21.15.8:51480) 2024-05-26T15:42:29.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32cce00640 1 -- 172.21.15.8:0/2902046871 learned_addr learned my addr 172.21.15.8:0/2902046871 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:29.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32c7e00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 0x7f32c80afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.081+0000 7f32c7400640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c80cb940 0x7f32c80aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32cce00640 1 -- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 msgr2=0x7f32c80afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:29.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32cce00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 0x7f32c80afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32cce00640 1 -- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c80cb940 msgr2=0x7f32c80aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32cce00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c80cb940 0x7f32c80aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32cce00640 1 -- 172.21.15.8:0/2902046871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8009b30 con 0x7f32c81500d0 2024-05-26T15:42:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32c7e00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 0x7f32c80afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:42:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32cce00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 0x7f32c8142be0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c410 tx=0x7f32c000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32bfe00640 1 -- 172.21.15.8:0/2902046871 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0011790 con 0x7f32c81500d0 2024-05-26T15:42:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32bfe00640 1 -- 172.21.15.8:0/2902046871 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c00118f0 con 0x7f32c81500d0 2024-05-26T15:42:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32cee00640 1 -- 172.21.15.8:0/2902046871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c806cb10 con 0x7f32c81500d0 2024-05-26T15:42:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32bfe00640 1 -- 172.21.15.8:0/2902046871 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0011ce0 con 0x7f32c81500d0 2024-05-26T15:42:29.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.082+0000 7f32cee00640 1 -- 172.21.15.8:0/2902046871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c806d3b0 con 0x7f32c81500d0 2024-05-26T15:42:29.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.084+0000 7f32cee00640 1 -- 172.21.15.8:0/2902046871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c80cb270 con 0x7f32c81500d0 2024-05-26T15:42:29.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.085+0000 7f32bfe00640 1 -- 172.21.15.8:0/2902046871 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f32c001c460 con 0x7f32c81500d0 2024-05-26T15:42:29.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.086+0000 7f32bfe00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f32a806ac50 0x7f32a806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.086+0000 7f32bfe00640 1 -- 172.21.15.8:0/2902046871 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f32c0089340 con 0x7f32c81500d0 2024-05-26T15:42:29.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.087+0000 7f32c7e00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f32a806ac50 0x7f32a806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.088+0000 7f32c7e00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f32a806ac50 0x7f32a806d110 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f32b8033000 tx=0x7f32b8009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:29.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.091+0000 7f32bfe00640 1 -- 172.21.15.8:0/2902046871 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f32c0054360 con 0x7f32c81500d0 2024-05-26T15:42:29.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.337+0000 7f32cee00640 1 -- 172.21.15.8:0/2902046871 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32c80cc530 con 0x7f32c81500d0 2024-05-26T15:42:29.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.338+0000 7f32bfe00640 1 -- 172.21.15.8:0/2902046871 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f32c0057980 con 0x7f32c81500d0 2024-05-26T15:42:29.337 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:29.337 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:29.337 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:42:29.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 -- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f32a806ac50 msgr2=0x7f32a806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:29.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f32a806ac50 0x7f32a806d110 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f32b8033000 tx=0x7f32b8009000 comp rx=0 tx=0).stop 2024-05-26T15:42:29.339 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 -- 172.21.15.8:0/2902046871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 msgr2=0x7f32c8142be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 0x7f32c8142be0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f32c000c410 tx=0x7f32c000c8d0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 -- 172.21.15.8:0/2902046871 shutdown_connections 2024-05-26T15:42:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f32c81500d0 0x7f32c8142be0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f32a806ac50 0x7f32a806d110 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32c80cb940 0x7f32c80aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.340 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 --2- 172.21.15.8:0/2902046871 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f32c80ae0d0 0x7f32c80afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 -- 172.21.15.8:0/2902046871 >> 172.21.15.8:0/2902046871 conn(0x7f32c80b0720 msgr2=0x7f32c815a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:29.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 -- 172.21.15.8:0/2902046871 shutdown_connections 2024-05-26T15:42:29.341 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.341+0000 7f32cee00640 1 -- 172.21.15.8:0/2902046871 wait complete. 2024-05-26T15:42:29.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-26T15:42:11.450547+0000', 'modified': '2024-05-26T15:42:29.269707+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 59, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5952}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5952': {'gid': 5952, 'name': 'a', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.8:6834/3351700355', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6832', 'nonce': 3351700355}, {'type': 'v1', 'addr': '172.21.15.8:6834', 'nonce': 3351700355}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-26T15:42:29.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-26T15:42:29.763 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-26T15:42:29.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.987+0000 7f781ca00640 1 Processor -- start 2024-05-26T15:42:29.986 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.988+0000 7f781ca00640 1 -- start start 2024-05-26T15:42:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.989+0000 7f781ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f78180add50 0x7f7818165430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.989+0000 7f781ca00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78180b2400 0x7f78180705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.989+0000 7f781ca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f78180b3330 0x7f78180b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.989+0000 7f781ca00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7818070fc0 con 0x7f78180add50 2024-05-26T15:42:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.989+0000 7f781ca00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78180cb450 con 0x7f78180b3330 2024-05-26T15:42:29.988 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.989+0000 7f781ca00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78180b3cc0 con 0x7f78180b2400 2024-05-26T15:42:29.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.990+0000 7f7817400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f78180add50 0x7f7818165430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.990+0000 7f7817400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f78180add50 0x7f7818165430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51484/0 (socket says 172.21.15.8:51484) 2024-05-26T15:42:29.989 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.990+0000 7f7817400640 1 -- 172.21.15.8:0/2462096179 learned_addr learned my addr 172.21.15.8:0/2462096179 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.990+0000 7f7816a00640 1 --2- 172.21.15.8:0/2462096179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78180b2400 0x7f78180705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.990+0000 7f7817e00640 1 --2- 172.21.15.8:0/2462096179 >> v2:172.21.15.47:3300/0 conn(0x7f78180b3330 0x7f78180b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.990+0000 7f7817400640 1 -- 172.21.15.8:0/2462096179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78180b2400 msgr2=0x7f78180705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.990+0000 7f7817400640 1 --2- 172.21.15.8:0/2462096179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78180b2400 0x7f78180705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.990+0000 7f7817400640 1 -- 172.21.15.8:0/2462096179 >> v2:172.21.15.47:3300/0 conn(0x7f78180b3330 msgr2=0x7f78180b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.990+0000 7f7817400640 1 --2- 172.21.15.8:0/2462096179 >> v2:172.21.15.47:3300/0 conn(0x7f78180b3330 0x7f78180b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.990+0000 7f7817400640 1 -- 172.21.15.8:0/2462096179 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818070ce0 con 0x7f78180add50 2024-05-26T15:42:29.990 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.991+0000 7f7817400640 1 --2- 172.21.15.8:0/2462096179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180add50 0x7f7818165430 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f78180ce6f0 tx=0x7f780802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a9cd9d9b4f5eba server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:29.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.992+0000 7f7816000640 1 -- 172.21.15.8:0/2462096179 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780802ae90 con 0x7f78180add50 2024-05-26T15:42:29.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.992+0000 7f7816000640 1 -- 172.21.15.8:0/2462096179 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808032440 con 0x7f78180add50 2024-05-26T15:42:29.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.992+0000 7f7816000640 1 -- 172.21.15.8:0/2462096179 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080327d0 con 0x7f78180add50 2024-05-26T15:42:29.991 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.992+0000 7f781ca00640 1 -- 172.21.15.8:0/2462096179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180add50 msgr2=0x7f7818165430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.992+0000 7f781ca00640 1 --2- 172.21.15.8:0/2462096179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180add50 0x7f7818165430 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f78180ce6f0 tx=0x7f780802a140 comp rx=0 tx=0).stop 2024-05-26T15:42:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.992+0000 7f781ca00640 1 -- 172.21.15.8:0/2462096179 shutdown_connections 2024-05-26T15:42:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.992+0000 7f781ca00640 1 --2- 172.21.15.8:0/2462096179 >> v2:172.21.15.47:3300/0 conn(0x7f78180b3330 0x7f78180b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.992+0000 7f781ca00640 1 --2- 172.21.15.8:0/2462096179 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78180b2400 0x7f78180705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.992+0000 7f781ca00640 1 --2- 172.21.15.8:0/2462096179 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180add50 0x7f7818165430 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.992+0000 7f781ca00640 1 -- 172.21.15.8:0/2462096179 >> 172.21.15.8:0/2462096179 conn(0x7f7818069ed0 msgr2=0x7f781806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.993+0000 7f781ca00640 1 -- 172.21.15.8:0/2462096179 shutdown_connections 2024-05-26T15:42:29.992 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.993+0000 7f781ca00640 1 -- 172.21.15.8:0/2462096179 wait complete. 2024-05-26T15:42:29.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.994+0000 7f781ca00640 1 Processor -- start 2024-05-26T15:42:29.993 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.995+0000 7f781ca00640 1 -- start start 2024-05-26T15:42:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.995+0000 7f781ca00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78180add50 0x7f781815f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.995+0000 7f781ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78180b2400 0x7f781814f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f781ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180b3330 0x7f781814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.994 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f781ca00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781815c690 con 0x7f78180b3330 2024-05-26T15:42:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f781ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781815b5f0 con 0x7f78180b2400 2024-05-26T15:42:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f781ca00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781815b8d0 con 0x7f78180add50 2024-05-26T15:42:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f7817e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180b3330 0x7f781814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f7817e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180b3330 0x7f781814fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51496/0 (socket says 172.21.15.8:51496) 2024-05-26T15:42:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f7817e00640 1 -- 172.21.15.8:0/64383048 learned_addr learned my addr 172.21.15.8:0/64383048 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f7816a00640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78180b2400 0x7f781814f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.995 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f7817400640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78180add50 0x7f781815f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f7817e00640 1 -- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78180add50 msgr2=0x7f781815f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.996+0000 7f7817e00640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78180add50 0x7f781815f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.997+0000 7f7817e00640 1 -- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78180b2400 msgr2=0x7f781814f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.997+0000 7f7817e00640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78180b2400 0x7f781814f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.997+0000 7f7817e00640 1 -- 172.21.15.8:0/64383048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080094d0 con 0x7f78180b3330 2024-05-26T15:42:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.997+0000 7f7817e00640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180b3330 0x7f781814fa40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7810007e40 tx=0x7f781000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.997+0000 7f780f400640 1 -- 172.21.15.8:0/64383048 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810014620 con 0x7f78180b3330 2024-05-26T15:42:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.997+0000 7f780f400640 1 -- 172.21.15.8:0/64383048 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781000ee90 con 0x7f78180b3330 2024-05-26T15:42:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.997+0000 7f780f400640 1 -- 172.21.15.8:0/64383048 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78100149e0 con 0x7f78180b3330 2024-05-26T15:42:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.997+0000 7f781ca00640 1 -- 172.21.15.8:0/64383048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781815bbb0 con 0x7f78180b3330 2024-05-26T15:42:29.997 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:29.997+0000 7f781ca00640 1 -- 172.21.15.8:0/64383048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781815c170 con 0x7f78180b3330 2024-05-26T15:42:29.998 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.000+0000 7f780f400640 1 -- 172.21.15.8:0/64383048 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7810014b40 con 0x7f78180b3330 2024-05-26T15:42:29.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.000+0000 7f780f400640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77f806ac00 0x7f77f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:29.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.001+0000 7f780f400640 1 -- 172.21.15.8:0/64383048 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f7810089dc0 con 0x7f78180b3330 2024-05-26T15:42:29.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.001+0000 7f7817400640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77f806ac00 0x7f77f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:29.999 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.001+0000 7f7820dd0740 1 Processor -- start 2024-05-26T15:42:30.000 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.002+0000 7f7820dd0740 1 -- start start 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.002+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92300 0x5644cea71d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.002+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea485a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.002+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea48ae0 0x5644cea49bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.002+0000 7f7820dd0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644ce9b3a70 con 0x5644cea92910 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.002+0000 7f7820dd0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644ce9b1200 con 0x5644cea92300 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.002+0000 7f7820dd0740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644ce9acaf0 con 0x5644cea48ae0 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.002+0000 7f7817400640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77f806ac00 0x7f77f806d0c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7808034000 tx=0x7f780802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.003+0000 7f7816a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.003+0000 7f7816a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea485a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51504/0 (socket says 172.21.15.8:51504) 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.003+0000 7f7816a00640 1 -- 172.21.15.8:0/1235961337 learned_addr learned my addr 172.21.15.8:0/1235961337 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:30.002 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.003+0000 7f7817400640 1 --2- 172.21.15.8:0/1235961337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92300 0x5644cea71d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.003+0000 7f7817e00640 1 --2- 172.21.15.8:0/1235961337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea48ae0 0x5644cea49bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.003+0000 7f7816a00640 1 -- 172.21.15.8:0/1235961337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea48ae0 msgr2=0x5644cea49bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.003+0000 7f7816a00640 1 --2- 172.21.15.8:0/1235961337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea48ae0 0x5644cea49bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.003+0000 7f7816a00640 1 -- 172.21.15.8:0/1235961337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92300 msgr2=0x5644cea71d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.003+0000 7f7816a00640 1 --2- 172.21.15.8:0/1235961337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92300 0x5644cea71d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.003+0000 7f7816a00640 1 -- 172.21.15.8:0/1235961337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644ce977b90 con 0x5644cea92910 2024-05-26T15:42:30.003 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.004+0000 7f7816a00640 1 --2- 172.21.15.8:0/1235961337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea485a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f780400b960 tx=0x7f780400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9e30a0e29ece59 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.004+0000 7f7803e00640 1 -- 172.21.15.8:0/1235961337 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400fa20 con 0x5644cea92910 2024-05-26T15:42:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.004+0000 7f7803e00640 1 -- 172.21.15.8:0/1235961337 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780400fb80 con 0x5644cea92910 2024-05-26T15:42:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.004+0000 7f7803e00640 1 -- 172.21.15.8:0/1235961337 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804014460 con 0x5644cea92910 2024-05-26T15:42:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.004+0000 7f7820dd0740 1 -- 172.21.15.8:0/1235961337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 msgr2=0x5644cea485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.004 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.004+0000 7f7820dd0740 1 --2- 172.21.15.8:0/1235961337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea485a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f780400b960 tx=0x7f780400be20 comp rx=0 tx=0).stop 2024-05-26T15:42:30.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.005+0000 7f7820dd0740 1 -- 172.21.15.8:0/1235961337 shutdown_connections 2024-05-26T15:42:30.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.005+0000 7f7820dd0740 1 --2- 172.21.15.8:0/1235961337 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea48ae0 0x5644cea49bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.005+0000 7f7820dd0740 1 --2- 172.21.15.8:0/1235961337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea485a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.005+0000 7f7820dd0740 1 --2- 172.21.15.8:0/1235961337 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92300 0x5644cea71d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.005+0000 7f7820dd0740 1 -- 172.21.15.8:0/1235961337 >> 172.21.15.8:0/1235961337 conn(0x5644cea47000 msgr2=0x5644cea8f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:30.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.005+0000 7f7820dd0740 1 -- 172.21.15.8:0/1235961337 shutdown_connections 2024-05-26T15:42:30.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.005+0000 7f7820dd0740 1 -- 172.21.15.8:0/1235961337 wait complete. 2024-05-26T15:42:30.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.005+0000 7f7820dd0740 1 -- start start 2024-05-26T15:42:30.005 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.006+0000 7f7820dd0740 1 Processor -- start 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.006+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92300 0x5644cea64c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 0x5644cea659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea682d0 0x5644cea68750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7820dd0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644ce94e220 con 0x5644cea92300 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7820dd0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644ce94dec0 con 0x5644cea92910 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7820dd0740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644ce713f20 con 0x5644cea682d0 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7820dd0740 10 client.0 _ll_register_callbacks cb 0x5644ce9a6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7817400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92300 0x5644cea64c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7817400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92300 0x5644cea64c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51520/0 (socket says 172.21.15.8:51520) 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7817400640 1 -- 172.21.15.8:0/3668838001 learned_addr learned my addr 172.21.15.8:0/3668838001 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:30.008 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7816a00640 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 0x5644cea659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7817e00640 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea682d0 0x5644cea68750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7817400640 1 -- 172.21.15.8:0/3668838001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea682d0 msgr2=0x5644cea68750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7817400640 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea682d0 0x5644cea68750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7817400640 1 -- 172.21.15.8:0/3668838001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 msgr2=0x5644cea659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7817400640 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 0x5644cea659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7817400640 1 -- 172.21.15.8:0/3668838001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780400e040 con 0x5644cea92300 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.007+0000 7f7816a00640 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 0x5644cea659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.008+0000 7f7817400640 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92300 0x5644cea64c20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f78080090b0 tx=0x7f7808004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797bd1d97a2eba3a server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.008+0000 7f7800c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.008+0000 7f7800c00640 1 -- 172.21.15.8:0/3668838001 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808046400 con 0x5644cea92300 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.008+0000 7f7800c00640 1 -- 172.21.15.8:0/3668838001 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f7808046560 con 0x5644cea92300 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.008+0000 7f7820dd0740 1 -- 172.21.15.8:0/3668838001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644ce9d6c90 con 0x5644cea92300 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.008+0000 7f7800c00640 1 -- 172.21.15.8:0/3668838001 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7808046720 con 0x5644cea92300 2024-05-26T15:42:30.009 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.008+0000 7f7820dd0740 10 client.5994 fetch_fsmap learned FSMap version 38 2024-05-26T15:42:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.008+0000 7f7820dd0740 1 -- 172.21.15.8:0/3668838001 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5644ce9ab170 con 0x5644cea92300 2024-05-26T15:42:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.009+0000 7f7800c00640 1 -- 172.21.15.8:0/3668838001 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5644ce9d6c90 con 0x5644cea92300 2024-05-26T15:42:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.009+0000 7f7800c00640 1 -- 172.21.15.8:0/3668838001 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 38) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7808044040 con 0x5644cea92300 2024-05-26T15:42:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.009+0000 7f7820dd0740 10 client.5994 fetch_fsmap finished waiting for FSMap version 38 2024-05-26T15:42:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.009+0000 7f7820dd0740 10 client.5994 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-26T15:42:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.009+0000 7f7820dd0740 20 client.5994 populate_metadata read hostname 'smithi008' 2024-05-26T15:42:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.009+0000 7f7820dd0740 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.8:6832/3351700355,v1:172.21.15.8:6834/3351700355] conn(0x5644cea6c9b0 0x5644cea6cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.009+0000 7f7820dd0740 4 client.5994 mds_command: new command op to 5952 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-26T15:42:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.009+0000 7f7820dd0740 1 -- 172.21.15.8:0/3668838001 --> [v2:172.21.15.8:6832/3351700355,v1:172.21.15.8:6834/3351700355] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644ce6a03c0 con 0x5644cea6c9b0 2024-05-26T15:42:30.010 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.009+0000 7f7816a00640 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.8:6832/3351700355,v1:172.21.15.8:6834/3351700355] conn(0x5644cea6c9b0 0x5644cea6cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.010+0000 7f7816a00640 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.8:6832/3351700355,v1:172.21.15.8:6834/3351700355] conn(0x5644cea6c9b0 0x5644cea6cd90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f45f1d4b4f7fe720 server_cookie=4c1d8efe20b8a418 in_seq=0 out_seq=0 2024-05-26T15:42:30.011 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.010+0000 7f7800c00640 10 client.5994 ms_handle_connect on v2:172.21.15.8:6832/3351700355 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7800c00640 1 -- 172.21.15.8:0/3668838001 <== mds.0 v2:172.21.15.8:6832/3351700355 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5644ce6a03c0 con 0x5644cea6c9b0 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7800c00640 10 client.5994 handle_command_reply: tid=0 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 client.5994 shutdown 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 -- 172.21.15.8:0/3668838001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92300 msgr2=0x5644cea64c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92300 0x5644cea64c20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f78080090b0 tx=0x7f7808004730 comp rx=0 tx=0).stop 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 -- 172.21.15.8:0/3668838001 shutdown_connections 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.8:6832/3351700355,v1:172.21.15.8:6834/3351700355] conn(0x5644cea6c9b0 0x5644cea6cd90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea682d0 0x5644cea68750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 0x5644cea659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 --2- 172.21.15.8:0/3668838001 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92300 0x5644cea64c20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 -- 172.21.15.8:0/3668838001 >> 172.21.15.8:0/3668838001 conn(0x5644cea48ae0 msgr2=0x5644cea43db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7800c00640 0 client.5994 ms_handle_reset on v2:172.21.15.8:6832/3351700355 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 -- 172.21.15.8:0/3668838001 shutdown_connections 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 1 -- 172.21.15.8:0/3668838001 wait complete. 2024-05-26T15:42:30.012 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.011+0000 7f7820dd0740 20 client.5994 trim_cache size 0 max 16384 2024-05-26T15:42:30.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.028+0000 7f7820dd0740 1 Processor -- start 2024-05-26T15:42:30.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.028+0000 7f7820dd0740 1 -- start start 2024-05-26T15:42:30.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea682d0 0x5644cea454d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea92300 0x5644cea44df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 0x5644cea8f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7820dd0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644cea4b260 con 0x5644cea682d0 2024-05-26T15:42:30.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7820dd0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644cea48000 con 0x5644cea92910 2024-05-26T15:42:30.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7820dd0740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644cea4bfd0 con 0x5644cea92300 2024-05-26T15:42:30.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7817400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea682d0 0x5644cea454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7817400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea682d0 0x5644cea454d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51532/0 (socket says 172.21.15.8:51532) 2024-05-26T15:42:30.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7817400640 1 -- 172.21.15.8:0/3205992961 learned_addr learned my addr 172.21.15.8:0/3205992961 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7816a00640 1 --2- 172.21.15.8:0/3205992961 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea92300 0x5644cea44df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7817e00640 1 --2- 172.21.15.8:0/3205992961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 0x5644cea8f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7817400640 1 -- 172.21.15.8:0/3205992961 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea92300 msgr2=0x5644cea44df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:30.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7817400640 1 --2- 172.21.15.8:0/3205992961 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea92300 0x5644cea44df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7817400640 1 -- 172.21.15.8:0/3205992961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 msgr2=0x5644cea8f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7817400640 1 --2- 172.21.15.8:0/3205992961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 0x5644cea8f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.029+0000 7f7817400640 1 -- 172.21.15.8:0/3205992961 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644ce9e0130 con 0x5644cea682d0 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.030+0000 7f7817400640 1 --2- 172.21.15.8:0/3205992961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea682d0 0x5644cea454d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7808032930 tx=0x7f7808048040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f32e337aefcced9 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.030+0000 7f780cc00640 1 -- 172.21.15.8:0/3205992961 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080468d0 con 0x5644cea682d0 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.030+0000 7f780cc00640 1 -- 172.21.15.8:0/3205992961 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808046400 con 0x5644cea682d0 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.030+0000 7f780cc00640 1 -- 172.21.15.8:0/3205992961 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780805e3f0 con 0x5644cea682d0 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.031+0000 7f7820dd0740 1 -- 172.21.15.8:0/3205992961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea682d0 msgr2=0x5644cea454d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.031+0000 7f7820dd0740 1 --2- 172.21.15.8:0/3205992961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea682d0 0x5644cea454d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7808032930 tx=0x7f7808048040 comp rx=0 tx=0).stop 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.031+0000 7f7820dd0740 1 -- 172.21.15.8:0/3205992961 shutdown_connections 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.031+0000 7f7820dd0740 1 --2- 172.21.15.8:0/3205992961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92910 0x5644cea8f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.031+0000 7f7820dd0740 1 --2- 172.21.15.8:0/3205992961 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea92300 0x5644cea44df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.031+0000 7f7820dd0740 1 --2- 172.21.15.8:0/3205992961 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea682d0 0x5644cea454d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.031+0000 7f7820dd0740 1 -- 172.21.15.8:0/3205992961 >> 172.21.15.8:0/3205992961 conn(0x5644cea48ae0 msgr2=0x5644cea404d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.031+0000 7f7820dd0740 1 -- 172.21.15.8:0/3205992961 shutdown_connections 2024-05-26T15:42:30.031 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.031+0000 7f7820dd0740 1 -- 172.21.15.8:0/3205992961 wait complete. 2024-05-26T15:42:30.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.031+0000 7f7820dd0740 1 -- start start 2024-05-26T15:42:30.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.032+0000 7f7820dd0740 1 Processor -- start 2024-05-26T15:42:30.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea682d0 0x5644ceaf0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92300 0x5644ceafcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7820dd0740 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea6ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7820dd0740 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644ceafd190 con 0x5644cea92910 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7820dd0740 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644ceafd5c0 con 0x5644cea92300 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7820dd0740 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644cea97e30 con 0x5644cea682d0 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7820dd0740 10 client.0 _ll_register_callbacks cb 0x5644cea86820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7817e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea6ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7817e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea6ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51546/0 (socket says 172.21.15.8:51546) 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7817e00640 1 -- 172.21.15.8:0/2542942190 learned_addr learned my addr 172.21.15.8:0/2542942190 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7817400640 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea682d0 0x5644ceaf0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7816a00640 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92300 0x5644ceafcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7817e00640 1 -- 172.21.15.8:0/2542942190 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea682d0 msgr2=0x5644ceaf0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7817e00640 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea682d0 0x5644ceaf0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7817e00640 1 -- 172.21.15.8:0/2542942190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92300 msgr2=0x5644ceafcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:30.034 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7817e00640 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92300 0x5644ceafcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.033+0000 7f7817e00640 1 -- 172.21.15.8:0/2542942190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644ce9ab170 con 0x5644cea92910 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7817e00640 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea6ffb0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f781000e9b0 tx=0x7f7810058b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e7b1dec4ff941e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7800c00640 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7800c00640 1 -- 172.21.15.8:0/2542942190 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810084030 con 0x5644cea92910 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7800c00640 1 -- 172.21.15.8:0/2542942190 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f7810085070 con 0x5644cea92910 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7820dd0740 1 -- 172.21.15.8:0/2542942190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f780400fb80 con 0x5644cea92910 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7800c00640 1 -- 172.21.15.8:0/2542942190 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7810055260 con 0x5644cea92910 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7820dd0740 10 client.6000 fetch_fsmap learned FSMap version 38 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7820dd0740 1 -- 172.21.15.8:0/2542942190 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5644ce94d430 con 0x5644cea92910 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7800c00640 1 -- 172.21.15.8:0/2542942190 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780400fb80 con 0x5644cea92910 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7800c00640 1 -- 172.21.15.8:0/2542942190 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 38) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7810058040 con 0x5644cea92910 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7820dd0740 10 client.6000 fetch_fsmap finished waiting for FSMap version 38 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7820dd0740 10 client.6000 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.034+0000 7f7820dd0740 20 client.6000 populate_metadata read hostname 'smithi008' 2024-05-26T15:42:30.035 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.035+0000 7f7820dd0740 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.8:6832/3351700355,v1:172.21.15.8:6834/3351700355] conn(0x5644cea8f9d0 0x5644cea8fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.035+0000 7f7820dd0740 4 client.6000 mds_command: new command op to 5952 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-26T15:42:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.035+0000 7f7820dd0740 1 -- 172.21.15.8:0/2542942190 --> [v2:172.21.15.8:6832/3351700355,v1:172.21.15.8:6834/3351700355] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5644ce6b16c0 con 0x5644cea8f9d0 2024-05-26T15:42:30.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.035+0000 7f7817400640 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.8:6832/3351700355,v1:172.21.15.8:6834/3351700355] conn(0x5644cea8f9d0 0x5644cea8fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.035+0000 7f7817400640 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.8:6832/3351700355,v1:172.21.15.8:6834/3351700355] conn(0x5644cea8f9d0 0x5644cea8fdb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75494f7c6adf700a server_cookie=d3a59b44ec569a88 in_seq=0 out_seq=0 2024-05-26T15:42:30.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.035+0000 7f7800c00640 10 client.6000 ms_handle_connect on v2:172.21.15.8:6832/3351700355 2024-05-26T15:42:30.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7800c00640 1 -- 172.21.15.8:0/2542942190 <== mds.0 v2:172.21.15.8:6832/3351700355 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5644ce6b16c0 con 0x5644cea8f9d0 2024-05-26T15:42:30.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7800c00640 10 client.6000 handle_command_reply: tid=0 2024-05-26T15:42:30.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 client.6000 shutdown 2024-05-26T15:42:30.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 -- 172.21.15.8:0/2542942190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 msgr2=0x5644cea6ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea6ffb0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f781000e9b0 tx=0x7f7810058b50 comp rx=0 tx=0).stop 2024-05-26T15:42:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 -- 172.21.15.8:0/2542942190 shutdown_connections 2024-05-26T15:42:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5644cea92910 0x5644cea6ffb0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x5644cea92300 0x5644ceafcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.8:6832/3351700355,v1:172.21.15.8:6834/3351700355] conn(0x5644cea8f9d0 0x5644cea8fdb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 --2- 172.21.15.8:0/2542942190 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x5644cea682d0 0x5644ceaf0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7800c00640 0 client.6000 ms_handle_reset on v2:172.21.15.8:6832/3351700355 2024-05-26T15:42:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 -- 172.21.15.8:0/2542942190 >> 172.21.15.8:0/2542942190 conn(0x5644cea48ae0 msgr2=0x5644cea65780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 -- 172.21.15.8:0/2542942190 shutdown_connections 2024-05-26T15:42:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 1 -- 172.21.15.8:0/2542942190 wait complete. 2024-05-26T15:42:30.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.036+0000 7f7820dd0740 20 client.6000 trim_cache size 0 max 16384 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "03132396-4584-4cf0-b2e0-b5ae6040045e", 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 5952, 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 4.7725279120000001, 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 38, 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 59, 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 59, 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 4.8182748929999999 2024-05-26T15:42:30.039 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:42:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 -- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77f806ac00 msgr2=0x7f77f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77f806ac00 0x7f77f806d0c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7808034000 tx=0x7f780802e000 comp rx=0 tx=0).stop 2024-05-26T15:42:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 -- 172.21.15.8:0/64383048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180b3330 msgr2=0x7f781814fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180b3330 0x7f781814fa40 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7810007e40 tx=0x7f781000e4b0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 -- 172.21.15.8:0/64383048 shutdown_connections 2024-05-26T15:42:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f78180b3330 0x7f781814fa40 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f77f806ac00 0x7f77f806d0c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f78180b2400 0x7f781814f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 --2- 172.21.15.8:0/64383048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f78180add50 0x7f781815f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 -- 172.21.15.8:0/64383048 >> 172.21.15.8:0/64383048 conn(0x7f7818069ed0 msgr2=0x7f7818161500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 -- 172.21.15.8:0/64383048 shutdown_connections 2024-05-26T15:42:30.041 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.037+0000 7f781ca00640 1 -- 172.21.15.8:0/64383048 wait complete. 2024-05-26T15:42:30.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:30.239 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.241+0000 7fbccbe00640 1 Processor -- start 2024-05-26T15:42:30.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.241+0000 7fbccbe00640 1 -- start start 2024-05-26T15:42:30.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.243+0000 7fbccbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbccc143120 0x7fbccc160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.243+0000 7fbccbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbccc0b1780 0x7fbccc06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.243+0000 7fbccbe00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc06db60 con 0x7fbccc070570 2024-05-26T15:42:30.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.243+0000 7fbccbe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc0ad000 con 0x7fbccc143120 2024-05-26T15:42:30.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.243+0000 7fbccbe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc0b1be0 con 0x7fbccc0b1780 2024-05-26T15:42:30.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.243+0000 7fbccaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbccc143120 0x7fbccc160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.243+0000 7fbccb400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbccc070570 0x7fbccc0ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59544/0 (socket says 172.21.15.8:59544) 2024-05-26T15:42:30.242 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.243+0000 7fbccb400640 1 -- 172.21.15.8:0/902277392 learned_addr learned my addr 172.21.15.8:0/902277392 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:30.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.243+0000 7fbccaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbccc143120 0x7fbccc160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51556/0 (socket says 172.21.15.8:51556) 2024-05-26T15:42:30.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.244+0000 7fbcca000640 1 --2- 172.21.15.8:0/902277392 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbccc0b1780 0x7fbccc06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.244+0000 7fbccaa00640 1 -- 172.21.15.8:0/902277392 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbccc0b1780 msgr2=0x7fbccc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:30.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.244+0000 7fbccaa00640 1 --2- 172.21.15.8:0/902277392 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbccc0b1780 0x7fbccc06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.244+0000 7fbccaa00640 1 -- 172.21.15.8:0/902277392 >> v1:172.21.15.8:6789/0 conn(0x7fbccc070570 legacy=0x7fbccc0ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.243 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.244+0000 7fbccaa00640 1 -- 172.21.15.8:0/902277392 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc143500 con 0x7fbccc143120 2024-05-26T15:42:30.244 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.246+0000 7fbccaa00640 1 --2- 172.21.15.8:0/902277392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 0x7fbccc160710 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097a0 tx=0x7fbcbc02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e03c0adb8b554c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:30.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.246+0000 7fbcc9600640 1 -- 172.21.15.8:0/902277392 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc02ac90 con 0x7fbccc143120 2024-05-26T15:42:30.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.246+0000 7fbcc9600640 1 -- 172.21.15.8:0/902277392 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc02adf0 con 0x7fbccc143120 2024-05-26T15:42:30.245 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.246+0000 7fbcc9600640 1 -- 172.21.15.8:0/902277392 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc032660 con 0x7fbccc143120 2024-05-26T15:42:30.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.247+0000 7fbccbe00640 1 -- 172.21.15.8:0/902277392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 msgr2=0x7fbccc160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.247+0000 7fbccbe00640 1 --2- 172.21.15.8:0/902277392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 0x7fbccc160710 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097a0 tx=0x7fbcbc02a000 comp rx=0 tx=0).stop 2024-05-26T15:42:30.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.247+0000 7fbccbe00640 1 -- 172.21.15.8:0/902277392 shutdown_connections 2024-05-26T15:42:30.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.247+0000 7fbccbe00640 1 --2- 172.21.15.8:0/902277392 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbccc0b1780 0x7fbccc06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.247+0000 7fbccbe00640 1 --2- 172.21.15.8:0/902277392 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 0x7fbccc160710 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.247+0000 7fbccbe00640 1 -- 172.21.15.8:0/902277392 >> 172.21.15.8:0/902277392 conn(0x7fbccc069ed0 msgr2=0x7fbccc06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:30.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.247+0000 7fbccbe00640 1 -- 172.21.15.8:0/902277392 shutdown_connections 2024-05-26T15:42:30.246 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.247+0000 7fbccbe00640 1 -- 172.21.15.8:0/902277392 wait complete. 2024-05-26T15:42:30.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.249+0000 7fbccbe00640 1 Processor -- start 2024-05-26T15:42:30.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.249+0000 7fbccbe00640 1 -- start start 2024-05-26T15:42:30.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.250+0000 7fbccbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbccc070570 0x7fbccc1f7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.251 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.250+0000 7fbccbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc0b1780 0x7fbccc0a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.250+0000 7fbccbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 0x7fbccc0aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.250+0000 7fbccbe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc1f7dc0 con 0x7fbccc143120 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.250+0000 7fbccbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc138770 con 0x7fbccc0b1780 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.250+0000 7fbccbe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc138a50 con 0x7fbccc070570 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbccb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 0x7fbccc0aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbccb400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 0x7fbccc0aa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51558/0 (socket says 172.21.15.8:51558) 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbccb400640 1 -- 172.21.15.8:0/2056907866 learned_addr learned my addr 172.21.15.8:0/2056907866 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbccaa00640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbccc070570 0x7fbccc1f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbcca000640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc0b1780 0x7fbccc0a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbccb400640 1 -- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbccc070570 msgr2=0x7fbccc1f7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbccb400640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbccc070570 0x7fbccc1f7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbccb400640 1 -- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc0b1780 msgr2=0x7fbccc0a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.252 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbccb400640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc0b1780 0x7fbccc0a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbccb400640 1 -- 172.21.15.8:0/2056907866 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc009400 con 0x7fbccc143120 2024-05-26T15:42:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbcca000640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc0b1780 0x7fbccc0a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.251+0000 7fbccb400640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 0x7fbccc0aa3d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400cad0 tx=0x7fbcc400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.252+0000 7fbcc2a00640 1 -- 172.21.15.8:0/2056907866 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400a820 con 0x7fbccc143120 2024-05-26T15:42:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.252+0000 7fbcc2a00640 1 -- 172.21.15.8:0/2056907866 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc400a980 con 0x7fbccc143120 2024-05-26T15:42:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.252+0000 7fbccbe00640 1 -- 172.21.15.8:0/2056907866 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc138d30 con 0x7fbccc143120 2024-05-26T15:42:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.252+0000 7fbcc2a00640 1 -- 172.21.15.8:0/2056907866 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400ad70 con 0x7fbccc143120 2024-05-26T15:42:30.253 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.252+0000 7fbccbe00640 1 -- 172.21.15.8:0/2056907866 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc142600 con 0x7fbccc143120 2024-05-26T15:42:30.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.253+0000 7fbccbe00640 1 -- 172.21.15.8:0/2056907866 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc04e210 con 0x7fbccc143120 2024-05-26T15:42:30.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.254+0000 7fbcc2a00640 1 -- 172.21.15.8:0/2056907866 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbcc40070d0 con 0x7fbccc143120 2024-05-26T15:42:30.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.255+0000 7fbcc2a00640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcac06ac00 0x7fbcac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:30.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.255+0000 7fbcc2a00640 1 -- 172.21.15.8:0/2056907866 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fbcc4088ba0 con 0x7fbccc143120 2024-05-26T15:42:30.254 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.256+0000 7fbccaa00640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcac06ac00 0x7fbcac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:30.255 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.257+0000 7fbccaa00640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcac06ac00 0x7fbcac06d0c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc034000 tx=0x7fbcbc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:30.258 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.260+0000 7fbcc2a00640 1 -- 172.21.15.8:0/2056907866 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbcc4053c70 con 0x7fbccc143120 2024-05-26T15:42:30.264 INFO:tasks.ceph.mds.a.smithi008.stderr:2024-05-26T15:42:30.266+0000 7f6e7fc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-26T15:42:30.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.502+0000 7fbccbe00640 1 -- 172.21.15.8:0/2056907866 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbccc06db30 con 0x7fbccc143120 2024-05-26T15:42:30.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.503+0000 7fbcc2a00640 1 -- 172.21.15.8:0/2056907866 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7fbcc4018070 con 0x7fbccc143120 2024-05-26T15:42:30.501 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:30.501 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:30.502 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:42:30.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 -- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcac06ac00 msgr2=0x7fbcac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcac06ac00 0x7fbcac06d0c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc034000 tx=0x7fbcbc02e000 comp rx=0 tx=0).stop 2024-05-26T15:42:30.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 -- 172.21.15.8:0/2056907866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 msgr2=0x7fbccc0aa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:30.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 0x7fbccc0aa3d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400cad0 tx=0x7fbcc400cf90 comp rx=0 tx=0).stop 2024-05-26T15:42:30.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 -- 172.21.15.8:0/2056907866 shutdown_connections 2024-05-26T15:42:30.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbccc143120 0x7fbccc0aa3d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbcac06ac00 0x7fbcac06d0c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbccc0b1780 0x7fbccc0a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 --2- 172.21.15.8:0/2056907866 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbccc070570 0x7fbccc1f7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:30.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 -- 172.21.15.8:0/2056907866 >> 172.21.15.8:0/2056907866 conn(0x7fbccc069ed0 msgr2=0x7fbccc0ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:30.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 -- 172.21.15.8:0/2056907866 shutdown_connections 2024-05-26T15:42:30.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:30.506+0000 7fbccbe00640 1 -- 172.21.15.8:0/2056907866 wait complete. 2024-05-26T15:42:30.524 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:42:30.751 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":35,"msgr_send_messages":29,"msgr_recv_bytes":112153,"msgr_send_bytes":28216,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.016316761,"msgr_running_send_time":0.002695518,"msgr_running_recv_time":0.013184931,"msgr_running_fast_dispatch_time":0.000608478,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.010883988,"avgtime":0.000375309},"msgr_handle_ack_lat":{"avgcount":5,"sum":0.000003586,"avgtime":0.000000717},"msgr_recv_encrypted_bytes":107424,"msgr_send_encrypted_bytes":5712},"AsyncMessenger::Worker-1":{"msgr_recv_messages":26,"msgr_send_messages":30,"msgr_recv_bytes":14155,"msgr_send_bytes":68945,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.010238425,"msgr_running_send_time":0.003172525,"msgr_running_recv_time":0.005117373,"msgr_running_fast_dispatch_time":0.001347295,"msgr_send_messages_queue_lat":{"avgcount":28,"sum":0.006800691,"avgtime":0.000242881},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":58800},"AsyncMessenger::Worker-2":{"msgr_recv_messages":14,"msgr_send_messages":16,"msgr_recv_bytes":10939,"msgr_send_bytes":5061,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.006263859,"msgr_running_send_time":0.000937214,"msgr_running_recv_time":0.004380222,"msgr_running_fast_dispatch_time":0.000610079,"msgr_send_messages_queue_lat":{"avgcount":15,"sum":0.008699627,"avgtime":0.000579975},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":47,"sum":0.008976213,"avgtime":0.000190983}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":2,"reply":0,"reply_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":7,"inodes_bottom":3,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":1,"traverse_hit":1,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":0},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":2,"evex":0,"evtrm":0,"ev":4,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196381,"rdpos":4195196,"jlat":{"avgcount":2,"sum":0.009030821,"avgtime":0.004515410},"replayed":2},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":1,"cap-":0,"rss":37632,"heap":223584},"mds_server":{"dispatch_client_request":1,"dispatch_server_request":0,"handle_client_request":2,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":0,"average_load":0,"avg_session_uptime":772,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":237493,"buffer_anon_items":71,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":51696,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":46,"op_send_bytes":1469,"op_resend":0,"op_reply":46,"op_latency":{"avgcount":46,"sum":0.093998901,"avgtime":0.002043454},"op_inflight":0,"oplen_avg":{"avgcount":46,"sum":92},"op":46,"op_r":36,"op_w":10,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":2,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":1,"omap_rd":48,"omap_del":0},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":72,"get_sum":128609,"get_or_fail_fail":0,"get_or_fail_success":72,"take":0,"take_sum":0,"put":72,"put_sum":128609,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":2351,"put":46,"put_sum":2351,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":46,"put":46,"put_sum":46,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":2,"get_sum":931,"get_or_fail_fail":0,"get_or_fail_success":2,"take":0,"take_sum":0,"put":2,"put_sum":931,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:42:30.752 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 5, "avgtime": 7.17e-07, "sum": 3.586e-06 }, "msgr_recv_bytes": 112153, "msgr_recv_encrypted_bytes": 107424, "msgr_recv_messages": 35, "msgr_running_fast_dispatch_time": 0.000608478, "msgr_running_recv_time": 0.013184931, "msgr_running_send_time": 0.002695518, "msgr_running_total_time": 0.016316761, "msgr_send_bytes": 28216, "msgr_send_encrypted_bytes": 5712, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.000375309, "sum": 0.010883988 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14155, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 26, "msgr_running_fast_dispatch_time": 0.001347295, "msgr_running_recv_time": 0.005117373, "msgr_running_send_time": 0.003172525, "msgr_running_total_time": 0.010238425, "msgr_send_bytes": 68945, "msgr_send_encrypted_bytes": 58800, "msgr_send_messages": 30, "msgr_send_messages_queue_lat": { "avgcount": 28, "avgtime": 0.000242881, "sum": 0.006800691 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10939, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 14, "msgr_running_fast_dispatch_time": 0.000610079, "msgr_running_recv_time": 0.004380222, "msgr_running_send_time": 0.000937214, "msgr_running_total_time": 0.006263859, "msgr_send_bytes": 5061, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 16, "msgr_send_messages_queue_lat": { "avgcount": 15, "avgtime": 0.000579975, "sum": 0.008699627 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 47, "avgtime": 0.000190983, "sum": 0.008976213 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 3, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 7, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 0, "q": 0, "reply": 0, "reply_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "request": 2, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 1, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 1, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 4, "evadd": 2, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 2, "avgtime": 0.00451541, "sum": 0.009030821 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4196381 }, "mds_mem": { "cap": 1, "cap+": 1, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 223584, "ino": 13, "ino+": 13, "ino-": 0, "rss": 37632 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 1, "dispatch_server_request": 0, "handle_client_request": 2, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 0, "avg_session_uptime": 772, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 0 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 237493, "buffer_anon_items": 71, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 51696, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 0, "omap_rd": 48, "omap_wr": 1, "op": 46, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 46, "avgtime": 0.002043454, "sum": 0.093998901 }, "op_pg": 0, "op_r": 36, "op_reply": 46, "op_resend": 0, "op_rmw": 0, "op_send": 46, "op_send_bytes": 1469, "op_w": 10, "oplen_avg": { "avgcount": 46, "sum": 92 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 72, "get_or_fail_fail": 0, "get_or_fail_success": 72, "get_started": 0, "get_sum": 128609, "max": 104857600, "put": 72, "put_sum": 128609, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 46, "put_sum": 2351, "take": 46, "take_sum": 2351, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 46, "put_sum": 46, "take": 46, "take_sum": 46, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 2, "get_or_fail_fail": 0, "get_or_fail_success": 2, "get_started": 0, "get_sum": 931, "max": 3758096384, "put": 2, "put_sum": 931, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:42:30.752 INFO:tasks.cephfs.test_openfiletable:omap_total_updates_0:0 2024-05-26T15:42:30.752 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:42:30.753 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:42:30.808 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits daemon-helper kill python3 -c ' 2024-05-26T15:42:30.809 DEBUG:teuthology.orchestra.run.smithi008:> import time 2024-05-26T15:42:30.809 DEBUG:teuthology.orchestra.run.smithi008:> 2024-05-26T15:42:30.809 DEBUG:teuthology.orchestra.run.smithi008:> with open("/home/ubuntu/cephtest/mnt.0/omap_counter_test_file", '"'"'w'"'"') as f: 2024-05-26T15:42:30.809 DEBUG:teuthology.orchestra.run.smithi008:> f.write("content") 2024-05-26T15:42:30.809 DEBUG:teuthology.orchestra.run.smithi008:> f.flush() 2024-05-26T15:42:30.809 DEBUG:teuthology.orchestra.run.smithi008:> while True: 2024-05-26T15:42:30.809 DEBUG:teuthology.orchestra.run.smithi008:> time.sleep(1) 2024-05-26T15:42:30.809 DEBUG:teuthology.orchestra.run.smithi008:> ' 2024-05-26T15:42:30.814 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/omap_counter_test_file 2024-05-26T15:42:30.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:42:30.860 INFO:teuthology.orchestra.run.smithi008.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/omap_counter_test_file': No such file or directory 2024-05-26T15:42:31.861 DEBUG:teuthology.orchestra.run.smithi008:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/omap_counter_test_file 2024-05-26T15:42:31.921 INFO:teuthology.orchestra.run.smithi008.stdout:7 2024-05-26T15:42:31.921 INFO:tasks.cephfs.mount:File omap_counter_test_file became visible with size 7 from 0 after 1s 2024-05-26T15:42:31.921 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:32.130 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.132+0000 7f9d6fe00640 1 Processor -- start 2024-05-26T15:42:32.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.132+0000 7f9d6fe00640 1 -- start start 2024-05-26T15:42:32.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.133+0000 7f9d6fe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9d7006e5a0 0x7f9d700cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:32.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.133+0000 7f9d6fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9d7015ad70 0x7f9d7015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:32.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.133+0000 7f9d6fe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d700cb880 con 0x7f9d70143fe0 2024-05-26T15:42:32.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.133+0000 7f9d6fe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d700cc250 con 0x7f9d7006e5a0 2024-05-26T15:42:32.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.133+0000 7f9d6fe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d701443c0 con 0x7f9d7015ad70 2024-05-26T15:42:32.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.134+0000 7f9d6e000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9d7006e5a0 0x7f9d700cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:32.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.134+0000 7f9d6e000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9d7006e5a0 0x7f9d700cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46088/0 (socket says 172.21.15.8:46088) 2024-05-26T15:42:32.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.134+0000 7f9d6e000640 1 -- 172.21.15.8:0/3641927666 learned_addr learned my addr 172.21.15.8:0/3641927666 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:32.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.134+0000 7f9d6f400640 1 --2- 172.21.15.8:0/3641927666 >> v2:172.21.15.47:3300/0 conn(0x7f9d7015ad70 0x7f9d7015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:32.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.134+0000 7f9d6e000640 1 -- 172.21.15.8:0/3641927666 >> v2:172.21.15.47:3300/0 conn(0x7f9d7015ad70 msgr2=0x7f9d7015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:32.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.134+0000 7f9d6e000640 1 --2- 172.21.15.8:0/3641927666 >> v2:172.21.15.47:3300/0 conn(0x7f9d7015ad70 0x7f9d7015b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:32.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.134+0000 7f9d6e000640 1 -- 172.21.15.8:0/3641927666 >> v1:172.21.15.47:6789/0 conn(0x7f9d70143fe0 legacy=0x7f9d7006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:32.133 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.134+0000 7f9d6e000640 1 -- 172.21.15.8:0/3641927666 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7015bb10 con 0x7f9d7006e5a0 2024-05-26T15:42:32.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.135+0000 7f9d6e000640 1 --2- 172.21.15.8:0/3641927666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d7006e5a0 0x7f9d700cbd10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9d7006aeb0 tx=0x7f9d5c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cef525e545590be server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:32.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6d600640 1 -- 172.21.15.8:0/3641927666 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c032440 con 0x7f9d7006e5a0 2024-05-26T15:42:32.134 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6d600640 1 -- 172.21.15.8:0/3641927666 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c0325a0 con 0x7f9d7006e5a0 2024-05-26T15:42:32.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6d600640 1 -- 172.21.15.8:0/3641927666 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c032930 con 0x7f9d7006e5a0 2024-05-26T15:42:32.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6fe00640 1 -- 172.21.15.8:0/3641927666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d7006e5a0 msgr2=0x7f9d700cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:32.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6fe00640 1 --2- 172.21.15.8:0/3641927666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d7006e5a0 0x7f9d700cbd10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9d7006aeb0 tx=0x7f9d5c02a230 comp rx=0 tx=0).stop 2024-05-26T15:42:32.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6fe00640 1 -- 172.21.15.8:0/3641927666 shutdown_connections 2024-05-26T15:42:32.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6fe00640 1 --2- 172.21.15.8:0/3641927666 >> v2:172.21.15.47:3300/0 conn(0x7f9d7015ad70 0x7f9d7015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:32.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6fe00640 1 --2- 172.21.15.8:0/3641927666 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d7006e5a0 0x7f9d700cbd10 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:32.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6fe00640 1 -- 172.21.15.8:0/3641927666 >> 172.21.15.8:0/3641927666 conn(0x7f9d70066370 msgr2=0x7f9d70069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:32.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6fe00640 1 -- 172.21.15.8:0/3641927666 shutdown_connections 2024-05-26T15:42:32.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.136+0000 7f9d6fe00640 1 -- 172.21.15.8:0/3641927666 wait complete. 2024-05-26T15:42:32.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.138+0000 7f9d6fe00640 1 Processor -- start 2024-05-26T15:42:32.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.138+0000 7f9d6fe00640 1 -- start start 2024-05-26T15:42:32.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.139+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7006e5a0 0x7f9d70153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.139+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70143fe0 0x7f9d7015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.139+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d7015ad70 0x7f9d700aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.139+0000 7f9d6fe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7015cc20 con 0x7f9d70143fe0 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.139+0000 7f9d6fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d701543a0 con 0x7f9d7006e5a0 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.139+0000 7f9d6fe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d70155f60 con 0x7f9d7015ad70 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.140+0000 7f9d6e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70143fe0 0x7f9d7015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.140+0000 7f9d6e000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70143fe0 0x7f9d7015d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46104/0 (socket says 172.21.15.8:46104) 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.140+0000 7f9d6e000640 1 -- 172.21.15.8:0/2603006579 learned_addr learned my addr 172.21.15.8:0/2603006579 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.140+0000 7f9d6ea00640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7006e5a0 0x7f9d70153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.140+0000 7f9d6f400640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d7015ad70 0x7f9d700aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.140+0000 7f9d6e000640 1 -- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d7015ad70 msgr2=0x7f9d700aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.140+0000 7f9d6e000640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d7015ad70 0x7f9d700aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.140+0000 7f9d6e000640 1 -- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7006e5a0 msgr2=0x7f9d70153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:32.139 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.140+0000 7f9d6e000640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7006e5a0 0x7f9d70153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:32.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.140+0000 7f9d6e000640 1 -- 172.21.15.8:0/2603006579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0094d0 con 0x7f9d70143fe0 2024-05-26T15:42:32.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.141+0000 7f9d6e000640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70143fe0 0x7f9d7015d8f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c02a270 tx=0x7f9d5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:32.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.141+0000 7f9d66a00640 1 -- 172.21.15.8:0/2603006579 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c030b80 con 0x7f9d70143fe0 2024-05-26T15:42:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.141+0000 7f9d66a00640 1 -- 172.21.15.8:0/2603006579 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c030ce0 con 0x7f9d70143fe0 2024-05-26T15:42:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.141+0000 7f9d66a00640 1 -- 172.21.15.8:0/2603006579 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c03d680 con 0x7f9d70143fe0 2024-05-26T15:42:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.141+0000 7f9d6fe00640 1 -- 172.21.15.8:0/2603006579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7015bd30 con 0x7f9d70143fe0 2024-05-26T15:42:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.141+0000 7f9d6fe00640 1 -- 172.21.15.8:0/2603006579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7015c2f0 con 0x7f9d70143fe0 2024-05-26T15:42:32.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.142+0000 7f9d6fe00640 1 -- 172.21.15.8:0/2603006579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7015cd90 con 0x7f9d70143fe0 2024-05-26T15:42:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.144+0000 7f9d66a00640 1 -- 172.21.15.8:0/2603006579 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9d5c039040 con 0x7f9d70143fe0 2024-05-26T15:42:32.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.144+0000 7f9d66a00640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d5006ac00 0x7f9d5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.145+0000 7f9d66a00640 1 -- 172.21.15.8:0/2603006579 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f9d5c0aa300 con 0x7f9d70143fe0 2024-05-26T15:42:32.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.145+0000 7f9d6ea00640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d5006ac00 0x7f9d5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:32.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.146+0000 7f9d6ea00640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d5006ac00 0x7f9d5006d0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9d60004ea0 tx=0x7f9d60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:32.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.149+0000 7f9d66a00640 1 -- 172.21.15.8:0/2603006579 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9d5c075350 con 0x7f9d70143fe0 2024-05-26T15:42:32.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.391+0000 7f9d6fe00640 1 -- 172.21.15.8:0/2603006579 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d70073fa0 con 0x7f9d70143fe0 2024-05-26T15:42:32.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.392+0000 7f9d66a00640 1 -- 172.21.15.8:0/2603006579 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f9d5c078970 con 0x7f9d70143fe0 2024-05-26T15:42:32.391 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:32.391 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:32.391 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:42:32.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.395+0000 7f9d6fe00640 1 -- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d5006ac00 msgr2=0x7f9d5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:32.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.395+0000 7f9d6fe00640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d5006ac00 0x7f9d5006d0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9d60004ea0 tx=0x7f9d60009040 comp rx=0 tx=0).stop 2024-05-26T15:42:32.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.395+0000 7f9d6fe00640 1 -- 172.21.15.8:0/2603006579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70143fe0 msgr2=0x7f9d7015d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:32.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.395+0000 7f9d6fe00640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70143fe0 0x7f9d7015d8f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c02a270 tx=0x7f9d5c0046c0 comp rx=0 tx=0).stop 2024-05-26T15:42:32.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.396+0000 7f9d6fe00640 1 -- 172.21.15.8:0/2603006579 shutdown_connections 2024-05-26T15:42:32.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.396+0000 7f9d6fe00640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9d7015ad70 0x7f9d700aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:32.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.396+0000 7f9d6fe00640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d70143fe0 0x7f9d7015d8f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:32.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.396+0000 7f9d6fe00640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d5006ac00 0x7f9d5006d0c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:32.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.396+0000 7f9d6fe00640 1 --2- 172.21.15.8:0/2603006579 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d7006e5a0 0x7f9d70153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:32.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.396+0000 7f9d6fe00640 1 -- 172.21.15.8:0/2603006579 >> 172.21.15.8:0/2603006579 conn(0x7f9d70066370 msgr2=0x7f9d700b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:32.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.396+0000 7f9d6fe00640 1 -- 172.21.15.8:0/2603006579 shutdown_connections 2024-05-26T15:42:32.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:32.396+0000 7f9d6fe00640 1 -- 172.21.15.8:0/2603006579 wait complete. 2024-05-26T15:42:32.414 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:42:32.631 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":40,"msgr_send_messages":32,"msgr_recv_bytes":113908,"msgr_send_bytes":30249,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.017555175,"msgr_running_send_time":0.003390608,"msgr_running_recv_time":0.013606405,"msgr_running_fast_dispatch_time":0.000767662,"msgr_send_messages_queue_lat":{"avgcount":32,"sum":0.011078675,"avgtime":0.000346208},"msgr_handle_ack_lat":{"avgcount":7,"sum":0.000005490,"avgtime":0.000000784},"msgr_recv_encrypted_bytes":107696,"msgr_send_encrypted_bytes":6304},"AsyncMessenger::Worker-1":{"msgr_recv_messages":27,"msgr_send_messages":31,"msgr_recv_bytes":14401,"msgr_send_bytes":71045,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.010428265,"msgr_running_send_time":0.003229364,"msgr_running_recv_time":0.005167826,"msgr_running_fast_dispatch_time":0.001416051,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.006845333,"avgtime":0.000236045},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":58800},"AsyncMessenger::Worker-2":{"msgr_recv_messages":14,"msgr_send_messages":16,"msgr_recv_bytes":10939,"msgr_send_bytes":5061,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.006263859,"msgr_running_send_time":0.000937214,"msgr_running_recv_time":0.004380222,"msgr_running_fast_dispatch_time":0.000610079,"msgr_send_messages_queue_lat":{"avgcount":15,"sum":0.008699627,"avgtime":0.000579975},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":49,"sum":0.009245741,"avgtime":0.000188688}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":3,"evex":0,"evtrm":0,"ev":5,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4198170,"rdpos":4195196,"jlat":{"avgcount":3,"sum":0.012523264,"avgtime":0.004174421},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":38144,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":772,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":237493,"buffer_anon_items":71,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":51696,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":47,"op_send_bytes":3258,"op_resend":0,"op_reply":47,"op_latency":{"avgcount":47,"sum":0.096998866,"avgtime":0.002063805},"op_inflight":0,"oplen_avg":{"avgcount":47,"sum":93},"op":47,"op_r":36,"op_w":11,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":3,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":1,"omap_rd":48,"omap_del":0},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":78,"get_sum":130082,"get_or_fail_fail":0,"get_or_fail_success":78,"take":0,"take_sum":0,"put":78,"put_sum":130082,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":47,"take_sum":4140,"put":47,"put_sum":4140,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":47,"take_sum":47,"put":47,"put_sum":47,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":3,"get_sum":2720,"get_or_fail_fail":0,"get_or_fail_success":3,"take":0,"take_sum":0,"put":3,"put_sum":2720,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:42:32.633 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 7, "avgtime": 7.84e-07, "sum": 5.49e-06 }, "msgr_recv_bytes": 113908, "msgr_recv_encrypted_bytes": 107696, "msgr_recv_messages": 40, "msgr_running_fast_dispatch_time": 0.000767662, "msgr_running_recv_time": 0.013606405, "msgr_running_send_time": 0.003390608, "msgr_running_total_time": 0.017555175, "msgr_send_bytes": 30249, "msgr_send_encrypted_bytes": 6304, "msgr_send_messages": 32, "msgr_send_messages_queue_lat": { "avgcount": 32, "avgtime": 0.000346208, "sum": 0.011078675 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14401, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 27, "msgr_running_fast_dispatch_time": 0.001416051, "msgr_running_recv_time": 0.005167826, "msgr_running_send_time": 0.003229364, "msgr_running_total_time": 0.010428265, "msgr_send_bytes": 71045, "msgr_send_encrypted_bytes": 58800, "msgr_send_messages": 31, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.000236045, "sum": 0.006845333 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 10939, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 14, "msgr_running_fast_dispatch_time": 0.000610079, "msgr_running_recv_time": 0.004380222, "msgr_running_send_time": 0.000937214, "msgr_running_total_time": 0.006263859, "msgr_send_bytes": 5061, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 16, "msgr_send_messages_queue_lat": { "avgcount": 15, "avgtime": 0.000579975, "sum": 0.008699627 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 49, "avgtime": 0.000188688, "sum": 0.009245741 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 5, "evadd": 3, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 3, "avgtime": 0.004174421, "sum": 0.012523264 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4198170 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 38144 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 772, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 237493, "buffer_anon_items": 71, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 51696, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 0, "omap_rd": 48, "omap_wr": 1, "op": 47, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 47, "avgtime": 0.002063805, "sum": 0.096998866 }, "op_pg": 0, "op_r": 36, "op_reply": 47, "op_resend": 0, "op_rmw": 0, "op_send": 47, "op_send_bytes": 3258, "op_w": 11, "oplen_avg": { "avgcount": 47, "sum": 93 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 78, "get_or_fail_fail": 0, "get_or_fail_success": 78, "get_started": 0, "get_sum": 130082, "max": 104857600, "put": 78, "put_sum": 130082, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 47, "put_sum": 4140, "take": 47, "take_sum": 4140, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 47, "put_sum": 47, "take": 47, "take_sum": 47, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 3, "get_or_fail_fail": 0, "get_or_fail_success": 3, "get_started": 0, "get_sum": 2720, "max": 3758096384, "put": 3, "put_sum": 2720, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:42:32.633 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2024-05-26T15:42:37.634 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:37.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.856+0000 7f925e200640 1 Processor -- start 2024-05-26T15:42:37.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.856+0000 7f925e200640 1 -- start start 2024-05-26T15:42:37.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.858+0000 7f925e200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9258144180 0x7f92580cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:37.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.858+0000 7f925e200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f925806db60 0x7f925806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:37.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.858+0000 7f925e200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9258144560 con 0x7f9258070570 2024-05-26T15:42:37.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.858+0000 7f925e200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925815b190 con 0x7f9258144180 2024-05-26T15:42:37.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.858+0000 7f925e200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925815b470 con 0x7f925806db60 2024-05-26T15:42:37.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.859+0000 7f925ce00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9258144180 0x7f92580cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:37.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.859+0000 7f925ce00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9258144180 0x7f92580cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46106/0 (socket says 172.21.15.8:46106) 2024-05-26T15:42:37.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.859+0000 7f925ce00640 1 -- 172.21.15.8:0/1359951658 learned_addr learned my addr 172.21.15.8:0/1359951658 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:37.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.859+0000 7f9257e00640 1 --2- 172.21.15.8:0/1359951658 >> v2:172.21.15.47:3300/0 conn(0x7f925806db60 0x7f925806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:37.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.859+0000 7f925ce00640 1 -- 172.21.15.8:0/1359951658 >> v2:172.21.15.47:3300/0 conn(0x7f925806db60 msgr2=0x7f925806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:37.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.859+0000 7f925ce00640 1 --2- 172.21.15.8:0/1359951658 >> v2:172.21.15.47:3300/0 conn(0x7f925806db60 0x7f925806dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:37.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.859+0000 7f925ce00640 1 -- 172.21.15.8:0/1359951658 >> v1:172.21.15.8:6789/0 conn(0x7f9258070570 legacy=0x7f925806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:37.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.860+0000 7f925ce00640 1 -- 172.21.15.8:0/1359951658 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925815b750 con 0x7f9258144180 2024-05-26T15:42:37.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.861+0000 7f925ce00640 1 --2- 172.21.15.8:0/1359951658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 0x7f92580cb160 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f925806abd0 tx=0x7f924802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef1409805cc2dfb server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:37.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.861+0000 7f9257400640 1 -- 172.21.15.8:0/1359951658 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248031600 con 0x7f9258144180 2024-05-26T15:42:37.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.861+0000 7f9257400640 1 -- 172.21.15.8:0/1359951658 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924802d050 con 0x7f9258144180 2024-05-26T15:42:37.860 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.861+0000 7f9257400640 1 -- 172.21.15.8:0/1359951658 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248031980 con 0x7f9258144180 2024-05-26T15:42:37.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.862+0000 7f925e200640 1 -- 172.21.15.8:0/1359951658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 msgr2=0x7f92580cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:37.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.862+0000 7f925e200640 1 --2- 172.21.15.8:0/1359951658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 0x7f92580cb160 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f925806abd0 tx=0x7f924802a6a0 comp rx=0 tx=0).stop 2024-05-26T15:42:37.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.862+0000 7f925e200640 1 -- 172.21.15.8:0/1359951658 shutdown_connections 2024-05-26T15:42:37.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.862+0000 7f925e200640 1 --2- 172.21.15.8:0/1359951658 >> v2:172.21.15.47:3300/0 conn(0x7f925806db60 0x7f925806dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:37.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.862+0000 7f925e200640 1 --2- 172.21.15.8:0/1359951658 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 0x7f92580cb160 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:37.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.862+0000 7f925e200640 1 -- 172.21.15.8:0/1359951658 >> 172.21.15.8:0/1359951658 conn(0x7f9258069ed0 msgr2=0x7f925806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:37.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.862+0000 7f925e200640 1 -- 172.21.15.8:0/1359951658 shutdown_connections 2024-05-26T15:42:37.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.862+0000 7f925e200640 1 -- 172.21.15.8:0/1359951658 wait complete. 2024-05-26T15:42:37.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.864+0000 7f925e200640 1 Processor -- start 2024-05-26T15:42:37.863 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.864+0000 7f925e200640 1 -- start start 2024-05-26T15:42:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.865+0000 7f925e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f925806db60 0x7f9258136e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.865+0000 7f925e200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9258070570 0x7f9258137370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.865+0000 7f925e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 0x7f92580b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.865+0000 7f925e200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9258155730 con 0x7f9258144180 2024-05-26T15:42:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.865+0000 7f925e200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9258131150 con 0x7f925806db60 2024-05-26T15:42:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.865+0000 7f925e200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92580b3310 con 0x7f9258070570 2024-05-26T15:42:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f925d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 0x7f92580b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:37.865 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f925d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 0x7f92580b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46108/0 (socket says 172.21.15.8:46108) 2024-05-26T15:42:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f925d800640 1 -- 172.21.15.8:0/288375119 learned_addr learned my addr 172.21.15.8:0/288375119 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f925ce00640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f925806db60 0x7f9258136e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f9257e00640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9258070570 0x7f9258137370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f925d800640 1 -- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9258070570 msgr2=0x7f9258137370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f925d800640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9258070570 0x7f9258137370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f925d800640 1 -- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f925806db60 msgr2=0x7f9258136e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f925d800640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f925806db60 0x7f9258136e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f925d800640 1 -- 172.21.15.8:0/288375119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9248009b30 con 0x7f9258144180 2024-05-26T15:42:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.866+0000 7f9257e00640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9258070570 0x7f9258137370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:37.866 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.867+0000 7f925d800640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 0x7f92580b1b10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9250001eb0 tx=0x7f925000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.867+0000 7f9254c00640 1 -- 172.21.15.8:0/288375119 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500052d0 con 0x7f9258144180 2024-05-26T15:42:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.867+0000 7f9254c00640 1 -- 172.21.15.8:0/288375119 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250005430 con 0x7f9258144180 2024-05-26T15:42:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.867+0000 7f925e200640 1 -- 172.21.15.8:0/288375119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925815af60 con 0x7f9258144180 2024-05-26T15:42:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.867+0000 7f9254c00640 1 -- 172.21.15.8:0/288375119 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250003810 con 0x7f9258144180 2024-05-26T15:42:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.867+0000 7f925e200640 1 -- 172.21.15.8:0/288375119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92580b2d50 con 0x7f9258144180 2024-05-26T15:42:37.867 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.868+0000 7f925e200640 1 -- 172.21.15.8:0/288375119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92580668d0 con 0x7f9258144180 2024-05-26T15:42:37.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.869+0000 7f9254c00640 1 -- 172.21.15.8:0/288375119 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9250003970 con 0x7f9258144180 2024-05-26T15:42:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.871+0000 7f9254c00640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f923406ac30 0x7f923406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:37.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.871+0000 7f9254c00640 1 -- 172.21.15.8:0/288375119 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f9250088ad0 con 0x7f9258144180 2024-05-26T15:42:37.870 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.872+0000 7f925ce00640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f923406ac30 0x7f923406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:37.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.873+0000 7f925ce00640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f923406ac30 0x7f923406d0f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9248033000 tx=0x7f9248009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:37.874 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:37.876+0000 7f9254c00640 1 -- 172.21.15.8:0/288375119 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9250053a70 con 0x7f9258144180 2024-05-26T15:42:38.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.119+0000 7f925e200640 1 -- 172.21.15.8:0/288375119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f925804e210 con 0x7f9258144180 2024-05-26T15:42:38.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.120+0000 7f9254c00640 1 -- 172.21.15.8:0/288375119 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f9250017090 con 0x7f9258144180 2024-05-26T15:42:38.119 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:38.119 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:38.119 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:42:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.122+0000 7f925e200640 1 -- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f923406ac30 msgr2=0x7f923406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.122+0000 7f925e200640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f923406ac30 0x7f923406d0f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9248033000 tx=0x7f9248009000 comp rx=0 tx=0).stop 2024-05-26T15:42:38.121 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.122+0000 7f925e200640 1 -- 172.21.15.8:0/288375119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 msgr2=0x7f92580b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.122+0000 7f925e200640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 0x7f92580b1b10 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f9250001eb0 tx=0x7f925000c890 comp rx=0 tx=0).stop 2024-05-26T15:42:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.123+0000 7f925e200640 1 -- 172.21.15.8:0/288375119 shutdown_connections 2024-05-26T15:42:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.123+0000 7f925e200640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9258144180 0x7f92580b1b10 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.123+0000 7f925e200640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9258070570 0x7f9258137370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.122 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.123+0000 7f925e200640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f923406ac30 0x7f923406d0f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.123+0000 7f925e200640 1 --2- 172.21.15.8:0/288375119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f925806db60 0x7f9258136e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.123+0000 7f925e200640 1 -- 172.21.15.8:0/288375119 >> 172.21.15.8:0/288375119 conn(0x7f9258069ed0 msgr2=0x7f925806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.123+0000 7f925e200640 1 -- 172.21.15.8:0/288375119 shutdown_connections 2024-05-26T15:42:38.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.123+0000 7f925e200640 1 -- 172.21.15.8:0/288375119 wait complete. 2024-05-26T15:42:38.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:42:38.369 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":48,"msgr_send_messages":34,"msgr_recv_bytes":116934,"msgr_send_bytes":31176,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.020243843,"msgr_running_send_time":0.004785588,"msgr_running_recv_time":0.014238834,"msgr_running_fast_dispatch_time":0.001331121,"msgr_send_messages_queue_lat":{"avgcount":34,"sum":0.011248466,"avgtime":0.000330837},"msgr_handle_ack_lat":{"avgcount":8,"sum":0.000006420,"avgtime":0.000000802},"msgr_recv_encrypted_bytes":107968,"msgr_send_encrypted_bytes":6896},"AsyncMessenger::Worker-1":{"msgr_recv_messages":28,"msgr_send_messages":33,"msgr_recv_bytes":14647,"msgr_send_bytes":74918,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.010804142,"msgr_running_send_time":0.003437228,"msgr_running_recv_time":0.005224289,"msgr_running_fast_dispatch_time":0.001475737,"msgr_send_messages_queue_lat":{"avgcount":31,"sum":0.007053951,"avgtime":0.000227546},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":60576},"AsyncMessenger::Worker-2":{"msgr_recv_messages":18,"msgr_send_messages":20,"msgr_recv_bytes":12233,"msgr_send_bytes":7123,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.007165708,"msgr_running_send_time":0.001434608,"msgr_running_recv_time":0.004552746,"msgr_running_fast_dispatch_time":0.000801788,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.009153694,"avgtime":0.000481773},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":53,"sum":0.009806223,"avgtime":0.000185023}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199956,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.017303902,"avgtime":0.004325975},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":38528,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":777,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":238061,"buffer_anon_items":75,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55160,"mds_co_items":248,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5580,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.120998586,"avgtime":0.002326895},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":91,"get_sum":133538,"get_or_fail_fail":0,"get_or_fail_success":91,"take":0,"take_sum":0,"put":91,"put_sum":133538,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6462,"put":52,"put_sum":6462,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4506,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4506,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:42:38.370 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 8, "avgtime": 8.02e-07, "sum": 6.42e-06 }, "msgr_recv_bytes": 116934, "msgr_recv_encrypted_bytes": 107968, "msgr_recv_messages": 48, "msgr_running_fast_dispatch_time": 0.001331121, "msgr_running_recv_time": 0.014238834, "msgr_running_send_time": 0.004785588, "msgr_running_total_time": 0.020243843, "msgr_send_bytes": 31176, "msgr_send_encrypted_bytes": 6896, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 34, "avgtime": 0.000330837, "sum": 0.011248466 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14647, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.001475737, "msgr_running_recv_time": 0.005224289, "msgr_running_send_time": 0.003437228, "msgr_running_total_time": 0.010804142, "msgr_send_bytes": 74918, "msgr_send_encrypted_bytes": 60576, "msgr_send_messages": 33, "msgr_send_messages_queue_lat": { "avgcount": 31, "avgtime": 0.000227546, "sum": 0.007053951 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 12233, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 18, "msgr_running_fast_dispatch_time": 0.000801788, "msgr_running_recv_time": 0.004552746, "msgr_running_send_time": 0.001434608, "msgr_running_total_time": 0.007165708, "msgr_send_bytes": 7123, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000481773, "sum": 0.009153694 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 53, "avgtime": 0.000185023, "sum": 0.009806223 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.004325975, "sum": 0.017303902 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199956 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 38528 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 777, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 238061, "buffer_anon_items": 75, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 55160, "mds_co_items": 248, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002326895, "sum": 0.120998586 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5580, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 91, "get_or_fail_fail": 0, "get_or_fail_success": 91, "get_started": 0, "get_sum": 133538, "max": 104857600, "put": 91, "put_sum": 133538, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6462, "take": 52, "take_sum": 6462, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4506, "max": 3758096384, "put": 4, "put_sum": 4506, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:42:38.371 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-05-26T15:42:38.371 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:38.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.583+0000 7fc123200640 1 Processor -- start 2024-05-26T15:42:38.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.583+0000 7fc123200640 1 -- start start 2024-05-26T15:42:38.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.584+0000 7fc123200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc124143120 0x7fc124160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:38.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.584+0000 7fc123200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc1240b1780 0x7fc12406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:38.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.584+0000 7fc123200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc124070570 0x7fc124070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:38.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc123200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc124070f40 con 0x7fc1240b1780 2024-05-26T15:42:38.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc123200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12406db60 con 0x7fc124070570 2024-05-26T15:42:38.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc123200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240ad000 con 0x7fc124143120 2024-05-26T15:42:38.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc11be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc1240b1780 0x7fc12406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:38.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc11be00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc1240b1780 0x7fc12406d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46116/0 (socket says 172.21.15.8:46116) 2024-05-26T15:42:38.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc11be00640 1 -- 172.21.15.8:0/3426134567 learned_addr learned my addr 172.21.15.8:0/3426134567 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc122800640 1 --2- 172.21.15.8:0/3426134567 >> v2:172.21.15.47:3300/0 conn(0x7fc124070570 0x7fc124070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc121e00640 1 --2- 172.21.15.8:0/3426134567 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc124143120 0x7fc124160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc11be00640 1 -- 172.21.15.8:0/3426134567 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc124143120 msgr2=0x7fc124160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc11be00640 1 --2- 172.21.15.8:0/3426134567 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc124143120 0x7fc124160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc11be00640 1 -- 172.21.15.8:0/3426134567 >> v2:172.21.15.47:3300/0 conn(0x7fc124070570 msgr2=0x7fc124070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc11be00640 1 --2- 172.21.15.8:0/3426134567 >> v2:172.21.15.47:3300/0 conn(0x7fc124070570 0x7fc124070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc11be00640 1 -- 172.21.15.8:0/3426134567 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1240b1be0 con 0x7fc1240b1780 2024-05-26T15:42:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.585+0000 7fc122800640 1 --2- 172.21.15.8:0/3426134567 >> v2:172.21.15.47:3300/0 conn(0x7fc124070570 0x7fc124070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:38.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.587+0000 7fc11be00640 1 --2- 172.21.15.8:0/3426134567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 0x7fc12406d620 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc1240ae3a0 tx=0x7fc10c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3271dd80d979184 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:38.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.587+0000 7fc121400640 1 -- 172.21.15.8:0/3426134567 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c02ae90 con 0x7fc1240b1780 2024-05-26T15:42:38.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.587+0000 7fc121400640 1 -- 172.21.15.8:0/3426134567 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c032440 con 0x7fc1240b1780 2024-05-26T15:42:38.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.587+0000 7fc121400640 1 -- 172.21.15.8:0/3426134567 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c0327d0 con 0x7fc1240b1780 2024-05-26T15:42:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.588+0000 7fc123200640 1 -- 172.21.15.8:0/3426134567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 msgr2=0x7fc12406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.588+0000 7fc123200640 1 --2- 172.21.15.8:0/3426134567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 0x7fc12406d620 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc1240ae3a0 tx=0x7fc10c02a140 comp rx=0 tx=0).stop 2024-05-26T15:42:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.588+0000 7fc123200640 1 -- 172.21.15.8:0/3426134567 shutdown_connections 2024-05-26T15:42:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.588+0000 7fc123200640 1 --2- 172.21.15.8:0/3426134567 >> v2:172.21.15.47:3300/0 conn(0x7fc124070570 0x7fc124070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.588+0000 7fc123200640 1 --2- 172.21.15.8:0/3426134567 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 0x7fc12406d620 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.588+0000 7fc123200640 1 --2- 172.21.15.8:0/3426134567 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc124143120 0x7fc124160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.588+0000 7fc123200640 1 -- 172.21.15.8:0/3426134567 >> 172.21.15.8:0/3426134567 conn(0x7fc124069ed0 msgr2=0x7fc12406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.588+0000 7fc123200640 1 -- 172.21.15.8:0/3426134567 shutdown_connections 2024-05-26T15:42:38.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.588+0000 7fc123200640 1 -- 172.21.15.8:0/3426134567 wait complete. 2024-05-26T15:42:38.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.590+0000 7fc123200640 1 Processor -- start 2024-05-26T15:42:38.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.590+0000 7fc123200640 1 -- start start 2024-05-26T15:42:38.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.591+0000 7fc123200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc124070570 0x7fc1241f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:38.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.591+0000 7fc123200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 0x7fc1240c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:38.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.591+0000 7fc123200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc124143120 0x7fc1240c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.591+0000 7fc123200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12415f0a0 con 0x7fc1240b1780 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.591+0000 7fc123200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12415f380 con 0x7fc124070570 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.591+0000 7fc123200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12415f660 con 0x7fc124143120 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.591+0000 7fc11be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 0x7fc1240c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.591+0000 7fc11be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 0x7fc1240c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46130/0 (socket says 172.21.15.8:46130) 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.591+0000 7fc11be00640 1 -- 172.21.15.8:0/4016578287 learned_addr learned my addr 172.21.15.8:0/4016578287 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.591+0000 7fc121e00640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc124070570 0x7fc1241f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc11be00640 1 -- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc124143120 msgr2=0x7fc1240c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc122800640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc124143120 0x7fc1240c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc11be00640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc124143120 0x7fc1240c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc11be00640 1 -- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc124070570 msgr2=0x7fc1241f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:38.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc11be00640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc124070570 0x7fc1241f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc11be00640 1 -- 172.21.15.8:0/4016578287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c0094d0 con 0x7fc1240b1780 2024-05-26T15:42:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc121e00640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc124070570 0x7fc1241f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc11be00640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 0x7fc1240c5ef0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc10c000c00 tx=0x7fc10c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc11a000640 1 -- 172.21.15.8:0/4016578287 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c030950 con 0x7fc1240b1780 2024-05-26T15:42:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc11a000640 1 -- 172.21.15.8:0/4016578287 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c030ab0 con 0x7fc1240b1780 2024-05-26T15:42:38.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc11a000640 1 -- 172.21.15.8:0/4016578287 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c030e60 con 0x7fc1240b1780 2024-05-26T15:42:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.592+0000 7fc123200640 1 -- 172.21.15.8:0/4016578287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12415f940 con 0x7fc1240b1780 2024-05-26T15:42:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.593+0000 7fc123200640 1 -- 172.21.15.8:0/4016578287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12415e500 con 0x7fc1240b1780 2024-05-26T15:42:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.594+0000 7fc123200640 1 -- 172.21.15.8:0/4016578287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12404e210 con 0x7fc1240b1780 2024-05-26T15:42:38.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.595+0000 7fc11a000640 1 -- 172.21.15.8:0/4016578287 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc10c039040 con 0x7fc1240b1780 2024-05-26T15:42:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.596+0000 7fc11a000640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc10006ac00 0x7fc10006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:38.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.596+0000 7fc11a000640 1 -- 172.21.15.8:0/4016578287 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fc10c0a9ec0 con 0x7fc1240b1780 2024-05-26T15:42:38.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.596+0000 7fc121e00640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc10006ac00 0x7fc10006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:38.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.597+0000 7fc121e00640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc10006ac00 0x7fc10006d0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc11400b820 tx=0x7fc114008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:38.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.600+0000 7fc11a000640 1 -- 172.21.15.8:0/4016578287 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc10c074e60 con 0x7fc1240b1780 2024-05-26T15:42:38.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.837+0000 7fc123200640 1 -- 172.21.15.8:0/4016578287 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc124160a80 con 0x7fc1240b1780 2024-05-26T15:42:38.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.838+0000 7fc11a000640 1 -- 172.21.15.8:0/4016578287 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7fc10c037090 con 0x7fc1240b1780 2024-05-26T15:42:38.837 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:38.837 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:38.837 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:42:38.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 -- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc10006ac00 msgr2=0x7fc10006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:38.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc10006ac00 0x7fc10006d0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc11400b820 tx=0x7fc114008040 comp rx=0 tx=0).stop 2024-05-26T15:42:38.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 -- 172.21.15.8:0/4016578287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 msgr2=0x7fc1240c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:38.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 0x7fc1240c5ef0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc10c000c00 tx=0x7fc10c0046c0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 -- 172.21.15.8:0/4016578287 shutdown_connections 2024-05-26T15:42:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc124143120 0x7fc1240c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1240b1780 0x7fc1240c5ef0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc10006ac00 0x7fc10006d0c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 --2- 172.21.15.8:0/4016578287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc124070570 0x7fc1241f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 -- 172.21.15.8:0/4016578287 >> 172.21.15.8:0/4016578287 conn(0x7fc124069ed0 msgr2=0x7fc1240b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 -- 172.21.15.8:0/4016578287 shutdown_connections 2024-05-26T15:42:38.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:38.841+0000 7fc123200640 1 -- 172.21.15.8:0/4016578287 wait complete. 2024-05-26T15:42:38.862 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:42:39.086 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":49,"msgr_send_messages":34,"msgr_recv_bytes":117336,"msgr_send_bytes":31176,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.020420514,"msgr_running_send_time":0.004858994,"msgr_running_recv_time":0.014283032,"msgr_running_fast_dispatch_time":0.001386441,"msgr_send_messages_queue_lat":{"avgcount":34,"sum":0.011248466,"avgtime":0.000330837},"msgr_handle_ack_lat":{"avgcount":8,"sum":0.000006420,"avgtime":0.000000802},"msgr_recv_encrypted_bytes":107968,"msgr_send_encrypted_bytes":6896},"AsyncMessenger::Worker-1":{"msgr_recv_messages":28,"msgr_send_messages":33,"msgr_recv_bytes":14647,"msgr_send_bytes":74918,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.010804142,"msgr_running_send_time":0.003437228,"msgr_running_recv_time":0.005224289,"msgr_running_fast_dispatch_time":0.001475737,"msgr_send_messages_queue_lat":{"avgcount":31,"sum":0.007053951,"avgtime":0.000227546},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":60576},"AsyncMessenger::Worker-2":{"msgr_recv_messages":18,"msgr_send_messages":20,"msgr_recv_bytes":12233,"msgr_send_bytes":7123,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.007165708,"msgr_running_send_time":0.001434608,"msgr_running_recv_time":0.004552746,"msgr_running_fast_dispatch_time":0.000801788,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.009153694,"avgtime":0.000481773},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":53,"sum":0.009806223,"avgtime":0.000185023}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199956,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.017303902,"avgtime":0.004325975},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":38528,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":777,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":238061,"buffer_anon_items":75,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55160,"mds_co_items":248,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5580,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.120998586,"avgtime":0.002326895},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":92,"get_sum":133866,"get_or_fail_fail":0,"get_or_fail_success":92,"take":0,"take_sum":0,"put":92,"put_sum":133866,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6462,"put":52,"put_sum":6462,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4506,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4506,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:42:39.088 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 8, "avgtime": 8.02e-07, "sum": 6.42e-06 }, "msgr_recv_bytes": 117336, "msgr_recv_encrypted_bytes": 107968, "msgr_recv_messages": 49, "msgr_running_fast_dispatch_time": 0.001386441, "msgr_running_recv_time": 0.014283032, "msgr_running_send_time": 0.004858994, "msgr_running_total_time": 0.020420514, "msgr_send_bytes": 31176, "msgr_send_encrypted_bytes": 6896, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 34, "avgtime": 0.000330837, "sum": 0.011248466 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14647, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.001475737, "msgr_running_recv_time": 0.005224289, "msgr_running_send_time": 0.003437228, "msgr_running_total_time": 0.010804142, "msgr_send_bytes": 74918, "msgr_send_encrypted_bytes": 60576, "msgr_send_messages": 33, "msgr_send_messages_queue_lat": { "avgcount": 31, "avgtime": 0.000227546, "sum": 0.007053951 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 12233, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 18, "msgr_running_fast_dispatch_time": 0.000801788, "msgr_running_recv_time": 0.004552746, "msgr_running_send_time": 0.001434608, "msgr_running_total_time": 0.007165708, "msgr_send_bytes": 7123, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000481773, "sum": 0.009153694 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 53, "avgtime": 0.000185023, "sum": 0.009806223 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.004325975, "sum": 0.017303902 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199956 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 38528 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 777, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 238061, "buffer_anon_items": 75, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 55160, "mds_co_items": 248, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002326895, "sum": 0.120998586 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5580, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 92, "get_or_fail_fail": 0, "get_or_fail_success": 92, "get_started": 0, "get_sum": 133866, "max": 104857600, "put": 92, "put_sum": 133866, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6462, "take": 52, "take_sum": 6462, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4506, "max": 3758096384, "put": 4, "put_sum": 4506, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:42:39.088 INFO:tasks.cephfs.test_openfiletable:omap_total_updates_1:2 2024-05-26T15:42:39.109 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.367+0000 7f8788c00640 1 Processor -- start 2024-05-26T15:42:39.366 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.367+0000 7f8788c00640 1 -- start start 2024-05-26T15:42:39.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.369+0000 7f8788c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87840ad4e0 0x7f878406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:39.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.369+0000 7f8788c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87840aca90 con 0x7f8784158380 2024-05-26T15:42:39.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.369+0000 7f8788c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8784158760 con 0x7f87840ad970 2024-05-26T15:42:39.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.369+0000 7f8788c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87840ae340 con 0x7f87840ad4e0 2024-05-26T15:42:39.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.370+0000 7f8783400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f8784158380 0x7f878415b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:51382/0 (socket says 172.21.15.8:51382) 2024-05-26T15:42:39.368 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.370+0000 7f8783400640 1 -- 172.21.15.8:0/2863807134 learned_addr learned my addr 172.21.15.8:0/2863807134 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.370+0000 7f877be00640 1 --2- 172.21.15.8:0/2863807134 >> v2:172.21.15.47:3300/0 conn(0x7f87840ad4e0 0x7f878406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.370+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782393714 0 0) 0x7f87840aca90 con 0x7f8784158380 2024-05-26T15:42:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.370+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8768003520 con 0x7f8784158380 2024-05-26T15:42:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.370+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1612169356 0 0) 0x7f8768003520 con 0x7f8784158380 2024-05-26T15:42:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 >> v2:172.21.15.47:3300/0 conn(0x7f87840ad4e0 msgr2=0x7f878406d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 --2- 172.21.15.8:0/2863807134 >> v2:172.21.15.47:3300/0 conn(0x7f87840ad4e0 0x7f878406d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 >> v1:172.21.15.47:6789/0 conn(0x7f87840ad970 legacy=0x7f8784069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87840ae620 con 0x7f8784158380 2024-05-26T15:42:39.370 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f8774001670 con 0x7f8784158380 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 >> v1:172.21.15.8:6789/0 conn(0x7f8784158380 legacy=0x7f878415b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 --2- 172.21.15.8:0/2863807134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8768003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 --2- 172.21.15.8:0/2863807134 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f87680047c0 0x7f8768004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 --2- 172.21.15.8:0/2863807134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8768005180 0x7f876800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87840ae340 con 0x7f8768003970 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876800c120 con 0x7f8768005180 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876800c2e0 con 0x7f87680047c0 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8783400640 1 --2- 172.21.15.8:0/2863807134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8768003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8783400640 1 -- 172.21.15.8:0/2863807134 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f87680047c0 msgr2=0x7f8768004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8783400640 1 --2- 172.21.15.8:0/2863807134 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f87680047c0 0x7f8768004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8783400640 1 -- 172.21.15.8:0/2863807134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8768005180 msgr2=0x7f876800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.371+0000 7f8783400640 1 --2- 172.21.15.8:0/2863807134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8768005180 0x7f876800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.372+0000 7f8783400640 1 -- 172.21.15.8:0/2863807134 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8768003520 con 0x7f8768003970 2024-05-26T15:42:39.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.372+0000 7f8783e00640 1 -- 172.21.15.8:0/2863807134 reap_dead start 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.373+0000 7f8783400640 1 --2- 172.21.15.8:0/2863807134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8768003d90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f877400c240 tx=0x7f87680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed331d7238db9e65 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.373+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877402e070 con 0x7f8768003970 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.373+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87740058d0 con 0x7f8768003970 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.373+0000 7f8782a00640 1 -- 172.21.15.8:0/2863807134 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774005d00 con 0x7f8768003970 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.374+0000 7f8788c00640 1 -- 172.21.15.8:0/2863807134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 msgr2=0x7f8768003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.374+0000 7f8788c00640 1 --2- 172.21.15.8:0/2863807134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8768003d90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f877400c240 tx=0x7f87680057f0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.374+0000 7f8788c00640 1 -- 172.21.15.8:0/2863807134 shutdown_connections 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.374+0000 7f8788c00640 1 --2- 172.21.15.8:0/2863807134 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8768003d90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.374+0000 7f8788c00640 1 -- 172.21.15.8:0/2863807134 >> 172.21.15.8:0/2863807134 conn(0x7f87840cf270 msgr2=0x7f87840cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.374+0000 7f8788c00640 1 -- 172.21.15.8:0/2863807134 shutdown_connections 2024-05-26T15:42:39.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.374+0000 7f8788c00640 1 -- 172.21.15.8:0/2863807134 wait complete. 2024-05-26T15:42:39.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.376+0000 7f8788c00640 1 Processor -- start 2024-05-26T15:42:39.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.376+0000 7f8788c00640 1 -- start start 2024-05-26T15:42:39.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.377+0000 7f8788c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8784143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:39.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.377+0000 7f8788c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f878415d4a0 0x7f87840cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:39.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.377+0000 7f8788c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f87840cb910 0x7f8784151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:39.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.377+0000 7f8788c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8784151950 con 0x7f8768003970 2024-05-26T15:42:39.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.377+0000 7f8788c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8784150d40 con 0x7f878415d4a0 2024-05-26T15:42:39.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.377+0000 7f8788c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8784151020 con 0x7f87840cb910 2024-05-26T15:42:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.377+0000 7f8783400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8784143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.378+0000 7f8783400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8784143800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46146/0 (socket says 172.21.15.8:46146) 2024-05-26T15:42:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.378+0000 7f8783400640 1 -- 172.21.15.8:0/2412141326 learned_addr learned my addr 172.21.15.8:0/2412141326 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.378+0000 7f877be00640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f878415d4a0 0x7f87840cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.378+0000 7f8783400640 1 -- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f87840cb910 msgr2=0x7f8784151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.378+0000 7f8783400640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f87840cb910 0x7f8784151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.378+0000 7f8783400640 1 -- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f878415d4a0 msgr2=0x7f87840cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.378+0000 7f8783400640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f878415d4a0 0x7f87840cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.378+0000 7f8783400640 1 -- 172.21.15.8:0/2412141326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8784151300 con 0x7f8768003970 2024-05-26T15:42:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.378+0000 7f8783400640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8784143800 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8774001930 tx=0x7f8774001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.379+0000 7f877b400640 1 -- 172.21.15.8:0/2412141326 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774005e70 con 0x7f8768003970 2024-05-26T15:42:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.379+0000 7f877b400640 1 -- 172.21.15.8:0/2412141326 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87740049f0 con 0x7f8768003970 2024-05-26T15:42:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.379+0000 7f877b400640 1 -- 172.21.15.8:0/2412141326 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774004da0 con 0x7f8768003970 2024-05-26T15:42:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.379+0000 7f8788c00640 1 -- 172.21.15.8:0/2412141326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87841515e0 con 0x7f8768003970 2024-05-26T15:42:39.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.379+0000 7f8788c00640 1 -- 172.21.15.8:0/2412141326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8784143d40 con 0x7f8768003970 2024-05-26T15:42:39.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.380+0000 7f8788c00640 1 -- 172.21.15.8:0/2412141326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8784066460 con 0x7f8768003970 2024-05-26T15:42:39.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.381+0000 7f877b400640 1 -- 172.21.15.8:0/2412141326 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8774005040 con 0x7f8768003970 2024-05-26T15:42:39.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.382+0000 7f877b400640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f876006ac30 0x7f876006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:39.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.382+0000 7f877b400640 1 -- 172.21.15.8:0/2412141326 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f87740a9440 con 0x7f8768003970 2024-05-26T15:42:39.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.383+0000 7f877be00640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f876006ac30 0x7f876006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:39.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.384+0000 7f877be00640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f876006ac30 0x7f876006d0f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f87840b2fe0 tx=0x7f876c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:39.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.387+0000 7f877b400640 1 -- 172.21.15.8:0/2412141326 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8774074480 con 0x7f8768003970 2024-05-26T15:42:39.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.624+0000 7f8788c00640 1 -- 172.21.15.8:0/2412141326 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8784066460 con 0x7f8768003970 2024-05-26T15:42:39.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.626+0000 7f877b400640 1 -- 172.21.15.8:0/2412141326 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f8774077aa0 con 0x7f8768003970 2024-05-26T15:42:39.624 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:39.624 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:39.625 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 -- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f876006ac30 msgr2=0x7f876006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f876006ac30 0x7f876006d0f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f87840b2fe0 tx=0x7f876c008040 comp rx=0 tx=0).stop 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 -- 172.21.15.8:0/2412141326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 msgr2=0x7f8784143800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8784143800 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8774001930 tx=0x7f8774001a00 comp rx=0 tx=0).stop 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 -- 172.21.15.8:0/2412141326 shutdown_connections 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f87840cb910 0x7f8784151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f876006ac30 0x7f876006d0f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f878415d4a0 0x7f87840cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 --2- 172.21.15.8:0/2412141326 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8768003970 0x7f8784143800 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 -- 172.21.15.8:0/2412141326 >> 172.21.15.8:0/2412141326 conn(0x7f87840cf270 msgr2=0x7f87841563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:39.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 -- 172.21.15.8:0/2412141326 shutdown_connections 2024-05-26T15:42:39.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:39.629+0000 7f8788c00640 1 -- 172.21.15.8:0/2412141326 wait complete. 2024-05-26T15:42:39.647 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:42:39.873 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":49,"msgr_send_messages":34,"msgr_recv_bytes":117336,"msgr_send_bytes":31176,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.020420514,"msgr_running_send_time":0.004858994,"msgr_running_recv_time":0.014283032,"msgr_running_fast_dispatch_time":0.001386441,"msgr_send_messages_queue_lat":{"avgcount":34,"sum":0.011248466,"avgtime":0.000330837},"msgr_handle_ack_lat":{"avgcount":8,"sum":0.000006420,"avgtime":0.000000802},"msgr_recv_encrypted_bytes":107968,"msgr_send_encrypted_bytes":6896},"AsyncMessenger::Worker-1":{"msgr_recv_messages":28,"msgr_send_messages":33,"msgr_recv_bytes":14647,"msgr_send_bytes":74918,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.010804142,"msgr_running_send_time":0.003437228,"msgr_running_recv_time":0.005224289,"msgr_running_fast_dispatch_time":0.001475737,"msgr_send_messages_queue_lat":{"avgcount":31,"sum":0.007053951,"avgtime":0.000227546},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":60576},"AsyncMessenger::Worker-2":{"msgr_recv_messages":18,"msgr_send_messages":20,"msgr_recv_bytes":12233,"msgr_send_bytes":7123,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.007165708,"msgr_running_send_time":0.001434608,"msgr_running_recv_time":0.004552746,"msgr_running_fast_dispatch_time":0.000801788,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.009153694,"avgtime":0.000481773},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":53,"sum":0.009806223,"avgtime":0.000185023}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199956,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.017303902,"avgtime":0.004325975},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":38656,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":777,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":238061,"buffer_anon_items":75,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55160,"mds_co_items":248,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5580,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.120998586,"avgtime":0.002326895},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":92,"get_sum":133866,"get_or_fail_fail":0,"get_or_fail_success":92,"take":0,"take_sum":0,"put":92,"put_sum":133866,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6462,"put":52,"put_sum":6462,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4506,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4506,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:42:39.874 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 8, "avgtime": 8.02e-07, "sum": 6.42e-06 }, "msgr_recv_bytes": 117336, "msgr_recv_encrypted_bytes": 107968, "msgr_recv_messages": 49, "msgr_running_fast_dispatch_time": 0.001386441, "msgr_running_recv_time": 0.014283032, "msgr_running_send_time": 0.004858994, "msgr_running_total_time": 0.020420514, "msgr_send_bytes": 31176, "msgr_send_encrypted_bytes": 6896, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 34, "avgtime": 0.000330837, "sum": 0.011248466 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14647, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.001475737, "msgr_running_recv_time": 0.005224289, "msgr_running_send_time": 0.003437228, "msgr_running_total_time": 0.010804142, "msgr_send_bytes": 74918, "msgr_send_encrypted_bytes": 60576, "msgr_send_messages": 33, "msgr_send_messages_queue_lat": { "avgcount": 31, "avgtime": 0.000227546, "sum": 0.007053951 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 12233, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 18, "msgr_running_fast_dispatch_time": 0.000801788, "msgr_running_recv_time": 0.004552746, "msgr_running_send_time": 0.001434608, "msgr_running_total_time": 0.007165708, "msgr_send_bytes": 7123, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000481773, "sum": 0.009153694 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 53, "avgtime": 0.000185023, "sum": 0.009806223 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.004325975, "sum": 0.017303902 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199956 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 38656 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 777, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 238061, "buffer_anon_items": 75, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 55160, "mds_co_items": 248, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002326895, "sum": 0.120998586 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5580, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 92, "get_or_fail_fail": 0, "get_or_fail_success": 92, "get_started": 0, "get_sum": 133866, "max": 104857600, "put": 92, "put_sum": 133866, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6462, "take": 52, "take_sum": 6462, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4506, "max": 3758096384, "put": 4, "put_sum": 4506, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:42:39.874 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2024-05-26T15:42:44.876 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:45.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.097+0000 7fbc45200640 1 Processor -- start 2024-05-26T15:42:45.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.098+0000 7fbc45200640 1 -- start start 2024-05-26T15:42:45.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.099+0000 7fbc45200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc400ced30 0x7fbc401625c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:45.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.099+0000 7fbc45200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbc40147940 0x7fbc400cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:45.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.099+0000 7fbc45200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc400d2540 con 0x7fbc40147560 2024-05-26T15:42:45.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.099+0000 7fbc45200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc400d2350 con 0x7fbc40147940 2024-05-26T15:42:45.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.099+0000 7fbc45200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40161ae0 con 0x7fbc400ced30 2024-05-26T15:42:45.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.100+0000 7fbc3e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbc40147940 0x7fbc400cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:45.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.100+0000 7fbc37e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc400ced30 0x7fbc401625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:45.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.100+0000 7fbc3e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbc40147940 0x7fbc400cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:39472/0 (socket says 172.21.15.8:39472) 2024-05-26T15:42:45.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.100+0000 7fbc3e800640 1 -- 172.21.15.8:0/2619550379 learned_addr learned my addr 172.21.15.8:0/2619550379 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:45.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.101+0000 7fbc3e800640 1 -- 172.21.15.8:0/2619550379 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc400ced30 msgr2=0x7fbc401625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:45.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.101+0000 7fbc3e800640 1 --2- 172.21.15.8:0/2619550379 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc400ced30 0x7fbc401625c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:45.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.101+0000 7fbc3e800640 1 -- 172.21.15.8:0/2619550379 >> v1:172.21.15.47:6789/0 conn(0x7fbc40147560 legacy=0x7fbc400d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:45.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.101+0000 7fbc3e800640 1 -- 172.21.15.8:0/2619550379 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40161dc0 con 0x7fbc40147940 2024-05-26T15:42:45.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.102+0000 7fbc3e800640 1 --2- 172.21.15.8:0/2619550379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc40147940 0x7fbc400cfae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009e50 tx=0x7fbc3802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1621b920277b7d40 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:45.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.103+0000 7fbc3d400640 1 -- 172.21.15.8:0/2619550379 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3802aea0 con 0x7fbc40147940 2024-05-26T15:42:45.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.104+0000 7fbc3d400640 1 -- 172.21.15.8:0/2619550379 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3802d050 con 0x7fbc40147940 2024-05-26T15:42:45.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.104+0000 7fbc3d400640 1 -- 172.21.15.8:0/2619550379 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38031820 con 0x7fbc40147940 2024-05-26T15:42:45.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.104+0000 7fbc45200640 1 -- 172.21.15.8:0/2619550379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc40147940 msgr2=0x7fbc400cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:45.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.104+0000 7fbc45200640 1 --2- 172.21.15.8:0/2619550379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc40147940 0x7fbc400cfae0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009e50 tx=0x7fbc3802a680 comp rx=0 tx=0).stop 2024-05-26T15:42:45.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.104+0000 7fbc45200640 1 -- 172.21.15.8:0/2619550379 shutdown_connections 2024-05-26T15:42:45.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.104+0000 7fbc45200640 1 --2- 172.21.15.8:0/2619550379 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc40147940 0x7fbc400cfae0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:45.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.104+0000 7fbc45200640 1 --2- 172.21.15.8:0/2619550379 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc400ced30 0x7fbc401625c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:45.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.104+0000 7fbc45200640 1 -- 172.21.15.8:0/2619550379 >> 172.21.15.8:0/2619550379 conn(0x7fbc40071600 msgr2=0x7fbc40071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:45.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.104+0000 7fbc45200640 1 -- 172.21.15.8:0/2619550379 shutdown_connections 2024-05-26T15:42:45.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.104+0000 7fbc45200640 1 -- 172.21.15.8:0/2619550379 wait complete. 2024-05-26T15:42:45.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.106+0000 7fbc45200640 1 Processor -- start 2024-05-26T15:42:45.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.106+0000 7fbc45200640 1 -- start start 2024-05-26T15:42:45.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.107+0000 7fbc45200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc400ced30 0x7fbc4015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:45.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.107+0000 7fbc45200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc40147560 0x7fbc400d1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:45.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.107+0000 7fbc45200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40147940 0x7fbc400b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:45.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.107+0000 7fbc45200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4013fc90 con 0x7fbc40147940 2024-05-26T15:42:45.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.107+0000 7fbc45200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4013f940 con 0x7fbc400ced30 2024-05-26T15:42:45.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.107+0000 7fbc45200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4013c960 con 0x7fbc40147560 2024-05-26T15:42:45.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc3e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40147940 0x7fbc400b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:45.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc3e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40147940 0x7fbc400b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58166/0 (socket says 172.21.15.8:58166) 2024-05-26T15:42:45.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc3e800640 1 -- 172.21.15.8:0/3429068542 learned_addr learned my addr 172.21.15.8:0/3429068542 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc3de00640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc400ced30 0x7fbc4015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc37e00640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc40147560 0x7fbc400d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc3e800640 1 -- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc40147560 msgr2=0x7fbc400d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc3e800640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc40147560 0x7fbc400d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc3e800640 1 -- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc400ced30 msgr2=0x7fbc4015e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc3e800640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc400ced30 0x7fbc4015e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc3e800640 1 -- 172.21.15.8:0/3429068542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38009b30 con 0x7fbc40147940 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.108+0000 7fbc3e800640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40147940 0x7fbc400b2600 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009e50 tx=0x7fbc38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.109+0000 7fbc36000640 1 -- 172.21.15.8:0/3429068542 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3803d860 con 0x7fbc40147940 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.109+0000 7fbc36000640 1 -- 172.21.15.8:0/3429068542 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3803d9c0 con 0x7fbc40147940 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.109+0000 7fbc36000640 1 -- 172.21.15.8:0/3429068542 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3803dd70 con 0x7fbc40147940 2024-05-26T15:42:45.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.109+0000 7fbc45200640 1 -- 172.21.15.8:0/3429068542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc400d29a0 con 0x7fbc40147940 2024-05-26T15:42:45.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.109+0000 7fbc45200640 1 -- 172.21.15.8:0/3429068542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4013cf20 con 0x7fbc40147940 2024-05-26T15:42:45.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.110+0000 7fbc45200640 1 -- 172.21.15.8:0/3429068542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4013fdd0 con 0x7fbc40147940 2024-05-26T15:42:45.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.111+0000 7fbc36000640 1 -- 172.21.15.8:0/3429068542 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc3803b400 con 0x7fbc40147940 2024-05-26T15:42:45.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.112+0000 7fbc36000640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc1c06ac00 0x7fbc1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:45.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.112+0000 7fbc36000640 1 -- 172.21.15.8:0/3429068542 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fbc380aa200 con 0x7fbc40147940 2024-05-26T15:42:45.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.113+0000 7fbc3de00640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc1c06ac00 0x7fbc1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:45.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.114+0000 7fbc3de00640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc1c06ac00 0x7fbc1c06d0c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbc40142090 tx=0x7fbc30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:45.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.117+0000 7fbc36000640 1 -- 172.21.15.8:0/3429068542 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbc4013fdd0 con 0x7fbc40147940 2024-05-26T15:42:45.357 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.358+0000 7fbc45200640 1 -- 172.21.15.8:0/3429068542 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc4013fdd0 con 0x7fbc40147940 2024-05-26T15:42:45.358 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.359+0000 7fbc36000640 1 -- 172.21.15.8:0/3429068542 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7fbc4013fdd0 con 0x7fbc40147940 2024-05-26T15:42:45.359 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:45.359 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:45.359 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:42:45.361 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 -- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc1c06ac00 msgr2=0x7fbc1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc1c06ac00 0x7fbc1c06d0c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbc40142090 tx=0x7fbc30009040 comp rx=0 tx=0).stop 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 -- 172.21.15.8:0/3429068542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40147940 msgr2=0x7fbc400b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40147940 0x7fbc400b2600 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009e50 tx=0x7fbc38004a40 comp rx=0 tx=0).stop 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 -- 172.21.15.8:0/3429068542 shutdown_connections 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40147940 0x7fbc400b2600 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbc40147560 0x7fbc400d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbc1c06ac00 0x7fbc1c06d0c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 --2- 172.21.15.8:0/3429068542 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbc400ced30 0x7fbc4015e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 -- 172.21.15.8:0/3429068542 >> 172.21.15.8:0/3429068542 conn(0x7fbc40071600 msgr2=0x7fbc400b76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 -- 172.21.15.8:0/3429068542 shutdown_connections 2024-05-26T15:42:45.362 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:45.362+0000 7fbc45200640 1 -- 172.21.15.8:0/3429068542 wait complete. 2024-05-26T15:42:45.382 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:42:45.610 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":58,"msgr_send_messages":37,"msgr_recv_bytes":120541,"msgr_send_bytes":32463,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.022924925,"msgr_running_send_time":0.006034392,"msgr_running_recv_time":0.014903503,"msgr_running_fast_dispatch_time":0.002049298,"msgr_send_messages_queue_lat":{"avgcount":37,"sum":0.011458067,"avgtime":0.000309677},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000007413,"avgtime":0.000000823},"msgr_recv_encrypted_bytes":108512,"msgr_send_encrypted_bytes":8080},"AsyncMessenger::Worker-1":{"msgr_recv_messages":28,"msgr_send_messages":35,"msgr_recv_bytes":14647,"msgr_send_bytes":78470,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.011021476,"msgr_running_send_time":0.003608739,"msgr_running_recv_time":0.005224289,"msgr_running_fast_dispatch_time":0.001475737,"msgr_send_messages_queue_lat":{"avgcount":33,"sum":0.007241524,"avgtime":0.000219440},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":64128},"AsyncMessenger::Worker-2":{"msgr_recv_messages":18,"msgr_send_messages":20,"msgr_recv_bytes":12233,"msgr_send_bytes":7123,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.007165708,"msgr_running_send_time":0.001434608,"msgr_running_recv_time":0.004552746,"msgr_running_fast_dispatch_time":0.000801788,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.009153694,"avgtime":0.000481773},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":53,"sum":0.009806223,"avgtime":0.000185023}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199956,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.017303902,"avgtime":0.004325975},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":38912,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":787,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":238061,"buffer_anon_items":75,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55200,"mds_co_items":253,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5580,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.120998586,"avgtime":0.002326895},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":101,"get_sum":136269,"get_or_fail_fail":0,"get_or_fail_success":101,"take":0,"take_sum":0,"put":101,"put_sum":136269,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6462,"put":52,"put_sum":6462,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4506,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4506,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:42:45.611 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 8.23e-07, "sum": 7.413e-06 }, "msgr_recv_bytes": 120541, "msgr_recv_encrypted_bytes": 108512, "msgr_recv_messages": 58, "msgr_running_fast_dispatch_time": 0.002049298, "msgr_running_recv_time": 0.014903503, "msgr_running_send_time": 0.006034392, "msgr_running_total_time": 0.022924925, "msgr_send_bytes": 32463, "msgr_send_encrypted_bytes": 8080, "msgr_send_messages": 37, "msgr_send_messages_queue_lat": { "avgcount": 37, "avgtime": 0.000309677, "sum": 0.011458067 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14647, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.001475737, "msgr_running_recv_time": 0.005224289, "msgr_running_send_time": 0.003608739, "msgr_running_total_time": 0.011021476, "msgr_send_bytes": 78470, "msgr_send_encrypted_bytes": 64128, "msgr_send_messages": 35, "msgr_send_messages_queue_lat": { "avgcount": 33, "avgtime": 0.00021944, "sum": 0.007241524 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 12233, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 18, "msgr_running_fast_dispatch_time": 0.000801788, "msgr_running_recv_time": 0.004552746, "msgr_running_send_time": 0.001434608, "msgr_running_total_time": 0.007165708, "msgr_send_bytes": 7123, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000481773, "sum": 0.009153694 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 53, "avgtime": 0.000185023, "sum": 0.009806223 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.004325975, "sum": 0.017303902 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199956 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 38912 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 787, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 238061, "buffer_anon_items": 75, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 55200, "mds_co_items": 253, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002326895, "sum": 0.120998586 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5580, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 101, "get_or_fail_fail": 0, "get_or_fail_success": 101, "get_started": 0, "get_sum": 136269, "max": 104857600, "put": 101, "put_sum": 136269, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6462, "take": 52, "take_sum": 6462, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4506, "max": 3758096384, "put": 4, "put_sum": 4506, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:42:45.611 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2024-05-26T15:42:50.613 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:50.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.835+0000 7f677d200640 1 Processor -- start 2024-05-26T15:42:50.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.835+0000 7f677d200640 1 -- start start 2024-05-26T15:42:50.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.837+0000 7f677d200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6778161040 0x7f67780cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:50.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.837+0000 7f677d200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f677806d690 0x7f67780b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:50.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.837+0000 7f677d200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67780ccc30 con 0x7f6778164a60 2024-05-26T15:42:50.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.837+0000 7f677d200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6778164ef0 con 0x7f677806d690 2024-05-26T15:42:50.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.837+0000 7f677d200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67781651d0 con 0x7f6778161040 2024-05-26T15:42:50.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.838+0000 7f6777e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f677806d690 0x7f67780b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:50.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.838+0000 7f6777400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6778161040 0x7f67780cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:50.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.838+0000 7f6777e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f677806d690 0x7f67780b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:39492/0 (socket says 172.21.15.8:39492) 2024-05-26T15:42:50.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.838+0000 7f6777e00640 1 -- 172.21.15.8:0/3041317310 learned_addr learned my addr 172.21.15.8:0/3041317310 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:50.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.839+0000 7f6777e00640 1 -- 172.21.15.8:0/3041317310 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6778161040 msgr2=0x7f67780cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:50.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.839+0000 7f6777e00640 1 --2- 172.21.15.8:0/3041317310 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6778161040 0x7f67780cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:50.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.839+0000 7f6777e00640 1 -- 172.21.15.8:0/3041317310 >> v1:172.21.15.47:6789/0 conn(0x7f6778164a60 legacy=0x7f6778070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:50.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.839+0000 7f6777e00640 1 -- 172.21.15.8:0/3041317310 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67781654b0 con 0x7f677806d690 2024-05-26T15:42:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.840+0000 7f6777e00640 1 --2- 172.21.15.8:0/3041317310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f677806d690 0x7f67780b1b40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6770009870 tx=0x7f677002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cdc850defd6685e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:50.839 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.841+0000 7f6776000640 1 -- 172.21.15.8:0/3041317310 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770032440 con 0x7f677806d690 2024-05-26T15:42:50.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.841+0000 7f6776000640 1 -- 172.21.15.8:0/3041317310 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67700325a0 con 0x7f677806d690 2024-05-26T15:42:50.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.841+0000 7f6776000640 1 -- 172.21.15.8:0/3041317310 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770032930 con 0x7f677806d690 2024-05-26T15:42:50.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.842+0000 7f677d200640 1 -- 172.21.15.8:0/3041317310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f677806d690 msgr2=0x7f67780b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:50.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.842+0000 7f677d200640 1 --2- 172.21.15.8:0/3041317310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f677806d690 0x7f67780b1b40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6770009870 tx=0x7f677002a270 comp rx=0 tx=0).stop 2024-05-26T15:42:50.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.842+0000 7f677d200640 1 -- 172.21.15.8:0/3041317310 shutdown_connections 2024-05-26T15:42:50.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.842+0000 7f677d200640 1 --2- 172.21.15.8:0/3041317310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f677806d690 0x7f67780b1b40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:50.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.842+0000 7f677d200640 1 --2- 172.21.15.8:0/3041317310 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6778161040 0x7f67780cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:50.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.842+0000 7f677d200640 1 -- 172.21.15.8:0/3041317310 >> 172.21.15.8:0/3041317310 conn(0x7f6778069ed0 msgr2=0x7f677806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:50.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.842+0000 7f677d200640 1 -- 172.21.15.8:0/3041317310 shutdown_connections 2024-05-26T15:42:50.841 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.842+0000 7f677d200640 1 -- 172.21.15.8:0/3041317310 wait complete. 2024-05-26T15:42:50.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.844+0000 7f677d200640 1 Processor -- start 2024-05-26T15:42:50.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.844+0000 7f677d200640 1 -- start start 2024-05-26T15:42:50.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.845+0000 7f677d200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f677806d690 0x7f677813f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:50.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.845+0000 7f677d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6778161040 0x7f6778141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:50.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.845+0000 7f677d200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f677815de20 0x7f67780cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:50.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.845+0000 7f677d200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677813fcc0 con 0x7f677815de20 2024-05-26T15:42:50.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.845+0000 7f677d200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677813f9b0 con 0x7f6778161040 2024-05-26T15:42:50.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.845+0000 7f677d200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6778141f80 con 0x7f677806d690 2024-05-26T15:42:50.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.845+0000 7f6777e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f677815de20 0x7f67780cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:50.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.845+0000 7f6777e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f677815de20 0x7f67780cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58170/0 (socket says 172.21.15.8:58170) 2024-05-26T15:42:50.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.845+0000 7f6777e00640 1 -- 172.21.15.8:0/2880650118 learned_addr learned my addr 172.21.15.8:0/2880650118 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:50.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.846+0000 7f6776a00640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6778161040 0x7f6778141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:50.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.846+0000 7f6777400640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f677806d690 0x7f677813f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:50.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.846+0000 7f6777e00640 1 -- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f677806d690 msgr2=0x7f677813f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:50.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.846+0000 7f6777e00640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f677806d690 0x7f677813f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:50.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.846+0000 7f6777e00640 1 -- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6778161040 msgr2=0x7f6778141a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:50.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.846+0000 7f6777e00640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6778161040 0x7f6778141a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:50.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.846+0000 7f6777e00640 1 -- 172.21.15.8:0/2880650118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67700094d0 con 0x7f677815de20 2024-05-26T15:42:50.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.846+0000 7f6777e00640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f677815de20 0x7f67780cd9d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6770009870 tx=0x7f67700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:50.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.846+0000 7f676f400640 1 -- 172.21.15.8:0/2880650118 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770032440 con 0x7f677815de20 2024-05-26T15:42:50.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.847+0000 7f676f400640 1 -- 172.21.15.8:0/2880650118 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6770030900 con 0x7f677815de20 2024-05-26T15:42:50.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.847+0000 7f676f400640 1 -- 172.21.15.8:0/2880650118 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770030c90 con 0x7f677815de20 2024-05-26T15:42:50.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.847+0000 7f677d200640 1 -- 172.21.15.8:0/2880650118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6778142200 con 0x7f677815de20 2024-05-26T15:42:50.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.847+0000 7f677d200640 1 -- 172.21.15.8:0/2880650118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67781427c0 con 0x7f677815de20 2024-05-26T15:42:50.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.848+0000 7f677d200640 1 -- 172.21.15.8:0/2880650118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6778067300 con 0x7f677815de20 2024-05-26T15:42:50.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.849+0000 7f676f400640 1 -- 172.21.15.8:0/2880650118 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6770039040 con 0x7f677815de20 2024-05-26T15:42:50.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.850+0000 7f676f400640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f675406ac00 0x7f675406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:50.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.850+0000 7f676f400640 1 -- 172.21.15.8:0/2880650118 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f67700a9e30 con 0x7f677815de20 2024-05-26T15:42:50.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.851+0000 7f6777400640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f675406ac00 0x7f675406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:50.850 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.852+0000 7f6777400640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f675406ac00 0x7f675406d0c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6768009a10 tx=0x7f6768008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:50.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:50.855+0000 7f676f400640 1 -- 172.21.15.8:0/2880650118 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6770074e60 con 0x7f677815de20 2024-05-26T15:42:51.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.096+0000 7f677d200640 1 -- 172.21.15.8:0/2880650118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67781429b0 con 0x7f677815de20 2024-05-26T15:42:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.097+0000 7f676f400640 1 -- 172.21.15.8:0/2880650118 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f6770078480 con 0x7f677815de20 2024-05-26T15:42:51.096 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:51.096 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:51.096 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:42:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.100+0000 7f677d200640 1 -- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f675406ac00 msgr2=0x7f675406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.100+0000 7f677d200640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f675406ac00 0x7f675406d0c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6768009a10 tx=0x7f6768008040 comp rx=0 tx=0).stop 2024-05-26T15:42:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.100+0000 7f677d200640 1 -- 172.21.15.8:0/2880650118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f677815de20 msgr2=0x7f67780cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.100+0000 7f677d200640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f677815de20 0x7f67780cd9d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6770009870 tx=0x7f67700046c0 comp rx=0 tx=0).stop 2024-05-26T15:42:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.100+0000 7f677d200640 1 -- 172.21.15.8:0/2880650118 shutdown_connections 2024-05-26T15:42:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.100+0000 7f677d200640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f677815de20 0x7f67780cd9d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.100+0000 7f677d200640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f675406ac00 0x7f675406d0c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.100+0000 7f677d200640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6778161040 0x7f6778141a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:51.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.100+0000 7f677d200640 1 --2- 172.21.15.8:0/2880650118 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f677806d690 0x7f677813f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:51.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.100+0000 7f677d200640 1 -- 172.21.15.8:0/2880650118 >> 172.21.15.8:0/2880650118 conn(0x7f6778069ed0 msgr2=0x7f67780b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:51.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.101+0000 7f677d200640 1 -- 172.21.15.8:0/2880650118 shutdown_connections 2024-05-26T15:42:51.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:51.101+0000 7f677d200640 1 -- 172.21.15.8:0/2880650118 wait complete. 2024-05-26T15:42:51.118 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:42:51.345 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":65,"msgr_send_messages":38,"msgr_recv_bytes":123225,"msgr_send_bytes":33055,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.025285510,"msgr_running_send_time":0.007129992,"msgr_running_recv_time":0.015483515,"msgr_running_fast_dispatch_time":0.002638052,"msgr_send_messages_queue_lat":{"avgcount":38,"sum":0.011562420,"avgtime":0.000304274},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000007413,"avgtime":0.000000823},"msgr_recv_encrypted_bytes":108784,"msgr_send_encrypted_bytes":8672},"AsyncMessenger::Worker-1":{"msgr_recv_messages":28,"msgr_send_messages":36,"msgr_recv_bytes":14647,"msgr_send_bytes":80246,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.011133305,"msgr_running_send_time":0.003695721,"msgr_running_recv_time":0.005224289,"msgr_running_fast_dispatch_time":0.001475737,"msgr_send_messages_queue_lat":{"avgcount":34,"sum":0.007328363,"avgtime":0.000215540},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":65904},"AsyncMessenger::Worker-2":{"msgr_recv_messages":18,"msgr_send_messages":20,"msgr_recv_bytes":12233,"msgr_send_bytes":7123,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.007165708,"msgr_running_send_time":0.001434608,"msgr_running_recv_time":0.004552746,"msgr_running_fast_dispatch_time":0.000801788,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.009153694,"avgtime":0.000481773},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":53,"sum":0.009806223,"avgtime":0.000185023}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199956,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.017303902,"avgtime":0.004325975},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":39040,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":792,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":238061,"buffer_anon_items":75,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55200,"mds_co_items":253,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5580,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.120998586,"avgtime":0.002326895},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":108,"get_sum":138367,"get_or_fail_fail":0,"get_or_fail_success":108,"take":0,"take_sum":0,"put":108,"put_sum":138367,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6462,"put":52,"put_sum":6462,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4506,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4506,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:42:51.347 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 8.23e-07, "sum": 7.413e-06 }, "msgr_recv_bytes": 123225, "msgr_recv_encrypted_bytes": 108784, "msgr_recv_messages": 65, "msgr_running_fast_dispatch_time": 0.002638052, "msgr_running_recv_time": 0.015483515, "msgr_running_send_time": 0.007129992, "msgr_running_total_time": 0.02528551, "msgr_send_bytes": 33055, "msgr_send_encrypted_bytes": 8672, "msgr_send_messages": 38, "msgr_send_messages_queue_lat": { "avgcount": 38, "avgtime": 0.000304274, "sum": 0.01156242 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14647, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.001475737, "msgr_running_recv_time": 0.005224289, "msgr_running_send_time": 0.003695721, "msgr_running_total_time": 0.011133305, "msgr_send_bytes": 80246, "msgr_send_encrypted_bytes": 65904, "msgr_send_messages": 36, "msgr_send_messages_queue_lat": { "avgcount": 34, "avgtime": 0.00021554, "sum": 0.007328363 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 12233, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 18, "msgr_running_fast_dispatch_time": 0.000801788, "msgr_running_recv_time": 0.004552746, "msgr_running_send_time": 0.001434608, "msgr_running_total_time": 0.007165708, "msgr_send_bytes": 7123, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000481773, "sum": 0.009153694 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 53, "avgtime": 0.000185023, "sum": 0.009806223 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.004325975, "sum": 0.017303902 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199956 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 39040 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 792, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 238061, "buffer_anon_items": 75, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 55200, "mds_co_items": 253, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002326895, "sum": 0.120998586 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5580, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 108, "get_or_fail_fail": 0, "get_or_fail_success": 108, "get_started": 0, "get_sum": 138367, "max": 104857600, "put": 108, "put_sum": 138367, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6462, "take": 52, "take_sum": 6462, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4506, "max": 3758096384, "put": 4, "put_sum": 4506, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:42:51.347 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2024-05-26T15:42:56.349 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:42:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.573+0000 7f3f17800640 1 Processor -- start 2024-05-26T15:42:56.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.573+0000 7f3f17800640 1 -- start start 2024-05-26T15:42:56.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.575+0000 7f3f17800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3f101445d0 0x7f3f1006e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.575+0000 7f3f17800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1006d380 con 0x7f3f1015f230 2024-05-26T15:42:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.575+0000 7f3f17800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1006d660 con 0x7f3f1015ed30 2024-05-26T15:42:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.575+0000 7f3f17800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1006d940 con 0x7f3f101445d0 2024-05-26T15:42:56.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.575+0000 7f3f07e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f3f1015f230 0x7f3f1015e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34816/0 (socket says 172.21.15.8:34816) 2024-05-26T15:42:56.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.576+0000 7f3f07e00640 1 -- 172.21.15.8:0/2254218867 learned_addr learned my addr 172.21.15.8:0/2254218867 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:42:56.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.575+0000 7f3f14e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f3f101445d0 0x7f3f1006e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:56.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.576+0000 7f3f0fe00640 1 -- 172.21.15.8:0/2254218867 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978949403 0 0) 0x7f3f1006d380 con 0x7f3f1015f230 2024-05-26T15:42:56.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.576+0000 7f3f0fe00640 1 -- 172.21.15.8:0/2254218867 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef4003520 con 0x7f3f1015f230 2024-05-26T15:42:56.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.576+0000 7f3f14e00640 1 -- 172.21.15.8:0/2254218867 >> v1:172.21.15.47:6789/0 conn(0x7f3f1015ed30 legacy=0x7f3f1015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:42:56.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.576+0000 7f3f14e00640 1 -- 172.21.15.8:0/2254218867 >> v1:172.21.15.8:6789/0 conn(0x7f3f1015f230 legacy=0x7f3f1015e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:56.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.576+0000 7f3f14e00640 1 -- 172.21.15.8:0/2254218867 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1006dc20 con 0x7f3f101445d0 2024-05-26T15:42:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.578+0000 7f3f14e00640 1 --2- 172.21.15.8:0/2254218867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f101445d0 0x7f3f1006e630 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3f000097a0 tx=0x7f3f0002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541f7c436db1d2e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:56.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.578+0000 7f3f0fe00640 1 -- 172.21.15.8:0/2254218867 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0002ae50 con 0x7f3f101445d0 2024-05-26T15:42:56.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.578+0000 7f3f0fe00640 1 -- 172.21.15.8:0/2254218867 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f00032440 con 0x7f3f101445d0 2024-05-26T15:42:56.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.578+0000 7f3f0fe00640 1 -- 172.21.15.8:0/2254218867 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f000327b0 con 0x7f3f101445d0 2024-05-26T15:42:56.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.579+0000 7f3f17800640 1 -- 172.21.15.8:0/2254218867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f101445d0 msgr2=0x7f3f1006e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:56.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.579+0000 7f3f17800640 1 --2- 172.21.15.8:0/2254218867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f101445d0 0x7f3f1006e630 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3f000097a0 tx=0x7f3f0002a140 comp rx=0 tx=0).stop 2024-05-26T15:42:56.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.579+0000 7f3f17800640 1 -- 172.21.15.8:0/2254218867 shutdown_connections 2024-05-26T15:42:56.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.579+0000 7f3f17800640 1 --2- 172.21.15.8:0/2254218867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f101445d0 0x7f3f1006e630 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:56.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.579+0000 7f3f17800640 1 -- 172.21.15.8:0/2254218867 >> 172.21.15.8:0/2254218867 conn(0x7f3f100b0720 msgr2=0x7f3f100b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:56.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.579+0000 7f3f17800640 1 -- 172.21.15.8:0/2254218867 shutdown_connections 2024-05-26T15:42:56.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.579+0000 7f3f17800640 1 -- 172.21.15.8:0/2254218867 wait complete. 2024-05-26T15:42:56.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.581+0000 7f3f17800640 1 Processor -- start 2024-05-26T15:42:56.580 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.581+0000 7f3f17800640 1 -- start start 2024-05-26T15:42:56.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.582+0000 7f3f17800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f101445d0 0x7f3f1013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:56.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.582+0000 7f3f17800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3f1015ed30 0x7f3f100acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:56.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.582+0000 7f3f17800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f1015f230 0x7f3f100ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:56.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.582+0000 7f3f17800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1013dc40 con 0x7f3f1015f230 2024-05-26T15:42:56.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.582+0000 7f3f17800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1013df20 con 0x7f3f101445d0 2024-05-26T15:42:56.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.582+0000 7f3f17800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1013e200 con 0x7f3f1015ed30 2024-05-26T15:42:56.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f15800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f1015f230 0x7f3f100ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:56.581 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f15800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f1015f230 0x7f3f100ad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34846/0 (socket says 172.21.15.8:34846) 2024-05-26T15:42:56.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f15800640 1 -- 172.21.15.8:0/1640732963 learned_addr learned my addr 172.21.15.8:0/1640732963 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:42:56.582 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f14e00640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f101445d0 0x7f3f1013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:56.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f07e00640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3f1015ed30 0x7f3f100acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:56.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f15800640 1 -- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3f1015ed30 msgr2=0x7f3f100acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:56.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f15800640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3f1015ed30 0x7f3f100acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:56.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f15800640 1 -- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f101445d0 msgr2=0x7f3f1013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:56.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f15800640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f101445d0 0x7f3f1013ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:56.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f15800640 1 -- 172.21.15.8:0/1640732963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f00009400 con 0x7f3f1015f230 2024-05-26T15:42:56.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.583+0000 7f3f07e00640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3f1015ed30 0x7f3f100acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:42:56.583 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.584+0000 7f3f15800640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f1015f230 0x7f3f100ad220 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800c780 tx=0x7f3f0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:56.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.584+0000 7f3f0d600640 1 -- 172.21.15.8:0/1640732963 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f08004b60 con 0x7f3f1015f230 2024-05-26T15:42:56.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.584+0000 7f3f0d600640 1 -- 172.21.15.8:0/1640732963 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0800ce90 con 0x7f3f1015f230 2024-05-26T15:42:56.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.584+0000 7f3f17800640 1 -- 172.21.15.8:0/1640732963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1013e4e0 con 0x7f3f1015f230 2024-05-26T15:42:56.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.584+0000 7f3f0d600640 1 -- 172.21.15.8:0/1640732963 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800a850 con 0x7f3f1015f230 2024-05-26T15:42:56.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.584+0000 7f3f17800640 1 -- 172.21.15.8:0/1640732963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f100b3690 con 0x7f3f1015f230 2024-05-26T15:42:56.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.585+0000 7f3f17800640 1 -- 172.21.15.8:0/1640732963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1013ea00 con 0x7f3f1015f230 2024-05-26T15:42:56.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.586+0000 7f3f0d600640 1 -- 172.21.15.8:0/1640732963 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3f0800a9b0 con 0x7f3f1015f230 2024-05-26T15:42:56.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.587+0000 7f3f0d600640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3eec06ac00 0x7f3eec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:42:56.585 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.587+0000 7f3f0d600640 1 -- 172.21.15.8:0/1640732963 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f3f080897c0 con 0x7f3f1015f230 2024-05-26T15:42:56.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.588+0000 7f3f14e00640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3eec06ac00 0x7f3eec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:42:56.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.589+0000 7f3f14e00640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3eec06ac00 0x7f3eec06d0c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f00034000 tx=0x7f3f0002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:42:56.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.592+0000 7f3f0d600640 1 -- 172.21.15.8:0/1640732963 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3f1013ea00 con 0x7f3f1015f230 2024-05-26T15:42:56.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.833+0000 7f3f17800640 1 -- 172.21.15.8:0/1640732963 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f1013ea00 con 0x7f3f1015f230 2024-05-26T15:42:56.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.835+0000 7f3f0d600640 1 -- 172.21.15.8:0/1640732963 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f3f1013ea00 con 0x7f3f1015f230 2024-05-26T15:42:56.833 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:42:56.833 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:42:56.834 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:42:56.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.837+0000 7f3f17800640 1 -- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3eec06ac00 msgr2=0x7f3eec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:56.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.837+0000 7f3f17800640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3eec06ac00 0x7f3eec06d0c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f00034000 tx=0x7f3f0002e000 comp rx=0 tx=0).stop 2024-05-26T15:42:56.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.838+0000 7f3f17800640 1 -- 172.21.15.8:0/1640732963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f1015f230 msgr2=0x7f3f100ad220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:42:56.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.838+0000 7f3f17800640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f1015f230 0x7f3f100ad220 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800c780 tx=0x7f3f0800cc40 comp rx=0 tx=0).stop 2024-05-26T15:42:56.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.838+0000 7f3f17800640 1 -- 172.21.15.8:0/1640732963 shutdown_connections 2024-05-26T15:42:56.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.838+0000 7f3f17800640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f1015f230 0x7f3f100ad220 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:56.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.838+0000 7f3f17800640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3f1015ed30 0x7f3f100acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:56.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.838+0000 7f3f17800640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3eec06ac00 0x7f3eec06d0c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:56.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.838+0000 7f3f17800640 1 --2- 172.21.15.8:0/1640732963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3f101445d0 0x7f3f1013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:42:56.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.838+0000 7f3f17800640 1 -- 172.21.15.8:0/1640732963 >> 172.21.15.8:0/1640732963 conn(0x7f3f100b0720 msgr2=0x7f3f100cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:42:56.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.838+0000 7f3f17800640 1 -- 172.21.15.8:0/1640732963 shutdown_connections 2024-05-26T15:42:56.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:42:56.838+0000 7f3f17800640 1 -- 172.21.15.8:0/1640732963 wait complete. 2024-05-26T15:42:56.855 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:42:57.079 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":73,"msgr_send_messages":40,"msgr_recv_bytes":126181,"msgr_send_bytes":34239,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.027568377,"msgr_running_send_time":0.008203252,"msgr_running_recv_time":0.016012745,"msgr_running_fast_dispatch_time":0.003245223,"msgr_send_messages_queue_lat":{"avgcount":40,"sum":0.011759735,"avgtime":0.000293993},"msgr_handle_ack_lat":{"avgcount":9,"sum":0.000007413,"avgtime":0.000000823},"msgr_recv_encrypted_bytes":109328,"msgr_send_encrypted_bytes":9856},"AsyncMessenger::Worker-1":{"msgr_recv_messages":28,"msgr_send_messages":37,"msgr_recv_bytes":14647,"msgr_send_bytes":82022,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.011246141,"msgr_running_send_time":0.003781821,"msgr_running_recv_time":0.005224289,"msgr_running_fast_dispatch_time":0.001475737,"msgr_send_messages_queue_lat":{"avgcount":35,"sum":0.007436699,"avgtime":0.000212477},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":67680},"AsyncMessenger::Worker-2":{"msgr_recv_messages":18,"msgr_send_messages":20,"msgr_recv_bytes":12233,"msgr_send_bytes":7123,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.007165708,"msgr_running_send_time":0.001434608,"msgr_running_recv_time":0.004552746,"msgr_running_fast_dispatch_time":0.000801788,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.009153694,"avgtime":0.000481773},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":53,"sum":0.009806223,"avgtime":0.000185023}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199956,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.017303902,"avgtime":0.004325975},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":39424,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":797,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":238061,"buffer_anon_items":75,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55200,"mds_co_items":253,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5580,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.120998586,"avgtime":0.002326895},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":116,"get_sum":140595,"get_or_fail_fail":0,"get_or_fail_success":116,"take":0,"take_sum":0,"put":116,"put_sum":140595,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6462,"put":52,"put_sum":6462,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4506,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4506,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:42:57.081 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 9, "avgtime": 8.23e-07, "sum": 7.413e-06 }, "msgr_recv_bytes": 126181, "msgr_recv_encrypted_bytes": 109328, "msgr_recv_messages": 73, "msgr_running_fast_dispatch_time": 0.003245223, "msgr_running_recv_time": 0.016012745, "msgr_running_send_time": 0.008203252, "msgr_running_total_time": 0.027568377, "msgr_send_bytes": 34239, "msgr_send_encrypted_bytes": 9856, "msgr_send_messages": 40, "msgr_send_messages_queue_lat": { "avgcount": 40, "avgtime": 0.000293993, "sum": 0.011759735 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14647, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.001475737, "msgr_running_recv_time": 0.005224289, "msgr_running_send_time": 0.003781821, "msgr_running_total_time": 0.011246141, "msgr_send_bytes": 82022, "msgr_send_encrypted_bytes": 67680, "msgr_send_messages": 37, "msgr_send_messages_queue_lat": { "avgcount": 35, "avgtime": 0.000212477, "sum": 0.007436699 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 12233, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 18, "msgr_running_fast_dispatch_time": 0.000801788, "msgr_running_recv_time": 0.004552746, "msgr_running_send_time": 0.001434608, "msgr_running_total_time": 0.007165708, "msgr_send_bytes": 7123, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000481773, "sum": 0.009153694 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 53, "avgtime": 0.000185023, "sum": 0.009806223 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.004325975, "sum": 0.017303902 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199956 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 39424 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 797, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 238061, "buffer_anon_items": 75, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 55200, "mds_co_items": 253, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002326895, "sum": 0.120998586 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5580, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 116, "get_or_fail_fail": 0, "get_or_fail_success": 116, "get_started": 0, "get_sum": 140595, "max": 104857600, "put": 116, "put_sum": 140595, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6462, "take": 52, "take_sum": 6462, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4506, "max": 3758096384, "put": 4, "put_sum": 4506, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:42:57.081 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2024-05-26T15:42:58.879 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:42:58.888 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:43:02.082 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:43:02.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.304+0000 7f1e1da00640 1 Processor -- start 2024-05-26T15:43:02.303 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.305+0000 7f1e1da00640 1 -- start start 2024-05-26T15:43:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.306+0000 7f1e1da00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1e1815ed30 0x7f1e1806e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.306+0000 7f1e1da00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1806d380 con 0x7f1e1815f230 2024-05-26T15:43:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.306+0000 7f1e1da00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1806d660 con 0x7f1e181445d0 2024-05-26T15:43:02.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.306+0000 7f1e1da00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1806d940 con 0x7f1e1815ed30 2024-05-26T15:43:02.306 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.307+0000 7f1e0fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1e1815f230 0x7f1e1815c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59560/0 (socket says 172.21.15.8:59560) 2024-05-26T15:43:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.307+0000 7f1e0fe00640 1 -- 172.21.15.8:0/109345912 learned_addr learned my addr 172.21.15.8:0/109345912 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.307+0000 7f1e17400640 1 --2- 172.21.15.8:0/109345912 >> v2:172.21.15.47:3300/0 conn(0x7f1e1815ed30 0x7f1e1806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.308+0000 7f1e16000640 1 -- 172.21.15.8:0/109345912 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250404461 0 0) 0x7f1e1806d380 con 0x7f1e1815f230 2024-05-26T15:43:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.308+0000 7f1e16000640 1 -- 172.21.15.8:0/109345912 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dfc003520 con 0x7f1e1815f230 2024-05-26T15:43:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.308+0000 7f1e17400640 1 -- 172.21.15.8:0/109345912 >> v1:172.21.15.47:6789/0 conn(0x7f1e181445d0 legacy=0x7f1e1815e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.308+0000 7f1e17400640 1 -- 172.21.15.8:0/109345912 >> v1:172.21.15.8:6789/0 conn(0x7f1e1815f230 legacy=0x7f1e1815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.308+0000 7f1e16000640 1 -- 172.21.15.8:0/109345912 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 625216573 0 0) 0x7f1dfc003520 con 0x7f1e1815f230 2024-05-26T15:43:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.308+0000 7f1e17400640 1 -- 172.21.15.8:0/109345912 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1806dc20 con 0x7f1e1815ed30 2024-05-26T15:43:02.307 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.309+0000 7f1e17400640 1 --2- 172.21.15.8:0/109345912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e1815ed30 0x7f1e1806e630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009d90 tx=0x7f1e1002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da226dab2c15e651 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.310+0000 7f1e16000640 1 -- 172.21.15.8:0/109345912 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00001670 con 0x7f1e1815ed30 2024-05-26T15:43:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.310+0000 7f1e16000640 1 -- 172.21.15.8:0/109345912 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1002d050 con 0x7f1e1815ed30 2024-05-26T15:43:02.308 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.310+0000 7f1e16000640 1 -- 172.21.15.8:0/109345912 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10007760 con 0x7f1e1815ed30 2024-05-26T15:43:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.310+0000 7f1e1da00640 1 -- 172.21.15.8:0/109345912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e1815ed30 msgr2=0x7f1e1806e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.310+0000 7f1e1da00640 1 --2- 172.21.15.8:0/109345912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e1815ed30 0x7f1e1806e630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009d90 tx=0x7f1e1002a5f0 comp rx=0 tx=0).stop 2024-05-26T15:43:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.311+0000 7f1e1da00640 1 -- 172.21.15.8:0/109345912 shutdown_connections 2024-05-26T15:43:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.311+0000 7f1e1da00640 1 --2- 172.21.15.8:0/109345912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e1815ed30 0x7f1e1806e630 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:02.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.311+0000 7f1e1da00640 1 -- 172.21.15.8:0/109345912 >> 172.21.15.8:0/109345912 conn(0x7f1e180b0720 msgr2=0x7f1e180b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.311+0000 7f1e1da00640 1 -- 172.21.15.8:0/109345912 shutdown_connections 2024-05-26T15:43:02.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.311+0000 7f1e1da00640 1 -- 172.21.15.8:0/109345912 wait complete. 2024-05-26T15:43:02.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.312+0000 7f1e1da00640 1 Processor -- start 2024-05-26T15:43:02.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.313+0000 7f1e1da00640 1 -- start start 2024-05-26T15:43:02.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.313+0000 7f1e1da00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1e181445d0 0x7f1e181f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.313+0000 7f1e1da00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e1815ed30 0x7f1e181f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.313+0000 7f1e1da00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e1815f230 0x7f1e181e6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.313+0000 7f1e1da00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181e7a50 con 0x7f1e1815f230 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.313+0000 7f1e1da00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181e6e40 con 0x7f1e1815ed30 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.313+0000 7f1e1da00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e181e7120 con 0x7f1e181445d0 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.314+0000 7f1e17400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e1815f230 0x7f1e181e6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.314+0000 7f1e17400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e1815f230 0x7f1e181e6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58174/0 (socket says 172.21.15.8:58174) 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.314+0000 7f1e17400640 1 -- 172.21.15.8:0/1146407997 learned_addr learned my addr 172.21.15.8:0/1146407997 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.314+0000 7f1e0fe00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e1815ed30 0x7f1e181f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.314+0000 7f1e16a00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1e181445d0 0x7f1e181f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.314+0000 7f1e17400640 1 -- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1e181445d0 msgr2=0x7f1e181f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:02.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.314+0000 7f1e17400640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1e181445d0 0x7f1e181f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:02.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.314+0000 7f1e17400640 1 -- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e1815ed30 msgr2=0x7f1e181f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:02.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.314+0000 7f1e17400640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e1815ed30 0x7f1e181f3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:02.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.314+0000 7f1e17400640 1 -- 172.21.15.8:0/1146407997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e10009a70 con 0x7f1e1815f230 2024-05-26T15:43:02.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.315+0000 7f1e17400640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e1815f230 0x7f1e181e6360 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009d90 tx=0x7f1e10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:02.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.315+0000 7f1e0ea00640 1 -- 172.21.15.8:0/1146407997 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1003c8f0 con 0x7f1e1815f230 2024-05-26T15:43:02.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.315+0000 7f1e0ea00640 1 -- 172.21.15.8:0/1146407997 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1003ca50 con 0x7f1e1815f230 2024-05-26T15:43:02.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.315+0000 7f1e0ea00640 1 -- 172.21.15.8:0/1146407997 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1003cdc0 con 0x7f1e1815f230 2024-05-26T15:43:02.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.315+0000 7f1e1da00640 1 -- 172.21.15.8:0/1146407997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e181e7400 con 0x7f1e1815f230 2024-05-26T15:43:02.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.315+0000 7f1e1da00640 1 -- 172.21.15.8:0/1146407997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e181416d0 con 0x7f1e1815f230 2024-05-26T15:43:02.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.316+0000 7f1e1da00640 1 -- 172.21.15.8:0/1146407997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e18066780 con 0x7f1e1815f230 2024-05-26T15:43:02.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.317+0000 7f1e0ea00640 1 -- 172.21.15.8:0/1146407997 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e1002ad50 con 0x7f1e1815f230 2024-05-26T15:43:02.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.318+0000 7f1e0ea00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1df406ac30 0x7f1df406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:02.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.318+0000 7f1e0ea00640 1 -- 172.21.15.8:0/1146407997 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f1e100aab60 con 0x7f1e1815f230 2024-05-26T15:43:02.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.319+0000 7f1e16a00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1df406ac30 0x7f1df406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:02.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.320+0000 7f1e16a00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1df406ac30 0x7f1df406d0f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1e08000f60 tx=0x7f1e08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:02.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.323+0000 7f1e0ea00640 1 -- 172.21.15.8:0/1146407997 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1e10075b00 con 0x7f1e1815f230 2024-05-26T15:43:02.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.564+0000 7f1e1da00640 1 -- 172.21.15.8:0/1146407997 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e1804e210 con 0x7f1e1815f230 2024-05-26T15:43:02.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.565+0000 7f1e0ea00640 1 -- 172.21.15.8:0/1146407997 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f1e10031400 con 0x7f1e1815f230 2024-05-26T15:43:02.564 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:02.564 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:43:02.564 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:43:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 -- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1df406ac30 msgr2=0x7f1df406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1df406ac30 0x7f1df406d0f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1e08000f60 tx=0x7f1e08009040 comp rx=0 tx=0).stop 2024-05-26T15:43:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 -- 172.21.15.8:0/1146407997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e1815f230 msgr2=0x7f1e181e6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e1815f230 0x7f1e181e6360 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009d90 tx=0x7f1e10004a40 comp rx=0 tx=0).stop 2024-05-26T15:43:02.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 -- 172.21.15.8:0/1146407997 shutdown_connections 2024-05-26T15:43:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e1815f230 0x7f1e181e6360 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1df406ac30 0x7f1df406d0f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1e1815ed30 0x7f1e181f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 --2- 172.21.15.8:0/1146407997 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1e181445d0 0x7f1e181f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 -- 172.21.15.8:0/1146407997 >> 172.21.15.8:0/1146407997 conn(0x7f1e180b0720 msgr2=0x7f1e18141bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 -- 172.21.15.8:0/1146407997 shutdown_connections 2024-05-26T15:43:02.568 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:02.568+0000 7f1e1da00640 1 -- 172.21.15.8:0/1146407997 wait complete. 2024-05-26T15:43:02.586 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:43:02.815 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":80,"msgr_send_messages":42,"msgr_recv_bytes":128712,"msgr_send_bytes":34934,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.029664985,"msgr_running_send_time":0.009237243,"msgr_running_recv_time":0.016565445,"msgr_running_fast_dispatch_time":0.003704694,"msgr_send_messages_queue_lat":{"avgcount":42,"sum":0.011913981,"avgtime":0.000283666},"msgr_handle_ack_lat":{"avgcount":10,"sum":0.000008323,"avgtime":0.000000832},"msgr_recv_encrypted_bytes":109600,"msgr_send_encrypted_bytes":10448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":28,"msgr_send_messages":38,"msgr_recv_bytes":14647,"msgr_send_bytes":83798,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.011362567,"msgr_running_send_time":0.003872840,"msgr_running_recv_time":0.005224289,"msgr_running_fast_dispatch_time":0.001475737,"msgr_send_messages_queue_lat":{"avgcount":36,"sum":0.007557661,"avgtime":0.000209935},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":69456},"AsyncMessenger::Worker-2":{"msgr_recv_messages":18,"msgr_send_messages":20,"msgr_recv_bytes":12233,"msgr_send_bytes":7123,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.007165708,"msgr_running_send_time":0.001434608,"msgr_running_recv_time":0.004552746,"msgr_running_fast_dispatch_time":0.000801788,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.009153694,"avgtime":0.000481773},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":53,"sum":0.009806223,"avgtime":0.000185023}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":4,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199956,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.017303902,"avgtime":0.004325975},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":39808,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":2,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":802,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":238061,"buffer_anon_items":75,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55200,"mds_co_items":253,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5580,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.120998586,"avgtime":0.002326895},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":123,"get_sum":142540,"get_or_fail_fail":0,"get_or_fail_success":123,"take":0,"take_sum":0,"put":123,"put_sum":142540,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6462,"put":52,"put_sum":6462,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4506,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4506,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:43:02.816 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 10, "avgtime": 8.32e-07, "sum": 8.323e-06 }, "msgr_recv_bytes": 128712, "msgr_recv_encrypted_bytes": 109600, "msgr_recv_messages": 80, "msgr_running_fast_dispatch_time": 0.003704694, "msgr_running_recv_time": 0.016565445, "msgr_running_send_time": 0.009237243, "msgr_running_total_time": 0.029664985, "msgr_send_bytes": 34934, "msgr_send_encrypted_bytes": 10448, "msgr_send_messages": 42, "msgr_send_messages_queue_lat": { "avgcount": 42, "avgtime": 0.000283666, "sum": 0.011913981 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14647, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.001475737, "msgr_running_recv_time": 0.005224289, "msgr_running_send_time": 0.00387284, "msgr_running_total_time": 0.011362567, "msgr_send_bytes": 83798, "msgr_send_encrypted_bytes": 69456, "msgr_send_messages": 38, "msgr_send_messages_queue_lat": { "avgcount": 36, "avgtime": 0.000209935, "sum": 0.007557661 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 12233, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 18, "msgr_running_fast_dispatch_time": 0.000801788, "msgr_running_recv_time": 0.004552746, "msgr_running_send_time": 0.001434608, "msgr_running_total_time": 0.007165708, "msgr_send_bytes": 7123, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000481773, "sum": 0.009153694 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 53, "avgtime": 0.000185023, "sum": 0.009806223 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.004325975, "sum": 0.017303902 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4199956 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 39808 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 2, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 802, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 238061, "buffer_anon_items": 75, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 55200, "mds_co_items": 253, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002326895, "sum": 0.120998586 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5580, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 123, "get_or_fail_fail": 0, "get_or_fail_success": 123, "get_started": 0, "get_sum": 142540, "max": 104857600, "put": 123, "put_sum": 142540, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6462, "take": 52, "take_sum": 6462, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4506, "max": 3758096384, "put": 4, "put_sum": 4506, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:43:02.816 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2024-05-26T15:43:07.817 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:43:08.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.039+0000 7f9dacc00640 1 Processor -- start 2024-05-26T15:43:08.038 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.040+0000 7f9dacc00640 1 -- start start 2024-05-26T15:43:08.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.041+0000 7f9dacc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da8142b30 0x7f9da80cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:08.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.041+0000 7f9dacc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da80cdd90 con 0x7f9da8142410 2024-05-26T15:43:08.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.041+0000 7f9dacc00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da8143340 con 0x7f9da806d6e0 2024-05-26T15:43:08.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.041+0000 7f9dacc00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80cdfe0 con 0x7f9da8142b30 2024-05-26T15:43:08.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.042+0000 7f9da7400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f9da8142410 0x7f9da8070f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:59568/0 (socket says 172.21.15.8:59568) 2024-05-26T15:43:08.040 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.042+0000 7f9da7400640 1 -- 172.21.15.8:0/8776974 learned_addr learned my addr 172.21.15.8:0/8776974 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:08.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.042+0000 7f9d9fe00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da8142b30 0x7f9da80cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:08.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.042+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945648442 0 0) 0x7f9da80cdd90 con 0x7f9da8142410 2024-05-26T15:43:08.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.042+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d8c005730 con 0x7f9da8142410 2024-05-26T15:43:08.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2661195453 0 0) 0x7f9d8c005730 con 0x7f9da8142410 2024-05-26T15:43:08.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da8142b30 msgr2=0x7f9da80cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:08.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da8142b30 0x7f9da80cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:08.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 >> v1:172.21.15.47:6789/0 conn(0x7f9da806d6e0 legacy=0x7f9da80b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:08.042 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da80ce2c0 con 0x7f9da8142410 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f9d98001670 con 0x7f9da8142410 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 >> v1:172.21.15.8:6789/0 conn(0x7f9da8142410 legacy=0x7f9da8070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da8142b30 0x7f9d8c005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c006180 0x7f9d8c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006f10 0x7f9d8c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80cdfe0 con 0x7f9d8c006180 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c00dcd0 con 0x7f9d8c006f10 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c00de90 con 0x7f9da8142b30 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.043+0000 7f9d9fe00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c006180 0x7f9d8c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.044+0000 7f9da7400640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da8142b30 0x7f9d8c005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.044+0000 7f9da7e00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006f10 0x7f9d8c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.044+0000 7f9d9fe00640 1 -- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da8142b30 msgr2=0x7f9d8c005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.044+0000 7f9d9fe00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da8142b30 0x7f9d8c005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:08.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.044+0000 7f9d9fe00640 1 -- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006f10 msgr2=0x7f9d8c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:08.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.044+0000 7f9d9fe00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006f10 0x7f9d8c007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:08.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.044+0000 7f9d9fe00640 1 -- 172.21.15.8:0/8776974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c005730 con 0x7f9d8c006180 2024-05-26T15:43:08.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.044+0000 7f9da7e00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006f10 0x7f9d8c007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.045+0000 7f9d9fe00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c006180 0x7f9d8c0069d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009ac0 tx=0x7f9d8c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ec7eacc93239be server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.045+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90031400 con 0x7f9d8c006180 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.045+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9002d050 con 0x7f9d8c006180 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.045+0000 7f9da6a00640 1 -- 172.21.15.8:0/8776974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90031780 con 0x7f9d8c006180 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.046+0000 7f9dacc00640 1 -- 172.21.15.8:0/8776974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c006180 msgr2=0x7f9d8c0069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.046+0000 7f9dacc00640 1 --2- 172.21.15.8:0/8776974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d8c006180 0x7f9d8c0069d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009ac0 tx=0x7f9d8c007a00 comp rx=0 tx=0).stop 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.046+0000 7f9da7e00640 1 -- 172.21.15.8:0/8776974 reap_dead start 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.046+0000 7f9dacc00640 1 -- 172.21.15.8:0/8776974 shutdown_connections 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.046+0000 7f9dacc00640 1 -- 172.21.15.8:0/8776974 >> 172.21.15.8:0/8776974 conn(0x7f9da8069ed0 msgr2=0x7f9da806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.046+0000 7f9dacc00640 1 -- 172.21.15.8:0/8776974 shutdown_connections 2024-05-26T15:43:08.045 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.046+0000 7f9dacc00640 1 -- 172.21.15.8:0/8776974 wait complete. 2024-05-26T15:43:08.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.048+0000 7f9dacc00640 1 Processor -- start 2024-05-26T15:43:08.046 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.048+0000 7f9dacc00640 1 -- start start 2024-05-26T15:43:08.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9dacc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006180 0x7f9da8133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:08.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9dacc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da80b0490 0x7f9da81f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:08.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9dacc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9da80b08f0 0x7f9da813c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:08.047 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9dacc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da8157aa0 con 0x7f9da80b08f0 2024-05-26T15:43:08.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9dacc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da8134390 con 0x7f9d8c006180 2024-05-26T15:43:08.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9dacc00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da8156e20 con 0x7f9da80b0490 2024-05-26T15:43:08.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9da7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9da80b08f0 0x7f9da813c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:08.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9da7e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9da80b08f0 0x7f9da813c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58188/0 (socket says 172.21.15.8:58188) 2024-05-26T15:43:08.048 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9da7e00640 1 -- 172.21.15.8:0/3149756211 learned_addr learned my addr 172.21.15.8:0/3149756211 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:08.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9da7400640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006180 0x7f9da8133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:08.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9d9fe00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da80b0490 0x7f9da81f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:08.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9da7e00640 1 -- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da80b0490 msgr2=0x7f9da81f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:08.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9da7e00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da80b0490 0x7f9da81f2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:08.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9da7e00640 1 -- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006180 msgr2=0x7f9da8133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:08.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9da7e00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006180 0x7f9da8133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:08.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9da7e00640 1 -- 172.21.15.8:0/3149756211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8157100 con 0x7f9da80b08f0 2024-05-26T15:43:08.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9d9fe00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da80b0490 0x7f9da81f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:08.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.049+0000 7f9da7400640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006180 0x7f9da8133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:08.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.050+0000 7f9da7e00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9da80b08f0 0x7f9da813c9a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9da806e3a0 tx=0x7f9da000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:08.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.050+0000 7f9d9f400640 1 -- 172.21.15.8:0/3149756211 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0006d50 con 0x7f9da80b08f0 2024-05-26T15:43:08.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.050+0000 7f9d9f400640 1 -- 172.21.15.8:0/3149756211 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da0003970 con 0x7f9da80b08f0 2024-05-26T15:43:08.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.050+0000 7f9d9f400640 1 -- 172.21.15.8:0/3149756211 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da0003d60 con 0x7f9da80b08f0 2024-05-26T15:43:08.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.050+0000 7f9dacc00640 1 -- 172.21.15.8:0/3149756211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da81573e0 con 0x7f9da80b08f0 2024-05-26T15:43:08.050 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.050+0000 7f9dacc00640 1 -- 172.21.15.8:0/3149756211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da813b1b0 con 0x7f9da80b08f0 2024-05-26T15:43:08.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.052+0000 7f9dacc00640 1 -- 172.21.15.8:0/3149756211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da8067300 con 0x7f9da80b08f0 2024-05-26T15:43:08.051 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.052+0000 7f9d9f400640 1 -- 172.21.15.8:0/3149756211 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9da0005070 con 0x7f9da80b08f0 2024-05-26T15:43:08.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.054+0000 7f9d9f400640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d8406ac00 0x7f9d8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:08.052 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.054+0000 7f9d9f400640 1 -- 172.21.15.8:0/3149756211 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f9da0089480 con 0x7f9da80b08f0 2024-05-26T15:43:08.053 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.055+0000 7f9da7400640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d8406ac00 0x7f9d8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:08.054 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.056+0000 7f9da7400640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d8406ac00 0x7f9d8406d0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9d98001bb0 tx=0x7f9d98000f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:08.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.059+0000 7f9d9f400640 1 -- 172.21.15.8:0/3149756211 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9da0054430 con 0x7f9da80b08f0 2024-05-26T15:43:08.295 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.296+0000 7f9dacc00640 1 -- 172.21.15.8:0/3149756211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9da8157be0 con 0x7f9da80b08f0 2024-05-26T15:43:08.296 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.297+0000 7f9d9f400640 1 -- 172.21.15.8:0/3149756211 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f9da8157be0 con 0x7f9da80b08f0 2024-05-26T15:43:08.296 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:08.296 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:43:08.297 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:43:08.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.300+0000 7f9dacc00640 1 -- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d8406ac00 msgr2=0x7f9d8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:08.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.300+0000 7f9dacc00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d8406ac00 0x7f9d8406d0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9d98001bb0 tx=0x7f9d98000f50 comp rx=0 tx=0).stop 2024-05-26T15:43:08.299 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.300+0000 7f9dacc00640 1 -- 172.21.15.8:0/3149756211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9da80b08f0 msgr2=0x7f9da813c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.300+0000 7f9dacc00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9da80b08f0 0x7f9da813c9a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9da806e3a0 tx=0x7f9da000dc00 comp rx=0 tx=0).stop 2024-05-26T15:43:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.301+0000 7f9dacc00640 1 -- 172.21.15.8:0/3149756211 shutdown_connections 2024-05-26T15:43:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.301+0000 7f9dacc00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9da80b08f0 0x7f9da813c9a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.301+0000 7f9dacc00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f9da80b0490 0x7f9da81f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.301+0000 7f9dacc00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f9d8406ac00 0x7f9d8406d0c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.301+0000 7f9dacc00640 1 --2- 172.21.15.8:0/3149756211 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d8c006180 0x7f9da8133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.301+0000 7f9dacc00640 1 -- 172.21.15.8:0/3149756211 >> 172.21.15.8:0/3149756211 conn(0x7f9da8069ed0 msgr2=0x7f9da80b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.301+0000 7f9dacc00640 1 -- 172.21.15.8:0/3149756211 shutdown_connections 2024-05-26T15:43:08.300 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:08.301+0000 7f9dacc00640 1 -- 172.21.15.8:0/3149756211 wait complete. 2024-05-26T15:43:08.319 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:43:08.551 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":89,"msgr_send_messages":44,"msgr_recv_bytes":131774,"msgr_send_bytes":36118,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.032203661,"msgr_running_send_time":0.010524865,"msgr_running_recv_time":0.017293981,"msgr_running_fast_dispatch_time":0.004223641,"msgr_send_messages_queue_lat":{"avgcount":44,"sum":0.012058911,"avgtime":0.000274066},"msgr_handle_ack_lat":{"avgcount":10,"sum":0.000008323,"avgtime":0.000000832},"msgr_recv_encrypted_bytes":110144,"msgr_send_encrypted_bytes":11632},"AsyncMessenger::Worker-1":{"msgr_recv_messages":28,"msgr_send_messages":39,"msgr_recv_bytes":14647,"msgr_send_bytes":85574,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.011481573,"msgr_running_send_time":0.003967123,"msgr_running_recv_time":0.005224289,"msgr_running_fast_dispatch_time":0.001475737,"msgr_send_messages_queue_lat":{"avgcount":37,"sum":0.007669417,"avgtime":0.000207281},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":71232},"AsyncMessenger::Worker-2":{"msgr_recv_messages":18,"msgr_send_messages":20,"msgr_recv_bytes":12233,"msgr_send_bytes":7123,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.007166251,"msgr_running_send_time":0.001434608,"msgr_running_recv_time":0.004552746,"msgr_running_fast_dispatch_time":0.000801788,"msgr_send_messages_queue_lat":{"avgcount":19,"sum":0.009153694,"avgtime":0.000481773},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":53,"sum":0.009806223,"avgtime":0.000185023}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4202283,"rdpos":4195196,"jlat":{"avgcount":4,"sum":0.017303902,"avgtime":0.004325975},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":40064,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":2,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":807,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":238061,"buffer_anon_items":75,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55152,"mds_co_items":252,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":52,"op_send_bytes":5580,"op_resend":0,"op_reply":52,"op_latency":{"avgcount":52,"sum":0.120998586,"avgtime":0.002326895},"op_inflight":0,"oplen_avg":{"avgcount":52,"sum":105},"op":52,"op_r":36,"op_w":16,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":132,"get_sum":144800,"get_or_fail_fail":0,"get_or_fail_success":132,"take":0,"take_sum":0,"put":132,"put_sum":144800,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":6462,"put":52,"put_sum":6462,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":52,"take_sum":52,"put":52,"put_sum":52,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":2327,"max":3758096384,"get_started":0,"get":5,"get_sum":6833,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":4,"put_sum":4506,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:43:08.552 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 10, "avgtime": 8.32e-07, "sum": 8.323e-06 }, "msgr_recv_bytes": 131774, "msgr_recv_encrypted_bytes": 110144, "msgr_recv_messages": 89, "msgr_running_fast_dispatch_time": 0.004223641, "msgr_running_recv_time": 0.017293981, "msgr_running_send_time": 0.010524865, "msgr_running_total_time": 0.032203661, "msgr_send_bytes": 36118, "msgr_send_encrypted_bytes": 11632, "msgr_send_messages": 44, "msgr_send_messages_queue_lat": { "avgcount": 44, "avgtime": 0.000274066, "sum": 0.012058911 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14647, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 28, "msgr_running_fast_dispatch_time": 0.001475737, "msgr_running_recv_time": 0.005224289, "msgr_running_send_time": 0.003967123, "msgr_running_total_time": 0.011481573, "msgr_send_bytes": 85574, "msgr_send_encrypted_bytes": 71232, "msgr_send_messages": 39, "msgr_send_messages_queue_lat": { "avgcount": 37, "avgtime": 0.000207281, "sum": 0.007669417 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 12233, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 18, "msgr_running_fast_dispatch_time": 0.000801788, "msgr_running_recv_time": 0.004552746, "msgr_running_send_time": 0.001434608, "msgr_running_total_time": 0.007166251, "msgr_send_bytes": 7123, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 20, "msgr_send_messages_queue_lat": { "avgcount": 19, "avgtime": 0.000481773, "sum": 0.009153694 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 53, "avgtime": 0.000185023, "sum": 0.009806223 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.004325975, "sum": 0.017303902 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4202283 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 40064 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 2, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 807, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 238061, "buffer_anon_items": 75, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 55152, "mds_co_items": 252, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 52, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 52, "avgtime": 0.002326895, "sum": 0.120998586 }, "op_pg": 0, "op_r": 36, "op_reply": 52, "op_resend": 0, "op_rmw": 0, "op_send": 52, "op_send_bytes": 5580, "op_w": 16, "oplen_avg": { "avgcount": 52, "sum": 105 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 132, "get_or_fail_fail": 0, "get_or_fail_success": 132, "get_started": 0, "get_sum": 144800, "max": 104857600, "put": 132, "put_sum": 144800, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 52, "put_sum": 6462, "take": 52, "take_sum": 6462, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 52, "put_sum": 52, "take": 52, "take_sum": 52, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6833, "max": 3758096384, "put": 4, "put_sum": 4506, "take": 0, "take_sum": 0, "val": 2327, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:43:08.552 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2024-05-26T15:43:13.553 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:43:13.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.777+0000 7f1eef200640 1 Processor -- start 2024-05-26T15:43:13.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.778+0000 7f1eef200640 1 -- start start 2024-05-26T15:43:13.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.779+0000 7f1eef200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1ef0144180 0x7f1ef00cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:13.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.779+0000 7f1eef200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ef006db60 0x7f1ef006dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:13.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.779+0000 7f1eef200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef0144560 con 0x7f1ef0070570 2024-05-26T15:43:13.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.779+0000 7f1eef200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef015b190 con 0x7f1ef006db60 2024-05-26T15:43:13.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.779+0000 7f1eef200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef015b470 con 0x7f1ef0144180 2024-05-26T15:43:13.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.780+0000 7f1eed400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ef006db60 0x7f1ef006dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:13.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.780+0000 7f1eed400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ef006db60 0x7f1ef006dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60992/0 (socket says 172.21.15.8:60992) 2024-05-26T15:43:13.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.780+0000 7f1eed400640 1 -- 172.21.15.8:0/3503947664 learned_addr learned my addr 172.21.15.8:0/3503947664 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:13.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.780+0000 7f1eede00640 1 --2- 172.21.15.8:0/3503947664 >> v2:172.21.15.47:3300/0 conn(0x7f1ef0144180 0x7f1ef00cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:13.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.780+0000 7f1eed400640 1 -- 172.21.15.8:0/3503947664 >> v2:172.21.15.47:3300/0 conn(0x7f1ef0144180 msgr2=0x7f1ef00cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:13.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.780+0000 7f1eed400640 1 --2- 172.21.15.8:0/3503947664 >> v2:172.21.15.47:3300/0 conn(0x7f1ef0144180 0x7f1ef00cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:13.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.781+0000 7f1eed400640 1 -- 172.21.15.8:0/3503947664 >> v1:172.21.15.47:6789/0 conn(0x7f1ef0070570 legacy=0x7f1ef006c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:13.780 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.781+0000 7f1eed400640 1 -- 172.21.15.8:0/3503947664 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef015b750 con 0x7f1ef006db60 2024-05-26T15:43:13.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.782+0000 7f1eed400640 1 --2- 172.21.15.8:0/3503947664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef006db60 0x7f1ef006dff0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1ef006ace0 tx=0x7f1ed802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8334af60e2fb6585 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:13.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.782+0000 7f1eeca00640 1 -- 172.21.15.8:0/3503947664 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8032440 con 0x7f1ef006db60 2024-05-26T15:43:13.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.782+0000 7f1eeca00640 1 -- 172.21.15.8:0/3503947664 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed80325a0 con 0x7f1ef006db60 2024-05-26T15:43:13.781 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.782+0000 7f1eeca00640 1 -- 172.21.15.8:0/3503947664 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8032930 con 0x7f1ef006db60 2024-05-26T15:43:13.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.783+0000 7f1eef200640 1 -- 172.21.15.8:0/3503947664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef006db60 msgr2=0x7f1ef006dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:13.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.783+0000 7f1eef200640 1 --2- 172.21.15.8:0/3503947664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef006db60 0x7f1ef006dff0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1ef006ace0 tx=0x7f1ed802a1a0 comp rx=0 tx=0).stop 2024-05-26T15:43:13.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.783+0000 7f1eef200640 1 -- 172.21.15.8:0/3503947664 shutdown_connections 2024-05-26T15:43:13.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.783+0000 7f1eef200640 1 --2- 172.21.15.8:0/3503947664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef006db60 0x7f1ef006dff0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:13.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.783+0000 7f1eef200640 1 --2- 172.21.15.8:0/3503947664 >> v2:172.21.15.47:3300/0 conn(0x7f1ef0144180 0x7f1ef00cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:13.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.783+0000 7f1eef200640 1 -- 172.21.15.8:0/3503947664 >> 172.21.15.8:0/3503947664 conn(0x7f1ef0069ed0 msgr2=0x7f1ef006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:13.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.783+0000 7f1eef200640 1 -- 172.21.15.8:0/3503947664 shutdown_connections 2024-05-26T15:43:13.782 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.783+0000 7f1eef200640 1 -- 172.21.15.8:0/3503947664 wait complete. 2024-05-26T15:43:13.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.785+0000 7f1eef200640 1 Processor -- start 2024-05-26T15:43:13.783 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.785+0000 7f1eef200640 1 -- start start 2024-05-26T15:43:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.786+0000 7f1eef200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ef006db60 0x7f1ef01362c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.786+0000 7f1eef200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ef0070570 0x7f1ef0155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.786+0000 7f1eef200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef0144180 0x7f1ef0156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:13.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.786+0000 7f1eef200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef0156b60 con 0x7f1ef0144180 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.786+0000 7f1eef200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef0143270 con 0x7f1ef0070570 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.786+0000 7f1eef200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef01424f0 con 0x7f1ef006db60 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.786+0000 7f1eee800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef0144180 0x7f1ef0156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.786+0000 7f1eee800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef0144180 0x7f1ef0156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60996/0 (socket says 172.21.15.8:60996) 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.786+0000 7f1eee800640 1 -- 172.21.15.8:0/2135534951 learned_addr learned my addr 172.21.15.8:0/2135534951 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1eed400640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ef0070570 0x7f1ef0155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1eede00640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ef006db60 0x7f1ef01362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1eee800640 1 -- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ef006db60 msgr2=0x7f1ef01362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1eee800640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ef006db60 0x7f1ef01362c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1eee800640 1 -- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ef0070570 msgr2=0x7f1ef0155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:13.787 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1eee800640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ef0070570 0x7f1ef0155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:13.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1eee800640 1 -- 172.21.15.8:0/2135534951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80094d0 con 0x7f1ef0144180 2024-05-26T15:43:13.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1eede00640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ef006db60 0x7f1ef01362c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:13.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1eee800640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef0144180 0x7f1ef0156200 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c7b0 tx=0x7f1ee800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:13.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1ee6000640 1 -- 172.21.15.8:0/2135534951 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8004b60 con 0x7f1ef0144180 2024-05-26T15:43:13.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1ee6000640 1 -- 172.21.15.8:0/2135534951 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee8004cc0 con 0x7f1ef0144180 2024-05-26T15:43:13.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1ee6000640 1 -- 172.21.15.8:0/2135534951 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee800aa90 con 0x7f1ef0144180 2024-05-26T15:43:13.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.787+0000 7f1eef200640 1 -- 172.21.15.8:0/2135534951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef015af60 con 0x7f1ef0144180 2024-05-26T15:43:13.788 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.788+0000 7f1eef200640 1 -- 172.21.15.8:0/2135534951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef0142a20 con 0x7f1ef0144180 2024-05-26T15:43:13.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.789+0000 7f1eef200640 1 -- 172.21.15.8:0/2135534951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef0156740 con 0x7f1ef0144180 2024-05-26T15:43:13.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.790+0000 7f1ee6000640 1 -- 172.21.15.8:0/2135534951 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ee800abf0 con 0x7f1ef0144180 2024-05-26T15:43:13.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.791+0000 7f1ee6000640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1ecc06ac00 0x7f1ecc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:13.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.791+0000 7f1ee6000640 1 -- 172.21.15.8:0/2135534951 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f1ee80896e0 con 0x7f1ef0144180 2024-05-26T15:43:13.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.792+0000 7f1eede00640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1ecc06ac00 0x7f1ecc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:13.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.793+0000 7f1eede00640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1ecc06ac00 0x7f1ecc06d0c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0006fd0 tx=0x7f1ee0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:13.794 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:13.795+0000 7f1ee6000640 1 -- 172.21.15.8:0/2135534951 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1ee8054710 con 0x7f1ef0144180 2024-05-26T15:43:14.032 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.033+0000 7f1eef200640 1 -- 172.21.15.8:0/2135534951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ef004e210 con 0x7f1ef0144180 2024-05-26T15:43:14.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.034+0000 7f1ee6000640 1 -- 172.21.15.8:0/2135534951 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f1ee8057d30 con 0x7f1ef0144180 2024-05-26T15:43:14.033 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:14.033 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:43:14.034 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 -- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1ecc06ac00 msgr2=0x7f1ecc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1ecc06ac00 0x7f1ecc06d0c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0006fd0 tx=0x7f1ee0008040 comp rx=0 tx=0).stop 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 -- 172.21.15.8:0/2135534951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef0144180 msgr2=0x7f1ef0156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef0144180 0x7f1ef0156200 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c7b0 tx=0x7f1ee800cc70 comp rx=0 tx=0).stop 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 -- 172.21.15.8:0/2135534951 shutdown_connections 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ef0144180 0x7f1ef0156200 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1ecc06ac00 0x7f1ecc06d0c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ef0070570 0x7f1ef0155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 --2- 172.21.15.8:0/2135534951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1ef006db60 0x7f1ef01362c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 -- 172.21.15.8:0/2135534951 >> 172.21.15.8:0/2135534951 conn(0x7f1ef0069ed0 msgr2=0x7f1ef00b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:14.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 -- 172.21.15.8:0/2135534951 shutdown_connections 2024-05-26T15:43:14.037 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.037+0000 7f1eef200640 1 -- 172.21.15.8:0/2135534951 wait complete. 2024-05-26T15:43:14.057 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:43:14.288 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":96,"msgr_send_messages":45,"msgr_recv_bytes":134458,"msgr_send_bytes":36710,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.034311230,"msgr_running_send_time":0.011506120,"msgr_running_recv_time":0.017787712,"msgr_running_fast_dispatch_time":0.004806227,"msgr_send_messages_queue_lat":{"avgcount":45,"sum":0.012159910,"avgtime":0.000270220},"msgr_handle_ack_lat":{"avgcount":10,"sum":0.000008323,"avgtime":0.000000832},"msgr_recv_encrypted_bytes":110416,"msgr_send_encrypted_bytes":12224},"AsyncMessenger::Worker-1":{"msgr_recv_messages":30,"msgr_send_messages":42,"msgr_recv_bytes":15139,"msgr_send_bytes":90389,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.012243416,"msgr_running_send_time":0.004357113,"msgr_running_recv_time":0.005343169,"msgr_running_fast_dispatch_time":0.001670821,"msgr_send_messages_queue_lat":{"avgcount":40,"sum":0.008050410,"avgtime":0.000201260},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":73008},"AsyncMessenger::Worker-2":{"msgr_recv_messages":22,"msgr_send_messages":24,"msgr_recv_bytes":13443,"msgr_send_bytes":8975,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.008123335,"msgr_running_send_time":0.001811774,"msgr_running_recv_time":0.004802054,"msgr_running_fast_dispatch_time":0.001078373,"msgr_send_messages_queue_lat":{"avgcount":23,"sum":0.009488514,"avgtime":0.000412544},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":58,"sum":0.010373052,"avgtime":0.000178845}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4202283,"rdpos":4195196,"jlat":{"avgcount":5,"sum":0.023690158,"avgtime":0.004738031},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":40448,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":2,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":812,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":254093,"buffer_anon_items":79,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":56528,"mds_co_items":257,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":58,"op_send_bytes":8399,"op_resend":0,"op_reply":58,"op_latency":{"avgcount":58,"sum":0.153998201,"avgtime":0.002655141},"op_inflight":0,"oplen_avg":{"avgcount":58,"sum":116},"op":58,"op_r":36,"op_w":22,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":5,"osdop_writefull":2,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":48,"omap_del":5},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":3,"omap_total_removes":1},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":145,"get_sum":148060,"get_or_fail_fail":0,"get_or_fail_success":145,"take":0,"take_sum":0,"put":145,"put_sum":148060,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":9281,"put":58,"put_sum":9281,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":58,"put":58,"put_sum":58,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":5,"get_sum":6833,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":5,"put_sum":6833,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:43:14.290 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 10, "avgtime": 8.32e-07, "sum": 8.323e-06 }, "msgr_recv_bytes": 134458, "msgr_recv_encrypted_bytes": 110416, "msgr_recv_messages": 96, "msgr_running_fast_dispatch_time": 0.004806227, "msgr_running_recv_time": 0.017787712, "msgr_running_send_time": 0.01150612, "msgr_running_total_time": 0.03431123, "msgr_send_bytes": 36710, "msgr_send_encrypted_bytes": 12224, "msgr_send_messages": 45, "msgr_send_messages_queue_lat": { "avgcount": 45, "avgtime": 0.00027022, "sum": 0.01215991 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 15139, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.001670821, "msgr_running_recv_time": 0.005343169, "msgr_running_send_time": 0.004357113, "msgr_running_total_time": 0.012243416, "msgr_send_bytes": 90389, "msgr_send_encrypted_bytes": 73008, "msgr_send_messages": 42, "msgr_send_messages_queue_lat": { "avgcount": 40, "avgtime": 0.00020126, "sum": 0.00805041 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 13443, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 22, "msgr_running_fast_dispatch_time": 0.001078373, "msgr_running_recv_time": 0.004802054, "msgr_running_send_time": 0.001811774, "msgr_running_total_time": 0.008123335, "msgr_send_bytes": 8975, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 24, "msgr_send_messages_queue_lat": { "avgcount": 23, "avgtime": 0.000412544, "sum": 0.009488514 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 58, "avgtime": 0.000178845, "sum": 0.010373052 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.004738031, "sum": 0.023690158 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4202283 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 40448 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 2, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 812, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 254093, "buffer_anon_items": 79, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 56528, "mds_co_items": 257, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 5, "omap_rd": 48, "omap_wr": 16, "op": 58, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 58, "avgtime": 0.002655141, "sum": 0.153998201 }, "op_pg": 0, "op_r": 36, "op_reply": 58, "op_resend": 0, "op_rmw": 0, "op_send": 58, "op_send_bytes": 8399, "op_w": 22, "oplen_avg": { "avgcount": 58, "sum": 116 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 3 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 145, "get_or_fail_fail": 0, "get_or_fail_success": 145, "get_started": 0, "get_sum": 148060, "max": 104857600, "put": 145, "put_sum": 148060, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 58, "put_sum": 9281, "take": 58, "take_sum": 9281, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 58, "put_sum": 58, "take": 58, "take_sum": 58, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6833, "max": 3758096384, "put": 5, "put_sum": 6833, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:43:14.290 DEBUG:tasks.ceph_test_case:wait_until_true: success in 30s and 0 retries 2024-05-26T15:43:14.290 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:43:14.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.507+0000 7ff3eec00640 1 Processor -- start 2024-05-26T15:43:14.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.507+0000 7ff3eec00640 1 -- start start 2024-05-26T15:43:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.509+0000 7ff3eec00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff3e81445d0 0x7ff3e806e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.509+0000 7ff3eec00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e806d380 con 0x7ff3e815ed30 2024-05-26T15:43:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.509+0000 7ff3eec00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e806d660 con 0x7ff3e815f230 2024-05-26T15:43:14.507 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.509+0000 7ff3eec00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e806d940 con 0x7ff3e81445d0 2024-05-26T15:43:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.509+0000 7ff3ecc00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff3e815ed30 0x7ff3e815c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:54072/0 (socket says 172.21.15.8:54072) 2024-05-26T15:43:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.509+0000 7ff3ecc00640 1 -- 172.21.15.8:0/2950662769 learned_addr learned my addr 172.21.15.8:0/2950662769 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.509+0000 7ff3e7e00640 1 --2- 172.21.15.8:0/2950662769 >> v2:172.21.15.47:3300/0 conn(0x7ff3e81445d0 0x7ff3e806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795169157 0 0) 0x7ff3e806d380 con 0x7ff3e815ed30 2024-05-26T15:43:14.508 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3cc003520 con 0x7ff3e815ed30 2024-05-26T15:43:14.510 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2532298540 0 0) 0x7ff3cc003520 con 0x7ff3e815ed30 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 >> v2:172.21.15.47:3300/0 conn(0x7ff3e81445d0 msgr2=0x7ff3e806e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 --2- 172.21.15.8:0/2950662769 >> v2:172.21.15.47:3300/0 conn(0x7ff3e81445d0 0x7ff3e806e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 >> v1:172.21.15.47:6789/0 conn(0x7ff3e815f230 legacy=0x7ff3e815e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e806dc20 con 0x7ff3e815ed30 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7ff3e00019f0 con 0x7ff3e815ed30 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 >> v1:172.21.15.8:6789/0 conn(0x7ff3e815ed30 legacy=0x7ff3e815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc003970 0x7ff3cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff3cc0047c0 0x7ff3cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3cc005180 0x7ff3cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e806d940 con 0x7ff3cc003970 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc00c120 con 0x7ff3cc005180 2024-05-26T15:43:14.511 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.510+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc00c2e0 con 0x7ff3cc0047c0 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3e7e00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc003970 0x7ff3cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3ecc00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3cc005180 0x7ff3cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3e7400640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff3cc0047c0 0x7ff3cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3e7e00640 1 -- 172.21.15.8:0/2950662769 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff3cc0047c0 msgr2=0x7ff3cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3e7e00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff3cc0047c0 0x7ff3cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3e7e00640 1 -- 172.21.15.8:0/2950662769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3cc005180 msgr2=0x7ff3cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3e7e00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3cc005180 0x7ff3cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3e7e00640 1 -- 172.21.15.8:0/2950662769 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc003520 con 0x7ff3cc003970 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3ecc00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3cc005180 0x7ff3cc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3e7400640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff3cc0047c0 0x7ff3cc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:14.512 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.511+0000 7ff3ecc00640 1 -- 172.21.15.8:0/2950662769 reap_dead start 2024-05-26T15:43:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.513+0000 7ff3e7e00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc003970 0x7ff3cc003d90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009ac0 tx=0x7ff3cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ea754ba3ce95d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.513+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8031400 con 0x7ff3cc003970 2024-05-26T15:43:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.513+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d802d050 con 0x7ff3cc003970 2024-05-26T15:43:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.513+0000 7ff3e6a00640 1 -- 172.21.15.8:0/2950662769 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8031780 con 0x7ff3cc003970 2024-05-26T15:43:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.514+0000 7ff3eec00640 1 -- 172.21.15.8:0/2950662769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc003970 msgr2=0x7ff3cc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.514+0000 7ff3eec00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc003970 0x7ff3cc003d90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009ac0 tx=0x7ff3cc0057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.514+0000 7ff3eec00640 1 -- 172.21.15.8:0/2950662769 shutdown_connections 2024-05-26T15:43:14.514 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.514+0000 7ff3eec00640 1 --2- 172.21.15.8:0/2950662769 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3cc003970 0x7ff3cc003d90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.514+0000 7ff3eec00640 1 -- 172.21.15.8:0/2950662769 >> 172.21.15.8:0/2950662769 conn(0x7ff3e80b0720 msgr2=0x7ff3e80b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.514+0000 7ff3eec00640 1 -- 172.21.15.8:0/2950662769 shutdown_connections 2024-05-26T15:43:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.514+0000 7ff3eec00640 1 -- 172.21.15.8:0/2950662769 wait complete. 2024-05-26T15:43:14.515 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.515+0000 7ff3eec00640 1 Processor -- start 2024-05-26T15:43:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.516+0000 7ff3eec00640 1 -- start start 2024-05-26T15:43:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3eec00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff3cc003970 0x7ff3e815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3eec00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e81f09b0 0x7ff3e81f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3eec00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e80af1d0 0x7ff3e80af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3eec00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e80afb90 con 0x7ff3e80af1d0 2024-05-26T15:43:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3eec00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e813bbe0 con 0x7ff3e81f09b0 2024-05-26T15:43:14.517 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3eec00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e813be30 con 0x7ff3cc003970 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3ecc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e80af1d0 0x7ff3e80af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3ecc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e80af1d0 0x7ff3e80af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32772/0 (socket says 172.21.15.8:32772) 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3ecc00640 1 -- 172.21.15.8:0/4134022137 learned_addr learned my addr 172.21.15.8:0/4134022137 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3e7e00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff3cc003970 0x7ff3e815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.517+0000 7ff3e7400640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e81f09b0 0x7ff3e81f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3ecc00640 1 -- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff3cc003970 msgr2=0x7ff3e815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3ecc00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff3cc003970 0x7ff3e815a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3ecc00640 1 -- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e81f09b0 msgr2=0x7ff3e81f0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3ecc00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e81f09b0 0x7ff3e81f0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3ecc00640 1 -- 172.21.15.8:0/4134022137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e813c110 con 0x7ff3e80af1d0 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3e7400640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e81f09b0 0x7ff3e81f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3ecc00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e80af1d0 0x7ff3e80af650 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0001f30 tx=0x7ff3e0007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:14.518 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3dfe00640 1 -- 172.21.15.8:0/4134022137 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e000ea80 con 0x7ff3e80af1d0 2024-05-26T15:43:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3dfe00640 1 -- 172.21.15.8:0/4134022137 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e000ebe0 con 0x7ff3e80af1d0 2024-05-26T15:43:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3eec00640 1 -- 172.21.15.8:0/4134022137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e813c3f0 con 0x7ff3e80af1d0 2024-05-26T15:43:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3dfe00640 1 -- 172.21.15.8:0/4134022137 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0013420 con 0x7ff3e80af1d0 2024-05-26T15:43:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.518+0000 7ff3eec00640 1 -- 172.21.15.8:0/4134022137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e81f3f60 con 0x7ff3e80af1d0 2024-05-26T15:43:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.520+0000 7ff3eec00640 1 -- 172.21.15.8:0/4134022137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e804e210 con 0x7ff3e80af1d0 2024-05-26T15:43:14.519 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.521+0000 7ff3dfe00640 1 -- 172.21.15.8:0/4134022137 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff3e0013580 con 0x7ff3e80af1d0 2024-05-26T15:43:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.521+0000 7ff3dfe00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff3c806ac00 0x7ff3c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.522+0000 7ff3dfe00640 1 -- 172.21.15.8:0/4134022137 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6115+0+0 (secure 0 0 0) 0x7ff3e0089910 con 0x7ff3e80af1d0 2024-05-26T15:43:14.520 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.522+0000 7ff3e7e00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff3c806ac00 0x7ff3c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:14.521 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.523+0000 7ff3e7e00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff3c806ac00 0x7ff3c806d0c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8033000 tx=0x7ff3d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:14.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.526+0000 7ff3dfe00640 1 -- 172.21.15.8:0/4134022137 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff3e00548b0 con 0x7ff3e80af1d0 2024-05-26T15:43:14.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.758+0000 7ff3eec00640 1 -- 172.21.15.8:0/4134022137 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3e813e830 con 0x7ff3e80af1d0 2024-05-26T15:43:14.757 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.759+0000 7ff3dfe00640 1 -- 172.21.15.8:0/4134022137 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7ff3e0057ed0 con 0x7ff3e80af1d0 2024-05-26T15:43:14.758 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:14.758 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:43:14.758 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:43:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.761+0000 7ff3eec00640 1 -- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff3c806ac00 msgr2=0x7ff3c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.761+0000 7ff3eec00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff3c806ac00 0x7ff3c806d0c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8033000 tx=0x7ff3d8008030 comp rx=0 tx=0).stop 2024-05-26T15:43:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.761+0000 7ff3eec00640 1 -- 172.21.15.8:0/4134022137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e80af1d0 msgr2=0x7ff3e80af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:14.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.761+0000 7ff3eec00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e80af1d0 0x7ff3e80af650 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0001f30 tx=0x7ff3e0007bc0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.763+0000 7ff3eec00640 1 -- 172.21.15.8:0/4134022137 shutdown_connections 2024-05-26T15:43:14.761 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.763+0000 7ff3eec00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff3e80af1d0 0x7ff3e80af650 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.763+0000 7ff3eec00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff3c806ac00 0x7ff3c806d0c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.763+0000 7ff3eec00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3e81f09b0 0x7ff3e81f0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.763+0000 7ff3eec00640 1 --2- 172.21.15.8:0/4134022137 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff3cc003970 0x7ff3e815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.763+0000 7ff3eec00640 1 -- 172.21.15.8:0/4134022137 >> 172.21.15.8:0/4134022137 conn(0x7ff3e80b0720 msgr2=0x7ff3e815e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.763+0000 7ff3eec00640 1 -- 172.21.15.8:0/4134022137 shutdown_connections 2024-05-26T15:43:14.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:14.763+0000 7ff3eec00640 1 -- 172.21.15.8:0/4134022137 wait complete. 2024-05-26T15:43:14.782 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:43:14.997 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":99,"msgr_send_messages":47,"msgr_recv_bytes":135589,"msgr_send_bytes":36989,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.035035785,"msgr_running_send_time":0.011888255,"msgr_running_recv_time":0.018121294,"msgr_running_fast_dispatch_time":0.004868981,"msgr_send_messages_queue_lat":{"avgcount":47,"sum":0.012284396,"avgtime":0.000261370},"msgr_handle_ack_lat":{"avgcount":11,"sum":0.000009480,"avgtime":0.000000861},"msgr_recv_encrypted_bytes":110896,"msgr_send_encrypted_bytes":12400},"AsyncMessenger::Worker-1":{"msgr_recv_messages":30,"msgr_send_messages":42,"msgr_recv_bytes":15139,"msgr_send_bytes":90389,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.012243416,"msgr_running_send_time":0.004357113,"msgr_running_recv_time":0.005343169,"msgr_running_fast_dispatch_time":0.001670821,"msgr_send_messages_queue_lat":{"avgcount":40,"sum":0.008050410,"avgtime":0.000201260},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":73008},"AsyncMessenger::Worker-2":{"msgr_recv_messages":22,"msgr_send_messages":24,"msgr_recv_bytes":13443,"msgr_send_bytes":8975,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.008123335,"msgr_running_send_time":0.001811774,"msgr_running_recv_time":0.004802054,"msgr_running_fast_dispatch_time":0.001078373,"msgr_send_messages_queue_lat":{"avgcount":23,"sum":0.009488514,"avgtime":0.000412544},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":58,"sum":0.010373052,"avgtime":0.000178845}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4202283,"rdpos":4195196,"jlat":{"avgcount":5,"sum":0.023690158,"avgtime":0.004738031},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":40576,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":3,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":812,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":254093,"buffer_anon_items":79,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":56528,"mds_co_items":257,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":58,"op_send_bytes":8399,"op_resend":0,"op_reply":58,"op_latency":{"avgcount":58,"sum":0.153998201,"avgtime":0.002655141},"op_inflight":0,"oplen_avg":{"avgcount":58,"sum":116},"op":58,"op_r":36,"op_w":22,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":5,"osdop_writefull":2,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":60,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":48,"omap_del":5},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":3,"omap_total_removes":1},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":148,"get_sum":148909,"get_or_fail_fail":0,"get_or_fail_success":148,"take":0,"take_sum":0,"put":148,"put_sum":148909,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":9281,"put":58,"put_sum":9281,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":58,"put":58,"put_sum":58,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":5,"get_sum":6833,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":5,"put_sum":6833,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:43:14.998 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 11, "avgtime": 8.61e-07, "sum": 9.48e-06 }, "msgr_recv_bytes": 135589, "msgr_recv_encrypted_bytes": 110896, "msgr_recv_messages": 99, "msgr_running_fast_dispatch_time": 0.004868981, "msgr_running_recv_time": 0.018121294, "msgr_running_send_time": 0.011888255, "msgr_running_total_time": 0.035035785, "msgr_send_bytes": 36989, "msgr_send_encrypted_bytes": 12400, "msgr_send_messages": 47, "msgr_send_messages_queue_lat": { "avgcount": 47, "avgtime": 0.00026137, "sum": 0.012284396 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 15139, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.001670821, "msgr_running_recv_time": 0.005343169, "msgr_running_send_time": 0.004357113, "msgr_running_total_time": 0.012243416, "msgr_send_bytes": 90389, "msgr_send_encrypted_bytes": 73008, "msgr_send_messages": 42, "msgr_send_messages_queue_lat": { "avgcount": 40, "avgtime": 0.00020126, "sum": 0.00805041 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 13443, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 22, "msgr_running_fast_dispatch_time": 0.001078373, "msgr_running_recv_time": 0.004802054, "msgr_running_send_time": 0.001811774, "msgr_running_total_time": 0.008123335, "msgr_send_bytes": 8975, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 24, "msgr_send_messages_queue_lat": { "avgcount": 23, "avgtime": 0.000412544, "sum": 0.009488514 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 58, "avgtime": 0.000178845, "sum": 0.010373052 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.004738031, "sum": 0.023690158 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4202283 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 40576 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 3, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 812, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 254093, "buffer_anon_items": 79, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 56528, "mds_co_items": 257, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 60, "map_full": 0, "map_inc": 1, "omap_del": 5, "omap_rd": 48, "omap_wr": 16, "op": 58, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 58, "avgtime": 0.002655141, "sum": 0.153998201 }, "op_pg": 0, "op_r": 36, "op_reply": 58, "op_resend": 0, "op_rmw": 0, "op_send": 58, "op_send_bytes": 8399, "op_w": 22, "oplen_avg": { "avgcount": 58, "sum": 116 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 3 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 148, "get_or_fail_fail": 0, "get_or_fail_success": 148, "get_started": 0, "get_sum": 148909, "max": 104857600, "put": 148, "put_sum": 148909, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 58, "put_sum": 9281, "take": 58, "take_sum": 9281, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 58, "put_sum": 58, "take": 58, "take_sum": 58, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6833, "max": 3758096384, "put": 5, "put_sum": 6833, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:43:14.999 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-05-26T15:43:14.999 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:43:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.206+0000 7f41f6a00640 1 Processor -- start 2024-05-26T15:43:15.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.206+0000 7f41f6a00640 1 -- start start 2024-05-26T15:43:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.207+0000 7f41f6a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f41f0144180 0x7f41f00cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.207+0000 7f41f6a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f41f0070c80 0x7f41f006dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:15.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.207+0000 7f41f6a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f0144560 con 0x7f41f006db60 2024-05-26T15:43:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.207+0000 7f41f6a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f015b190 con 0x7f41f0070c80 2024-05-26T15:43:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.207+0000 7f41f6a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f015b470 con 0x7f41f0144180 2024-05-26T15:43:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.208+0000 7f41f6000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f41f0070c80 0x7f41f006dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.208+0000 7f41f6000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f41f0070c80 0x7f41f006dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32776/0 (socket says 172.21.15.8:32776) 2024-05-26T15:43:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.208+0000 7f41f6000640 1 -- 172.21.15.8:0/2102128408 learned_addr learned my addr 172.21.15.8:0/2102128408 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:15.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.208+0000 7f41f5600640 1 --2- 172.21.15.8:0/2102128408 >> v2:172.21.15.47:3300/0 conn(0x7f41f0144180 0x7f41f00cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.208+0000 7f41f6000640 1 -- 172.21.15.8:0/2102128408 >> v2:172.21.15.47:3300/0 conn(0x7f41f0144180 msgr2=0x7f41f00cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.208+0000 7f41f6000640 1 --2- 172.21.15.8:0/2102128408 >> v2:172.21.15.47:3300/0 conn(0x7f41f0144180 0x7f41f00cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.208+0000 7f41f6000640 1 -- 172.21.15.8:0/2102128408 >> v1:172.21.15.47:6789/0 conn(0x7f41f006db60 legacy=0x7f41f0070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.208+0000 7f41f6000640 1 -- 172.21.15.8:0/2102128408 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f015b750 con 0x7f41f0070c80 2024-05-26T15:43:15.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.209+0000 7f41f6000640 1 --2- 172.21.15.8:0/2102128408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 0x7f41f006dff0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f41f006ace0 tx=0x7f41e802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb484e6583085d51 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.210+0000 7f41efe00640 1 -- 172.21.15.8:0/2102128408 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8031600 con 0x7f41f0070c80 2024-05-26T15:43:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.210+0000 7f41efe00640 1 -- 172.21.15.8:0/2102128408 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e802d050 con 0x7f41f0070c80 2024-05-26T15:43:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.210+0000 7f41efe00640 1 -- 172.21.15.8:0/2102128408 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8031980 con 0x7f41f0070c80 2024-05-26T15:43:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.210+0000 7f41f6a00640 1 -- 172.21.15.8:0/2102128408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 msgr2=0x7f41f006dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.210+0000 7f41f6a00640 1 --2- 172.21.15.8:0/2102128408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 0x7f41f006dff0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f41f006ace0 tx=0x7f41e802a6a0 comp rx=0 tx=0).stop 2024-05-26T15:43:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.210+0000 7f41f6a00640 1 -- 172.21.15.8:0/2102128408 shutdown_connections 2024-05-26T15:43:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.210+0000 7f41f6a00640 1 --2- 172.21.15.8:0/2102128408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 0x7f41f006dff0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:15.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.210+0000 7f41f6a00640 1 --2- 172.21.15.8:0/2102128408 >> v2:172.21.15.47:3300/0 conn(0x7f41f0144180 0x7f41f00cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.210+0000 7f41f6a00640 1 -- 172.21.15.8:0/2102128408 >> 172.21.15.8:0/2102128408 conn(0x7f41f0069ed0 msgr2=0x7f41f006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.211+0000 7f41f6a00640 1 -- 172.21.15.8:0/2102128408 shutdown_connections 2024-05-26T15:43:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.211+0000 7f41f6a00640 1 -- 172.21.15.8:0/2102128408 wait complete. 2024-05-26T15:43:15.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.212+0000 7f41f6a00640 1 Processor -- start 2024-05-26T15:43:15.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.213+0000 7f41f6a00640 1 -- start start 2024-05-26T15:43:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.213+0000 7f41f6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f006db60 0x7f41f00afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.213+0000 7f41f6a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 0x7f41f00ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.213+0000 7f41f6a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f41f0144180 0x7f41f00ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.214+0000 7f41f6a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00afa00 con 0x7f41f0070c80 2024-05-26T15:43:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.214+0000 7f41f6a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00aeb20 con 0x7f41f006db60 2024-05-26T15:43:15.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.214+0000 7f41f6a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00aedf0 con 0x7f41f0144180 2024-05-26T15:43:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.214+0000 7f41f4c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 0x7f41f00ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.214+0000 7f41f4c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 0x7f41f00ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32786/0 (socket says 172.21.15.8:32786) 2024-05-26T15:43:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.214+0000 7f41f4c00640 1 -- 172.21.15.8:0/1573965951 learned_addr learned my addr 172.21.15.8:0/1573965951 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.214+0000 7f41f5600640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f006db60 0x7f41f00afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.214+0000 7f41f6000640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f41f0144180 0x7f41f00ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.214+0000 7f41f4c00640 1 -- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f41f0144180 msgr2=0x7f41f00ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41f4c00640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f41f0144180 0x7f41f00ac320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:15.214 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41f4c00640 1 -- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f006db60 msgr2=0x7f41f00afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41f4c00640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f006db60 0x7f41f00afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41f4c00640 1 -- 172.21.15.8:0/1573965951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e8009b30 con 0x7f41f0070c80 2024-05-26T15:43:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41f5600640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f006db60 0x7f41f00afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:43:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41f4c00640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 0x7f41f00ae5e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c450 tx=0x7f41dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41ed600640 1 -- 172.21.15.8:0/1573965951 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0052d0 con 0x7f41f0070c80 2024-05-26T15:43:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41ed600640 1 -- 172.21.15.8:0/1573965951 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc005430 con 0x7f41f0070c80 2024-05-26T15:43:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41f6a00640 1 -- 172.21.15.8:0/1573965951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f015af60 con 0x7f41f0070c80 2024-05-26T15:43:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41ed600640 1 -- 172.21.15.8:0/1573965951 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc012870 con 0x7f41f0070c80 2024-05-26T15:43:15.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.215+0000 7f41f6a00640 1 -- 172.21.15.8:0/1573965951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f00af3b0 con 0x7f41f0070c80 2024-05-26T15:43:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.217+0000 7f41f6a00640 1 -- 172.21.15.8:0/1573965951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f00afb70 con 0x7f41f0070c80 2024-05-26T15:43:15.216 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.217+0000 7f41ed600640 1 -- 172.21.15.8:0/1573965951 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f41dc0129d0 con 0x7f41f0070c80 2024-05-26T15:43:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.218+0000 7f41ed600640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41d006ac00 0x7f41d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.218+0000 7f41ed600640 1 -- 172.21.15.8:0/1573965951 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f41dc089130 con 0x7f41f0070c80 2024-05-26T15:43:15.217 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.219+0000 7f41f5600640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41d006ac00 0x7f41d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:15.218 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.220+0000 7f41f5600640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41d006ac00 0x7f41d006d0c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f41e4006fd0 tx=0x7f41e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:15.221 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.223+0000 7f41ed600640 1 -- 172.21.15.8:0/1573965951 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f41dc0540a0 con 0x7f41f0070c80 2024-05-26T15:43:15.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.463+0000 7f41f6a00640 1 -- 172.21.15.8:0/1573965951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41f004e210 con 0x7f41f0070c80 2024-05-26T15:43:15.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.465+0000 7f41ed600640 1 -- 172.21.15.8:0/1573965951 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f41dc0576c0 con 0x7f41f0070c80 2024-05-26T15:43:15.464 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:15.464 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:43:15.464 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:43:15.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.467+0000 7f41f6a00640 1 -- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41d006ac00 msgr2=0x7f41d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:15.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41d006ac00 0x7f41d006d0c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f41e4006fd0 tx=0x7f41e4008040 comp rx=0 tx=0).stop 2024-05-26T15:43:15.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 -- 172.21.15.8:0/1573965951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 msgr2=0x7f41f00ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:15.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 0x7f41f00ae5e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00c450 tx=0x7f41dc00c910 comp rx=0 tx=0).stop 2024-05-26T15:43:15.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 -- 172.21.15.8:0/1573965951 shutdown_connections 2024-05-26T15:43:15.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f41f0144180 0x7f41f00ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:15.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f41f0070c80 0x7f41f00ae5e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:15.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f41d006ac00 0x7f41d006d0c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:15.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 --2- 172.21.15.8:0/1573965951 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f41f006db60 0x7f41f00afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:15.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 -- 172.21.15.8:0/1573965951 >> 172.21.15.8:0/1573965951 conn(0x7f41f0069ed0 msgr2=0x7f41f006d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:15.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 -- 172.21.15.8:0/1573965951 shutdown_connections 2024-05-26T15:43:15.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:15.468+0000 7f41f6a00640 1 -- 172.21.15.8:0/1573965951 wait complete. 2024-05-26T15:43:15.488 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-05-26T15:43:15.715 INFO:teuthology.orchestra.run.smithi008.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":99,"msgr_send_messages":47,"msgr_recv_bytes":135589,"msgr_send_bytes":36989,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.035035785,"msgr_running_send_time":0.011888255,"msgr_running_recv_time":0.018121294,"msgr_running_fast_dispatch_time":0.004868981,"msgr_send_messages_queue_lat":{"avgcount":47,"sum":0.012284396,"avgtime":0.000261370},"msgr_handle_ack_lat":{"avgcount":11,"sum":0.000009480,"avgtime":0.000000861},"msgr_recv_encrypted_bytes":110896,"msgr_send_encrypted_bytes":12400},"AsyncMessenger::Worker-1":{"msgr_recv_messages":30,"msgr_send_messages":43,"msgr_recv_bytes":15139,"msgr_send_bytes":92165,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.012384589,"msgr_running_send_time":0.004466899,"msgr_running_recv_time":0.005343169,"msgr_running_fast_dispatch_time":0.001670821,"msgr_send_messages_queue_lat":{"avgcount":41,"sum":0.008138078,"avgtime":0.000198489},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":74784},"AsyncMessenger::Worker-2":{"msgr_recv_messages":22,"msgr_send_messages":24,"msgr_recv_bytes":13443,"msgr_send_bytes":8975,"msgr_created_connections":6,"msgr_active_connections":5,"msgr_running_total_time":0.008123335,"msgr_running_send_time":0.001811774,"msgr_running_recv_time":0.004802054,"msgr_running_fast_dispatch_time":0.001078373,"msgr_send_messages_queue_lat":{"avgcount":23,"sum":0.009488514,"avgtime":0.000412544},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":58,"sum":0.010373052,"avgtime":0.000178845}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000208443,"avgtime":0.000052110}},"mds":{"request":4,"reply":2,"reply_latency":{"avgcount":2,"sum":0.004811737,"avgtime":0.002405868},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":4,"traverse_hit":4,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":0,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":1,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evadd":5,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":1,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4202283,"rdpos":4195196,"jlat":{"avgcount":5,"sum":0.023690158,"avgtime":0.004738031},"replayed":2},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":1,"cap+":2,"cap-":1,"rss":40704,"heap":223584},"mds_server":{"dispatch_client_request":3,"dispatch_server_request":0,"handle_client_request":4,"handle_client_session":3,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.004573282,"avgtime":0.004573282},"req_getattr_latency":{"avgcount":1,"sum":0.000238455,"avgtime":0.000238455},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":817,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":238061,"buffer_anon_items":75,"buffer_meta_bytes":88,"buffer_meta_items":1,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5848,"osdmap_items":95,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":54728,"mds_co_items":250,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":58,"op_send_bytes":8399,"op_resend":0,"op_reply":58,"op_latency":{"avgcount":58,"sum":0.153998201,"avgtime":0.002655141},"op_inflight":0,"oplen_avg":{"avgcount":58,"sum":116},"op":58,"op_r":36,"op_w":22,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":5,"osdop_writefull":2,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":60,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":16,"omap_rd":48,"omap_del":5},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":3,"omap_total_removes":1},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":148,"get_sum":148909,"get_or_fail_fail":0,"get_or_fail_success":148,"take":0,"take_sum":0,"put":148,"put_sum":148909,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":9281,"put":58,"put_sum":9281,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":58,"take_sum":58,"put":58,"put_sum":58,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x563b8a7da500":{"val":0,"max":3758096384,"get_started":0,"get":5,"get_sum":6833,"get_or_fail_fail":0,"get_or_fail_success":5,"take":0,"take_sum":0,"put":5,"put_sum":6833,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-05-26T15:43:15.717 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 11, "avgtime": 8.61e-07, "sum": 9.48e-06 }, "msgr_recv_bytes": 135589, "msgr_recv_encrypted_bytes": 110896, "msgr_recv_messages": 99, "msgr_running_fast_dispatch_time": 0.004868981, "msgr_running_recv_time": 0.018121294, "msgr_running_send_time": 0.011888255, "msgr_running_total_time": 0.035035785, "msgr_send_bytes": 36989, "msgr_send_encrypted_bytes": 12400, "msgr_send_messages": 47, "msgr_send_messages_queue_lat": { "avgcount": 47, "avgtime": 0.00026137, "sum": 0.012284396 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 15139, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 30, "msgr_running_fast_dispatch_time": 0.001670821, "msgr_running_recv_time": 0.005343169, "msgr_running_send_time": 0.004466899, "msgr_running_total_time": 0.012384589, "msgr_send_bytes": 92165, "msgr_send_encrypted_bytes": 74784, "msgr_send_messages": 43, "msgr_send_messages_queue_lat": { "avgcount": 41, "avgtime": 0.000198489, "sum": 0.008138078 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 5, "msgr_created_connections": 6, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 13443, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 22, "msgr_running_fast_dispatch_time": 0.001078373, "msgr_running_recv_time": 0.004802054, "msgr_running_send_time": 0.001811774, "msgr_running_total_time": 0.008123335, "msgr_send_bytes": 8975, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 24, "msgr_send_messages_queue_lat": { "avgcount": 23, "avgtime": 0.000412544, "sum": 0.009488514 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 58, "avgtime": 0.000178845, "sum": 0.010373052 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 5.211e-05, "sum": 0.000208443 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 0, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 2, "reply_latency": { "avgcount": 2, "avgtime": 0.002405868, "sum": 0.004811737 }, "request": 4, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 4, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 4, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 5, "evex": 0, "evexd": 0, "evexg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 5, "avgtime": 0.004738031, "sum": 0.023690158 }, "rdpos": 4195196, "replayed": 2, "seg": 1, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segtrm": 0, "wrpos": 4202283 }, "mds_mem": { "cap": 1, "cap+": 2, "cap-": 1, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 223584, "ino": 14, "ino+": 14, "ino-": 0, "rss": 40704 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 3, "dispatch_server_request": 0, "handle_client_request": 4, "handle_client_session": 3, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.004573282, "sum": 0.004573282 }, "req_getattr_latency": { "avgcount": 1, "avgtime": 0.000238455, "sum": 0.000238455 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 817, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 238061, "buffer_anon_items": 75, "buffer_meta_bytes": 88, "buffer_meta_items": 1, "mds_co_bytes": 54728, "mds_co_items": 250, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5848, "osdmap_items": 95, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 60, "map_full": 0, "map_inc": 1, "omap_del": 5, "omap_rd": 48, "omap_wr": 16, "op": 58, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 58, "avgtime": 0.002655141, "sum": 0.153998201 }, "op_pg": 0, "op_r": 36, "op_reply": 58, "op_resend": 0, "op_rmw": 0, "op_send": 58, "op_send_bytes": 8399, "op_w": 22, "oplen_avg": { "avgcount": 58, "sum": 116 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 5, "osdop_writefull": 2, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 3 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 148, "get_or_fail_fail": 0, "get_or_fail_success": 148, "get_started": 0, "get_sum": 148909, "max": 104857600, "put": 148, "put_sum": 148909, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 58, "put_sum": 9281, "take": 58, "take_sum": 9281, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 58, "put_sum": 58, "take": 58, "take_sum": 58, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x563b8a7da500": { "get": 5, "get_or_fail_fail": 0, "get_or_fail_success": 5, "get_started": 0, "get_sum": 6833, "max": 3758096384, "put": 5, "put_sum": 6833, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-05-26T15:43:15.717 INFO:tasks.cephfs.test_openfiletable:omap_total_removes:1 2024-05-26T15:43:15.717 INFO:tasks.cephfs.test_openfiletable:omap_total_kv_pairs:1 2024-05-26T15:43:15.718 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-26T15:43:15.718 DEBUG:teuthology.orchestra.run.smithi008:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-26T15:43:15.818 DEBUG:teuthology.orchestra.run.smithi047:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-26T15:43:15.938 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-26T15:43:15.939 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:43:15.939 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:43:15.999 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:43:15.999 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:43:16.058 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:43:16.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.275+0000 7f55e3e00640 1 Processor -- start 2024-05-26T15:43:16.274 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.276+0000 7f55e3e00640 1 -- start start 2024-05-26T15:43:16.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.277+0000 7f55e3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f55e4142410 0x7f55e40cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.277+0000 7f55e3e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f55e406d6e0 0x7f55e406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.277+0000 7f55e3e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e40cdd90 con 0x7f55e4142b30 2024-05-26T15:43:16.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.277+0000 7f55e3e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e406e090 con 0x7f55e406d6e0 2024-05-26T15:43:16.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.277+0000 7f55e3e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e4143340 con 0x7f55e4142410 2024-05-26T15:43:16.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.278+0000 7f55e3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f55e406d6e0 0x7f55e406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.278+0000 7f55e3400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f55e406d6e0 0x7f55e406db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32802/0 (socket says 172.21.15.8:32802) 2024-05-26T15:43:16.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.278+0000 7f55e3400640 1 -- 172.21.15.8:0/3898427393 learned_addr learned my addr 172.21.15.8:0/3898427393 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:16.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.278+0000 7f55e2a00640 1 --2- 172.21.15.8:0/3898427393 >> v2:172.21.15.47:3300/0 conn(0x7f55e4142410 0x7f55e40cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.278+0000 7f55e3400640 1 -- 172.21.15.8:0/3898427393 >> v2:172.21.15.47:3300/0 conn(0x7f55e4142410 msgr2=0x7f55e40cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:16.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.278+0000 7f55e3400640 1 --2- 172.21.15.8:0/3898427393 >> v2:172.21.15.47:3300/0 conn(0x7f55e4142410 0x7f55e40cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.278+0000 7f55e3400640 1 -- 172.21.15.8:0/3898427393 >> v1:172.21.15.47:6789/0 conn(0x7f55e4142b30 legacy=0x7f55e4070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:16.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.279+0000 7f55e3400640 1 -- 172.21.15.8:0/3898427393 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e40cdfe0 con 0x7f55e406d6e0 2024-05-26T15:43:16.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.280+0000 7f55e3400640 1 --2- 172.21.15.8:0/3898427393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 0x7f55e406db50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f55e406ace0 tx=0x7f55dc02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdc3d7d692474e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:16.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.280+0000 7f55e1600640 1 -- 172.21.15.8:0/3898427393 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc031600 con 0x7f55e406d6e0 2024-05-26T15:43:16.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.280+0000 7f55e1600640 1 -- 172.21.15.8:0/3898427393 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc02d050 con 0x7f55e406d6e0 2024-05-26T15:43:16.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.280+0000 7f55e1600640 1 -- 172.21.15.8:0/3898427393 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc031980 con 0x7f55e406d6e0 2024-05-26T15:43:16.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.281+0000 7f55e3e00640 1 -- 172.21.15.8:0/3898427393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 msgr2=0x7f55e406db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:16.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.281+0000 7f55e3e00640 1 --2- 172.21.15.8:0/3898427393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 0x7f55e406db50 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f55e406ace0 tx=0x7f55dc02a760 comp rx=0 tx=0).stop 2024-05-26T15:43:16.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.281+0000 7f55e3e00640 1 -- 172.21.15.8:0/3898427393 shutdown_connections 2024-05-26T15:43:16.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.281+0000 7f55e3e00640 1 --2- 172.21.15.8:0/3898427393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 0x7f55e406db50 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.281+0000 7f55e3e00640 1 --2- 172.21.15.8:0/3898427393 >> v2:172.21.15.47:3300/0 conn(0x7f55e4142410 0x7f55e40cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.281+0000 7f55e3e00640 1 -- 172.21.15.8:0/3898427393 >> 172.21.15.8:0/3898427393 conn(0x7f55e4069ed0 msgr2=0x7f55e406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:16.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.281+0000 7f55e3e00640 1 -- 172.21.15.8:0/3898427393 shutdown_connections 2024-05-26T15:43:16.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.281+0000 7f55e3e00640 1 -- 172.21.15.8:0/3898427393 wait complete. 2024-05-26T15:43:16.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.283+0000 7f55e3e00640 1 Processor -- start 2024-05-26T15:43:16.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.283+0000 7f55e3e00640 1 -- start start 2024-05-26T15:43:16.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.284+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 0x7f55e413b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.284+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f55e4142410 0x7f55e4140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.284+0000 7f55e3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4142b30 0x7f55e4158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.284+0000 7f55e3e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e41553b0 con 0x7f55e406d6e0 2024-05-26T15:43:16.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.284+0000 7f55e3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e4154f20 con 0x7f55e4142b30 2024-05-26T15:43:16.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.284+0000 7f55e3e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e4154310 con 0x7f55e4142410 2024-05-26T15:43:16.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.285+0000 7f55e2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 0x7f55e413b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.285+0000 7f55e2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 0x7f55e413b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32806/0 (socket says 172.21.15.8:32806) 2024-05-26T15:43:16.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.285+0000 7f55e2a00640 1 -- 172.21.15.8:0/2212015274 learned_addr learned my addr 172.21.15.8:0/2212015274 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:16.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.285+0000 7f55e3400640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4142b30 0x7f55e4158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.285+0000 7f55e2a00640 1 -- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f55e4142410 msgr2=0x7f55e4140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:16.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.285+0000 7f55e2a00640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f55e4142410 0x7f55e4140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.285+0000 7f55e2a00640 1 -- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4142b30 msgr2=0x7f55e4158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:16.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.285+0000 7f55e2a00640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4142b30 0x7f55e4158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.285+0000 7f55e2a00640 1 -- 172.21.15.8:0/2212015274 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc009b30 con 0x7f55e406d6e0 2024-05-26T15:43:16.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.286+0000 7f55e2a00640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 0x7f55e413b5d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f55d400d800 tx=0x7f55d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:16.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.286+0000 7f55daa00640 1 -- 172.21.15.8:0/2212015274 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d400b6c0 con 0x7f55e406d6e0 2024-05-26T15:43:16.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.286+0000 7f55daa00640 1 -- 172.21.15.8:0/2212015274 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d400b840 con 0x7f55e406d6e0 2024-05-26T15:43:16.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.286+0000 7f55daa00640 1 -- 172.21.15.8:0/2212015274 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d400bbf0 con 0x7f55e406d6e0 2024-05-26T15:43:16.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.286+0000 7f55e3e00640 1 -- 172.21.15.8:0/2212015274 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e41545f0 con 0x7f55e406d6e0 2024-05-26T15:43:16.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.286+0000 7f55e3e00640 1 -- 172.21.15.8:0/2212015274 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e4154bb0 con 0x7f55e406d6e0 2024-05-26T15:43:16.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.287+0000 7f55e3e00640 1 -- 172.21.15.8:0/2212015274 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e404e210 con 0x7f55e406d6e0 2024-05-26T15:43:16.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.288+0000 7f55daa00640 1 -- 172.21.15.8:0/2212015274 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55d400bd50 con 0x7f55e406d6e0 2024-05-26T15:43:16.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.289+0000 7f55daa00640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f55c006ac00 0x7f55c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.289+0000 7f55daa00640 1 -- 172.21.15.8:0/2212015274 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f55d4089b60 con 0x7f55e406d6e0 2024-05-26T15:43:16.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.290+0000 7f55e2000640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f55c006ac00 0x7f55c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.291+0000 7f55e2000640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f55c006ac00 0x7f55c006d0c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f55cc000f60 tx=0x7f55cc0079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:16.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.294+0000 7f55daa00640 1 -- 172.21.15.8:0/2212015274 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f55d4054ae0 con 0x7f55e406d6e0 2024-05-26T15:43:16.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.495+0000 7f55e3e00640 1 -- 172.21.15.8:0/2212015274 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55e40b1c00 con 0x7f55e406d6e0 2024-05-26T15:43:16.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.497+0000 7f55daa00640 1 -- 172.21.15.8:0/2212015274 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16379 (secure 0 0 0) 0x7f55d4058100 con 0x7f55e406d6e0 2024-05-26T15:43:16.495 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:16.496 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":61,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:43:15.748510+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:42:09.031612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-26T15:42:10.475864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6836/3388176100":"2024-05-27T15:42:25.245849+0000","172.21.15.47:6834/3388176100":"2024-05-27T15:42:25.245849+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:43:16.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.499+0000 7f55e3e00640 1 -- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f55c006ac00 msgr2=0x7f55c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:16.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.499+0000 7f55e3e00640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f55c006ac00 0x7f55c006d0c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f55cc000f60 tx=0x7f55cc0079b0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.499+0000 7f55e3e00640 1 -- 172.21.15.8:0/2212015274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 msgr2=0x7f55e413b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:16.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.499+0000 7f55e3e00640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 0x7f55e413b5d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f55d400d800 tx=0x7f55d400dcc0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.499+0000 7f55e3e00640 1 -- 172.21.15.8:0/2212015274 shutdown_connections 2024-05-26T15:43:16.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.499+0000 7f55e3e00640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f55c006ac00 0x7f55c006d0c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.499+0000 7f55e3e00640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f55e4142b30 0x7f55e4158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.499+0000 7f55e3e00640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f55e4142410 0x7f55e4140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.499+0000 7f55e3e00640 1 --2- 172.21.15.8:0/2212015274 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f55e406d6e0 0x7f55e413b5d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.499+0000 7f55e3e00640 1 -- 172.21.15.8:0/2212015274 >> 172.21.15.8:0/2212015274 conn(0x7f55e4069ed0 msgr2=0x7f55e40cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:16.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.500+0000 7f55e3e00640 1 -- 172.21.15.8:0/2212015274 shutdown_connections 2024-05-26T15:43:16.499 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.500+0000 7f55e3e00640 1 -- 172.21.15.8:0/2212015274 wait complete. 2024-05-26T15:43:16.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:42:09.031612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:42:10.475864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-26T15:43:16.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:43:16.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.724+0000 7f348f200640 1 Processor -- start 2024-05-26T15:43:16.723 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.725+0000 7f348f200640 1 -- start start 2024-05-26T15:43:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.726+0000 7f348f200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f349006e200 0x7f34900705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.726+0000 7f348f200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 0x7f34900cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.726+0000 7f348f200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f34900cca10 0x7f349013fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.726+0000 7f348f200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349013db80 con 0x7f349006e200 2024-05-26T15:43:16.725 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.726+0000 7f348f200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3490070f60 con 0x7f34900cca10 2024-05-26T15:43:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.726+0000 7f348f200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349006c600 con 0x7f3490070ae0 2024-05-26T15:43:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f348de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f349006e200 0x7f34900705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f348de00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f349006e200 0x7f34900705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32816/0 (socket says 172.21.15.8:32816) 2024-05-26T15:43:16.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f348de00640 1 -- 172.21.15.8:0/2199267694 learned_addr learned my addr 172.21.15.8:0/2199267694 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f3487e00640 1 --2- 172.21.15.8:0/2199267694 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 0x7f34900cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f348e800640 1 --2- 172.21.15.8:0/2199267694 >> v2:172.21.15.47:3300/0 conn(0x7f34900cca10 0x7f349013fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f348de00640 1 -- 172.21.15.8:0/2199267694 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 msgr2=0x7f34900cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f348de00640 1 --2- 172.21.15.8:0/2199267694 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 0x7f34900cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f348de00640 1 -- 172.21.15.8:0/2199267694 >> v2:172.21.15.47:3300/0 conn(0x7f34900cca10 msgr2=0x7f349013fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f348de00640 1 --2- 172.21.15.8:0/2199267694 >> v2:172.21.15.47:3300/0 conn(0x7f34900cca10 0x7f349013fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f348de00640 1 -- 172.21.15.8:0/2199267694 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900cd520 con 0x7f349006e200 2024-05-26T15:43:16.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f3487e00640 1 --2- 172.21.15.8:0/2199267694 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 0x7f34900cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.727+0000 7f348e800640 1 --2- 172.21.15.8:0/2199267694 >> v2:172.21.15.47:3300/0 conn(0x7f34900cca10 0x7f349013fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:16.729 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.729+0000 7f348de00640 1 --2- 172.21.15.8:0/2199267694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349006e200 0x7f34900705a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f34900cc1f0 tx=0x7f348002a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a16e05f3f795f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:16.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.729+0000 7f348d400640 1 -- 172.21.15.8:0/2199267694 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480032440 con 0x7f349006e200 2024-05-26T15:43:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.729+0000 7f348d400640 1 -- 172.21.15.8:0/2199267694 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34800325a0 con 0x7f349006e200 2024-05-26T15:43:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.729+0000 7f348d400640 1 -- 172.21.15.8:0/2199267694 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480032930 con 0x7f349006e200 2024-05-26T15:43:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.729+0000 7f348f200640 1 -- 172.21.15.8:0/2199267694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349006e200 msgr2=0x7f34900705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.729+0000 7f348f200640 1 --2- 172.21.15.8:0/2199267694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349006e200 0x7f34900705a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f34900cc1f0 tx=0x7f348002a1d0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.730+0000 7f348f200640 1 -- 172.21.15.8:0/2199267694 shutdown_connections 2024-05-26T15:43:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.730+0000 7f348f200640 1 --2- 172.21.15.8:0/2199267694 >> v2:172.21.15.47:3300/0 conn(0x7f34900cca10 0x7f349013fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.730+0000 7f348f200640 1 --2- 172.21.15.8:0/2199267694 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 0x7f34900cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.730+0000 7f348f200640 1 --2- 172.21.15.8:0/2199267694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f349006e200 0x7f34900705a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.730+0000 7f348f200640 1 -- 172.21.15.8:0/2199267694 >> 172.21.15.8:0/2199267694 conn(0x7f3490069ed0 msgr2=0x7f349006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:16.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.730+0000 7f348f200640 1 -- 172.21.15.8:0/2199267694 shutdown_connections 2024-05-26T15:43:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.730+0000 7f348f200640 1 -- 172.21.15.8:0/2199267694 wait complete. 2024-05-26T15:43:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.732+0000 7f348f200640 1 Processor -- start 2024-05-26T15:43:16.732 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.732+0000 7f348f200640 1 -- start start 2024-05-26T15:43:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.733+0000 7f348f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f349006e200 0x7f349015d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.733+0000 7f348f200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 0x7f349015d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.733+0000 7f348f200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34900cca10 0x7f3490147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.733 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.733+0000 7f348f200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490145100 con 0x7f34900cca10 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.733+0000 7f348f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34901453e0 con 0x7f349006e200 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.733+0000 7f348f200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34901456c0 con 0x7f3490070ae0 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.733+0000 7f348e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34900cca10 0x7f3490147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.733+0000 7f348e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34900cca10 0x7f3490147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32828/0 (socket says 172.21.15.8:32828) 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.733+0000 7f348e800640 1 -- 172.21.15.8:0/3869276591 learned_addr learned my addr 172.21.15.8:0/3869276591 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.733+0000 7f3487e00640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 0x7f349015d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f348e800640 1 -- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 msgr2=0x7f349015d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f348e800640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 0x7f349015d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f348e800640 1 -- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f349006e200 msgr2=0x7f349015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f348e800640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f349006e200 0x7f349015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f348e800640 1 -- 172.21.15.8:0/3869276591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34800094d0 con 0x7f34900cca10 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f348e800640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34900cca10 0x7f3490147210 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f348800cd50 tx=0x7f348800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:16.734 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f3486000640 1 -- 172.21.15.8:0/3869276591 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800f680 con 0x7f34900cca10 2024-05-26T15:43:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f3486000640 1 -- 172.21.15.8:0/3869276591 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348800f800 con 0x7f34900cca10 2024-05-26T15:43:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f3486000640 1 -- 172.21.15.8:0/3869276591 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800fbb0 con 0x7f34900cca10 2024-05-26T15:43:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f348f200640 1 -- 172.21.15.8:0/3869276591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34901459a0 con 0x7f34900cca10 2024-05-26T15:43:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.734+0000 7f348f200640 1 -- 172.21.15.8:0/3869276591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3490147f90 con 0x7f34900cca10 2024-05-26T15:43:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.736+0000 7f348f200640 1 -- 172.21.15.8:0/3869276591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34900cdf60 con 0x7f34900cca10 2024-05-26T15:43:16.735 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.737+0000 7f3486000640 1 -- 172.21.15.8:0/3869276591 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f348800b040 con 0x7f34900cca10 2024-05-26T15:43:16.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.737+0000 7f3486000640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f346c06ac30 0x7f346c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:16.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.738+0000 7f3486000640 1 -- 172.21.15.8:0/3869276591 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f3488089f30 con 0x7f34900cca10 2024-05-26T15:43:16.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.738+0000 7f348de00640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f346c06ac30 0x7f346c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:16.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.739+0000 7f348de00640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f346c06ac30 0x7f346c06d0f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3480034000 tx=0x7f348002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:16.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.742+0000 7f3486000640 1 -- 172.21.15.8:0/3869276591 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3488054ea0 con 0x7f34900cca10 2024-05-26T15:43:16.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.939+0000 7f348f200640 1 -- 172.21.15.8:0/3869276591 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3490145240 con 0x7f34900cca10 2024-05-26T15:43:16.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.939+0000 7f3486000640 1 -- 172.21.15.8:0/3869276591 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3490145240 con 0x7f34900cca10 2024-05-26T15:43:16.939 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:43:16.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.942+0000 7f348f200640 1 -- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f346c06ac30 msgr2=0x7f346c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:16.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.942+0000 7f348f200640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f346c06ac30 0x7f346c06d0f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3480034000 tx=0x7f348002c000 comp rx=0 tx=0).stop 2024-05-26T15:43:16.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.942+0000 7f348f200640 1 -- 172.21.15.8:0/3869276591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34900cca10 msgr2=0x7f3490147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:16.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.942+0000 7f348f200640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34900cca10 0x7f3490147210 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f348800cd50 tx=0x7f348800a650 comp rx=0 tx=0).stop 2024-05-26T15:43:16.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.943+0000 7f348f200640 1 -- 172.21.15.8:0/3869276591 shutdown_connections 2024-05-26T15:43:16.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.943+0000 7f348f200640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34900cca10 0x7f3490147210 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.943+0000 7f348f200640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3490070ae0 0x7f349015d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.943+0000 7f348f200640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f346c06ac30 0x7f346c06d0f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.943+0000 7f348f200640 1 --2- 172.21.15.8:0/3869276591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f349006e200 0x7f349015d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:16.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.943+0000 7f348f200640 1 -- 172.21.15.8:0/3869276591 >> 172.21.15.8:0/3869276591 conn(0x7f3490069ed0 msgr2=0x7f34900b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:16.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.943+0000 7f348f200640 1 -- 172.21.15.8:0/3869276591 shutdown_connections 2024-05-26T15:43:16.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:16.943+0000 7f348f200640 1 -- 172.21.15.8:0/3869276591 wait complete. 2024-05-26T15:43:16.961 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:43:17.178 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.180+0000 7f4fb9e00640 1 Processor -- start 2024-05-26T15:43:17.179 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.180+0000 7f4fb9e00640 1 -- start start 2024-05-26T15:43:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.181+0000 7f4fb9e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4fb40ae700 0x7f4fb415da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.181+0000 7f4fb9e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4fb40b28a0 0x7f4fb4153060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.181+0000 7f4fb9e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb415df60 con 0x7f4fb41605c0 2024-05-26T15:43:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.181+0000 7f4fb9e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb4160aa0 con 0x7f4fb40ae700 2024-05-26T15:43:17.181 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.181+0000 7f4fb9e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb4160d80 con 0x7f4fb40b28a0 2024-05-26T15:43:17.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.182+0000 7f4fb8a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4fb40ae700 0x7f4fb415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.182+0000 7f4fb8a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4fb40ae700 0x7f4fb415da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32834/0 (socket says 172.21.15.8:32834) 2024-05-26T15:43:17.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.182+0000 7f4fb8a00640 1 -- 172.21.15.8:0/1436099999 learned_addr learned my addr 172.21.15.8:0/1436099999 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:17.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.182+0000 7f4fb9400640 1 --2- 172.21.15.8:0/1436099999 >> v2:172.21.15.47:3300/0 conn(0x7f4fb40b28a0 0x7f4fb4153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.182 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.182+0000 7f4fb8a00640 1 -- 172.21.15.8:0/1436099999 >> v2:172.21.15.47:3300/0 conn(0x7f4fb40b28a0 msgr2=0x7f4fb4153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:17.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.182+0000 7f4fb8a00640 1 --2- 172.21.15.8:0/1436099999 >> v2:172.21.15.47:3300/0 conn(0x7f4fb40b28a0 0x7f4fb4153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.182+0000 7f4fb8a00640 1 -- 172.21.15.8:0/1436099999 >> v1:172.21.15.47:6789/0 conn(0x7f4fb41605c0 legacy=0x7f4fb40b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:17.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.182+0000 7f4fb8a00640 1 -- 172.21.15.8:0/1436099999 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb4161060 con 0x7f4fb40ae700 2024-05-26T15:43:17.183 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.182+0000 7f4fb9400640 1 --2- 172.21.15.8:0/1436099999 >> v2:172.21.15.47:3300/0 conn(0x7f4fb40b28a0 0x7f4fb4153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:17.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.183+0000 7f4fb8a00640 1 --2- 172.21.15.8:0/1436099999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb40ae700 0x7f4fb415da20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4fb415cfd0 tx=0x7f4fa402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55bc04857eaafda1 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:17.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb3400640 1 -- 172.21.15.8:0/1436099999 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4032440 con 0x7f4fb40ae700 2024-05-26T15:43:17.189 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb3400640 1 -- 172.21.15.8:0/1436099999 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa40325a0 con 0x7f4fb40ae700 2024-05-26T15:43:17.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb3400640 1 -- 172.21.15.8:0/1436099999 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4032930 con 0x7f4fb40ae700 2024-05-26T15:43:17.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1436099999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb40ae700 msgr2=0x7f4fb415da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb9e00640 1 --2- 172.21.15.8:0/1436099999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb40ae700 0x7f4fb415da20 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4fb415cfd0 tx=0x7f4fa402a230 comp rx=0 tx=0).stop 2024-05-26T15:43:17.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1436099999 shutdown_connections 2024-05-26T15:43:17.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb9e00640 1 --2- 172.21.15.8:0/1436099999 >> v2:172.21.15.47:3300/0 conn(0x7f4fb40b28a0 0x7f4fb4153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb9e00640 1 --2- 172.21.15.8:0/1436099999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb40ae700 0x7f4fb415da20 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1436099999 >> 172.21.15.8:0/1436099999 conn(0x7f4fb40cee10 msgr2=0x7f4fb40cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:17.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1436099999 shutdown_connections 2024-05-26T15:43:17.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.184+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1436099999 wait complete. 2024-05-26T15:43:17.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.186+0000 7f4fb9e00640 1 Processor -- start 2024-05-26T15:43:17.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.186+0000 7f4fb9e00640 1 -- start start 2024-05-26T15:43:17.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.187+0000 7f4fb9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fb40b28a0 0x7f4fb4144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.187+0000 7f4fb9e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb41605c0 0x7f4fb41f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.187+0000 7f4fb9e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4fb4150bd0 0x7f4fb4151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.187+0000 7f4fb9e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4160460 con 0x7f4fb41605c0 2024-05-26T15:43:17.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.187+0000 7f4fb9e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb41515a0 con 0x7f4fb40b28a0 2024-05-26T15:43:17.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.187+0000 7f4fb9e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb41f3d30 con 0x7f4fb4150bd0 2024-05-26T15:43:17.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb41605c0 0x7f4fb41f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb41605c0 0x7f4fb41f37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32846/0 (socket says 172.21.15.8:32846) 2024-05-26T15:43:17.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb3e00640 1 -- 172.21.15.8:0/1690448899 learned_addr learned my addr 172.21.15.8:0/1690448899 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:17.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb8a00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fb40b28a0 0x7f4fb4144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb9400640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4fb4150bd0 0x7f4fb4151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb3e00640 1 -- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4fb4150bd0 msgr2=0x7f4fb4151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb3e00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4fb4150bd0 0x7f4fb4151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb3e00640 1 -- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fb40b28a0 msgr2=0x7f4fb4144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb3e00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fb40b28a0 0x7f4fb4144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb3e00640 1 -- 172.21.15.8:0/1690448899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40094d0 con 0x7f4fb41605c0 2024-05-26T15:43:17.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb8a00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fb40b28a0 0x7f4fb4144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:17.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.188+0000 7f4fb9400640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4fb4150bd0 0x7f4fb4151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:17.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.189+0000 7f4fb3e00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb41605c0 0x7f4fb41f37f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000ba80 tx=0x7f4fa000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:17.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.189+0000 7f4fb0c00640 1 -- 172.21.15.8:0/1690448899 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000cc90 con 0x7f4fb41605c0 2024-05-26T15:43:17.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.189+0000 7f4fb0c00640 1 -- 172.21.15.8:0/1690448899 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa000cdf0 con 0x7f4fb41605c0 2024-05-26T15:43:17.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.189+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1690448899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb41f35d0 con 0x7f4fb41605c0 2024-05-26T15:43:17.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.189+0000 7f4fb0c00640 1 -- 172.21.15.8:0/1690448899 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0014680 con 0x7f4fb41605c0 2024-05-26T15:43:17.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.189+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1690448899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb40cb990 con 0x7f4fb41605c0 2024-05-26T15:43:17.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.190+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1690448899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb4153560 con 0x7f4fb41605c0 2024-05-26T15:43:17.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.191+0000 7f4fb0c00640 1 -- 172.21.15.8:0/1690448899 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4fa001d3b0 con 0x7f4fb41605c0 2024-05-26T15:43:17.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.192+0000 7f4fb0c00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f9406ac00 0x7f4f9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.192+0000 7f4fb0c00640 1 -- 172.21.15.8:0/1690448899 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f4fa00894b0 con 0x7f4fb41605c0 2024-05-26T15:43:17.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.193+0000 7f4fb8a00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f9406ac00 0x7f4f9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.194+0000 7f4fb8a00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f9406ac00 0x7f4f9406d0c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4034000 tx=0x7f4fa402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:17.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.197+0000 7f4fb0c00640 1 -- 172.21.15.8:0/1690448899 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4fa0054550 con 0x7f4fb41605c0 2024-05-26T15:43:17.396 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.398+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1690448899 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fb4073fa0 con 0x7f4fb41605c0 2024-05-26T15:43:17.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.399+0000 7f4fb0c00640 1 -- 172.21.15.8:0/1690448899 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fa0057b70 con 0x7f4fb41605c0 2024-05-26T15:43:17.397 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:43:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.401+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f9406ac00 msgr2=0x7f4f9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.401+0000 7f4fb9e00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f9406ac00 0x7f4f9406d0c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4034000 tx=0x7f4fa402e000 comp rx=0 tx=0).stop 2024-05-26T15:43:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.401+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1690448899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb41605c0 msgr2=0x7f4fb41f37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.401+0000 7f4fb9e00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb41605c0 0x7f4fb41f37f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000ba80 tx=0x7f4fa000bf40 comp rx=0 tx=0).stop 2024-05-26T15:43:17.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.402+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1690448899 shutdown_connections 2024-05-26T15:43:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.402+0000 7f4fb9e00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4fb4150bd0 0x7f4fb4151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.402+0000 7f4fb9e00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fb41605c0 0x7f4fb41f37f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.402+0000 7f4fb9e00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4f9406ac00 0x7f4f9406d0c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.402+0000 7f4fb9e00640 1 --2- 172.21.15.8:0/1690448899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4fb40b28a0 0x7f4fb4144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.402+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1690448899 >> 172.21.15.8:0/1690448899 conn(0x7f4fb40cee10 msgr2=0x7f4fb40aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.402+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1690448899 shutdown_connections 2024-05-26T15:43:17.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.402+0000 7f4fb9e00640 1 -- 172.21.15.8:0/1690448899 wait complete. 2024-05-26T15:43:17.421 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:43:17.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.650+0000 7f1b9ca00640 1 Processor -- start 2024-05-26T15:43:17.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.650+0000 7f1b9ca00640 1 -- start start 2024-05-26T15:43:17.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.652+0000 7f1b9ca00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b9806f260 0x7f1b9815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.652+0000 7f1b9ca00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9815d560 con 0x7f1b98069ed0 2024-05-26T15:43:17.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.652+0000 7f1b9ca00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b980ae1e0 con 0x7f1b980b41b0 2024-05-26T15:43:17.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.652+0000 7f1b9ca00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980b2630 con 0x7f1b9806f260 2024-05-26T15:43:17.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.652+0000 7f1b97400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1b98069ed0 0x7f1b9806a2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:54074/0 (socket says 172.21.15.8:54074) 2024-05-26T15:43:17.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.652+0000 7f1b97400640 1 -- 172.21.15.8:0/156421329 learned_addr learned my addr 172.21.15.8:0/156421329 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:17.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36830288 0 0) 0x7f1b9815d560 con 0x7f1b98069ed0 2024-05-26T15:43:17.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b7c003520 con 0x7f1b98069ed0 2024-05-26T15:43:17.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96a00640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b9806f260 0x7f1b9815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 302893707 0 0) 0x7f1b7c003520 con 0x7f1b98069ed0 2024-05-26T15:43:17.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b9806f260 msgr2=0x7f1b9815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:17.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b9806f260 0x7f1b9815d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 >> v1:172.21.15.47:6789/0 conn(0x7f1b980b41b0 legacy=0x7f1b9806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b980b2910 con 0x7f1b98069ed0 2024-05-26T15:43:17.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f1b880019f0 con 0x7f1b98069ed0 2024-05-26T15:43:17.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 >> v1:172.21.15.8:6789/0 conn(0x7f1b98069ed0 legacy=0x7f1b9806a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b9806f260 0x7f1b7c003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b7c004090 0x7f1b7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b7c004d70 0x7f1b7c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980b2630 con 0x7f1b7c004d70 2024-05-26T15:43:17.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c00bbe0 con 0x7f1b7c004090 2024-05-26T15:43:17.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.653+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c00bda0 con 0x7f1b9806f260 2024-05-26T15:43:17.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.654+0000 7f1b97e00640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b7c004d70 0x7f1b7c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.654+0000 7f1b96a00640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b7c004090 0x7f1b7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.654+0000 7f1b97e00640 1 -- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b9806f260 msgr2=0x7f1b7c003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:17.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.654+0000 7f1b97e00640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b9806f260 0x7f1b7c003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.654+0000 7f1b97e00640 1 -- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b7c004090 msgr2=0x7f1b7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:17.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.654+0000 7f1b97e00640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b7c004090 0x7f1b7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.654+0000 7f1b97e00640 1 -- 172.21.15.8:0/156421329 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c003520 con 0x7f1b7c004d70 2024-05-26T15:43:17.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.654+0000 7f1b96a00640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b7c004090 0x7f1b7c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:17.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.655+0000 7f1b97e00640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b7c004d70 0x7f1b7c0051f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1b90001750 tx=0x7f1b7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f78bd96c1ec291e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:17.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.655+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900052d0 con 0x7f1b7c004d70 2024-05-26T15:43:17.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.656+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b90005430 con 0x7f1b7c004d70 2024-05-26T15:43:17.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.656+0000 7f1b96000640 1 -- 172.21.15.8:0/156421329 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9002ab20 con 0x7f1b7c004d70 2024-05-26T15:43:17.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.656+0000 7f1b9ca00640 1 -- 172.21.15.8:0/156421329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b7c004d70 msgr2=0x7f1b7c0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.656+0000 7f1b9ca00640 1 --2- 172.21.15.8:0/156421329 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b7c004d70 0x7f1b7c0051f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1b90001750 tx=0x7f1b7c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.656+0000 7f1b97e00640 1 -- 172.21.15.8:0/156421329 reap_dead start 2024-05-26T15:43:17.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.656+0000 7f1b9ca00640 1 -- 172.21.15.8:0/156421329 shutdown_connections 2024-05-26T15:43:17.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.656+0000 7f1b9ca00640 1 -- 172.21.15.8:0/156421329 >> 172.21.15.8:0/156421329 conn(0x7f1b98098a40 msgr2=0x7f1b980b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:17.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.656+0000 7f1b9ca00640 1 -- 172.21.15.8:0/156421329 shutdown_connections 2024-05-26T15:43:17.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.656+0000 7f1b9ca00640 1 -- 172.21.15.8:0/156421329 wait complete. 2024-05-26T15:43:17.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.658+0000 7f1b9ca00640 1 Processor -- start 2024-05-26T15:43:17.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.658+0000 7f1b9ca00640 1 -- start start 2024-05-26T15:43:17.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.659+0000 7f1b9ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b98146ce0 0x7f1b9814d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.659+0000 7f1b9ca00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b981470c0 0x7f1b980b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.659+0000 7f1b9ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98147600 0x7f1b98147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.659+0000 7f1b9ca00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980cb950 con 0x7f1b98146ce0 2024-05-26T15:43:17.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.659+0000 7f1b9ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980b11a0 con 0x7f1b98147600 2024-05-26T15:43:17.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.659+0000 7f1b9ca00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980cc490 con 0x7f1b981470c0 2024-05-26T15:43:17.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b97400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b98146ce0 0x7f1b9814d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b97400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b98146ce0 0x7f1b9814d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32852/0 (socket says 172.21.15.8:32852) 2024-05-26T15:43:17.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b97400640 1 -- 172.21.15.8:0/351303344 learned_addr learned my addr 172.21.15.8:0/351303344 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:17.666 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b97e00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98147600 0x7f1b98147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b96a00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b981470c0 0x7f1b980b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b97400640 1 -- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b981470c0 msgr2=0x7f1b980b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b97400640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b981470c0 0x7f1b980b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b97400640 1 -- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98147600 msgr2=0x7f1b98147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b97400640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98147600 0x7f1b98147a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b97400640 1 -- 172.21.15.8:0/351303344 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b980cb670 con 0x7f1b98146ce0 2024-05-26T15:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b97e00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98147600 0x7f1b98147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.660+0000 7f1b96a00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b981470c0 0x7f1b980b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.661+0000 7f1b97400640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b98146ce0 0x7f1b9814d6a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800cad0 tx=0x7f1b8800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.661+0000 7f1b8f400640 1 -- 172.21.15.8:0/351303344 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800abd0 con 0x7f1b98146ce0 2024-05-26T15:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.661+0000 7f1b8f400640 1 -- 172.21.15.8:0/351303344 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8800ad70 con 0x7f1b98146ce0 2024-05-26T15:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.661+0000 7f1b9ca00640 1 -- 172.21.15.8:0/351303344 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b980b0e30 con 0x7f1b98146ce0 2024-05-26T15:43:17.668 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.661+0000 7f1b8f400640 1 -- 172.21.15.8:0/351303344 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88007310 con 0x7f1b98146ce0 2024-05-26T15:43:17.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.661+0000 7f1b9ca00640 1 -- 172.21.15.8:0/351303344 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b980b1b70 con 0x7f1b98146ce0 2024-05-26T15:43:17.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.662+0000 7f1b9ca00640 1 -- 172.21.15.8:0/351303344 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b980b0fc0 con 0x7f1b98146ce0 2024-05-26T15:43:17.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.663+0000 7f1b8f400640 1 -- 172.21.15.8:0/351303344 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b88007470 con 0x7f1b98146ce0 2024-05-26T15:43:17.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.664+0000 7f1b8f400640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1b7406ac00 0x7f1b7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:17.669 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.664+0000 7f1b8f400640 1 -- 172.21.15.8:0/351303344 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f1b880894f0 con 0x7f1b98146ce0 2024-05-26T15:43:17.670 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.665+0000 7f1b96a00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1b7406ac00 0x7f1b7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:17.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.666+0000 7f1b96a00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1b7406ac00 0x7f1b7406d0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1b980d00e0 tx=0x7f1b80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:17.671 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.669+0000 7f1b8f400640 1 -- 172.21.15.8:0/351303344 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1b880544f0 con 0x7f1b98146ce0 2024-05-26T15:43:17.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.869+0000 7f1b9ca00640 1 -- 172.21.15.8:0/351303344 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b98073fa0 con 0x7f1b98146ce0 2024-05-26T15:43:17.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.870+0000 7f1b8f400640 1 -- 172.21.15.8:0/351303344 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b88001e80 con 0x7f1b98146ce0 2024-05-26T15:43:17.869 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:43:17.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.873+0000 7f1b9ca00640 1 -- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1b7406ac00 msgr2=0x7f1b7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.873+0000 7f1b9ca00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1b7406ac00 0x7f1b7406d0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1b980d00e0 tx=0x7f1b80008040 comp rx=0 tx=0).stop 2024-05-26T15:43:17.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.873+0000 7f1b9ca00640 1 -- 172.21.15.8:0/351303344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b98146ce0 msgr2=0x7f1b9814d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:17.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.873+0000 7f1b9ca00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b98146ce0 0x7f1b9814d6a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800cad0 tx=0x7f1b8800cf90 comp rx=0 tx=0).stop 2024-05-26T15:43:17.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.873+0000 7f1b9ca00640 1 -- 172.21.15.8:0/351303344 shutdown_connections 2024-05-26T15:43:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.873+0000 7f1b9ca00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1b7406ac00 0x7f1b7406d0c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.873+0000 7f1b9ca00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b98147600 0x7f1b98147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.873+0000 7f1b9ca00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1b981470c0 0x7f1b980b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.873+0000 7f1b9ca00640 1 --2- 172.21.15.8:0/351303344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1b98146ce0 0x7f1b9814d6a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.873+0000 7f1b9ca00640 1 -- 172.21.15.8:0/351303344 >> 172.21.15.8:0/351303344 conn(0x7f1b98098a40 msgr2=0x7f1b9815fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.874+0000 7f1b9ca00640 1 -- 172.21.15.8:0/351303344 shutdown_connections 2024-05-26T15:43:17.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:17.874+0000 7f1b9ca00640 1 -- 172.21.15.8:0/351303344 wait complete. 2024-05-26T15:43:17.893 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-26T15:43:18.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.095+0000 7f4c13200640 1 Processor -- start 2024-05-26T15:43:18.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.095+0000 7f4c13200640 1 -- start start 2024-05-26T15:43:18.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.097+0000 7f4c13200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4c0c161000 0x7f4c0c0705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.097+0000 7f4c13200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c0c070b20 0x7f4c0c0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.097+0000 7f4c13200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0c1605b0 con 0x7f4c0c146230 2024-05-26T15:43:18.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.097+0000 7f4c13200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0c070fb0 con 0x7f4c0c070b20 2024-05-26T15:43:18.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.097+0000 7f4c13200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c15db30 con 0x7f4c0c161000 2024-05-26T15:43:18.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.098+0000 7f4c12800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c0c070b20 0x7f4c0c0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.098+0000 7f4c12800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c0c070b20 0x7f4c0c0ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:54984/0 (socket says 172.21.15.8:54984) 2024-05-26T15:43:18.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.098+0000 7f4c12800640 1 -- 172.21.15.8:0/2589477989 learned_addr learned my addr 172.21.15.8:0/2589477989 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:18.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.098+0000 7f4c11400640 1 --2- 172.21.15.8:0/2589477989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4c0c161000 0x7f4c0c0705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.099+0000 7f4c12800640 1 -- 172.21.15.8:0/2589477989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4c0c161000 msgr2=0x7f4c0c0705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:18.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.099+0000 7f4c12800640 1 --2- 172.21.15.8:0/2589477989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4c0c161000 0x7f4c0c0705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.099+0000 7f4c12800640 1 -- 172.21.15.8:0/2589477989 >> v1:172.21.15.47:6789/0 conn(0x7f4c0c146230 legacy=0x7f4c0c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:18.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.099+0000 7f4c12800640 1 -- 172.21.15.8:0/2589477989 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c15de10 con 0x7f4c0c070b20 2024-05-26T15:43:18.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.100+0000 7f4c12800640 1 --2- 172.21.15.8:0/2589477989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c0c070b20 0x7f4c0c0ace90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009e50 tx=0x7f4c0802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d053d3649d6aeebb server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:18.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.101+0000 7f4c10a00640 1 -- 172.21.15.8:0/2589477989 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08031600 con 0x7f4c0c070b20 2024-05-26T15:43:18.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.101+0000 7f4c10a00640 1 -- 172.21.15.8:0/2589477989 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0802d050 con 0x7f4c0c070b20 2024-05-26T15:43:18.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.101+0000 7f4c10a00640 1 -- 172.21.15.8:0/2589477989 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08031980 con 0x7f4c0c070b20 2024-05-26T15:43:18.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.101+0000 7f4c13200640 1 -- 172.21.15.8:0/2589477989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c0c070b20 msgr2=0x7f4c0c0ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:18.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.101+0000 7f4c13200640 1 --2- 172.21.15.8:0/2589477989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c0c070b20 0x7f4c0c0ace90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009e50 tx=0x7f4c0802a710 comp rx=0 tx=0).stop 2024-05-26T15:43:18.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.102+0000 7f4c13200640 1 -- 172.21.15.8:0/2589477989 shutdown_connections 2024-05-26T15:43:18.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.102+0000 7f4c13200640 1 --2- 172.21.15.8:0/2589477989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c0c070b20 0x7f4c0c0ace90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.102+0000 7f4c13200640 1 --2- 172.21.15.8:0/2589477989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4c0c161000 0x7f4c0c0705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.102+0000 7f4c13200640 1 -- 172.21.15.8:0/2589477989 >> 172.21.15.8:0/2589477989 conn(0x7f4c0c069ed0 msgr2=0x7f4c0c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:18.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.102+0000 7f4c13200640 1 -- 172.21.15.8:0/2589477989 shutdown_connections 2024-05-26T15:43:18.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.102+0000 7f4c13200640 1 -- 172.21.15.8:0/2589477989 wait complete. 2024-05-26T15:43:18.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.104+0000 7f4c13200640 1 Processor -- start 2024-05-26T15:43:18.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.104+0000 7f4c13200640 1 -- start start 2024-05-26T15:43:18.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.105+0000 7f4c13200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c0c070b20 0x7f4c0c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.105+0000 7f4c13200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4c0c146230 0x7f4c0c0af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.105+0000 7f4c13200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c161000 0x7f4c0c141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.105+0000 7f4c13200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c1f2100 con 0x7f4c0c161000 2024-05-26T15:43:18.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.105+0000 7f4c13200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c0b0510 con 0x7f4c0c070b20 2024-05-26T15:43:18.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.105+0000 7f4c13200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c0aff50 con 0x7f4c0c146230 2024-05-26T15:43:18.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.106+0000 7f4c12800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c161000 0x7f4c0c141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.106+0000 7f4c12800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c161000 0x7f4c0c141f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32862/0 (socket says 172.21.15.8:32862) 2024-05-26T15:43:18.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.106+0000 7f4c12800640 1 -- 172.21.15.8:0/1945737120 learned_addr learned my addr 172.21.15.8:0/1945737120 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:18.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.106+0000 7f4c11e00640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c0c070b20 0x7f4c0c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.106+0000 7f4c11400640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4c0c146230 0x7f4c0c0af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.106+0000 7f4c12800640 1 -- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4c0c146230 msgr2=0x7f4c0c0af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:18.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.106+0000 7f4c12800640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4c0c146230 0x7f4c0c0af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.106+0000 7f4c12800640 1 -- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c0c070b20 msgr2=0x7f4c0c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:18.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.106+0000 7f4c12800640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c0c070b20 0x7f4c0c0c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.106+0000 7f4c12800640 1 -- 172.21.15.8:0/1945737120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08009b30 con 0x7f4c0c161000 2024-05-26T15:43:18.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.107+0000 7f4c12800640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c161000 0x7f4c0c141f80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4c08034040 tx=0x7f4c08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:18.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.107+0000 7f4c06000640 1 -- 172.21.15.8:0/1945737120 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0803d860 con 0x7f4c0c161000 2024-05-26T15:43:18.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.107+0000 7f4c06000640 1 -- 172.21.15.8:0/1945737120 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0803d9c0 con 0x7f4c0c161000 2024-05-26T15:43:18.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.107+0000 7f4c06000640 1 -- 172.21.15.8:0/1945737120 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0803dd70 con 0x7f4c0c161000 2024-05-26T15:43:18.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.107+0000 7f4c13200640 1 -- 172.21.15.8:0/1945737120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c0b0230 con 0x7f4c0c161000 2024-05-26T15:43:18.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.107+0000 7f4c13200640 1 -- 172.21.15.8:0/1945737120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c0c3ae0 con 0x7f4c0c161000 2024-05-26T15:43:18.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.108+0000 7f4c13200640 1 -- 172.21.15.8:0/1945737120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0c0c3cd0 con 0x7f4c0c161000 2024-05-26T15:43:18.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.109+0000 7f4c06000640 1 -- 172.21.15.8:0/1945737120 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4c0803b400 con 0x7f4c0c161000 2024-05-26T15:43:18.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.110+0000 7f4c06000640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bf006ac00 0x7f4bf006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.110+0000 7f4c06000640 1 -- 172.21.15.8:0/1945737120 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f4c080aa490 con 0x7f4c0c161000 2024-05-26T15:43:18.109 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.111+0000 7f4c11e00640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bf006ac00 0x7f4bf006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.112+0000 7f4c11e00640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bf006ac00 0x7f4bf006d0c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4c00000f60 tx=0x7f4c00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:18.115 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.116+0000 7f4c06000640 1 -- 172.21.15.8:0/1945737120 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4c08075400 con 0x7f4c0c161000 2024-05-26T15:43:18.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.328+0000 7f4c13200640 1 -- 172.21.15.8:0/1945737120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4c0c04e210 con 0x7f4c0c161000 2024-05-26T15:43:18.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.329+0000 7f4c06000640 1 -- 172.21.15.8:0/1945737120 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v61) v1 ==== 80+0+122 (secure 0 0 0) 0x7f4c08009510 con 0x7f4c0c161000 2024-05-26T15:43:18.328 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.47:6836/3388176100 2024-05-27T15:42:25.245849+0000 2024-05-26T15:43:18.328 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.47:6834/3388176100 2024-05-27T15:42:25.245849+0000 2024-05-26T15:43:18.328 INFO:teuthology.orchestra.run.smithi008.stderr:listed 2 entries 2024-05-26T15:43:18.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 -- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bf006ac00 msgr2=0x7f4bf006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:18.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bf006ac00 0x7f4bf006d0c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4c00000f60 tx=0x7f4c00009040 comp rx=0 tx=0).stop 2024-05-26T15:43:18.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 -- 172.21.15.8:0/1945737120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c161000 msgr2=0x7f4c0c141f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:18.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c161000 0x7f4c0c141f80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4c08034040 tx=0x7f4c08004a40 comp rx=0 tx=0).stop 2024-05-26T15:43:18.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 -- 172.21.15.8:0/1945737120 shutdown_connections 2024-05-26T15:43:18.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c0c161000 0x7f4c0c141f80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4c0c146230 0x7f4c0c0af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bf006ac00 0x7f4bf006d0c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 --2- 172.21.15.8:0/1945737120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c0c070b20 0x7f4c0c0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 -- 172.21.15.8:0/1945737120 >> 172.21.15.8:0/1945737120 conn(0x7f4c0c069ed0 msgr2=0x7f4c0c15e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:18.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 -- 172.21.15.8:0/1945737120 shutdown_connections 2024-05-26T15:43:18.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.332+0000 7f4c13200640 1 -- 172.21.15.8:0/1945737120 wait complete. 2024-05-26T15:43:18.348 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-26T15:43:18.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:18.348 DEBUG:teuthology.orchestra.run.smithi008:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-26T15:43:18.435 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:43:18.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:18.435 DEBUG:teuthology.orchestra.run.smithi008:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-26T15:43:18.484 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:43:18.485 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:43:18.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-26T15:43:18.546 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:43:18.546 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:43:18.604 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-26T15:43:18.605 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:43:18.605 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:43:18.664 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-26T15:43:18.664 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:43:18.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.880+0000 7f7ff5e00640 1 Processor -- start 2024-05-26T15:43:18.879 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.880+0000 7f7ff5e00640 1 -- start start 2024-05-26T15:43:18.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.882+0000 7f7ff5e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ff0070e00 0x7f7ff0071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.882+0000 7f7ff5e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7ff00cd070 0x7f7ff00cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.880 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.882+0000 7f7ff5e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff00717a0 con 0x7f7ff014ffb0 2024-05-26T15:43:18.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.882+0000 7f7ff5e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff006d380 con 0x7f7ff0070e00 2024-05-26T15:43:18.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.882+0000 7f7ff5e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff0150390 con 0x7f7ff00cd070 2024-05-26T15:43:18.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.882+0000 7f7fefe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ff0070e00 0x7f7ff0071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.882+0000 7f7fefe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7ff0070e00 0x7f7ff0071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32872/0 (socket says 172.21.15.8:32872) 2024-05-26T15:43:18.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.882+0000 7f7fefe00640 1 -- 172.21.15.8:0/2773520024 learned_addr learned my addr 172.21.15.8:0/2773520024 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:18.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.882+0000 7f7fefe00640 1 -- 172.21.15.8:0/2773520024 >> v2:172.21.15.47:3300/0 conn(0x7f7ff00cd070 msgr2=0x7f7ff00cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:18.881 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.883+0000 7f7fefe00640 1 --2- 172.21.15.8:0/2773520024 >> v2:172.21.15.47:3300/0 conn(0x7f7ff00cd070 0x7f7ff00cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.883+0000 7f7fefe00640 1 -- 172.21.15.8:0/2773520024 >> v1:172.21.15.8:6789/0 conn(0x7f7ff014ffb0 legacy=0x7f7ff00adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.883+0000 7f7fefe00640 1 -- 172.21.15.8:0/2773520024 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00ae1e0 con 0x7f7ff0070e00 2024-05-26T15:43:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.884+0000 7f7fefe00640 1 --2- 172.21.15.8:0/2773520024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff0070e00 0x7f7ff0071260 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0153ac0 tx=0x7f7fdc02b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434fd66acfcdc5ed server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.884+0000 7f7fef400640 1 -- 172.21.15.8:0/2773520024 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc033440 con 0x7f7ff0070e00 2024-05-26T15:43:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.884+0000 7f7fef400640 1 -- 172.21.15.8:0/2773520024 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc0335a0 con 0x7f7ff0070e00 2024-05-26T15:43:18.882 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.884+0000 7f7fef400640 1 -- 172.21.15.8:0/2773520024 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc033930 con 0x7f7ff0070e00 2024-05-26T15:43:18.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.885+0000 7f7ff5e00640 1 -- 172.21.15.8:0/2773520024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff0070e00 msgr2=0x7f7ff0071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:18.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.885+0000 7f7ff5e00640 1 --2- 172.21.15.8:0/2773520024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff0070e00 0x7f7ff0071260 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0153ac0 tx=0x7f7fdc02b260 comp rx=0 tx=0).stop 2024-05-26T15:43:18.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.885+0000 7f7ff5e00640 1 -- 172.21.15.8:0/2773520024 shutdown_connections 2024-05-26T15:43:18.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.885+0000 7f7ff5e00640 1 --2- 172.21.15.8:0/2773520024 >> v2:172.21.15.47:3300/0 conn(0x7f7ff00cd070 0x7f7ff00cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.883 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.885+0000 7f7ff5e00640 1 --2- 172.21.15.8:0/2773520024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff0070e00 0x7f7ff0071260 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.885+0000 7f7ff5e00640 1 -- 172.21.15.8:0/2773520024 >> 172.21.15.8:0/2773520024 conn(0x7f7ff0069ed0 msgr2=0x7f7ff006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:18.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.885+0000 7f7ff5e00640 1 -- 172.21.15.8:0/2773520024 shutdown_connections 2024-05-26T15:43:18.884 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.885+0000 7f7ff5e00640 1 -- 172.21.15.8:0/2773520024 wait complete. 2024-05-26T15:43:18.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.887+0000 7f7ff5e00640 1 Processor -- start 2024-05-26T15:43:18.885 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.887+0000 7f7ff5e00640 1 -- start start 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.888+0000 7f7ff5e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ff0070e00 0x7f7ff014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.888+0000 7f7ff5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ff00cd070 0x7f7ff0145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.888+0000 7f7ff5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff014ffb0 0x7f7ff0157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.888+0000 7f7ff5e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff014ca60 con 0x7f7ff014ffb0 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.888+0000 7f7ff5e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff014ea70 con 0x7f7ff00cd070 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.888+0000 7f7ff5e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff0145bb0 con 0x7f7ff0070e00 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.888+0000 7f7ff5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff014ffb0 0x7f7ff0157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.888+0000 7f7ff5400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff014ffb0 0x7f7ff0157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32886/0 (socket says 172.21.15.8:32886) 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.888+0000 7f7ff5400640 1 -- 172.21.15.8:0/1798916234 learned_addr learned my addr 172.21.15.8:0/1798916234 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.888+0000 7f7fefe00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ff00cd070 0x7f7ff0145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.889+0000 7f7ff4a00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ff0070e00 0x7f7ff014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.889+0000 7f7ff5400640 1 -- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ff0070e00 msgr2=0x7f7ff014ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.889+0000 7f7ff5400640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ff0070e00 0x7f7ff014ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.889+0000 7f7ff5400640 1 -- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ff00cd070 msgr2=0x7f7ff0145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.889+0000 7f7ff5400640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ff00cd070 0x7f7ff0145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.889+0000 7f7ff5400640 1 -- 172.21.15.8:0/1798916234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc0094d0 con 0x7f7ff014ffb0 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.889+0000 7f7ff5400640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff014ffb0 0x7f7ff0157f40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800b970 tx=0x7f7fe800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.889+0000 7f7fecc00640 1 -- 172.21.15.8:0/1798916234 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe800cb40 con 0x7f7ff014ffb0 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.889+0000 7f7fecc00640 1 -- 172.21.15.8:0/1798916234 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe800ccc0 con 0x7f7ff014ffb0 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.890+0000 7f7ff5e00640 1 -- 172.21.15.8:0/1798916234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff00af5c0 con 0x7f7ff014ffb0 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.890+0000 7f7fecc00640 1 -- 172.21.15.8:0/1798916234 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8014680 con 0x7f7ff014ffb0 2024-05-26T15:43:18.889 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.890+0000 7f7ff5e00640 1 -- 172.21.15.8:0/1798916234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff014f440 con 0x7f7ff014ffb0 2024-05-26T15:43:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.891+0000 7f7ff5e00640 1 -- 172.21.15.8:0/1798916234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff014ceb0 con 0x7f7ff014ffb0 2024-05-26T15:43:18.890 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.892+0000 7f7fecc00640 1 -- 172.21.15.8:0/1798916234 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7fe801d3b0 con 0x7f7ff014ffb0 2024-05-26T15:43:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.893+0000 7f7fecc00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fd006ac00 0x7f7fd006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:18.891 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.893+0000 7f7fecc00640 1 -- 172.21.15.8:0/1798916234 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f7fe8089540 con 0x7f7ff014ffb0 2024-05-26T15:43:18.892 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.894+0000 7f7ff4a00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fd006ac00 0x7f7fd006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:18.893 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.895+0000 7f7ff4a00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fd006ac00 0x7f7fd006d0c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4000f60 tx=0x7f7fe4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:18.896 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:18.898+0000 7f7fecc00640 1 -- 172.21.15.8:0/1798916234 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7ff014ceb0 con 0x7f7ff014ffb0 2024-05-26T15:43:19.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.136+0000 7f7ff5e00640 1 -- 172.21.15.8:0/1798916234 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ff014e840 con 0x7f7ff014ffb0 2024-05-26T15:43:19.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.137+0000 7f7fecc00640 1 -- 172.21.15.8:0/1798916234 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f7ff014e840 con 0x7f7ff014ffb0 2024-05-26T15:43:19.137 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:19.137 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:43:19.137 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:43:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.140+0000 7f7ff5e00640 1 -- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fd006ac00 msgr2=0x7f7fd006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.140+0000 7f7ff5e00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fd006ac00 0x7f7fd006d0c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4000f60 tx=0x7f7fe4009040 comp rx=0 tx=0).stop 2024-05-26T15:43:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.140+0000 7f7ff5e00640 1 -- 172.21.15.8:0/1798916234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff014ffb0 msgr2=0x7f7ff0157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.140+0000 7f7ff5e00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff014ffb0 0x7f7ff0157f40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800b970 tx=0x7f7fe800be30 comp rx=0 tx=0).stop 2024-05-26T15:43:19.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.140+0000 7f7ff5e00640 1 -- 172.21.15.8:0/1798916234 shutdown_connections 2024-05-26T15:43:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.140+0000 7f7ff5e00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff014ffb0 0x7f7ff0157f40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.140+0000 7f7ff5e00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7fd006ac00 0x7f7fd006d0c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.140+0000 7f7ff5e00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ff00cd070 0x7f7ff0145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.140+0000 7f7ff5e00640 1 --2- 172.21.15.8:0/1798916234 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7ff0070e00 0x7f7ff014ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.140+0000 7f7ff5e00640 1 -- 172.21.15.8:0/1798916234 >> 172.21.15.8:0/1798916234 conn(0x7f7ff0069ed0 msgr2=0x7f7ff00b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:19.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.141+0000 7f7ff5e00640 1 -- 172.21.15.8:0/1798916234 shutdown_connections 2024-05-26T15:43:19.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.141+0000 7f7ff5e00640 1 -- 172.21.15.8:0/1798916234 wait complete. 2024-05-26T15:43:19.159 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:43:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.371+0000 7ff7bd400640 1 Processor -- start 2024-05-26T15:43:19.369 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.371+0000 7ff7bd400640 1 -- start start 2024-05-26T15:43:19.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.372+0000 7ff7bd400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff7b8144180 0x7ff7b80cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.372+0000 7ff7bd400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b806db60 0x7ff7b806dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.372+0000 7ff7bd400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b8144560 con 0x7ff7b8070570 2024-05-26T15:43:19.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.372+0000 7ff7bd400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b815b190 con 0x7ff7b8144180 2024-05-26T15:43:19.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.372+0000 7ff7bd400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b815b470 con 0x7ff7b806db60 2024-05-26T15:43:19.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.373+0000 7ff7b7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff7b8144180 0x7ff7b80cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.373+0000 7ff7b7e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff7b8144180 0x7ff7b80cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32894/0 (socket says 172.21.15.8:32894) 2024-05-26T15:43:19.371 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.373+0000 7ff7b7e00640 1 -- 172.21.15.8:0/3007360695 learned_addr learned my addr 172.21.15.8:0/3007360695 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:19.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.373+0000 7ff7b7400640 1 --2- 172.21.15.8:0/3007360695 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b806db60 0x7ff7b806dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.373+0000 7ff7b7e00640 1 -- 172.21.15.8:0/3007360695 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b806db60 msgr2=0x7ff7b806dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:19.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.373+0000 7ff7b7e00640 1 --2- 172.21.15.8:0/3007360695 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b806db60 0x7ff7b806dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.373+0000 7ff7b7e00640 1 -- 172.21.15.8:0/3007360695 >> v1:172.21.15.47:6789/0 conn(0x7ff7b8070570 legacy=0x7ff7b806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:19.372 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.373+0000 7ff7b7e00640 1 -- 172.21.15.8:0/3007360695 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b815b750 con 0x7ff7b8144180 2024-05-26T15:43:19.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.373+0000 7ff7b7400640 1 --2- 172.21.15.8:0/3007360695 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b806db60 0x7ff7b806dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:19.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.374+0000 7ff7b7e00640 1 --2- 172.21.15.8:0/3007360695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8144180 0x7ff7b80cb160 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009870 tx=0x7ff7a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de608646aca09a1e server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:19.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.375+0000 7ff7b6a00640 1 -- 172.21.15.8:0/3007360695 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a802ae90 con 0x7ff7b8144180 2024-05-26T15:43:19.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.375+0000 7ff7b6a00640 1 -- 172.21.15.8:0/3007360695 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a8032440 con 0x7ff7b8144180 2024-05-26T15:43:19.373 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.375+0000 7ff7b6a00640 1 -- 172.21.15.8:0/3007360695 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a80327d0 con 0x7ff7b8144180 2024-05-26T15:43:19.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.375+0000 7ff7bd400640 1 -- 172.21.15.8:0/3007360695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8144180 msgr2=0x7ff7b80cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.375+0000 7ff7bd400640 1 --2- 172.21.15.8:0/3007360695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8144180 0x7ff7b80cb160 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8009870 tx=0x7ff7a802a180 comp rx=0 tx=0).stop 2024-05-26T15:43:19.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.375+0000 7ff7bd400640 1 -- 172.21.15.8:0/3007360695 shutdown_connections 2024-05-26T15:43:19.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.375+0000 7ff7bd400640 1 --2- 172.21.15.8:0/3007360695 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b806db60 0x7ff7b806dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.375+0000 7ff7bd400640 1 --2- 172.21.15.8:0/3007360695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8144180 0x7ff7b80cb160 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.375+0000 7ff7bd400640 1 -- 172.21.15.8:0/3007360695 >> 172.21.15.8:0/3007360695 conn(0x7ff7b8069ed0 msgr2=0x7ff7b806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:19.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.376+0000 7ff7bd400640 1 -- 172.21.15.8:0/3007360695 shutdown_connections 2024-05-26T15:43:19.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.376+0000 7ff7bd400640 1 -- 172.21.15.8:0/3007360695 wait complete. 2024-05-26T15:43:19.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.377+0000 7ff7bd400640 1 Processor -- start 2024-05-26T15:43:19.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.378+0000 7ff7bd400640 1 -- start start 2024-05-26T15:43:19.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.378+0000 7ff7bd400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7b806db60 0x7ff7b8139540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.378+0000 7ff7bd400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8070570 0x7ff7b81f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7bd400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b8144180 0x7ff7b81f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7bd400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b813b360 con 0x7ff7b8070570 2024-05-26T15:43:19.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7bd400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b813fa50 con 0x7ff7b806db60 2024-05-26T15:43:19.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7bd400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b81f45f0 con 0x7ff7b8144180 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7b7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8070570 0x7ff7b81f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7b7400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8070570 0x7ff7b81f3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32904/0 (socket says 172.21.15.8:32904) 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7b7400640 1 -- 172.21.15.8:0/2394344048 learned_addr learned my addr 172.21.15.8:0/2394344048 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7b7e00640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7b806db60 0x7ff7b8139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7bca00640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b8144180 0x7ff7b81f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7b7400640 1 -- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b8144180 msgr2=0x7ff7b81f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7b7400640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b8144180 0x7ff7b81f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7b7400640 1 -- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7b806db60 msgr2=0x7ff7b8139540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7b7400640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7b806db60 0x7ff7b8139540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7b7400640 1 -- 172.21.15.8:0/2394344048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a80094d0 con 0x7ff7b8070570 2024-05-26T15:43:19.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7b7e00640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7b806db60 0x7ff7b8139540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:19.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.379+0000 7ff7bca00640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b8144180 0x7ff7b81f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:19.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.380+0000 7ff7b7400640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8070570 0x7ff7b81f3a80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400c7f0 tx=0x7ff7a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:19.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.380+0000 7ff7afe00640 1 -- 172.21.15.8:0/2394344048 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4007a30 con 0x7ff7b8070570 2024-05-26T15:43:19.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.380+0000 7ff7afe00640 1 -- 172.21.15.8:0/2394344048 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a4007b90 con 0x7ff7b8070570 2024-05-26T15:43:19.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.380+0000 7ff7afe00640 1 -- 172.21.15.8:0/2394344048 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400ce40 con 0x7ff7b8070570 2024-05-26T15:43:19.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.380+0000 7ff7bd400640 1 -- 172.21.15.8:0/2394344048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b815af60 con 0x7ff7b8070570 2024-05-26T15:43:19.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.380+0000 7ff7bd400640 1 -- 172.21.15.8:0/2394344048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b813ad10 con 0x7ff7b8070570 2024-05-26T15:43:19.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.381+0000 7ff7bd400640 1 -- 172.21.15.8:0/2394344048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b804e210 con 0x7ff7b8070570 2024-05-26T15:43:19.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.382+0000 7ff7afe00640 1 -- 172.21.15.8:0/2394344048 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff7a40113f0 con 0x7ff7b8070570 2024-05-26T15:43:19.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.383+0000 7ff7afe00640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff79806ac00 0x7ff79806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.383+0000 7ff7afe00640 1 -- 172.21.15.8:0/2394344048 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7ff7a4089780 con 0x7ff7b8070570 2024-05-26T15:43:19.383 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.384+0000 7ff7b7e00640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff79806ac00 0x7ff79806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.385+0000 7ff7b7e00640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff79806ac00 0x7ff79806d0c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8034000 tx=0x7ff7a802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:19.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.388+0000 7ff7afe00640 1 -- 172.21.15.8:0/2394344048 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff7a40546f0 con 0x7ff7b8070570 2024-05-26T15:43:19.584 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.586+0000 7ff7bd400640 1 -- 172.21.15.8:0/2394344048 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7b806d6b0 con 0x7ff7b8070570 2024-05-26T15:43:19.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.588+0000 7ff7afe00640 1 -- 172.21.15.8:0/2394344048 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16379 (secure 0 0 0) 0x7ff7a4087e60 con 0x7ff7b8070570 2024-05-26T15:43:19.586 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:19.587 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":61,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:43:15.748510+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:42:09.031612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-26T15:42:10.475864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6836/3388176100":"2024-05-27T15:42:25.245849+0000","172.21.15.47:6834/3388176100":"2024-05-27T15:42:25.245849+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:43:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.590+0000 7ff7bd400640 1 -- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff79806ac00 msgr2=0x7ff79806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.590+0000 7ff7bd400640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff79806ac00 0x7ff79806d0c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8034000 tx=0x7ff7a802e000 comp rx=0 tx=0).stop 2024-05-26T15:43:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.590+0000 7ff7bd400640 1 -- 172.21.15.8:0/2394344048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8070570 msgr2=0x7ff7b81f3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.590+0000 7ff7bd400640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8070570 0x7ff7b81f3a80 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400c7f0 tx=0x7ff7a400cbf0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.590+0000 7ff7bd400640 1 -- 172.21.15.8:0/2394344048 shutdown_connections 2024-05-26T15:43:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.590+0000 7ff7bd400640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff7b8144180 0x7ff7b81f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.590+0000 7ff7bd400640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff7b8070570 0x7ff7b81f3a80 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.590+0000 7ff7bd400640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff79806ac00 0x7ff79806d0c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.590+0000 7ff7bd400640 1 --2- 172.21.15.8:0/2394344048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff7b806db60 0x7ff7b8139540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.590+0000 7ff7bd400640 1 -- 172.21.15.8:0/2394344048 >> 172.21.15.8:0/2394344048 conn(0x7ff7b8069ed0 msgr2=0x7ff7b806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.591+0000 7ff7bd400640 1 -- 172.21.15.8:0/2394344048 shutdown_connections 2024-05-26T15:43:19.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.591+0000 7ff7bd400640 1 -- 172.21.15.8:0/2394344048 wait complete. 2024-05-26T15:43:19.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-26T15:39:22.226598+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-26T15:42:09.031612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-05-26T15:42:10.475864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-26T15:43:19.609 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-26T15:43:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.821+0000 7f2b1be00640 1 Processor -- start 2024-05-26T15:43:19.819 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.821+0000 7f2b1be00640 1 -- start start 2024-05-26T15:43:19.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.822+0000 7f2b1be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2b1c15cc60 0x7f2b1c0b8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.822+0000 7f2b1be00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c0d0a60 con 0x7f2b1c0cf300 2024-05-26T15:43:19.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.822+0000 7f2b1be00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c0d0d40 con 0x7f2b1c0b1e30 2024-05-26T15:43:19.821 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.823+0000 7f2b1be00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1c0b6190 con 0x7f2b1c15cc60 2024-05-26T15:43:19.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.823+0000 7f2b1b400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2b1c0cf300 0x7f2b1c0cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:54084/0 (socket says 172.21.15.8:54084) 2024-05-26T15:43:19.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.823+0000 7f2b1b400640 1 -- 172.21.15.8:0/2568262015 learned_addr learned my addr 172.21.15.8:0/2568262015 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:19.822 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.823+0000 7f2b1aa00640 1 --2- 172.21.15.8:0/2568262015 >> v2:172.21.15.47:3300/0 conn(0x7f2b1c15cc60 0x7f2b1c0b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.823+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565022650 0 0) 0x7f2b1c0d0a60 con 0x7f2b1c0cf300 2024-05-26T15:43:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.823+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2afc003520 con 0x7f2b1c0cf300 2024-05-26T15:43:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1790428935 0 0) 0x7f2afc003520 con 0x7f2b1c0cf300 2024-05-26T15:43:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 >> v2:172.21.15.47:3300/0 conn(0x7f2b1c15cc60 msgr2=0x7f2b1c0b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 --2- 172.21.15.8:0/2568262015 >> v2:172.21.15.47:3300/0 conn(0x7f2b1c15cc60 0x7f2b1c0b8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 >> v1:172.21.15.47:6789/0 conn(0x7f2b1c0b1e30 legacy=0x7f2b1c0b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c0d1020 con 0x7f2b1c0cf300 2024-05-26T15:43:19.824 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f2b14001670 con 0x7f2b1c0cf300 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 >> v1:172.21.15.8:6789/0 conn(0x7f2b1c0cf300 legacy=0x7f2b1c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2afc003a30 0x7f2afc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2afc0047c0 0x7f2afc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2afc0051d0 0x7f2afc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0b6190 con 0x7f2afc0051d0 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc00c100 con 0x7f2afc0047c0 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc00c2c0 con 0x7f2afc003a30 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.824+0000 7f2b1b400640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2afc0051d0 0x7f2afc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.825+0000 7f2b1aa00640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2afc003a30 0x7f2afc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.825+0000 7f2b1b400640 1 -- 172.21.15.8:0/2568262015 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2afc003a30 msgr2=0x7f2afc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:19.825 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.825+0000 7f2b1b400640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2afc003a30 0x7f2afc003e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.825+0000 7f2b1a000640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2afc0047c0 0x7f2afc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.825+0000 7f2b1b400640 1 -- 172.21.15.8:0/2568262015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2afc0047c0 msgr2=0x7f2afc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.825+0000 7f2b1b400640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2afc0047c0 0x7f2afc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.825+0000 7f2b1b400640 1 -- 172.21.15.8:0/2568262015 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc003520 con 0x7f2afc0051d0 2024-05-26T15:43:19.826 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.826+0000 7f2b1b400640 1 -- 172.21.15.8:0/2568262015 reap_dead start 2024-05-26T15:43:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.826+0000 7f2b1b400640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2afc0051d0 0x7f2afc00b980 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2b14007fb0 tx=0x7f2afc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1445e9f2a2ed0e0b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:19.827 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.826+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14005ad0 con 0x7f2afc0051d0 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.826+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1402d070 con 0x7f2afc0051d0 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.826+0000 7f2b19600640 1 -- 172.21.15.8:0/2568262015 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14005e70 con 0x7f2afc0051d0 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.827+0000 7f2b1be00640 1 -- 172.21.15.8:0/2568262015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2afc0051d0 msgr2=0x7f2afc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.827+0000 7f2b1be00640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2afc0051d0 0x7f2afc00b980 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2b14007fb0 tx=0x7f2afc0057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.827+0000 7f2b1be00640 1 -- 172.21.15.8:0/2568262015 shutdown_connections 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.827+0000 7f2b1be00640 1 --2- 172.21.15.8:0/2568262015 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2afc0051d0 0x7f2afc00b980 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.827+0000 7f2b1be00640 1 -- 172.21.15.8:0/2568262015 >> 172.21.15.8:0/2568262015 conn(0x7f2b1c06b740 msgr2=0x7f2b1c06bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.827+0000 7f2b1be00640 1 -- 172.21.15.8:0/2568262015 shutdown_connections 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.827+0000 7f2b1be00640 1 -- 172.21.15.8:0/2568262015 wait complete. 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.829+0000 7f2b1be00640 1 Processor -- start 2024-05-26T15:43:19.828 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.829+0000 7f2b1be00640 1 -- start start 2024-05-26T15:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2afc0051d0 0x7f2b1c14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1be00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2b1c149970 0x7f2b1c14b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1f1cc0 0x7f2b1c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1be00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c14ad70 con 0x7f2b1c1f1cc0 2024-05-26T15:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1be00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c14a0f0 con 0x7f2afc0051d0 2024-05-26T15:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1be00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c14a3d0 con 0x7f2b1c149970 2024-05-26T15:43:19.831 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1f1cc0 0x7f2b1c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1f1cc0 0x7f2b1c15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32920/0 (socket says 172.21.15.8:32920) 2024-05-26T15:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1b400640 1 -- 172.21.15.8:0/506065488 learned_addr learned my addr 172.21.15.8:0/506065488 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1aa00640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2afc0051d0 0x7f2b1c14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1b400640 1 -- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2b1c149970 msgr2=0x7f2b1c14b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1a000640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2b1c149970 0x7f2b1c14b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1b400640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2b1c149970 0x7f2b1c14b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1b400640 1 -- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2afc0051d0 msgr2=0x7f2b1c14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.830+0000 7f2b1b400640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2afc0051d0 0x7f2b1c14c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.831+0000 7f2b1b400640 1 -- 172.21.15.8:0/506065488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c14a6b0 con 0x7f2b1c1f1cc0 2024-05-26T15:43:19.832 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.831+0000 7f2b1b400640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1f1cc0 0x7f2b1c15d830 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2b14000c00 tx=0x7f2b1c0b59d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:19.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.831+0000 7f2b13400640 1 -- 172.21.15.8:0/506065488 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b140047e0 con 0x7f2b1c1f1cc0 2024-05-26T15:43:19.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.831+0000 7f2b13400640 1 -- 172.21.15.8:0/506065488 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b14004940 con 0x7f2b1c1f1cc0 2024-05-26T15:43:19.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.831+0000 7f2b13400640 1 -- 172.21.15.8:0/506065488 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14004cd0 con 0x7f2b1c1f1cc0 2024-05-26T15:43:19.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.831+0000 7f2b1be00640 1 -- 172.21.15.8:0/506065488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c14a990 con 0x7f2b1c1f1cc0 2024-05-26T15:43:19.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.831+0000 7f2b1be00640 1 -- 172.21.15.8:0/506065488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c14b6d0 con 0x7f2b1c1f1cc0 2024-05-26T15:43:19.833 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.833+0000 7f2b1be00640 1 -- 172.21.15.8:0/506065488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c14aeb0 con 0x7f2b1c1f1cc0 2024-05-26T15:43:19.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.833+0000 7f2b13400640 1 -- 172.21.15.8:0/506065488 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b1402f030 con 0x7f2b1c1f1cc0 2024-05-26T15:43:19.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.834+0000 7f2b13400640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2af806ac30 0x7f2af806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:19.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.834+0000 7f2b13400640 1 -- 172.21.15.8:0/506065488 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f2b140a8180 con 0x7f2b1c1f1cc0 2024-05-26T15:43:19.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.835+0000 7f2b1aa00640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2af806ac30 0x7f2af806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:19.835 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.836+0000 7f2b1aa00640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2af806ac30 0x7f2af806d0f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009910 tx=0x7f2b0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:19.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:19.839+0000 7f2b13400640 1 -- 172.21.15.8:0/506065488 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2b1c14aeb0 con 0x7f2b1c1f1cc0 2024-05-26T15:43:20.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.040+0000 7f2b1be00640 1 -- 172.21.15.8:0/506065488 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b1c14aeb0 con 0x7f2b1c1f1cc0 2024-05-26T15:43:20.039 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.041+0000 7f2b13400640 1 -- 172.21.15.8:0/506065488 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b1c14aeb0 con 0x7f2b1c1f1cc0 2024-05-26T15:43:20.040 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2024-05-26T15:43:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.044+0000 7f2b1be00640 1 -- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2af806ac30 msgr2=0x7f2af806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.044+0000 7f2b1be00640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2af806ac30 0x7f2af806d0f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009910 tx=0x7f2b0c008040 comp rx=0 tx=0).stop 2024-05-26T15:43:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.044+0000 7f2b1be00640 1 -- 172.21.15.8:0/506065488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1f1cc0 msgr2=0x7f2b1c15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.044+0000 7f2b1be00640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1f1cc0 0x7f2b1c15d830 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f2b14000c00 tx=0x7f2b1c0b59d0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.044+0000 7f2b1be00640 1 -- 172.21.15.8:0/506065488 shutdown_connections 2024-05-26T15:43:20.043 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.044+0000 7f2b1be00640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1f1cc0 0x7f2b1c15d830 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.044+0000 7f2b1be00640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f2b1c149970 0x7f2b1c14b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.044+0000 7f2b1be00640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f2af806ac30 0x7f2af806d0f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.044+0000 7f2b1be00640 1 --2- 172.21.15.8:0/506065488 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2afc0051d0 0x7f2b1c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.044+0000 7f2b1be00640 1 -- 172.21.15.8:0/506065488 >> 172.21.15.8:0/506065488 conn(0x7f2b1c06b740 msgr2=0x7f2b1c0cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.045+0000 7f2b1be00640 1 -- 172.21.15.8:0/506065488 shutdown_connections 2024-05-26T15:43:20.044 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.045+0000 7f2b1be00640 1 -- 172.21.15.8:0/506065488 wait complete. 2024-05-26T15:43:20.064 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-26T15:43:20.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.281+0000 7fce8ca00640 1 Processor -- start 2024-05-26T15:43:20.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.281+0000 7fce8ca00640 1 -- start start 2024-05-26T15:43:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.282+0000 7fce8ca00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fce8815ff00 0x7fce880cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.282+0000 7fce8ca00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce881602e0 0x7fce880cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.282+0000 7fce8ca00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce881614d0 con 0x7fce880b5d20 2024-05-26T15:43:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.282+0000 7fce8ca00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce880d0c10 con 0x7fce8815ff00 2024-05-26T15:43:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.283+0000 7fce8ca00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce880d0e20 con 0x7fce881602e0 2024-05-26T15:43:20.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.283+0000 7fce87400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fce8815ff00 0x7fce880cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:20.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.283+0000 7fce87400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fce8815ff00 0x7fce880cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32924/0 (socket says 172.21.15.8:32924) 2024-05-26T15:43:20.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.283+0000 7fce87400640 1 -- 172.21.15.8:0/1070921173 learned_addr learned my addr 172.21.15.8:0/1070921173 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:20.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.283+0000 7fce86a00640 1 --2- 172.21.15.8:0/1070921173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce881602e0 0x7fce880cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:20.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.284+0000 7fce87400640 1 -- 172.21.15.8:0/1070921173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce881602e0 msgr2=0x7fce880cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:20.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.284+0000 7fce87400640 1 --2- 172.21.15.8:0/1070921173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce881602e0 0x7fce880cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.284+0000 7fce87400640 1 -- 172.21.15.8:0/1070921173 >> v1:172.21.15.47:6789/0 conn(0x7fce880b5d20 legacy=0x7fce881607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:20.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.284+0000 7fce87400640 1 -- 172.21.15.8:0/1070921173 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce880d1100 con 0x7fce8815ff00 2024-05-26T15:43:20.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.285+0000 7fce87400640 1 --2- 172.21.15.8:0/1070921173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 0x7fce880cf3f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fce78009e50 tx=0x7fce7802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48aad6346d00ded server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:20.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.285+0000 7fce86000640 1 -- 172.21.15.8:0/1070921173 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7802aea0 con 0x7fce8815ff00 2024-05-26T15:43:20.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.285+0000 7fce86000640 1 -- 172.21.15.8:0/1070921173 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7802d050 con 0x7fce8815ff00 2024-05-26T15:43:20.284 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.285+0000 7fce86000640 1 -- 172.21.15.8:0/1070921173 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78031820 con 0x7fce8815ff00 2024-05-26T15:43:20.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.286+0000 7fce8ca00640 1 -- 172.21.15.8:0/1070921173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 msgr2=0x7fce880cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.286+0000 7fce8ca00640 1 --2- 172.21.15.8:0/1070921173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 0x7fce880cf3f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fce78009e50 tx=0x7fce7802a6c0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.286+0000 7fce8ca00640 1 -- 172.21.15.8:0/1070921173 shutdown_connections 2024-05-26T15:43:20.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.286+0000 7fce8ca00640 1 --2- 172.21.15.8:0/1070921173 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce881602e0 0x7fce880cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.286+0000 7fce8ca00640 1 --2- 172.21.15.8:0/1070921173 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 0x7fce880cf3f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.286+0000 7fce8ca00640 1 -- 172.21.15.8:0/1070921173 >> 172.21.15.8:0/1070921173 conn(0x7fce880b4530 msgr2=0x7fce880b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:20.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.286+0000 7fce8ca00640 1 -- 172.21.15.8:0/1070921173 shutdown_connections 2024-05-26T15:43:20.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.286+0000 7fce8ca00640 1 -- 172.21.15.8:0/1070921173 wait complete. 2024-05-26T15:43:20.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.288+0000 7fce8ca00640 1 Processor -- start 2024-05-26T15:43:20.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.288+0000 7fce8ca00640 1 -- start start 2024-05-26T15:43:20.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.289+0000 7fce8ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce880b5d20 0x7fce88154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.289+0000 7fce8ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 0x7fce880cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.289+0000 7fce8ca00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce881602e0 0x7fce880cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.289+0000 7fce8ca00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce880cac00 con 0x7fce8815ff00 2024-05-26T15:43:20.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.289+0000 7fce8ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce880cb390 con 0x7fce880b5d20 2024-05-26T15:43:20.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.289+0000 7fce8ca00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce880cb670 con 0x7fce881602e0 2024-05-26T15:43:20.290 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.290+0000 7fce86a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 0x7fce880cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.290+0000 7fce86a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 0x7fce880cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32926/0 (socket says 172.21.15.8:32926) 2024-05-26T15:43:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.290+0000 7fce86a00640 1 -- 172.21.15.8:0/985560298 learned_addr learned my addr 172.21.15.8:0/985560298 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.290+0000 7fce86a00640 1 -- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce881602e0 msgr2=0x7fce880cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.290+0000 7fce86a00640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce881602e0 0x7fce880cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.290+0000 7fce86a00640 1 -- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce880b5d20 msgr2=0x7fce88154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.290+0000 7fce86a00640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce880b5d20 0x7fce88154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.290+0000 7fce86a00640 1 -- 172.21.15.8:0/985560298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78009b30 con 0x7fce8815ff00 2024-05-26T15:43:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.290+0000 7fce86a00640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 0x7fce880cc150 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fce7400d5c0 tx=0x7fce7400da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.291+0000 7fce7f400640 1 -- 172.21.15.8:0/985560298 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740125f0 con 0x7fce8815ff00 2024-05-26T15:43:20.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.291+0000 7fce7f400640 1 -- 172.21.15.8:0/985560298 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74012750 con 0x7fce8815ff00 2024-05-26T15:43:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.291+0000 7fce7f400640 1 -- 172.21.15.8:0/985560298 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74012b00 con 0x7fce8815ff00 2024-05-26T15:43:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.291+0000 7fce8ca00640 1 -- 172.21.15.8:0/985560298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce880cb950 con 0x7fce8815ff00 2024-05-26T15:43:20.292 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.291+0000 7fce8ca00640 1 -- 172.21.15.8:0/985560298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce881553c0 con 0x7fce8815ff00 2024-05-26T15:43:20.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.292+0000 7fce8ca00640 1 -- 172.21.15.8:0/985560298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce88155580 con 0x7fce8815ff00 2024-05-26T15:43:20.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.293+0000 7fce7f400640 1 -- 172.21.15.8:0/985560298 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce74012c60 con 0x7fce8815ff00 2024-05-26T15:43:20.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.294+0000 7fce7f400640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce6806ac00 0x7fce6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.294+0000 7fce7f400640 1 -- 172.21.15.8:0/985560298 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7fce74089a80 con 0x7fce8815ff00 2024-05-26T15:43:20.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.295+0000 7fce87400640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce6806ac00 0x7fce6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:20.294 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.296+0000 7fce87400640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce6806ac00 0x7fce6806d0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fce78033000 tx=0x7fce7802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:20.297 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.298+0000 7fce7f400640 1 -- 172.21.15.8:0/985560298 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fce740549f0 con 0x7fce8815ff00 2024-05-26T15:43:20.495 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.496+0000 7fce8ca00640 1 -- 172.21.15.8:0/985560298 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce88073fa0 con 0x7fce8815ff00 2024-05-26T15:43:20.496 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.497+0000 7fce7f400640 1 -- 172.21.15.8:0/985560298 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7fce74058010 con 0x7fce8815ff00 2024-05-26T15:43:20.496 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.500+0000 7fce8ca00640 1 -- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce6806ac00 msgr2=0x7fce6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.500+0000 7fce8ca00640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce6806ac00 0x7fce6806d0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fce78033000 tx=0x7fce7802e000 comp rx=0 tx=0).stop 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.500+0000 7fce8ca00640 1 -- 172.21.15.8:0/985560298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 msgr2=0x7fce880cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.500+0000 7fce8ca00640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 0x7fce880cc150 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fce7400d5c0 tx=0x7fce7400da80 comp rx=0 tx=0).stop 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.501+0000 7fce8ca00640 1 -- 172.21.15.8:0/985560298 shutdown_connections 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.501+0000 7fce8ca00640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fce881602e0 0x7fce880cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.501+0000 7fce8ca00640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fce8815ff00 0x7fce880cc150 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.501+0000 7fce8ca00640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fce6806ac00 0x7fce6806d0c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.501+0000 7fce8ca00640 1 --2- 172.21.15.8:0/985560298 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fce880b5d20 0x7fce88154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.501+0000 7fce8ca00640 1 -- 172.21.15.8:0/985560298 >> 172.21.15.8:0/985560298 conn(0x7fce880b4530 msgr2=0x7fce880d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:20.500 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.501+0000 7fce8ca00640 1 -- 172.21.15.8:0/985560298 shutdown_connections 2024-05-26T15:43:20.501 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.501+0000 7fce8ca00640 1 -- 172.21.15.8:0/985560298 wait complete. 2024-05-26T15:43:20.519 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-26T15:43:20.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.738+0000 7f7a4d800640 1 Processor -- start 2024-05-26T15:43:20.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.739+0000 7f7a4d800640 1 -- start start 2024-05-26T15:43:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.740+0000 7f7a4d800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f7a4815cab0 0x7f7a48159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.740+0000 7f7a4d800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7a4806d680 0x7f7a4806db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.740+0000 7f7a4d800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a48070880 con 0x7f7a4815ce90 2024-05-26T15:43:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.740+0000 7f7a4d800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a4806e070 con 0x7f7a4815cab0 2024-05-26T15:43:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.740+0000 7f7a4d800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a48070b60 con 0x7f7a4806d680 2024-05-26T15:43:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.741+0000 7f7a3fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f7a4815ce90 0x7f7a480cdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:54096/0 (socket says 172.21.15.8:54096) 2024-05-26T15:43:20.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.741+0000 7f7a3fe00640 1 -- 172.21.15.8:0/291012593 learned_addr learned my addr 172.21.15.8:0/291012593 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.741+0000 7f7a47e00640 1 --2- 172.21.15.8:0/291012593 >> v2:172.21.15.8:3300/0 conn(0x7f7a4815cab0 0x7f7a48159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.741+0000 7f7a47400640 1 -- 172.21.15.8:0/291012593 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86754957 0 0) 0x7f7a48070880 con 0x7f7a4815ce90 2024-05-26T15:43:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.741+0000 7f7a4ce00640 1 --2- 172.21.15.8:0/291012593 >> v2:172.21.15.47:3300/0 conn(0x7f7a4806d680 0x7f7a4806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:20.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.741+0000 7f7a47400640 1 -- 172.21.15.8:0/291012593 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a2c003520 con 0x7f7a4815ce90 2024-05-26T15:43:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.742+0000 7f7a47e00640 1 -- 172.21.15.8:0/291012593 >> v2:172.21.15.47:3300/0 conn(0x7f7a4806d680 msgr2=0x7f7a4806db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.742+0000 7f7a47e00640 1 --2- 172.21.15.8:0/291012593 >> v2:172.21.15.47:3300/0 conn(0x7f7a4806d680 0x7f7a4806db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.742+0000 7f7a47400640 1 -- 172.21.15.8:0/291012593 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59768457 0 0) 0x7f7a2c003520 con 0x7f7a4815ce90 2024-05-26T15:43:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.742+0000 7f7a47e00640 1 -- 172.21.15.8:0/291012593 >> v1:172.21.15.8:6789/0 conn(0x7f7a4815ce90 legacy=0x7f7a480cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.742+0000 7f7a47e00640 1 -- 172.21.15.8:0/291012593 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a48070e40 con 0x7f7a4815cab0 2024-05-26T15:43:20.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.743+0000 7f7a47e00640 1 --2- 172.21.15.8:0/291012593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 0x7f7a48159da0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7a4806e5a0 tx=0x7f7a3802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33eeaf3ea6ac5c22 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:20.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.743+0000 7f7a47400640 1 -- 172.21.15.8:0/291012593 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a30001670 con 0x7f7a4815cab0 2024-05-26T15:43:20.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.743+0000 7f7a47400640 1 -- 172.21.15.8:0/291012593 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3802ac50 con 0x7f7a4815cab0 2024-05-26T15:43:20.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.743+0000 7f7a47400640 1 -- 172.21.15.8:0/291012593 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38032440 con 0x7f7a4815cab0 2024-05-26T15:43:20.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.744+0000 7f7a4d800640 1 -- 172.21.15.8:0/291012593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 msgr2=0x7f7a48159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.744+0000 7f7a4d800640 1 --2- 172.21.15.8:0/291012593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 0x7f7a48159da0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7a4806e5a0 tx=0x7f7a3802a1c0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.744+0000 7f7a4d800640 1 -- 172.21.15.8:0/291012593 shutdown_connections 2024-05-26T15:43:20.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.744+0000 7f7a4d800640 1 --2- 172.21.15.8:0/291012593 >> v2:172.21.15.47:3300/0 conn(0x7f7a4806d680 0x7f7a4806db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.744+0000 7f7a4d800640 1 --2- 172.21.15.8:0/291012593 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 0x7f7a48159da0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.744+0000 7f7a4d800640 1 -- 172.21.15.8:0/291012593 >> 172.21.15.8:0/291012593 conn(0x7f7a48069ed0 msgr2=0x7f7a4806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:20.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.744+0000 7f7a4d800640 1 -- 172.21.15.8:0/291012593 shutdown_connections 2024-05-26T15:43:20.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.744+0000 7f7a4d800640 1 -- 172.21.15.8:0/291012593 wait complete. 2024-05-26T15:43:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.746+0000 7f7a4d800640 1 Processor -- start 2024-05-26T15:43:20.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.746+0000 7f7a4d800640 1 -- start start 2024-05-26T15:43:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.747+0000 7f7a4d800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a4806d680 0x7f7a48143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.747+0000 7f7a4d800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 0x7f7a4814ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.747+0000 7f7a4d800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7a4815ce90 0x7f7a481586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.747+0000 7f7a4d800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4814e330 con 0x7f7a4815cab0 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.747+0000 7f7a4d800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4814f6c0 con 0x7f7a4806d680 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.747+0000 7f7a4d800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4814e560 con 0x7f7a4815ce90 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.747+0000 7f7a3fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 0x7f7a4814ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.748+0000 7f7a3fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 0x7f7a4814ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:32946/0 (socket says 172.21.15.8:32946) 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.748+0000 7f7a3fe00640 1 -- 172.21.15.8:0/341938453 learned_addr learned my addr 172.21.15.8:0/341938453 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.748+0000 7f7a47e00640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a4806d680 0x7f7a48143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.748+0000 7f7a3fe00640 1 -- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7a4815ce90 msgr2=0x7f7a481586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.748+0000 7f7a3fe00640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7a4815ce90 0x7f7a481586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.748+0000 7f7a3fe00640 1 -- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a4806d680 msgr2=0x7f7a48143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.748+0000 7f7a3fe00640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a4806d680 0x7f7a48143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.748+0000 7f7a3fe00640 1 -- 172.21.15.8:0/341938453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a38009400 con 0x7f7a4815cab0 2024-05-26T15:43:20.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.748+0000 7f7a47e00640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a4806d680 0x7f7a48143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.748+0000 7f7a3fe00640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 0x7f7a4814ddf0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7a300011e0 tx=0x7f7a3000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.749+0000 7f7a44c00640 1 -- 172.21.15.8:0/341938453 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a30005ad0 con 0x7f7a4815cab0 2024-05-26T15:43:20.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.749+0000 7f7a44c00640 1 -- 172.21.15.8:0/341938453 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a30005c50 con 0x7f7a4815cab0 2024-05-26T15:43:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.749+0000 7f7a4d800640 1 -- 172.21.15.8:0/341938453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a480aba00 con 0x7f7a4815cab0 2024-05-26T15:43:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.749+0000 7f7a44c00640 1 -- 172.21.15.8:0/341938453 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a30007070 con 0x7f7a4815cab0 2024-05-26T15:43:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.749+0000 7f7a4d800640 1 -- 172.21.15.8:0/341938453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a480abfc0 con 0x7f7a4815cab0 2024-05-26T15:43:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.750+0000 7f7a4d800640 1 -- 172.21.15.8:0/341938453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a480704f0 con 0x7f7a4815cab0 2024-05-26T15:43:20.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.751+0000 7f7a44c00640 1 -- 172.21.15.8:0/341938453 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7a300071d0 con 0x7f7a4815cab0 2024-05-26T15:43:20.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.752+0000 7f7a44c00640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7a2406ac50 0x7f7a2406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.752+0000 7f7a44c00640 1 -- 172.21.15.8:0/341938453 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f7a30088c50 con 0x7f7a4815cab0 2024-05-26T15:43:20.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.753+0000 7f7a47e00640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7a2406ac50 0x7f7a2406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:20.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.754+0000 7f7a47e00640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7a2406ac50 0x7f7a2406d110 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7a38034000 tx=0x7f7a3802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:20.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.756+0000 7f7a44c00640 1 -- 172.21.15.8:0/341938453 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7a480704f0 con 0x7f7a4815cab0 2024-05-26T15:43:20.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.960+0000 7f7a4d800640 1 -- 172.21.15.8:0/341938453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a480704f0 con 0x7f7a4815cab0 2024-05-26T15:43:20.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.961+0000 7f7a44c00640 1 -- 172.21.15.8:0/341938453 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a480704f0 con 0x7f7a4815cab0 2024-05-26T15:43:20.960 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2024-05-26T15:43:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.964+0000 7f7a4d800640 1 -- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7a2406ac50 msgr2=0x7f7a2406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.964+0000 7f7a4d800640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7a2406ac50 0x7f7a2406d110 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7a38034000 tx=0x7f7a3802e000 comp rx=0 tx=0).stop 2024-05-26T15:43:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.964+0000 7f7a4d800640 1 -- 172.21.15.8:0/341938453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 msgr2=0x7f7a4814ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.964+0000 7f7a4d800640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 0x7f7a4814ddf0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f7a300011e0 tx=0x7f7a3000cbe0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.964+0000 7f7a4d800640 1 -- 172.21.15.8:0/341938453 shutdown_connections 2024-05-26T15:43:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.964+0000 7f7a4d800640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f7a4815ce90 0x7f7a481586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.964+0000 7f7a4d800640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7a4815cab0 0x7f7a4814ddf0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.964+0000 7f7a4d800640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f7a2406ac50 0x7f7a2406d110 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.964+0000 7f7a4d800640 1 --2- 172.21.15.8:0/341938453 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a4806d680 0x7f7a48143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:20.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.964+0000 7f7a4d800640 1 -- 172.21.15.8:0/341938453 >> 172.21.15.8:0/341938453 conn(0x7f7a48069ed0 msgr2=0x7f7a481573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:20.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.965+0000 7f7a4d800640 1 -- 172.21.15.8:0/341938453 shutdown_connections 2024-05-26T15:43:20.964 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:20.965+0000 7f7a4d800640 1 -- 172.21.15.8:0/341938453 wait complete. 2024-05-26T15:43:20.983 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:43:21.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.193+0000 7fe127200640 1 Processor -- start 2024-05-26T15:43:21.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.193+0000 7fe127200640 1 -- start start 2024-05-26T15:43:21.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.195+0000 7fe127200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe120144180 0x7fe1200cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.195+0000 7fe127200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe120070c80 0x7fe12006dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.195+0000 7fe127200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe120144560 con 0x7fe12006db60 2024-05-26T15:43:21.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.195+0000 7fe127200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12015b190 con 0x7fe120070c80 2024-05-26T15:43:21.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.195+0000 7fe127200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12015b470 con 0x7fe120144180 2024-05-26T15:43:21.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.195+0000 7fe126800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe120070c80 0x7fe12006dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:21.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.195+0000 7fe126800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fe120070c80 0x7fe12006dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39096/0 (socket says 172.21.15.8:39096) 2024-05-26T15:43:21.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.195+0000 7fe126800640 1 -- 172.21.15.8:0/3502099304 learned_addr learned my addr 172.21.15.8:0/3502099304 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:21.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.196+0000 7fe125e00640 1 --2- 172.21.15.8:0/3502099304 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe120144180 0x7fe1200cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.196+0000 7fe126800640 1 -- 172.21.15.8:0/3502099304 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe120144180 msgr2=0x7fe1200cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.196+0000 7fe126800640 1 --2- 172.21.15.8:0/3502099304 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe120144180 0x7fe1200cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.196+0000 7fe126800640 1 -- 172.21.15.8:0/3502099304 >> v1:172.21.15.47:6789/0 conn(0x7fe12006db60 legacy=0x7fe120070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.196+0000 7fe126800640 1 -- 172.21.15.8:0/3502099304 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12015b750 con 0x7fe120070c80 2024-05-26T15:43:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.196+0000 7fe125e00640 1 --2- 172.21.15.8:0/3502099304 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe120144180 0x7fe1200cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:43:21.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.197+0000 7fe126800640 1 --2- 172.21.15.8:0/3502099304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120070c80 0x7fe12006dfc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009e50 tx=0x7fe11c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64496ce78ff5a088 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:21.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.198+0000 7fe124a00640 1 -- 172.21.15.8:0/3502099304 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c02aea0 con 0x7fe120070c80 2024-05-26T15:43:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.198+0000 7fe124a00640 1 -- 172.21.15.8:0/3502099304 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c02d050 con 0x7fe120070c80 2024-05-26T15:43:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.198+0000 7fe124a00640 1 -- 172.21.15.8:0/3502099304 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c031820 con 0x7fe120070c80 2024-05-26T15:43:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.198+0000 7fe127200640 1 -- 172.21.15.8:0/3502099304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120070c80 msgr2=0x7fe12006dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.198+0000 7fe127200640 1 --2- 172.21.15.8:0/3502099304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120070c80 0x7fe12006dfc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009e50 tx=0x7fe11c02a680 comp rx=0 tx=0).stop 2024-05-26T15:43:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.198+0000 7fe127200640 1 -- 172.21.15.8:0/3502099304 shutdown_connections 2024-05-26T15:43:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.198+0000 7fe127200640 1 --2- 172.21.15.8:0/3502099304 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120070c80 0x7fe12006dfc0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.198+0000 7fe127200640 1 --2- 172.21.15.8:0/3502099304 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe120144180 0x7fe1200cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.198+0000 7fe127200640 1 -- 172.21.15.8:0/3502099304 >> 172.21.15.8:0/3502099304 conn(0x7fe120069ed0 msgr2=0x7fe12006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.199+0000 7fe127200640 1 -- 172.21.15.8:0/3502099304 shutdown_connections 2024-05-26T15:43:21.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.199+0000 7fe127200640 1 -- 172.21.15.8:0/3502099304 wait complete. 2024-05-26T15:43:21.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.200+0000 7fe127200640 1 Processor -- start 2024-05-26T15:43:21.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.201+0000 7fe127200640 1 -- start start 2024-05-26T15:43:21.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe127200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe12006db60 0x7fe1200ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe127200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe120070c80 0x7fe120140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe127200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120144180 0x7fe12013a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe127200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe120140ec0 con 0x7fe120144180 2024-05-26T15:43:21.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe127200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1201406d0 con 0x7fe12006db60 2024-05-26T15:43:21.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe127200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe120140900 con 0x7fe120070c80 2024-05-26T15:43:21.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe126800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120144180 0x7fe12013a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:21.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe126800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120144180 0x7fe12013a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39112/0 (socket says 172.21.15.8:39112) 2024-05-26T15:43:21.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe126800640 1 -- 172.21.15.8:0/4012007259 learned_addr learned my addr 172.21.15.8:0/4012007259 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:21.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe125e00640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe12006db60 0x7fe1200ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:21.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe126800640 1 -- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe120070c80 msgr2=0x7fe120140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe126800640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe120070c80 0x7fe120140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe126800640 1 -- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe12006db60 msgr2=0x7fe1200ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe126800640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe12006db60 0x7fe1200ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.202+0000 7fe126800640 1 -- 172.21.15.8:0/4012007259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c009b30 con 0x7fe120144180 2024-05-26T15:43:21.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.203+0000 7fe126800640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120144180 0x7fe12013a320 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe11c034040 tx=0x7fe11c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:21.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.203+0000 7fe11a000640 1 -- 172.21.15.8:0/4012007259 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c03d860 con 0x7fe120144180 2024-05-26T15:43:21.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.203+0000 7fe11a000640 1 -- 172.21.15.8:0/4012007259 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c03d9e0 con 0x7fe120144180 2024-05-26T15:43:21.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.203+0000 7fe11a000640 1 -- 172.21.15.8:0/4012007259 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c03dd90 con 0x7fe120144180 2024-05-26T15:43:21.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.203+0000 7fe127200640 1 -- 172.21.15.8:0/4012007259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12015af60 con 0x7fe120144180 2024-05-26T15:43:21.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.203+0000 7fe127200640 1 -- 172.21.15.8:0/4012007259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1200b1a20 con 0x7fe120144180 2024-05-26T15:43:21.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.204+0000 7fe127200640 1 -- 172.21.15.8:0/4012007259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1200b1880 con 0x7fe120144180 2024-05-26T15:43:21.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.205+0000 7fe11a000640 1 -- 172.21.15.8:0/4012007259 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe11c03b400 con 0x7fe120144180 2024-05-26T15:43:21.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.206+0000 7fe11a000640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe10406ac00 0x7fe10406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.206+0000 7fe11a000640 1 -- 172.21.15.8:0/4012007259 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7fe11c0aa400 con 0x7fe120144180 2024-05-26T15:43:21.205 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.207+0000 7fe125e00640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe10406ac00 0x7fe10406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:21.207 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.208+0000 7fe125e00640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe10406ac00 0x7fe10406d0c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1140096d0 tx=0x7fe114008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:21.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.210+0000 7fe11a000640 1 -- 172.21.15.8:0/4012007259 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe1200b1880 con 0x7fe120144180 2024-05-26T15:43:21.452 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.454+0000 7fe127200640 1 -- 172.21.15.8:0/4012007259 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1200b1880 con 0x7fe120144180 2024-05-26T15:43:21.453 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.455+0000 7fe11a000640 1 -- 172.21.15.8:0/4012007259 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7fe1200b1880 con 0x7fe120144180 2024-05-26T15:43:21.453 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:21.453 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:43:21.454 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:43:21.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 -- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe10406ac00 msgr2=0x7fe10406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.455 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe10406ac00 0x7fe10406d0c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1140096d0 tx=0x7fe114008040 comp rx=0 tx=0).stop 2024-05-26T15:43:21.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 -- 172.21.15.8:0/4012007259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120144180 msgr2=0x7fe12013a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120144180 0x7fe12013a320 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe11c034040 tx=0x7fe11c004a40 comp rx=0 tx=0).stop 2024-05-26T15:43:21.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 -- 172.21.15.8:0/4012007259 shutdown_connections 2024-05-26T15:43:21.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe120144180 0x7fe12013a320 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe120070c80 0x7fe120140190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.456 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe10406ac00 0x7fe10406d0c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 --2- 172.21.15.8:0/4012007259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe12006db60 0x7fe1200ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 -- 172.21.15.8:0/4012007259 >> 172.21.15.8:0/4012007259 conn(0x7fe120069ed0 msgr2=0x7fe12006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:21.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.457+0000 7fe127200640 1 -- 172.21.15.8:0/4012007259 shutdown_connections 2024-05-26T15:43:21.457 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.458+0000 7fe127200640 1 -- 172.21.15.8:0/4012007259 wait complete. 2024-05-26T15:43:21.474 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:43:21.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.684+0000 7f35d3200640 1 Processor -- start 2024-05-26T15:43:21.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.684+0000 7f35d3200640 1 -- start start 2024-05-26T15:43:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.686+0000 7f35d3200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f35d4143120 0x7f35d4160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.686+0000 7f35d3200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35d4070c80 0x7f35d406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.686+0000 7f35d3200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d406db60 con 0x7f35d40b1780 2024-05-26T15:43:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.686+0000 7f35d3200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d40ad000 con 0x7f35d4143120 2024-05-26T15:43:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.686+0000 7f35d3200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d40b1be0 con 0x7f35d4070c80 2024-05-26T15:43:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.686+0000 7f35d1e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f35d4143120 0x7f35d4160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.687+0000 7f35d1e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f35d4143120 0x7f35d4160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39126/0 (socket says 172.21.15.8:39126) 2024-05-26T15:43:21.685 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.687+0000 7f35d1e00640 1 -- 172.21.15.8:0/2241213291 learned_addr learned my addr 172.21.15.8:0/2241213291 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.687+0000 7f35d2800640 1 --2- 172.21.15.8:0/2241213291 >> v2:172.21.15.47:3300/0 conn(0x7f35d4070c80 0x7f35d406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.687+0000 7f35d1e00640 1 -- 172.21.15.8:0/2241213291 >> v2:172.21.15.47:3300/0 conn(0x7f35d4070c80 msgr2=0x7f35d406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.687+0000 7f35d1e00640 1 --2- 172.21.15.8:0/2241213291 >> v2:172.21.15.47:3300/0 conn(0x7f35d4070c80 0x7f35d406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.687+0000 7f35d1e00640 1 -- 172.21.15.8:0/2241213291 >> v1:172.21.15.47:6789/0 conn(0x7f35d40b1780 legacy=0x7f35d4070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:21.686 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.687+0000 7f35d1e00640 1 -- 172.21.15.8:0/2241213291 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4143500 con 0x7f35d4143120 2024-05-26T15:43:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.688+0000 7f35d1e00640 1 --2- 172.21.15.8:0/2241213291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4143120 0x7f35d4160710 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f35d40acf70 tx=0x7f35c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f3710df33c37b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.689+0000 7f35d0a00640 1 -- 172.21.15.8:0/2241213291 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4032440 con 0x7f35d4143120 2024-05-26T15:43:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.689+0000 7f35d0a00640 1 -- 172.21.15.8:0/2241213291 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c40325a0 con 0x7f35d4143120 2024-05-26T15:43:21.687 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.689+0000 7f35d0a00640 1 -- 172.21.15.8:0/2241213291 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4032930 con 0x7f35d4143120 2024-05-26T15:43:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.690+0000 7f35d3200640 1 -- 172.21.15.8:0/2241213291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4143120 msgr2=0x7f35d4160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.690+0000 7f35d3200640 1 --2- 172.21.15.8:0/2241213291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4143120 0x7f35d4160710 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f35d40acf70 tx=0x7f35c402a1a0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.690+0000 7f35d3200640 1 -- 172.21.15.8:0/2241213291 shutdown_connections 2024-05-26T15:43:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.690+0000 7f35d3200640 1 --2- 172.21.15.8:0/2241213291 >> v2:172.21.15.47:3300/0 conn(0x7f35d4070c80 0x7f35d406d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.690+0000 7f35d3200640 1 --2- 172.21.15.8:0/2241213291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4143120 0x7f35d4160710 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.690+0000 7f35d3200640 1 -- 172.21.15.8:0/2241213291 >> 172.21.15.8:0/2241213291 conn(0x7f35d4069ed0 msgr2=0x7f35d406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.690+0000 7f35d3200640 1 -- 172.21.15.8:0/2241213291 shutdown_connections 2024-05-26T15:43:21.689 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.690+0000 7f35d3200640 1 -- 172.21.15.8:0/2241213291 wait complete. 2024-05-26T15:43:21.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.692+0000 7f35d3200640 1 Processor -- start 2024-05-26T15:43:21.690 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.692+0000 7f35d3200640 1 -- start start 2024-05-26T15:43:21.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.693+0000 7f35d3200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4070c80 0x7f35d40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.693+0000 7f35d3200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35d40b1780 0x7f35d413b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.693+0000 7f35d3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d4143120 0x7f35d4144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.693+0000 7f35d3200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d41600b0 con 0x7f35d4070c80 2024-05-26T15:43:21.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.693+0000 7f35d3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4160650 con 0x7f35d4143120 2024-05-26T15:43:21.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.693+0000 7f35d3200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d415c470 con 0x7f35d40b1780 2024-05-26T15:43:21.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.693+0000 7f35d1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4070c80 0x7f35d40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:21.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.694+0000 7f35d1e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4070c80 0x7f35d40b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39140/0 (socket says 172.21.15.8:39140) 2024-05-26T15:43:21.692 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.694+0000 7f35d1e00640 1 -- 172.21.15.8:0/83246729 learned_addr learned my addr 172.21.15.8:0/83246729 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:21.693 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.694+0000 7f35d1e00640 1 -- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35d40b1780 msgr2=0x7f35d413b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.694+0000 7f35d1e00640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35d40b1780 0x7f35d413b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.694+0000 7f35d1e00640 1 -- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d4143120 msgr2=0x7f35d4144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.694+0000 7f35d1e00640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d4143120 0x7f35d4144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.694+0000 7f35d1e00640 1 -- 172.21.15.8:0/83246729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40094d0 con 0x7f35d4070c80 2024-05-26T15:43:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.694+0000 7f35d1e00640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4070c80 0x7f35d40b1050 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f35c4000c00 tx=0x7f35c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.695+0000 7f35ca000640 1 -- 172.21.15.8:0/83246729 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4032440 con 0x7f35d4070c80 2024-05-26T15:43:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.695+0000 7f35ca000640 1 -- 172.21.15.8:0/83246729 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c4030b80 con 0x7f35d4070c80 2024-05-26T15:43:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.695+0000 7f35ca000640 1 -- 172.21.15.8:0/83246729 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c403b400 con 0x7f35d4070c80 2024-05-26T15:43:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.695+0000 7f35d3200640 1 -- 172.21.15.8:0/83246729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d413cf20 con 0x7f35d4070c80 2024-05-26T15:43:21.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.695+0000 7f35d3200640 1 -- 172.21.15.8:0/83246729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d41602e0 con 0x7f35d4070c80 2024-05-26T15:43:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.696+0000 7f35d3200640 1 -- 172.21.15.8:0/83246729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d404e210 con 0x7f35d4070c80 2024-05-26T15:43:21.695 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.697+0000 7f35ca000640 1 -- 172.21.15.8:0/83246729 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f35c4039040 con 0x7f35d4070c80 2024-05-26T15:43:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.698+0000 7f35ca000640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35b406ac30 0x7f35b406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:21.696 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.698+0000 7f35ca000640 1 -- 172.21.15.8:0/83246729 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f35c40a9b70 con 0x7f35d4070c80 2024-05-26T15:43:21.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.699+0000 7f35d1400640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35b406ac30 0x7f35b406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:21.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.700+0000 7f35d1400640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35b406ac30 0x7f35b406d0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f35d41f5f10 tx=0x7f35c00079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:21.701 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.703+0000 7f35ca000640 1 -- 172.21.15.8:0/83246729 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f35c4074c90 con 0x7f35d4070c80 2024-05-26T15:43:21.908 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.910+0000 7f35d3200640 1 -- 172.21.15.8:0/83246729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35d406e480 con 0x7f35d4070c80 2024-05-26T15:43:21.910 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.912+0000 7f35ca000640 1 -- 172.21.15.8:0/83246729 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16379 (secure 0 0 0) 0x7f35c4037090 con 0x7f35d4070c80 2024-05-26T15:43:21.911 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:21.911 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":61,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:43:15.748510+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:42:09.031612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-26T15:42:10.475864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6836/3388176100":"2024-05-27T15:42:25.245849+0000","172.21.15.47:6834/3388176100":"2024-05-27T15:42:25.245849+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:43:21.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.914+0000 7f35d3200640 1 -- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35b406ac30 msgr2=0x7f35b406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.914+0000 7f35d3200640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35b406ac30 0x7f35b406d0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f35d41f5f10 tx=0x7f35c00079b0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.914+0000 7f35d3200640 1 -- 172.21.15.8:0/83246729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4070c80 msgr2=0x7f35d40b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:21.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.914+0000 7f35d3200640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4070c80 0x7f35d40b1050 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f35c4000c00 tx=0x7f35c40046c0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.915+0000 7f35d3200640 1 -- 172.21.15.8:0/83246729 shutdown_connections 2024-05-26T15:43:21.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.915+0000 7f35d3200640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f35b406ac30 0x7f35b406d0f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.915+0000 7f35d3200640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35d4143120 0x7f35d4144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.915+0000 7f35d3200640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f35d40b1780 0x7f35d413b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.915+0000 7f35d3200640 1 --2- 172.21.15.8:0/83246729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f35d4070c80 0x7f35d40b1050 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:21.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.915+0000 7f35d3200640 1 -- 172.21.15.8:0/83246729 >> 172.21.15.8:0/83246729 conn(0x7f35d4069ed0 msgr2=0x7f35d40af630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:21.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.915+0000 7f35d3200640 1 -- 172.21.15.8:0/83246729 shutdown_connections 2024-05-26T15:43:21.914 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:21.915+0000 7f35d3200640 1 -- 172.21.15.8:0/83246729 wait complete. 2024-05-26T15:43:21.932 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-26T15:43:21.932 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:43:22.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.140+0000 7f6640a00640 1 Processor -- start 2024-05-26T15:43:22.138 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.140+0000 7f6640a00640 1 -- start start 2024-05-26T15:43:22.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.142+0000 7f6640a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c071260 0x7f663c0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.142+0000 7f6640a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c150390 con 0x7f663c070e00 2024-05-26T15:43:22.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.142+0000 7f6640a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0ae1e0 con 0x7f663c14ffb0 2024-05-26T15:43:22.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.142+0000 7f6640a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c06d380 con 0x7f663c071260 2024-05-26T15:43:22.140 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.142+0000 7f6639e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f663c070e00 0x7f663c0cd070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32932/0 (socket says 172.21.15.8:32932) 2024-05-26T15:43:22.141 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.142+0000 7f6639e00640 1 -- 172.21.15.8:0/3680529017 learned_addr learned my addr 172.21.15.8:0/3680529017 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:22.142 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.142+0000 7f663b200640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c071260 0x7f663c0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961421513 0 0) 0x7f663c150390 con 0x7f663c070e00 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6620003520 con 0x7f663c070e00 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2385616349 0 0) 0x7f6620003520 con 0x7f663c070e00 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c071260 msgr2=0x7f663c0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c071260 0x7f663c0cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 >> v1:172.21.15.47:6789/0 conn(0x7f663c14ffb0 legacy=0x7f663c0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c06c700 con 0x7f663c070e00 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f66280019f0 con 0x7f663c070e00 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 >> v1:172.21.15.8:6789/0 conn(0x7f663c070e00 legacy=0x7f663c0cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66200039a0 0x7f6620003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 0x7f6620004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c071260 0x7f662000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.143 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c06d380 con 0x7f66200047c0 2024-05-26T15:43:22.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66200054e0 con 0x7f66200039a0 2024-05-26T15:43:22.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.143+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662000bec0 con 0x7f663c071260 2024-05-26T15:43:22.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.144+0000 7f6639e00640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 0x7f6620004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.144+0000 7f663a800640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66200039a0 0x7f6620003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.144+0000 7f663b200640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c071260 0x7f662000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.144+0000 7f6639e00640 1 -- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c071260 msgr2=0x7f662000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:22.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.144+0000 7f6639e00640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c071260 0x7f662000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.144+0000 7f6639e00640 1 -- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66200039a0 msgr2=0x7f6620003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:22.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.144+0000 7f6639e00640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66200039a0 0x7f6620003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.144 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.144+0000 7f6639e00640 1 -- 172.21.15.8:0/3680529017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6620003520 con 0x7f66200047c0 2024-05-26T15:43:22.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.145+0000 7f6639e00640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 0x7f6620004c40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f662800a760 tx=0x7f66200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f9b80e2d6061fa server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:22.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.146+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662802b980 con 0x7f66200047c0 2024-05-26T15:43:22.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.146+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662802bae0 con 0x7f66200047c0 2024-05-26T15:43:22.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.146+0000 7f6639400640 1 -- 172.21.15.8:0/3680529017 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628034470 con 0x7f66200047c0 2024-05-26T15:43:22.145 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.146+0000 7f6640a00640 1 -- 172.21.15.8:0/3680529017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 msgr2=0x7f6620004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.146+0000 7f6640a00640 1 --2- 172.21.15.8:0/3680529017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 0x7f6620004c40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f662800a760 tx=0x7f66200057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.146+0000 7f663b200640 1 -- 172.21.15.8:0/3680529017 reap_dead start 2024-05-26T15:43:22.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.146+0000 7f6640a00640 1 -- 172.21.15.8:0/3680529017 shutdown_connections 2024-05-26T15:43:22.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.146+0000 7f6640a00640 1 -- 172.21.15.8:0/3680529017 >> 172.21.15.8:0/3680529017 conn(0x7f663c069ed0 msgr2=0x7f663c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:22.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.146+0000 7f6640a00640 1 -- 172.21.15.8:0/3680529017 shutdown_connections 2024-05-26T15:43:22.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.146+0000 7f6640a00640 1 -- 172.21.15.8:0/3680529017 wait complete. 2024-05-26T15:43:22.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.148+0000 7f6640a00640 1 Processor -- start 2024-05-26T15:43:22.146 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.148+0000 7f6640a00640 1 -- start start 2024-05-26T15:43:22.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.149+0000 7f6640a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 0x7f663c13ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.149+0000 7f6640a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c1380c0 0x7f663c13d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.149+0000 7f6640a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f663c13db80 0x7f663c13e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.148 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.149+0000 7f6640a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c13c910 con 0x7f66200047c0 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.149+0000 7f6640a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c13baa0 con 0x7f663c13db80 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.149+0000 7f6640a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c13f280 con 0x7f663c1380c0 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.149+0000 7f663a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 0x7f663c13ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.149+0000 7f663a800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 0x7f663c13ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39156/0 (socket says 172.21.15.8:39156) 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.150+0000 7f663a800640 1 -- 172.21.15.8:0/1012834811 learned_addr learned my addr 172.21.15.8:0/1012834811 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.150+0000 7f663b200640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f663c13db80 0x7f663c13e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.150+0000 7f6639e00640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c1380c0 0x7f663c13d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.150+0000 7f663a800640 1 -- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c1380c0 msgr2=0x7f663c13d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.150+0000 7f663a800640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c1380c0 0x7f663c13d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.150+0000 7f663a800640 1 -- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f663c13db80 msgr2=0x7f663c13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.150+0000 7f663a800640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f663c13db80 0x7f663c13e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.149 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.150+0000 7f663a800640 1 -- 172.21.15.8:0/1012834811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c13bcd0 con 0x7f66200047c0 2024-05-26T15:43:22.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.150+0000 7f663a800640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 0x7f663c13ed40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e550 tx=0x7f662c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:22.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.151+0000 7f6632a00640 1 -- 172.21.15.8:0/1012834811 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0052e0 con 0x7f66200047c0 2024-05-26T15:43:22.150 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.151+0000 7f6632a00640 1 -- 172.21.15.8:0/1012834811 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c005440 con 0x7f66200047c0 2024-05-26T15:43:22.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.151+0000 7f6632a00640 1 -- 172.21.15.8:0/1012834811 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c003810 con 0x7f66200047c0 2024-05-26T15:43:22.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.151+0000 7f6640a00640 1 -- 172.21.15.8:0/1012834811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c13bf70 con 0x7f66200047c0 2024-05-26T15:43:22.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.151+0000 7f6640a00640 1 -- 172.21.15.8:0/1012834811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c13c530 con 0x7f66200047c0 2024-05-26T15:43:22.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.152+0000 7f6640a00640 1 -- 172.21.15.8:0/1012834811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c0b3c40 con 0x7f66200047c0 2024-05-26T15:43:22.151 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.153+0000 7f6632a00640 1 -- 172.21.15.8:0/1012834811 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f662c003970 con 0x7f66200047c0 2024-05-26T15:43:22.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.154+0000 7f6632a00640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f661c06ac50 0x7f661c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.152 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.154+0000 7f6632a00640 1 -- 172.21.15.8:0/1012834811 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7f662c089120 con 0x7f66200047c0 2024-05-26T15:43:22.153 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.154+0000 7f6639e00640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f661c06ac50 0x7f661c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.156+0000 7f6639e00640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f661c06ac50 0x7f661c06d110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6628033000 tx=0x7f6628009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:22.156 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.158+0000 7f6632a00640 1 -- 172.21.15.8:0/1012834811 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f662c0542a0 con 0x7f66200047c0 2024-05-26T15:43:22.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.398+0000 7f6640a00640 1 -- 172.21.15.8:0/1012834811 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f663c04e210 con 0x7f66200047c0 2024-05-26T15:43:22.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.399+0000 7f6632a00640 1 -- 172.21.15.8:0/1012834811 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7f662c0578c0 con 0x7f66200047c0 2024-05-26T15:43:22.398 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:22.398 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:43:22.398 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:43:22.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 -- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f661c06ac50 msgr2=0x7f661c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f661c06ac50 0x7f661c06d110 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6628033000 tx=0x7f6628009030 comp rx=0 tx=0).stop 2024-05-26T15:43:22.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 -- 172.21.15.8:0/1012834811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 msgr2=0x7f663c13ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 0x7f663c13ed40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e550 tx=0x7f662c00ea10 comp rx=0 tx=0).stop 2024-05-26T15:43:22.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 -- 172.21.15.8:0/1012834811 shutdown_connections 2024-05-26T15:43:22.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f661c06ac50 0x7f661c06d110 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f663c13db80 0x7f663c13e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f663c1380c0 0x7f663c13d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 --2- 172.21.15.8:0/1012834811 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f66200047c0 0x7f663c13ed40 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 -- 172.21.15.8:0/1012834811 >> 172.21.15.8:0/1012834811 conn(0x7f663c069ed0 msgr2=0x7f663c0b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:22.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 -- 172.21.15.8:0/1012834811 shutdown_connections 2024-05-26T15:43:22.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.402+0000 7f6640a00640 1 -- 172.21.15.8:0/1012834811 wait complete. 2024-05-26T15:43:22.418 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:43:22.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.619+0000 7fac36a00640 1 Processor -- start 2024-05-26T15:43:22.618 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.619+0000 7fac36a00640 1 -- start start 2024-05-26T15:43:22.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.620+0000 7fac36a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fac301445d0 0x7fac3006e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.620+0000 7fac36a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac3015f230 0x7fac3015e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.620+0000 7fac36a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac3015eb60 0x7fac3015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.620+0000 7fac36a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac3015efd0 con 0x7fac3015eb60 2024-05-26T15:43:22.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.621+0000 7fac36a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac3006d380 con 0x7fac301445d0 2024-05-26T15:43:22.619 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.621+0000 7fac36a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3006d660 con 0x7fac3015f230 2024-05-26T15:43:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.621+0000 7fac34a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac3015eb60 0x7fac3015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.620 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.621+0000 7fac34a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fac3015eb60 0x7fac3015aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39170/0 (socket says 172.21.15.8:39170) 2024-05-26T15:43:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.621+0000 7fac34a00640 1 -- 172.21.15.8:0/1592464886 learned_addr learned my addr 172.21.15.8:0/1592464886 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.621+0000 7fac2fe00640 1 --2- 172.21.15.8:0/1592464886 >> v2:172.21.15.47:3300/0 conn(0x7fac301445d0 0x7fac3006e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.621+0000 7fac2f400640 1 --2- 172.21.15.8:0/1592464886 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac3015f230 0x7fac3015e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.622+0000 7fac34a00640 1 -- 172.21.15.8:0/1592464886 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac3015f230 msgr2=0x7fac3015e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.622+0000 7fac34a00640 1 --2- 172.21.15.8:0/1592464886 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac3015f230 0x7fac3015e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.622+0000 7fac34a00640 1 -- 172.21.15.8:0/1592464886 >> v2:172.21.15.47:3300/0 conn(0x7fac301445d0 msgr2=0x7fac3006e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.622+0000 7fac34a00640 1 --2- 172.21.15.8:0/1592464886 >> v2:172.21.15.47:3300/0 conn(0x7fac301445d0 0x7fac3006e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.622+0000 7fac34a00640 1 -- 172.21.15.8:0/1592464886 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3006d940 con 0x7fac3015eb60 2024-05-26T15:43:22.621 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.622+0000 7fac2f400640 1 --2- 172.21.15.8:0/1592464886 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac3015f230 0x7fac3015e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.623+0000 7fac34a00640 1 --2- 172.21.15.8:0/1592464886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac3015eb60 0x7fac3015aff0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fac30071d40 tx=0x7fac2802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b97a00230b5f697 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.623+0000 7fac2ea00640 1 -- 172.21.15.8:0/1592464886 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2802ae90 con 0x7fac3015eb60 2024-05-26T15:43:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.623+0000 7fac2ea00640 1 -- 172.21.15.8:0/1592464886 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac28032440 con 0x7fac3015eb60 2024-05-26T15:43:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.623+0000 7fac2ea00640 1 -- 172.21.15.8:0/1592464886 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280327d0 con 0x7fac3015eb60 2024-05-26T15:43:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.624+0000 7fac36a00640 1 -- 172.21.15.8:0/1592464886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac3015eb60 msgr2=0x7fac3015aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.622 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.624+0000 7fac36a00640 1 --2- 172.21.15.8:0/1592464886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac3015eb60 0x7fac3015aff0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fac30071d40 tx=0x7fac2802a140 comp rx=0 tx=0).stop 2024-05-26T15:43:22.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.624+0000 7fac36a00640 1 -- 172.21.15.8:0/1592464886 shutdown_connections 2024-05-26T15:43:22.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.624+0000 7fac36a00640 1 --2- 172.21.15.8:0/1592464886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac3015eb60 0x7fac3015aff0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.624+0000 7fac36a00640 1 --2- 172.21.15.8:0/1592464886 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac3015f230 0x7fac3015e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.624+0000 7fac36a00640 1 --2- 172.21.15.8:0/1592464886 >> v2:172.21.15.47:3300/0 conn(0x7fac301445d0 0x7fac3006e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.624+0000 7fac36a00640 1 -- 172.21.15.8:0/1592464886 >> 172.21.15.8:0/1592464886 conn(0x7fac300b0720 msgr2=0x7fac300b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:22.623 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.624+0000 7fac36a00640 1 -- 172.21.15.8:0/1592464886 shutdown_connections 2024-05-26T15:43:22.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.624+0000 7fac36a00640 1 -- 172.21.15.8:0/1592464886 wait complete. 2024-05-26T15:43:22.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.626+0000 7fac36a00640 1 Processor -- start 2024-05-26T15:43:22.624 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.626+0000 7fac36a00640 1 -- start start 2024-05-26T15:43:22.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.627+0000 7fac36a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac301445d0 0x7fac3015a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.627+0000 7fac36a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac3015eb60 0x7fac301f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.627+0000 7fac36a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac3015f230 0x7fac30140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.626 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.627+0000 7fac36a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3013e280 con 0x7fac301445d0 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.627+0000 7fac36a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3015a950 con 0x7fac3015eb60 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.627+0000 7fac36a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3013e4d0 con 0x7fac3015f230 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.627+0000 7fac2fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac301445d0 0x7fac3015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.627+0000 7fac2fe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac301445d0 0x7fac3015a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39184/0 (socket says 172.21.15.8:39184) 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.627+0000 7fac2fe00640 1 -- 172.21.15.8:0/1141094796 learned_addr learned my addr 172.21.15.8:0/1141094796 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac2fe00640 1 -- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac3015f230 msgr2=0x7fac30140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac2fe00640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac3015f230 0x7fac30140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac2f400640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac3015eb60 0x7fac301f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac2fe00640 1 -- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac3015eb60 msgr2=0x7fac301f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac2fe00640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac3015eb60 0x7fac301f2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac2fe00640 1 -- 172.21.15.8:0/1141094796 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac280094d0 con 0x7fac301445d0 2024-05-26T15:43:22.627 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac2fe00640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac301445d0 0x7fac3015a410 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fac20007e60 tx=0x7fac2000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:22.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac27e00640 1 -- 172.21.15.8:0/1141094796 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20014620 con 0x7fac301445d0 2024-05-26T15:43:22.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac27e00640 1 -- 172.21.15.8:0/1141094796 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2000ee90 con 0x7fac301445d0 2024-05-26T15:43:22.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac27e00640 1 -- 172.21.15.8:0/1141094796 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200149c0 con 0x7fac301445d0 2024-05-26T15:43:22.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac36a00640 1 -- 172.21.15.8:0/1141094796 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3013e7b0 con 0x7fac301445d0 2024-05-26T15:43:22.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.628+0000 7fac36a00640 1 -- 172.21.15.8:0/1141094796 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3013ed70 con 0x7fac301445d0 2024-05-26T15:43:22.628 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.630+0000 7fac36a00640 1 -- 172.21.15.8:0/1141094796 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3004e210 con 0x7fac301445d0 2024-05-26T15:43:22.629 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.631+0000 7fac27e00640 1 -- 172.21.15.8:0/1141094796 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac20014b20 con 0x7fac301445d0 2024-05-26T15:43:22.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.631+0000 7fac27e00640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fac1006ac00 0x7fac1006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:22.630 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.632+0000 7fac27e00640 1 -- 172.21.15.8:0/1141094796 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7fac20089fe0 con 0x7fac301445d0 2024-05-26T15:43:22.631 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.632+0000 7fac2f400640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fac1006ac00 0x7fac1006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:22.632 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.633+0000 7fac2f400640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fac1006ac00 0x7fac1006d0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fac30067330 tx=0x7fac1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:22.634 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.636+0000 7fac27e00640 1 -- 172.21.15.8:0/1141094796 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fac20054f00 con 0x7fac301445d0 2024-05-26T15:43:22.871 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.873+0000 7fac36a00640 1 -- 172.21.15.8:0/1141094796 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac300b1480 con 0x7fac301445d0 2024-05-26T15:43:22.873 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.874+0000 7fac27e00640 1 -- 172.21.15.8:0/1141094796 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4729 (secure 0 0 0) 0x7fac20058520 con 0x7fac301445d0 2024-05-26T15:43:22.873 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:22.873 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-26T15:42:11.450547+0000","modified":"2024-05-26T15:42:29.269707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":59,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5952},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5952":{"gid":5952,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":5,"addr":"172.21.15.8:6834/3351700355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3351700355},{"type":"v1","addr":"172.21.15.8:6834","nonce":3351700355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-05-26T15:43:22.873 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 38 2024-05-26T15:43:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.877+0000 7fac36a00640 1 -- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fac1006ac00 msgr2=0x7fac1006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.877+0000 7fac36a00640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fac1006ac00 0x7fac1006d0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fac30067330 tx=0x7fac1c008040 comp rx=0 tx=0).stop 2024-05-26T15:43:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.877+0000 7fac36a00640 1 -- 172.21.15.8:0/1141094796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac301445d0 msgr2=0x7fac3015a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.877+0000 7fac36a00640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac301445d0 0x7fac3015a410 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fac20007e60 tx=0x7fac2000e4b0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.877+0000 7fac36a00640 1 -- 172.21.15.8:0/1141094796 shutdown_connections 2024-05-26T15:43:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.877+0000 7fac36a00640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fac3015f230 0x7fac30140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.877+0000 7fac36a00640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fac1006ac00 0x7fac1006d0c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.877+0000 7fac36a00640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac3015eb60 0x7fac301f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.877+0000 7fac36a00640 1 --2- 172.21.15.8:0/1141094796 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fac301445d0 0x7fac3015a410 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:22.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.877+0000 7fac36a00640 1 -- 172.21.15.8:0/1141094796 >> 172.21.15.8:0/1141094796 conn(0x7fac300b0720 msgr2=0x7fac300af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:22.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.878+0000 7fac36a00640 1 -- 172.21.15.8:0/1141094796 shutdown_connections 2024-05-26T15:43:22.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:22.878+0000 7fac36a00640 1 -- 172.21.15.8:0/1141094796 wait complete. 2024-05-26T15:43:22.895 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:43:23.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.106+0000 7feb60600640 1 Processor -- start 2024-05-26T15:43:23.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.106+0000 7feb60600640 1 -- start start 2024-05-26T15:43:23.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.108+0000 7feb60600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb5806e6d0 0x7feb580cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.108+0000 7feb60600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5815e310 con 0x7feb580cc210 2024-05-26T15:43:23.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.108+0000 7feb60600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb58143780 con 0x7feb581433a0 2024-05-26T15:43:23.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.108+0000 7feb60600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5815d700 con 0x7feb5806e6d0 2024-05-26T15:43:23.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.109+0000 7feb5e600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7feb580cc210 0x7feb5815b2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32942/0 (socket says 172.21.15.8:32942) 2024-05-26T15:43:23.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.109+0000 7feb5e600640 1 -- 172.21.15.8:0/2542913019 learned_addr learned my addr 172.21.15.8:0/2542913019 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:23.110 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.109+0000 7feb5d200640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb5806e6d0 0x7feb580cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.109+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585022762 0 0) 0x7feb5815e310 con 0x7feb580cc210 2024-05-26T15:43:23.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.109+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb40005730 con 0x7feb580cc210 2024-05-26T15:43:23.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1873239628 0 0) 0x7feb40005730 con 0x7feb580cc210 2024-05-26T15:43:23.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb5806e6d0 msgr2=0x7feb580cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:23.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb5806e6d0 0x7feb580cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 >> v1:172.21.15.47:6789/0 conn(0x7feb581433a0 legacy=0x7feb5806dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5815d9e0 con 0x7feb580cc210 2024-05-26T15:43:23.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7feb500019f0 con 0x7feb580cc210 2024-05-26T15:43:23.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 >> v1:172.21.15.8:6789/0 conn(0x7feb580cc210 legacy=0x7feb5815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb40005bb0 0x7feb40005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 0x7feb40006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb5806e6d0 0x7feb40007440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5815d700 con 0x7feb400069d0 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4000dd20 con 0x7feb40005bb0 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4000dee0 con 0x7feb5806e6d0 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.110+0000 7feb5d200640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 0x7feb40006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.111+0000 7feb5e600640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb5806e6d0 0x7feb40007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.111+0000 7feb5d200640 1 -- 172.21.15.8:0/2542913019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb5806e6d0 msgr2=0x7feb40007440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.111+0000 7feb5d200640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb5806e6d0 0x7feb40007440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.111+0000 7feb5d200640 1 -- 172.21.15.8:0/2542913019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb40005bb0 msgr2=0x7feb40005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.111+0000 7feb5d200640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb40005bb0 0x7feb40005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.112 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.111+0000 7feb5d200640 1 -- 172.21.15.8:0/2542913019 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40005730 con 0x7feb400069d0 2024-05-26T15:43:23.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.112+0000 7feb5d200640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 0x7feb40006e50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7feb44009ac0 tx=0x7feb40007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8a9a1aacecbbbc server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:23.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.112+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44031400 con 0x7feb400069d0 2024-05-26T15:43:23.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.112+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4402d050 con 0x7feb400069d0 2024-05-26T15:43:23.113 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.112+0000 7feb57e00640 1 -- 172.21.15.8:0/2542913019 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44031780 con 0x7feb400069d0 2024-05-26T15:43:23.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.113+0000 7feb60600640 1 -- 172.21.15.8:0/2542913019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 msgr2=0x7feb40006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.113+0000 7feb60600640 1 --2- 172.21.15.8:0/2542913019 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 0x7feb40006e50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7feb44009ac0 tx=0x7feb40007a00 comp rx=0 tx=0).stop 2024-05-26T15:43:23.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.113+0000 7feb5e600640 1 -- 172.21.15.8:0/2542913019 reap_dead start 2024-05-26T15:43:23.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.113+0000 7feb60600640 1 -- 172.21.15.8:0/2542913019 shutdown_connections 2024-05-26T15:43:23.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.113+0000 7feb60600640 1 -- 172.21.15.8:0/2542913019 >> 172.21.15.8:0/2542913019 conn(0x7feb580b0720 msgr2=0x7feb580b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:23.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.113+0000 7feb60600640 1 -- 172.21.15.8:0/2542913019 shutdown_connections 2024-05-26T15:43:23.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.113+0000 7feb60600640 1 -- 172.21.15.8:0/2542913019 wait complete. 2024-05-26T15:43:23.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.115+0000 7feb60600640 1 Processor -- start 2024-05-26T15:43:23.114 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.115+0000 7feb60600640 1 -- start start 2024-05-26T15:43:23.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.116+0000 7feb60600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 0x7feb580c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.116+0000 7feb60600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb580acdd0 0x7feb58136860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.116+0000 7feb60600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb580ad230 0x7feb58136da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.116+0000 7feb60600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb580c49e0 con 0x7feb400069d0 2024-05-26T15:43:23.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.116+0000 7feb60600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5813abc0 con 0x7feb580ad230 2024-05-26T15:43:23.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.116+0000 7feb60600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb580c3a30 con 0x7feb580acdd0 2024-05-26T15:43:23.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.116+0000 7feb5dc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 0x7feb580c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.116 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.116+0000 7feb5dc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 0x7feb580c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39198/0 (socket says 172.21.15.8:39198) 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.116+0000 7feb5dc00640 1 -- 172.21.15.8:0/3749941098 learned_addr learned my addr 172.21.15.8:0/3749941098 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb5e600640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb580ad230 0x7feb58136da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb5d200640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb580acdd0 0x7feb58136860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb5dc00640 1 -- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb580acdd0 msgr2=0x7feb58136860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb5dc00640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb580acdd0 0x7feb58136860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb5dc00640 1 -- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb580ad230 msgr2=0x7feb58136da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb5dc00640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb580ad230 0x7feb58136da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb5dc00640 1 -- 172.21.15.8:0/3749941098 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58137400 con 0x7feb400069d0 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb5d200640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb580acdd0 0x7feb58136860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb5dc00640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 0x7feb580c44a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c560 tx=0x7feb4c00ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb55600640 1 -- 172.21.15.8:0/3749941098 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0052d0 con 0x7feb400069d0 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb55600640 1 -- 172.21.15.8:0/3749941098 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c005470 con 0x7feb400069d0 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb60600640 1 -- 172.21.15.8:0/3749941098 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb580c3ca0 con 0x7feb400069d0 2024-05-26T15:43:23.117 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb55600640 1 -- 172.21.15.8:0/3749941098 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c012870 con 0x7feb400069d0 2024-05-26T15:43:23.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.117+0000 7feb60600640 1 -- 172.21.15.8:0/3749941098 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb581376e0 con 0x7feb400069d0 2024-05-26T15:43:23.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.119+0000 7feb60600640 1 -- 172.21.15.8:0/3749941098 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5804e210 con 0x7feb400069d0 2024-05-26T15:43:23.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.119+0000 7feb55600640 1 -- 172.21.15.8:0/3749941098 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb4c0129d0 con 0x7feb400069d0 2024-05-26T15:43:23.118 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.120+0000 7feb55600640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feb3806ac00 0x7feb3806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.120+0000 7feb55600640 1 -- 172.21.15.8:0/3749941098 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7feb4c089050 con 0x7feb400069d0 2024-05-26T15:43:23.119 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.121+0000 7feb5d200640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feb3806ac00 0x7feb3806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.120 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.122+0000 7feb5d200640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feb3806ac00 0x7feb3806d0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feb44009ac0 tx=0x7feb44008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:23.123 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.125+0000 7feb55600640 1 -- 172.21.15.8:0/3749941098 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7feb4c0540f0 con 0x7feb400069d0 2024-05-26T15:43:23.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.329+0000 7feb60600640 1 -- 172.21.15.8:0/3749941098 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb580b13f0 con 0x7feb400069d0 2024-05-26T15:43:23.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.330+0000 7feb55600640 1 -- 172.21.15.8:0/3749941098 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+16379 (secure 0 0 0) 0x7feb4c057710 con 0x7feb400069d0 2024-05-26T15:43:23.329 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:23.329 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":61,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:43:15.748510+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-05-26T15:42:09.031612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-05-26T15:42:10.475864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.1f","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6836/3388176100":"2024-05-27T15:42:25.245849+0000","172.21.15.47:6834/3388176100":"2024-05-27T15:42:25.245849+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:43:23.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.333+0000 7feb60600640 1 -- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feb3806ac00 msgr2=0x7feb3806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.333+0000 7feb60600640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feb3806ac00 0x7feb3806d0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feb44009ac0 tx=0x7feb44008030 comp rx=0 tx=0).stop 2024-05-26T15:43:23.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.334+0000 7feb60600640 1 -- 172.21.15.8:0/3749941098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 msgr2=0x7feb580c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.334+0000 7feb60600640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 0x7feb580c44a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c560 tx=0x7feb4c00ca20 comp rx=0 tx=0).stop 2024-05-26T15:43:23.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.334+0000 7feb60600640 1 -- 172.21.15.8:0/3749941098 shutdown_connections 2024-05-26T15:43:23.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.334+0000 7feb60600640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7feb3806ac00 0x7feb3806d0c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.334+0000 7feb60600640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb580ad230 0x7feb58136da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.334+0000 7feb60600640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7feb580acdd0 0x7feb58136860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.334+0000 7feb60600640 1 --2- 172.21.15.8:0/3749941098 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb400069d0 0x7feb580c44a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.334+0000 7feb60600640 1 -- 172.21.15.8:0/3749941098 >> 172.21.15.8:0/3749941098 conn(0x7feb580b0720 msgr2=0x7feb58142900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:23.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.334+0000 7feb60600640 1 -- 172.21.15.8:0/3749941098 shutdown_connections 2024-05-26T15:43:23.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.334+0000 7feb60600640 1 -- 172.21.15.8:0/3749941098 wait complete. 2024-05-26T15:43:23.353 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-26T15:43:23.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.563+0000 7fc87a200640 1 Processor -- start 2024-05-26T15:43:23.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.563+0000 7fc87a200640 1 -- start start 2024-05-26T15:43:23.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.565+0000 7fc87a200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc87415c7c0 0x7fc8740cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.565+0000 7fc87a200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8740a76b0 con 0x7fc874070850 2024-05-26T15:43:23.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.565+0000 7fc87a200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87415b320 con 0x7fc8740cc610 2024-05-26T15:43:23.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.565+0000 7fc87a200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87406cd50 con 0x7fc87415c7c0 2024-05-26T15:43:23.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.565+0000 7fc878e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc874070850 0x7fc87406c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32952/0 (socket says 172.21.15.8:32952) 2024-05-26T15:43:23.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.565+0000 7fc878e00640 1 -- 172.21.15.8:0/232570305 learned_addr learned my addr 172.21.15.8:0/232570305 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:23.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc879800640 1 --2- 172.21.15.8:0/232570305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc87415c7c0 0x7fc8740cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769883088 0 0) 0x7fc8740a76b0 con 0x7fc874070850 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc85c003520 con 0x7fc874070850 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1229681544 0 0) 0x7fc85c003520 con 0x7fc874070850 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc87415c7c0 msgr2=0x7fc8740cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 --2- 172.21.15.8:0/232570305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc87415c7c0 0x7fc8740cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 >> v1:172.21.15.47:6789/0 conn(0x7fc8740cc610 legacy=0x7fc8740cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87406d500 con 0x7fc874070850 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fc868001670 con 0x7fc874070850 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 >> v1:172.21.15.8:6789/0 conn(0x7fc874070850 legacy=0x7fc87406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 --2- 172.21.15.8:0/232570305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc85c0039a0 0x7fc85c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 --2- 172.21.15.8:0/232570305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc85c0047c0 0x7fc85c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.566+0000 7fc873400640 1 --2- 172.21.15.8:0/232570305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc87415c7c0 0x7fc85c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.567+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c00bac0 con 0x7fc85c0039a0 2024-05-26T15:43:23.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.567+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c00bc00 con 0x7fc85c0047c0 2024-05-26T15:43:23.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.567+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c00bdc0 con 0x7fc87415c7c0 2024-05-26T15:43:23.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.567+0000 7fc878e00640 1 --2- 172.21.15.8:0/232570305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc85c0039a0 0x7fc85c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.567+0000 7fc878e00640 1 -- 172.21.15.8:0/232570305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc87415c7c0 msgr2=0x7fc85c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:23.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.567+0000 7fc878e00640 1 --2- 172.21.15.8:0/232570305 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc87415c7c0 0x7fc85c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.567+0000 7fc878e00640 1 -- 172.21.15.8:0/232570305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc85c0047c0 msgr2=0x7fc85c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:23.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.567+0000 7fc878e00640 1 --2- 172.21.15.8:0/232570305 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc85c0047c0 0x7fc85c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.567+0000 7fc878e00640 1 -- 172.21.15.8:0/232570305 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c003520 con 0x7fc85c0039a0 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.568+0000 7fc878e00640 1 --2- 172.21.15.8:0/232570305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc85c0039a0 0x7fc85c003dc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc86800c210 tx=0x7fc85c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168823652d77849b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.568+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868005ad0 con 0x7fc85c0039a0 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.568+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86802d070 con 0x7fc85c0039a0 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.568+0000 7fc873400640 1 -- 172.21.15.8:0/232570305 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868005e50 con 0x7fc85c0039a0 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.569+0000 7fc87a200640 1 -- 172.21.15.8:0/232570305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc85c0039a0 msgr2=0x7fc85c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.569+0000 7fc87a200640 1 --2- 172.21.15.8:0/232570305 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc85c0039a0 0x7fc85c003dc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc86800c210 tx=0x7fc85c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.569+0000 7fc879800640 1 -- 172.21.15.8:0/232570305 reap_dead start 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.569+0000 7fc87a200640 1 -- 172.21.15.8:0/232570305 shutdown_connections 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.569+0000 7fc87a200640 1 -- 172.21.15.8:0/232570305 >> 172.21.15.8:0/232570305 conn(0x7fc874069ed0 msgr2=0x7fc87406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.569+0000 7fc87a200640 1 -- 172.21.15.8:0/232570305 shutdown_connections 2024-05-26T15:43:23.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.569+0000 7fc87a200640 1 -- 172.21.15.8:0/232570305 wait complete. 2024-05-26T15:43:23.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.571+0000 7fc87a200640 1 Processor -- start 2024-05-26T15:43:23.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.571+0000 7fc87a200640 1 -- start start 2024-05-26T15:43:23.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.572+0000 7fc87a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc85c0039a0 0x7fc87415a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.572+0000 7fc87a200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc874135bd0 0x7fc874136050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.572+0000 7fc87a200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8740b0490 0x7fc8740b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.572+0000 7fc87a200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874136590 con 0x7fc874135bd0 2024-05-26T15:43:23.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.572+0000 7fc87a200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740b0e50 con 0x7fc85c0039a0 2024-05-26T15:43:23.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.572+0000 7fc87a200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87415a640 con 0x7fc8740b0490 2024-05-26T15:43:23.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.572+0000 7fc873e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc874135bd0 0x7fc874136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.572+0000 7fc873e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc874135bd0 0x7fc874136050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39204/0 (socket says 172.21.15.8:39204) 2024-05-26T15:43:23.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.572+0000 7fc873e00640 1 -- 172.21.15.8:0/901197876 learned_addr learned my addr 172.21.15.8:0/901197876 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:23.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.573+0000 7fc878e00640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc85c0039a0 0x7fc87415a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.573+0000 7fc879800640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8740b0490 0x7fc8740b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.573+0000 7fc873e00640 1 -- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8740b0490 msgr2=0x7fc8740b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.573+0000 7fc873e00640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8740b0490 0x7fc8740b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.573+0000 7fc873e00640 1 -- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc85c0039a0 msgr2=0x7fc87415a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.573+0000 7fc873e00640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc85c0039a0 0x7fc87415a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.573+0000 7fc873e00640 1 -- 172.21.15.8:0/901197876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8741347c0 con 0x7fc874135bd0 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.573+0000 7fc873e00640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc874135bd0 0x7fc874136050 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc86000c530 tx=0x7fc86000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.573+0000 7fc870c00640 1 -- 172.21.15.8:0/901197876 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600052d0 con 0x7fc874135bd0 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.574+0000 7fc870c00640 1 -- 172.21.15.8:0/901197876 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc860005430 con 0x7fc874135bd0 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.574+0000 7fc870c00640 1 -- 172.21.15.8:0/901197876 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860012870 con 0x7fc874135bd0 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.574+0000 7fc87a200640 1 -- 172.21.15.8:0/901197876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc874134aa0 con 0x7fc874135bd0 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.574+0000 7fc87a200640 1 -- 172.21.15.8:0/901197876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc874135060 con 0x7fc874135bd0 2024-05-26T15:43:23.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.575+0000 7fc87a200640 1 -- 172.21.15.8:0/901197876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc874066ff0 con 0x7fc874135bd0 2024-05-26T15:43:23.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.576+0000 7fc870c00640 1 -- 172.21.15.8:0/901197876 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc8600129d0 con 0x7fc874135bd0 2024-05-26T15:43:23.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.577+0000 7fc870c00640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc85406ac30 0x7fc85406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:23.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.577+0000 7fc870c00640 1 -- 172.21.15.8:0/901197876 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6173+0+0 (secure 0 0 0) 0x7fc860089180 con 0x7fc874135bd0 2024-05-26T15:43:23.576 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.578+0000 7fc878e00640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc85406ac30 0x7fc85406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:23.577 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.579+0000 7fc878e00640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc85406ac30 0x7fc85406d0f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0057a0 tx=0x7fc86802d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:23.579 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.581+0000 7fc870c00640 1 -- 172.21.15.8:0/901197876 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc8600540f0 con 0x7fc874135bd0 2024-05-26T15:43:23.817 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.818+0000 7fc87a200640 1 -- 172.21.15.8:0/901197876 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc87415aa30 con 0x7fc874135bd0 2024-05-26T15:43:23.819 INFO:tasks.ceph.mon.a.smithi008.stderr:2024-05-26T15:43:23.820+0000 7f3e01a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-26T15:43:23.834 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.835+0000 7fc870c00640 1 -- 172.21.15.8:0/901197876 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc860057710 con 0x7fc874135bd0 2024-05-26T15:43:23.834 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-26T15:43:23.836 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.838+0000 7fc87a200640 1 -- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc85406ac30 msgr2=0x7fc85406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.838+0000 7fc87a200640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc85406ac30 0x7fc85406d0f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0057a0 tx=0x7fc86802d000 comp rx=0 tx=0).stop 2024-05-26T15:43:23.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.838+0000 7fc87a200640 1 -- 172.21.15.8:0/901197876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc874135bd0 msgr2=0x7fc874136050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:23.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.838+0000 7fc87a200640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc874135bd0 0x7fc874136050 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc86000c530 tx=0x7fc86000c9f0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.838+0000 7fc87a200640 1 -- 172.21.15.8:0/901197876 shutdown_connections 2024-05-26T15:43:23.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.838+0000 7fc87a200640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc8740b0490 0x7fc8740b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.838+0000 7fc87a200640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc874135bd0 0x7fc874136050 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.838+0000 7fc87a200640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc85406ac30 0x7fc85406d0f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.838+0000 7fc87a200640 1 --2- 172.21.15.8:0/901197876 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc85c0039a0 0x7fc87415a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:23.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.838+0000 7fc87a200640 1 -- 172.21.15.8:0/901197876 >> 172.21.15.8:0/901197876 conn(0x7fc874069ed0 msgr2=0x7fc87413ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:23.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.839+0000 7fc87a200640 1 -- 172.21.15.8:0/901197876 shutdown_connections 2024-05-26T15:43:23.838 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:23.839+0000 7fc87a200640 1 -- 172.21.15.8:0/901197876 wait complete. 2024-05-26T15:43:23.847 INFO:tasks.ceph.mds.a.smithi008.stderr: -2712> 2024-05-26T15:42:30.266+0000 7f6e7fc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-26T15:43:23.856 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-26T15:43:23.908 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2024-05-26T15:43:24.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.063+0000 7fad75800640 1 Processor -- start 2024-05-26T15:43:24.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.063+0000 7fad75800640 1 -- start start 2024-05-26T15:43:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.065+0000 7fad75800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad70144360 0x7fad700cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.065+0000 7fad75800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fad7015b080 0x7fad7006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:24.063 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.065+0000 7fad75800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad70144740 con 0x7fad70070760 2024-05-26T15:43:24.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.065+0000 7fad75800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad700cb860 con 0x7fad7015b080 2024-05-26T15:43:24.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.065+0000 7fad75800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7015b5e0 con 0x7fad70144360 2024-05-26T15:43:24.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.065+0000 7fad6f400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fad70070760 0x7fad7006cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32958/0 (socket says 172.21.15.8:32958) 2024-05-26T15:43:24.064 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.065+0000 7fad6f400640 1 -- 172.21.15.8:0/1803262672 learned_addr learned my addr 172.21.15.8:0/1803262672 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:24.065 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.065+0000 7fad6ea00640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad70144360 0x7fad700cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.065+0000 7fad6e000640 1 --2- 172.21.15.8:0/1803262672 >> v2:172.21.15.47:3300/0 conn(0x7fad7015b080 0x7fad7006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867459877 0 0) 0x7fad70144740 con 0x7fad70070760 2024-05-26T15:43:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad54003520 con 0x7fad70070760 2024-05-26T15:43:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3924380527 0 0) 0x7fad54003520 con 0x7fad70070760 2024-05-26T15:43:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad70144360 msgr2=0x7fad700cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad70144360 0x7fad700cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 >> v2:172.21.15.47:3300/0 conn(0x7fad7015b080 msgr2=0x7fad7006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 --2- 172.21.15.8:0/1803262672 >> v2:172.21.15.47:3300/0 conn(0x7fad7015b080 0x7fad7006e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7015b8c0 con 0x7fad70070760 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fad680019f0 con 0x7fad70070760 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 >> v1:172.21.15.8:6789/0 conn(0x7fad70070760 legacy=0x7fad7006cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad70144360 0x7fad54003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad54003ef0 0x7fad540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 0x7fad54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad700cb860 con 0x7fad54004d00 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7015b5e0 con 0x7fad54003ef0 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.066+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5400b9d0 con 0x7fad70144360 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.067+0000 7fad6f400640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 0x7fad54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.067+0000 7fad6ea00640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad70144360 0x7fad54003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.067+0000 7fad6e000640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad54003ef0 0x7fad540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:24.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.067+0000 7fad6f400640 1 -- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad70144360 msgr2=0x7fad54003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.067+0000 7fad6f400640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad70144360 0x7fad54003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.067+0000 7fad6f400640 1 -- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad54003ef0 msgr2=0x7fad540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.067+0000 7fad6f400640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad54003ef0 0x7fad540047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.067+0000 7fad6f400640 1 -- 172.21.15.8:0/1803262672 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54003520 con 0x7fad54004d00 2024-05-26T15:43:24.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.067+0000 7fad6ea00640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad70144360 0x7fad54003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.068+0000 7fad6f400640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 0x7fad54005180 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fad6800a890 tx=0x7fad540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddd2194ea1cad02 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.068+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6802ba70 con 0x7fad54004d00 2024-05-26T15:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.068+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6802bbd0 con 0x7fad54004d00 2024-05-26T15:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.069+0000 7fad6d600640 1 -- 172.21.15.8:0/1803262672 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68034470 con 0x7fad54004d00 2024-05-26T15:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.069+0000 7fad75800640 1 -- 172.21.15.8:0/1803262672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 msgr2=0x7fad54005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.069+0000 7fad75800640 1 --2- 172.21.15.8:0/1803262672 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 0x7fad54005180 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fad6800a890 tx=0x7fad540057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.069+0000 7fad6f400640 1 -- 172.21.15.8:0/1803262672 reap_dead start 2024-05-26T15:43:24.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.069+0000 7fad75800640 1 -- 172.21.15.8:0/1803262672 shutdown_connections 2024-05-26T15:43:24.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.069+0000 7fad75800640 1 -- 172.21.15.8:0/1803262672 >> 172.21.15.8:0/1803262672 conn(0x7fad700b0820 msgr2=0x7fad700b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:24.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.069+0000 7fad75800640 1 -- 172.21.15.8:0/1803262672 shutdown_connections 2024-05-26T15:43:24.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.069+0000 7fad75800640 1 -- 172.21.15.8:0/1803262672 wait complete. 2024-05-26T15:43:24.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.071+0000 7fad75800640 1 Processor -- start 2024-05-26T15:43:24.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.071+0000 7fad75800640 1 -- start start 2024-05-26T15:43:24.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.072+0000 7fad75800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 0x7fad701f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:24.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.072+0000 7fad75800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad701f6570 0x7fad7015dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:24.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.072+0000 7fad75800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad700cba30 0x7fad700cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:24.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.072+0000 7fad75800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7015d900 con 0x7fad54004d00 2024-05-26T15:43:24.074 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.072+0000 7fad75800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701f6150 con 0x7fad700cba30 2024-05-26T15:43:24.076 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.072+0000 7fad75800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad700cc3f0 con 0x7fad701f6570 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.073+0000 7fad6ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 0x7fad701f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.073+0000 7fad6ea00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 0x7fad701f1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39242/0 (socket says 172.21.15.8:39242) 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.073+0000 7fad6ea00640 1 -- 172.21.15.8:0/1648464034 learned_addr learned my addr 172.21.15.8:0/1648464034 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.073+0000 7fad6e000640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad701f6570 0x7fad7015dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.073+0000 7fad6ea00640 1 -- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad701f6570 msgr2=0x7fad7015dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.073+0000 7fad6ea00640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad701f6570 0x7fad7015dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.073+0000 7fad6ea00640 1 -- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad700cba30 msgr2=0x7fad700cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.073+0000 7fad6ea00640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad700cba30 0x7fad700cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.073+0000 7fad6ea00640 1 -- 172.21.15.8:0/1648464034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7015e1a0 con 0x7fad54004d00 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.073+0000 7fad6ea00640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 0x7fad701f1d40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fad600108e0 tx=0x7fad60010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.074+0000 7fad66a00640 1 -- 172.21.15.8:0/1648464034 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6000eb00 con 0x7fad54004d00 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.074+0000 7fad66a00640 1 -- 172.21.15.8:0/1648464034 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6000ec60 con 0x7fad54004d00 2024-05-26T15:43:24.077 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.074+0000 7fad75800640 1 -- 172.21.15.8:0/1648464034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7015d620 con 0x7fad54004d00 2024-05-26T15:43:24.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.074+0000 7fad66a00640 1 -- 172.21.15.8:0/1648464034 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6001c400 con 0x7fad54004d00 2024-05-26T15:43:24.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.074+0000 7fad75800640 1 -- 172.21.15.8:0/1648464034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad701f5d70 con 0x7fad54004d00 2024-05-26T15:43:24.078 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.075+0000 7fad75800640 1 -- 172.21.15.8:0/1648464034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad701f58f0 con 0x7fad54004d00 2024-05-26T15:43:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.076+0000 7fad66a00640 1 -- 172.21.15.8:0/1648464034 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fad6001c560 con 0x7fad54004d00 2024-05-26T15:43:24.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.077+0000 7fad66a00640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fad5006ac30 0x7fad5006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.077+0000 7fad66a00640 1 -- 172.21.15.8:0/1648464034 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6259+0+0 (secure 0 0 0) 0x7fad60089a00 con 0x7fad54004d00 2024-05-26T15:43:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.078+0000 7fad6e000640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fad5006ac30 0x7fad5006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.079+0000 7fad6e000640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fad5006ac30 0x7fad5006d0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fad700adad0 tx=0x7fad5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:24.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.081+0000 7fad66a00640 1 -- 172.21.15.8:0/1648464034 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fad701f58f0 con 0x7fad54004d00 2024-05-26T15:43:24.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.321+0000 7fad75800640 1 -- 172.21.15.8:0/1648464034 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fad701f58f0 con 0x7fad54004d00 2024-05-26T15:43:24.837 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.838+0000 7fad66a00640 1 -- 172.21.15.8:0/1648464034 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7fad701f58f0 con 0x7fad54004d00 2024-05-26T15:43:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 -- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fad5006ac30 msgr2=0x7fad5006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fad5006ac30 0x7fad5006d0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fad700adad0 tx=0x7fad5c008040 comp rx=0 tx=0).stop 2024-05-26T15:43:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 -- 172.21.15.8:0/1648464034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 msgr2=0x7fad701f1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 0x7fad701f1d40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fad600108e0 tx=0x7fad60010da0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 -- 172.21.15.8:0/1648464034 shutdown_connections 2024-05-26T15:43:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fad5006ac30 0x7fad5006d0f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad700cba30 0x7fad700cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fad701f6570 0x7fad7015dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 --2- 172.21.15.8:0/1648464034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad54004d00 0x7fad701f1d40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:24.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 -- 172.21.15.8:0/1648464034 >> 172.21.15.8:0/1648464034 conn(0x7fad700b0820 msgr2=0x7fad7015e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:24.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 -- 172.21.15.8:0/1648464034 shutdown_connections 2024-05-26T15:43:24.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:24.843+0000 7fad75800640 1 -- 172.21.15.8:0/1648464034 wait complete. 2024-05-26T15:43:24.864 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-26T15:43:25.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.081+0000 7f467fc00640 1 Processor -- start 2024-05-26T15:43:25.080 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.082+0000 7f467fc00640 1 -- start start 2024-05-26T15:43:25.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.083+0000 7f467fc00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f467815cd40 0x7f46780b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:25.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.083+0000 7f467fc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f46780d2150 0x7f46780d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:25.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.083+0000 7f467fc00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46781608b0 con 0x7f46780b46d0 2024-05-26T15:43:25.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.083+0000 7f467fc00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4678161780 con 0x7f467815cd40 2024-05-26T15:43:25.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.083+0000 7f467fc00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4678160b00 con 0x7f46780d2150 2024-05-26T15:43:25.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.083+0000 7f467d200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f467815cd40 0x7f46780b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:25.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.083+0000 7f467d200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f467815cd40 0x7f46780b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39250/0 (socket says 172.21.15.8:39250) 2024-05-26T15:43:25.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.083+0000 7f467d200640 1 -- 172.21.15.8:0/1904636461 learned_addr learned my addr 172.21.15.8:0/1904636461 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:25.082 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.083+0000 7f467dc00640 1 --1- 172.21.15.8:0/1904636461 >> v1:172.21.15.8:6789/0 conn(0x7f46780b46d0 0x7f46780d0f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32968/0 (socket says 172.21.15.8:32968) 2024-05-26T15:43:25.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.084+0000 7f4677e00640 1 --2- 172.21.15.8:0/1904636461 >> v2:172.21.15.47:3300/0 conn(0x7f46780d2150 0x7f46780d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:25.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.084+0000 7f467d200640 1 -- 172.21.15.8:0/1904636461 >> v2:172.21.15.47:3300/0 conn(0x7f46780d2150 msgr2=0x7f46780d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:25.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.084+0000 7f467d200640 1 --2- 172.21.15.8:0/1904636461 >> v2:172.21.15.47:3300/0 conn(0x7f46780d2150 0x7f46780d25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:25.083 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.084+0000 7f467d200640 1 -- 172.21.15.8:0/1904636461 >> v1:172.21.15.8:6789/0 conn(0x7f46780b46d0 legacy=0x7f46780d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:25.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.084+0000 7f467d200640 1 -- 172.21.15.8:0/1904636461 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4678160de0 con 0x7f467815cd40 2024-05-26T15:43:25.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.084+0000 7f4677400640 1 -- 172.21.15.8:0/1904636461 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018979253 0 0) 0x7f46781608b0 con 0x7f46780b46d0 2024-05-26T15:43:25.084 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.085+0000 7f467d200640 1 --2- 172.21.15.8:0/1904636461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f467815cd40 0x7f46780b5ce0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f46780cf630 tx=0x7f466002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6baf480fd2d448 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.085+0000 7f4677400640 1 -- 172.21.15.8:0/1904636461 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660032440 con 0x7f467815cd40 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.085+0000 7f4677400640 1 -- 172.21.15.8:0/1904636461 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46600325a0 con 0x7f467815cd40 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.085+0000 7f4677400640 1 -- 172.21.15.8:0/1904636461 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660032930 con 0x7f467815cd40 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.086+0000 7f467fc00640 1 -- 172.21.15.8:0/1904636461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f467815cd40 msgr2=0x7f46780b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.086+0000 7f467fc00640 1 --2- 172.21.15.8:0/1904636461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f467815cd40 0x7f46780b5ce0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f46780cf630 tx=0x7f466002a1e0 comp rx=0 tx=0).stop 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.086+0000 7f467fc00640 1 -- 172.21.15.8:0/1904636461 shutdown_connections 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.086+0000 7f467fc00640 1 --2- 172.21.15.8:0/1904636461 >> v2:172.21.15.47:3300/0 conn(0x7f46780d2150 0x7f46780d25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.086+0000 7f467fc00640 1 --2- 172.21.15.8:0/1904636461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f467815cd40 0x7f46780b5ce0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.086+0000 7f467fc00640 1 -- 172.21.15.8:0/1904636461 >> 172.21.15.8:0/1904636461 conn(0x7f4678071c30 msgr2=0x7f46780cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.086+0000 7f467fc00640 1 -- 172.21.15.8:0/1904636461 shutdown_connections 2024-05-26T15:43:25.085 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.086+0000 7f467fc00640 1 -- 172.21.15.8:0/1904636461 wait complete. 2024-05-26T15:43:25.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.088+0000 7f467fc00640 1 Processor -- start 2024-05-26T15:43:25.086 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.088+0000 7f467fc00640 1 -- start start 2024-05-26T15:43:25.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.089+0000 7f467fc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46780b46d0 0x7f46780cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:25.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.089+0000 7f467fc00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46780d2150 0x7f4678158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:25.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.089+0000 7f467fc00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f467815cd40 0x7f46781590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:25.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.089+0000 7f467fc00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4678159610 con 0x7f46780d2150 2024-05-26T15:43:25.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.089+0000 7f467fc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46780b7250 con 0x7f46780b46d0 2024-05-26T15:43:25.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.089+0000 7f467fc00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46781f3180 con 0x7f467815cd40 2024-05-26T15:43:25.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.089+0000 7f4677e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46780d2150 0x7f4678158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:25.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f4677e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46780d2150 0x7f4678158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39252/0 (socket says 172.21.15.8:39252) 2024-05-26T15:43:25.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f4677e00640 1 -- 172.21.15.8:0/3245914816 learned_addr learned my addr 172.21.15.8:0/3245914816 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:25.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f467dc00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f467815cd40 0x7f46781590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:25.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f467d200640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46780b46d0 0x7f46780cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:25.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f4677e00640 1 -- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f467815cd40 msgr2=0x7f46781590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:25.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f4677e00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f467815cd40 0x7f46781590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:25.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f4677e00640 1 -- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46780b46d0 msgr2=0x7f46780cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f4677e00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46780b46d0 0x7f46780cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f4677e00640 1 -- 172.21.15.8:0/3245914816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46600094d0 con 0x7f46780d2150 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f467dc00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f467815cd40 0x7f46781590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f467d200640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46780b46d0 0x7f46780cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.090+0000 7f4677e00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46780d2150 0x7f4678158b90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4668007f20 tx=0x7f466800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.091+0000 7f4674c00640 1 -- 172.21.15.8:0/3245914816 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668014620 con 0x7f46780d2150 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.091+0000 7f4674c00640 1 -- 172.21.15.8:0/3245914816 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4668014780 con 0x7f46780d2150 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.091+0000 7f4674c00640 1 -- 172.21.15.8:0/3245914816 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668014b30 con 0x7f46780d2150 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.091+0000 7f467fc00640 1 -- 172.21.15.8:0/3245914816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46780b6c90 con 0x7f46780d2150 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.091+0000 7f467fc00640 1 -- 172.21.15.8:0/3245914816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467815fc00 con 0x7f46780d2150 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.092+0000 7f467fc00640 1 -- 172.21.15.8:0/3245914816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467815fd90 con 0x7f46780d2150 2024-05-26T15:43:25.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.093+0000 7f4674c00640 1 -- 172.21.15.8:0/3245914816 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4668014c90 con 0x7f46780d2150 2024-05-26T15:43:25.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.094+0000 7f4674c00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f465406ac00 0x7f465406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:25.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.094+0000 7f4674c00640 1 -- 172.21.15.8:0/3245914816 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6259+0+0 (secure 0 0 0) 0x7f4668089f90 con 0x7f46780d2150 2024-05-26T15:43:25.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.095+0000 7f467d200640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f465406ac00 0x7f465406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:25.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.096+0000 7f467d200640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f465406ac00 0x7f465406d0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4660034000 tx=0x7f466002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:25.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.098+0000 7f4674c00640 1 -- 172.21.15.8:0/3245914816 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f46680bd900 con 0x7f46780d2150 2024-05-26T15:43:25.301 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.302+0000 7f467fc00640 1 -- 172.21.15.8:0/3245914816 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f46780ce250 con 0x7f46780d2150 2024-05-26T15:43:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.850+0000 7f4674c00640 1 -- 172.21.15.8:0/3245914816 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) v1 ==== 181+0+0 (secure 0 0 0) 0x7f46780ce250 con 0x7f46780d2150 2024-05-26T15:43:25.849 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2024-05-26T15:43:25.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.855+0000 7f467fc00640 1 -- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f465406ac00 msgr2=0x7f465406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:25.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.855+0000 7f467fc00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f465406ac00 0x7f465406d0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4660034000 tx=0x7f466002e000 comp rx=0 tx=0).stop 2024-05-26T15:43:25.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.855+0000 7f467fc00640 1 -- 172.21.15.8:0/3245914816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46780d2150 msgr2=0x7f4678158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:25.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.855+0000 7f467fc00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46780d2150 0x7f4678158b90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4668007f20 tx=0x7f466800e570 comp rx=0 tx=0).stop 2024-05-26T15:43:25.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.856+0000 7f467fc00640 1 -- 172.21.15.8:0/3245914816 shutdown_connections 2024-05-26T15:43:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.856+0000 7f467fc00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f467815cd40 0x7f46781590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.856+0000 7f467fc00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f46780d2150 0x7f4678158b90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.856+0000 7f467fc00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f465406ac00 0x7f465406d0c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.856+0000 7f467fc00640 1 --2- 172.21.15.8:0/3245914816 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46780b46d0 0x7f46780cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.856+0000 7f467fc00640 1 -- 172.21.15.8:0/3245914816 >> 172.21.15.8:0/3245914816 conn(0x7f4678071c30 msgr2=0x7f46780cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.856+0000 7f467fc00640 1 -- 172.21.15.8:0/3245914816 shutdown_connections 2024-05-26T15:43:25.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:25.856+0000 7f467fc00640 1 -- 172.21.15.8:0/3245914816 wait complete. 2024-05-26T15:43:25.879 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-26T15:43:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.094+0000 7fb324400640 1 Processor -- start 2024-05-26T15:43:26.092 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.094+0000 7fb324400640 1 -- start start 2024-05-26T15:43:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.096+0000 7fb324400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb31c15af40 0x7fb31c098a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:26.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.096+0000 7fb324400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c0ae3d0 0x7fb31c0ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.096+0000 7fb324400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c0ce990 con 0x7fb31c15ab60 2024-05-26T15:43:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.096+0000 7fb324400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c0aed90 con 0x7fb31c15af40 2024-05-26T15:43:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.096+0000 7fb324400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0cec00 con 0x7fb31c0ae3d0 2024-05-26T15:43:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.096+0000 7fb321a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fb31c15ab60 0x7fb31c0cf6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32974/0 (socket says 172.21.15.8:32974) 2024-05-26T15:43:26.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.096+0000 7fb321a00640 1 -- 172.21.15.8:0/2203051028 learned_addr learned my addr 172.21.15.8:0/2203051028 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927680806 0 0) 0x7fb31c0ce990 con 0x7fb31c15ab60 2024-05-26T15:43:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb304003520 con 0x7fb31c15ab60 2024-05-26T15:43:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb321000640 1 --2- 172.21.15.8:0/2203051028 >> v2:172.21.15.47:3300/0 conn(0x7fb31c15af40 0x7fb31c098a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb322400640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c0ae3d0 0x7fb31c0ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 668328169 0 0) 0x7fb304003520 con 0x7fb31c15ab60 2024-05-26T15:43:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c0ae3d0 msgr2=0x7fb31c0ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c0ae3d0 0x7fb31c0ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 >> v2:172.21.15.47:3300/0 conn(0x7fb31c15af40 msgr2=0x7fb31c098a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:26.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 --2- 172.21.15.8:0/2203051028 >> v2:172.21.15.47:3300/0 conn(0x7fb31c15af40 0x7fb31c098a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c0ceee0 con 0x7fb31c15ab60 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fb310001a10 con 0x7fb31c15ab60 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 >> v1:172.21.15.8:6789/0 conn(0x7fb31c15ab60 legacy=0x7fb31c0cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c0ae3d0 0x7fb3040039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb304004010 0x7fb3040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb304004d00 0x7fb304005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0aed90 con 0x7fb304004010 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0cec00 con 0x7fb304004d00 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30400bb10 con 0x7fb31c0ae3d0 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.097+0000 7fb321000640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb304004010 0x7fb3040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.098+0000 7fb321a00640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c0ae3d0 0x7fb3040039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.098+0000 7fb322400640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb304004d00 0x7fb304005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:26.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.098+0000 7fb321000640 1 -- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c0ae3d0 msgr2=0x7fb3040039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.098+0000 7fb321000640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c0ae3d0 0x7fb3040039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.098+0000 7fb321000640 1 -- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb304004d00 msgr2=0x7fb304005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.098+0000 7fb321000640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb304004d00 0x7fb304005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.098+0000 7fb321000640 1 -- 172.21.15.8:0/2203051028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304003520 con 0x7fb304004010 2024-05-26T15:43:26.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.098+0000 7fb322400640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb304004d00 0x7fb304005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:26.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.099+0000 7fb321000640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb304004010 0x7fb3040047c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb30800ba00 tx=0x7fb3040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a683c415902010 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:26.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.099+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30802ade0 con 0x7fb304004010 2024-05-26T15:43:26.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.099+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30802e070 con 0x7fb304004010 2024-05-26T15:43:26.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.099+0000 7fb31be00640 1 -- 172.21.15.8:0/2203051028 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308034620 con 0x7fb304004010 2024-05-26T15:43:26.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.100+0000 7fb324400640 1 -- 172.21.15.8:0/2203051028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb304004010 msgr2=0x7fb3040047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:26.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.100+0000 7fb324400640 1 --2- 172.21.15.8:0/2203051028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb304004010 0x7fb3040047c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb30800ba00 tx=0x7fb3040057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.100+0000 7fb322400640 1 -- 172.21.15.8:0/2203051028 reap_dead start 2024-05-26T15:43:26.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.100+0000 7fb324400640 1 -- 172.21.15.8:0/2203051028 shutdown_connections 2024-05-26T15:43:26.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.100+0000 7fb324400640 1 -- 172.21.15.8:0/2203051028 >> 172.21.15.8:0/2203051028 conn(0x7fb31c0b2d60 msgr2=0x7fb31c0b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:26.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.100+0000 7fb324400640 1 -- 172.21.15.8:0/2203051028 shutdown_connections 2024-05-26T15:43:26.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.100+0000 7fb324400640 1 -- 172.21.15.8:0/2203051028 wait complete. 2024-05-26T15:43:26.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.102+0000 7fb324400640 1 Processor -- start 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.102+0000 7fb324400640 1 -- start start 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.103+0000 7fb324400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb304004010 0x7fb31c141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.103+0000 7fb324400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c150010 0x7fb31c0adc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.103+0000 7fb324400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb31c0ac1c0 0x7fb31c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.103+0000 7fb324400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c142140 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.103+0000 7fb324400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0ad7b0 con 0x7fb304004010 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.103+0000 7fb324400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0ae180 con 0x7fb31c150010 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.104+0000 7fb322400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb31c0ac1c0 0x7fb31c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.104+0000 7fb322400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb31c0ac1c0 0x7fb31c0c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39256/0 (socket says 172.21.15.8:39256) 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.104+0000 7fb322400640 1 -- 172.21.15.8:0/3199663314 learned_addr learned my addr 172.21.15.8:0/3199663314 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.104+0000 7fb321a00640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb304004010 0x7fb31c141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.104+0000 7fb321000640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c150010 0x7fb31c0adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:26.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.104+0000 7fb322400640 1 -- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c150010 msgr2=0x7fb31c0adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.104+0000 7fb322400640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c150010 0x7fb31c0adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.104+0000 7fb322400640 1 -- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb304004010 msgr2=0x7fb31c141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.104+0000 7fb322400640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb304004010 0x7fb31c141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.104 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.104+0000 7fb322400640 1 -- 172.21.15.8:0/3199663314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c0acba0 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.105+0000 7fb322400640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb31c0ac1c0 0x7fb31c0c8ec0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb314006fd0 tx=0x7fb314009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.105+0000 7fb319600640 1 -- 172.21.15.8:0/3199663314 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400c070 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.105+0000 7fb319600640 1 -- 172.21.15.8:0/3199663314 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314012670 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.105+0000 7fb324400640 1 -- 172.21.15.8:0/3199663314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c0ace80 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.105+0000 7fb319600640 1 -- 172.21.15.8:0/3199663314 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314012a20 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.105+0000 7fb324400640 1 -- 172.21.15.8:0/3199663314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c0ad440 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.106+0000 7fb324400640 1 -- 172.21.15.8:0/3199663314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c0ad5d0 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.107+0000 7fb319600640 1 -- 172.21.15.8:0/3199663314 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb314012b80 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.106 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.108+0000 7fb319600640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb2fc06ac30 0x7fb2fc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.108+0000 7fb319600640 1 -- 172.21.15.8:0/3199663314 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5821+0+0 (secure 0 0 0) 0x7fb314088710 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.107 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.109+0000 7fb321a00640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb2fc06ac30 0x7fb2fc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:26.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.110+0000 7fb321a00640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb2fc06ac30 0x7fb2fc06d0f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb310005fd0 tx=0x7fb310009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:26.111 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.113+0000 7fb319600640 1 -- 172.21.15.8:0/3199663314 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb3140537e0 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.311+0000 7fb324400640 1 -- 172.21.15.8:0/3199663314 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb31c0afee0 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.862 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.863+0000 7fb319600640 1 -- 172.21.15.8:0/3199663314 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb314056e00 con 0x7fb31c0ac1c0 2024-05-26T15:43:26.862 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2024-05-26T15:43:26.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.868+0000 7fb324400640 1 -- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb2fc06ac30 msgr2=0x7fb2fc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:26.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.868+0000 7fb324400640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb2fc06ac30 0x7fb2fc06d0f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb310005fd0 tx=0x7fb310009040 comp rx=0 tx=0).stop 2024-05-26T15:43:26.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.868+0000 7fb324400640 1 -- 172.21.15.8:0/3199663314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb31c0ac1c0 msgr2=0x7fb31c0c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:26.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.868+0000 7fb324400640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb31c0ac1c0 0x7fb31c0c8ec0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb314006fd0 tx=0x7fb314009820 comp rx=0 tx=0).stop 2024-05-26T15:43:26.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.869+0000 7fb324400640 1 -- 172.21.15.8:0/3199663314 shutdown_connections 2024-05-26T15:43:26.868 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.869+0000 7fb324400640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb31c0ac1c0 0x7fb31c0c8ec0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.869+0000 7fb324400640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fb31c150010 0x7fb31c0adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.869+0000 7fb324400640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fb2fc06ac30 0x7fb2fc06d0f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.869+0000 7fb324400640 1 --2- 172.21.15.8:0/3199663314 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb304004010 0x7fb31c141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:26.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.869+0000 7fb324400640 1 -- 172.21.15.8:0/3199663314 >> 172.21.15.8:0/3199663314 conn(0x7fb31c0b2d60 msgr2=0x7fb31c157700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:26.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.870+0000 7fb324400640 1 -- 172.21.15.8:0/3199663314 shutdown_connections 2024-05-26T15:43:26.869 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:26.870+0000 7fb324400640 1 -- 172.21.15.8:0/3199663314 wait complete. 2024-05-26T15:43:26.897 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-26T15:43:26.905 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-26T15:43:27.051 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2024-05-26T15:43:27.051 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2024-05-26T15:43:27.051 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-26T15:43:27.051 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2024-05-26T15:43:27.051 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.051 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2024-05-26T15:43:27.052 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2024-05-26T15:43:27.053 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:43:27.054 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: osd mclock profile = high_recovery_ops 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2024-05-26T15:43:27.055 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2024-05-26T15:43:27.056 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 20 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 20 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 10 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-05-26T15:43:27.057 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2024-05-26T15:43:27.058 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2024-05-26T15:43:27.059 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-26T15:43:27.060 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = "" 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2024-05-26T15:43:27.061 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2024-05-26T15:43:27.062 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds balancer = 20 2024-05-26T15:43:27.062 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2024-05-26T15:43:27.062 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2024-05-26T15:43:27.062 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2024-05-26T15:43:27.062 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2024-05-26T15:43:27.062 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2024-05-26T15:43:27.062 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2024-05-26T15:43:27.062 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2024-05-26T15:43:27.062 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.063 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-05-26T15:43:27.064 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-05-26T15:43:27.065 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.8,172.21.15.47,[v2:172.21.15.47:3301,v1:172.21.15.47:6790]" 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on skipped message = False 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 03132396-4584-4cf0-b2e0-b5ae6040045e 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-05-26T15:43:27.066 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.067 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 20 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 20 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:43:27.068 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 10 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-26T15:43:27.069 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-05-26T15:43:27.070 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-05-26T15:43:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = "" 2024-05-26T15:43:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-05-26T15:43:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-05-26T15:43:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-05-26T15:43:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-05-26T15:43:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-26T15:43:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-26T15:43:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-26T15:43:27.091 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-26T15:43:27.275 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.277+0000 7f3db6c00640 1 Processor -- start 2024-05-26T15:43:27.276 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.277+0000 7f3db6c00640 1 -- start start 2024-05-26T15:43:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.279+0000 7f3db6c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db00cd890 0x7f3db006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.279+0000 7f3db6c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3db00cdc70 0x7f3db00cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.279+0000 7f3db6c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db006cf90 con 0x7f3db015ae80 2024-05-26T15:43:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.279+0000 7f3db6c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db00ce200 con 0x7f3db00cdc70 2024-05-26T15:43:27.277 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.279+0000 7f3db6c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00cc0a0 con 0x7f3db00cd890 2024-05-26T15:43:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.279+0000 7f3db5800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db00cd890 0x7f3db006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.279+0000 7f3db4e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3db00cdc70 0x7f3db00cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.280+0000 7f3db5800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db00cd890 0x7f3db006dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3301/0 says I am v2:172.21.15.8:58738/0 (socket says 172.21.15.8:58738) 2024-05-26T15:43:27.278 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.280+0000 7f3db5800640 1 -- 172.21.15.8:0/4273797143 learned_addr learned my addr 172.21.15.8:0/4273797143 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.280+0000 7f3db4e00640 1 -- 172.21.15.8:0/4273797143 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db00cd890 msgr2=0x7f3db006dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.280+0000 7f3db4e00640 1 --2- 172.21.15.8:0/4273797143 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db00cd890 0x7f3db006dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.280+0000 7f3db4e00640 1 -- 172.21.15.8:0/4273797143 >> v1:172.21.15.47:6789/0 conn(0x7f3db015ae80 legacy=0x7f3db015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:27.279 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.280+0000 7f3db4e00640 1 -- 172.21.15.8:0/4273797143 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db006d230 con 0x7f3db00cdc70 2024-05-26T15:43:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.282+0000 7f3db4e00640 1 --2- 172.21.15.8:0/4273797143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db00cdc70 0x7f3db00cb9c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0097a0 tx=0x7f3d9c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17c992ad865388b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.282+0000 7f3dafe00640 1 -- 172.21.15.8:0/4273797143 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c032440 con 0x7f3db00cdc70 2024-05-26T15:43:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.282+0000 7f3dafe00640 1 -- 172.21.15.8:0/4273797143 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0325a0 con 0x7f3db00cdc70 2024-05-26T15:43:27.280 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.282+0000 7f3dafe00640 1 -- 172.21.15.8:0/4273797143 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c032930 con 0x7f3db00cdc70 2024-05-26T15:43:27.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.283+0000 7f3db6c00640 1 -- 172.21.15.8:0/4273797143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db00cdc70 msgr2=0x7f3db00cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:27.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.283+0000 7f3db6c00640 1 --2- 172.21.15.8:0/4273797143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db00cdc70 0x7f3db00cb9c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0097a0 tx=0x7f3d9c02a180 comp rx=0 tx=0).stop 2024-05-26T15:43:27.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.283+0000 7f3db6c00640 1 -- 172.21.15.8:0/4273797143 shutdown_connections 2024-05-26T15:43:27.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.283+0000 7f3db6c00640 1 --2- 172.21.15.8:0/4273797143 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db00cdc70 0x7f3db00cb9c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.281 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.283+0000 7f3db6c00640 1 --2- 172.21.15.8:0/4273797143 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db00cd890 0x7f3db006dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.283+0000 7f3db6c00640 1 -- 172.21.15.8:0/4273797143 >> 172.21.15.8:0/4273797143 conn(0x7f3db00ce4d0 msgr2=0x7f3db00ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:27.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.283+0000 7f3db6c00640 1 -- 172.21.15.8:0/4273797143 shutdown_connections 2024-05-26T15:43:27.282 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.283+0000 7f3db6c00640 1 -- 172.21.15.8:0/4273797143 wait complete. 2024-05-26T15:43:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.285+0000 7f3db6c00640 1 Processor -- start 2024-05-26T15:43:27.283 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.285+0000 7f3db6c00640 1 -- start start 2024-05-26T15:43:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.286+0000 7f3db6c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db00cd890 0x7f3db00b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.286+0000 7f3db6c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3db00cdc70 0x7f3db00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.286+0000 7f3db6c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db015ae80 0x7f3db014c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.285 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.286+0000 7f3db6c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00abc40 con 0x7f3db00cdc70 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.286+0000 7f3db6c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db01f2560 con 0x7f3db00cd890 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.286+0000 7f3db6c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00b3720 con 0x7f3db015ae80 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.286+0000 7f3db4e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3db00cdc70 0x7f3db00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.286+0000 7f3db4e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3db00cdc70 0x7f3db00b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39272/0 (socket says 172.21.15.8:39272) 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.286+0000 7f3db4e00640 1 -- 172.21.15.8:0/1929831166 learned_addr learned my addr 172.21.15.8:0/1929831166 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.286+0000 7f3db5800640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db00cd890 0x7f3db00b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3db6200640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db015ae80 0x7f3db014c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3db4e00640 1 -- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db015ae80 msgr2=0x7f3db014c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3db4e00640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db015ae80 0x7f3db014c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3db4e00640 1 -- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db00cd890 msgr2=0x7f3db00b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3db4e00640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db00cd890 0x7f3db00b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3db4e00640 1 -- 172.21.15.8:0/1929831166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c009400 con 0x7f3db00cdc70 2024-05-26T15:43:27.286 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3db6200640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db015ae80 0x7f3db014c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:27.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3db5800640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db00cd890 0x7f3db00b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:27.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3db4e00640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3db00cdc70 0x7f3db00b31e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c035040 tx=0x7f3d9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:27.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3dad600640 1 -- 172.21.15.8:0/1929831166 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c006e10 con 0x7f3db00cdc70 2024-05-26T15:43:27.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.287+0000 7f3dad600640 1 -- 172.21.15.8:0/1929831166 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c032e90 con 0x7f3db00cdc70 2024-05-26T15:43:27.287 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.288+0000 7f3dad600640 1 -- 172.21.15.8:0/1929831166 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c030be0 con 0x7f3db00cdc70 2024-05-26T15:43:27.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.288+0000 7f3db6c00640 1 -- 172.21.15.8:0/1929831166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db014cea0 con 0x7f3db00cdc70 2024-05-26T15:43:27.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.288+0000 7f3db6c00640 1 -- 172.21.15.8:0/1929831166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db00ab8f0 con 0x7f3db00cdc70 2024-05-26T15:43:27.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.289+0000 7f3db6c00640 1 -- 172.21.15.8:0/1929831166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db00abd80 con 0x7f3db00cdc70 2024-05-26T15:43:27.288 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.290+0000 7f3dad600640 1 -- 172.21.15.8:0/1929831166 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3d9c039040 con 0x7f3db00cdc70 2024-05-26T15:43:27.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.291+0000 7f3dad600640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3d9006ac00 0x7f3d9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.291+0000 7f3dad600640 1 -- 172.21.15.8:0/1929831166 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f3d9c0a9990 con 0x7f3db00cdc70 2024-05-26T15:43:27.289 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.291+0000 7f3db5800640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3d9006ac00 0x7f3d9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.291 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.293+0000 7f3db5800640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3d9006ac00 0x7f3d9006d0c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3da4009ac0 tx=0x7f3da4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:27.293 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.295+0000 7f3dad600640 1 -- 172.21.15.8:0/1929831166 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3db00abd80 con 0x7f3db00cdc70 2024-05-26T15:43:27.492 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.493+0000 7f3db6c00640 1 -- 172.21.15.8:0/1929831166 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3db014cea0 con 0x7f3db00cdc70 2024-05-26T15:43:27.498 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.500+0000 7f3dad600640 1 -- 172.21.15.8:0/1929831166 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3db014cea0 con 0x7f3db00cdc70 2024-05-26T15:43:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.502+0000 7f3db6c00640 1 -- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3d9006ac00 msgr2=0x7f3d9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.502+0000 7f3db6c00640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3d9006ac00 0x7f3d9006d0c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3da4009ac0 tx=0x7f3da4008040 comp rx=0 tx=0).stop 2024-05-26T15:43:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.502+0000 7f3db6c00640 1 -- 172.21.15.8:0/1929831166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3db00cdc70 msgr2=0x7f3db00b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.502+0000 7f3db6c00640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3db00cdc70 0x7f3db00b31e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c035040 tx=0x7f3d9c0046c0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.503+0000 7f3db6c00640 1 -- 172.21.15.8:0/1929831166 shutdown_connections 2024-05-26T15:43:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.503+0000 7f3db6c00640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f3db015ae80 0x7f3db014c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.503+0000 7f3db6c00640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3db00cdc70 0x7f3db00b31e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.503+0000 7f3db6c00640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f3d9006ac00 0x7f3d9006d0c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.502 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.503+0000 7f3db6c00640 1 --2- 172.21.15.8:0/1929831166 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3db00cd890 0x7f3db00b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.503+0000 7f3db6c00640 1 -- 172.21.15.8:0/1929831166 >> 172.21.15.8:0/1929831166 conn(0x7f3db00ce4d0 msgr2=0x7f3db0152050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.503+0000 7f3db6c00640 1 -- 172.21.15.8:0/1929831166 shutdown_connections 2024-05-26T15:43:27.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.503+0000 7f3db6c00640 1 -- 172.21.15.8:0/1929831166 wait complete. 2024-05-26T15:43:27.521 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters' 2024-05-26T15:43:27.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.739+0000 7ff082400640 1 Processor -- start 2024-05-26T15:43:27.737 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.739+0000 7ff082400640 1 -- start start 2024-05-26T15:43:27.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.741+0000 7ff082400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7ff07c0b0f60 0x7ff07c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.741+0000 7ff082400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 0x7ff07c0c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.741+0000 7ff082400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c15b640 con 0x7ff07c154f50 2024-05-26T15:43:27.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.741+0000 7ff082400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c15bee0 con 0x7ff07c0b0f60 2024-05-26T15:43:27.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.741+0000 7ff082400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0b0ba0 con 0x7ff07c15f0c0 2024-05-26T15:43:27.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.741+0000 7ff081000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7ff07c154f50 0x7ff07c15ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32980/0 (socket says 172.21.15.8:32980) 2024-05-26T15:43:27.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.741+0000 7ff081000640 1 -- 172.21.15.8:0/411029389 learned_addr learned my addr 172.21.15.8:0/411029389 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:27.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.741+0000 7ff07be00640 1 --2- 172.21.15.8:0/411029389 >> v2:172.21.15.8:3300/0 conn(0x7ff07c0b0f60 0x7ff07c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.742+0000 7ff081a00640 1 --2- 172.21.15.8:0/411029389 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 0x7ff07c0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.742+0000 7ff07b400640 1 -- 172.21.15.8:0/411029389 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947380160 0 0) 0x7ff07c15b640 con 0x7ff07c154f50 2024-05-26T15:43:27.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.742+0000 7ff07b400640 1 -- 172.21.15.8:0/411029389 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff060003520 con 0x7ff07c154f50 2024-05-26T15:43:27.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.742+0000 7ff07be00640 1 -- 172.21.15.8:0/411029389 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 msgr2=0x7ff07c0c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:27.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.742+0000 7ff07be00640 1 --2- 172.21.15.8:0/411029389 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 0x7ff07c0c36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.742+0000 7ff07be00640 1 -- 172.21.15.8:0/411029389 >> v1:172.21.15.8:6789/0 conn(0x7ff07c154f50 legacy=0x7ff07c15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:27.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.742+0000 7ff07be00640 1 -- 172.21.15.8:0/411029389 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c15b920 con 0x7ff07c0b0f60 2024-05-26T15:43:27.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.743+0000 7ff07be00640 1 --2- 172.21.15.8:0/411029389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c0b0f60 0x7ff07c15eb80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff068009dc0 tx=0x7ff06802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6233d9efeb843ab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:27.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.743+0000 7ff07b400640 1 -- 172.21.15.8:0/411029389 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068007740 con 0x7ff07c0b0f60 2024-05-26T15:43:27.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.743+0000 7ff07b400640 1 -- 172.21.15.8:0/411029389 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06802d050 con 0x7ff07c0b0f60 2024-05-26T15:43:27.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.743+0000 7ff07b400640 1 -- 172.21.15.8:0/411029389 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068007ac0 con 0x7ff07c0b0f60 2024-05-26T15:43:27.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.744+0000 7ff082400640 1 -- 172.21.15.8:0/411029389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c0b0f60 msgr2=0x7ff07c15eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:27.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.744+0000 7ff082400640 1 --2- 172.21.15.8:0/411029389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c0b0f60 0x7ff07c15eb80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff068009dc0 tx=0x7ff06802a5f0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.743 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.744+0000 7ff082400640 1 -- 172.21.15.8:0/411029389 shutdown_connections 2024-05-26T15:43:27.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.744+0000 7ff082400640 1 --2- 172.21.15.8:0/411029389 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 0x7ff07c0c36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.744+0000 7ff082400640 1 --2- 172.21.15.8:0/411029389 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c0b0f60 0x7ff07c15eb80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.744+0000 7ff082400640 1 -- 172.21.15.8:0/411029389 >> 172.21.15.8:0/411029389 conn(0x7ff07c070480 msgr2=0x7ff07c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:27.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.744+0000 7ff082400640 1 -- 172.21.15.8:0/411029389 shutdown_connections 2024-05-26T15:43:27.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.744+0000 7ff082400640 1 -- 172.21.15.8:0/411029389 wait complete. 2024-05-26T15:43:27.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.746+0000 7ff082400640 1 Processor -- start 2024-05-26T15:43:27.744 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.746+0000 7ff082400640 1 -- start start 2024-05-26T15:43:27.746 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.747+0000 7ff082400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff07c0b0f60 0x7ff07c13fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.747+0000 7ff082400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c154f50 0x7ff07c141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.747+0000 7ff082400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 0x7ff07c1421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.747+0000 7ff082400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c151ba0 con 0x7ff07c154f50 2024-05-26T15:43:27.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.747+0000 7ff082400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c13ed10 con 0x7ff07c0b0f60 2024-05-26T15:43:27.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.747+0000 7ff082400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c13eff0 con 0x7ff07c15f0c0 2024-05-26T15:43:27.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.747+0000 7ff07be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c154f50 0x7ff07c141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.747+0000 7ff07be00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c154f50 0x7ff07c141c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39294/0 (socket says 172.21.15.8:39294) 2024-05-26T15:43:27.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.747+0000 7ff07be00640 1 -- 172.21.15.8:0/2472542514 learned_addr learned my addr 172.21.15.8:0/2472542514 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:27.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.748+0000 7ff081000640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff07c0b0f60 0x7ff07c13fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.748+0000 7ff081a00640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 0x7ff07c1421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.748+0000 7ff07be00640 1 -- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 msgr2=0x7ff07c1421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:27.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.748+0000 7ff07be00640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 0x7ff07c1421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.748+0000 7ff07be00640 1 -- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff07c0b0f60 msgr2=0x7ff07c13fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:27.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.748+0000 7ff07be00640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff07c0b0f60 0x7ff07c13fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:27.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.748+0000 7ff07be00640 1 -- 172.21.15.8:0/2472542514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068009a70 con 0x7ff07c154f50 2024-05-26T15:43:27.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.748+0000 7ff081a00640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 0x7ff07c1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:27.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.748+0000 7ff07be00640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c154f50 0x7ff07c141c90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff068000f80 tx=0x7ff068004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:27.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.749+0000 7ff078c00640 1 -- 172.21.15.8:0/2472542514 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068031890 con 0x7ff07c154f50 2024-05-26T15:43:27.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.749+0000 7ff078c00640 1 -- 172.21.15.8:0/2472542514 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0680319f0 con 0x7ff07c154f50 2024-05-26T15:43:27.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.749+0000 7ff082400640 1 -- 172.21.15.8:0/2472542514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c13f2d0 con 0x7ff07c154f50 2024-05-26T15:43:27.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.749+0000 7ff078c00640 1 -- 172.21.15.8:0/2472542514 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068031d60 con 0x7ff07c154f50 2024-05-26T15:43:27.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.749+0000 7ff082400640 1 -- 172.21.15.8:0/2472542514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c13f890 con 0x7ff07c154f50 2024-05-26T15:43:27.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.750+0000 7ff082400640 1 -- 172.21.15.8:0/2472542514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c04e280 con 0x7ff07c154f50 2024-05-26T15:43:27.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.751+0000 7ff078c00640 1 -- 172.21.15.8:0/2472542514 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff06803c420 con 0x7ff07c154f50 2024-05-26T15:43:27.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.752+0000 7ff078c00640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff05c06acd0 0x7ff05c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:27.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.752+0000 7ff078c00640 1 -- 172.21.15.8:0/2472542514 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff0680aae70 con 0x7ff07c154f50 2024-05-26T15:43:27.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.753+0000 7ff081000640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff05c06acd0 0x7ff05c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:27.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.754+0000 7ff081000640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff05c06acd0 0x7ff05c06d190 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0011e0 tx=0x7ff06c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:27.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:27.756+0000 7ff078c00640 1 -- 172.21.15.8:0/2472542514 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff068076240 con 0x7ff07c154f50 2024-05-26T15:43:28.036 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.038+0000 7ff082400640 1 -- 172.21.15.8:0/2472542514 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]} v 0) v1 -- 0x7ff07c0714a0 con 0x7ff07c154f50 2024-05-26T15:43:28.872 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.873+0000 7ff078c00640 1 -- 172.21.15.8:0/2472542514 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]}]=0 v219) v1 ==== 143+0+0 (secure 0 0 0) 0x7ff068079860 con 0x7ff07c154f50 2024-05-26T15:43:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 -- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff05c06acd0 msgr2=0x7ff05c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff05c06acd0 0x7ff05c06d190 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0011e0 tx=0x7ff06c009040 comp rx=0 tx=0).stop 2024-05-26T15:43:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 -- 172.21.15.8:0/2472542514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c154f50 msgr2=0x7ff07c141c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c154f50 0x7ff07c141c90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff068000f80 tx=0x7ff068004a40 comp rx=0 tx=0).stop 2024-05-26T15:43:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 -- 172.21.15.8:0/2472542514 shutdown_connections 2024-05-26T15:43:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7ff07c15f0c0 0x7ff07c1421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:28.876 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff07c154f50 0x7ff07c141c90 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7ff05c06acd0 0x7ff05c06d190 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 --2- 172.21.15.8:0/2472542514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff07c0b0f60 0x7ff07c13fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 -- 172.21.15.8:0/2472542514 >> 172.21.15.8:0/2472542514 conn(0x7ff07c070480 msgr2=0x7ff07c0c4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.877+0000 7ff082400640 1 -- 172.21.15.8:0/2472542514 shutdown_connections 2024-05-26T15:43:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:28.878+0000 7ff082400640 1 -- 172.21.15.8:0/2472542514 wait complete. 2024-05-26T15:43:28.895 INFO:tasks.cephfs_test_runner:Opening a file should increment omap_total_updates by 1. ... ok 2024-05-26T15:43:28.896 INFO:tasks.cephfs_test_runner: 2024-05-26T15:43:28.896 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-26T15:43:28.896 INFO:tasks.cephfs_test_runner:Ran 2 tests in 170.297s 2024-05-26T15:43:28.896 INFO:tasks.cephfs_test_runner: 2024-05-26T15:43:28.896 INFO:tasks.cephfs_test_runner:OK 2024-05-26T15:43:28.897 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-26T15:43:28.906 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-26T15:43:28.914 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-26T15:43:28.914 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:43:28.914 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:43:28.968 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-26T15:43:28.968 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2024-05-26T15:43:28.968 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:43:29.020 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:43:29.026 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:43:29.027 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-26T15:43:29.027 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:43:29.028 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:43:29.084 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-26T15:43:29.085 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-26T15:43:29.085 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-26T15:43:29.183 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053506,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249616k,nr_inodes=812404,mode=700,uid=1000,gid=1316 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499240k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-26T15:43:29.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:29.183 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-05-26T15:43:29.242 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-26T15:43:29.242 INFO:teuthology.orchestra.run.smithi008.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-26T15:43:29.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:29.243 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-26T15:43:29.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:29.334 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-26T15:43:29.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:29.412 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2024-05-26T15:43:29.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:29.523 DEBUG:teuthology.orchestra.run.smithi008:> ip netns list 2024-05-26T15:43:29.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:29.569 DEBUG:teuthology.orchestra.run.smithi008:> sudo ip link delete ceph-brx 2024-05-26T15:43:29.702 INFO:teuthology.orchestra.run.smithi008.stderr:Cannot find device "ceph-brx" 2024-05-26T15:43:29.706 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:43:29.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:29.707 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-26T15:43:29.767 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-26T15:43:29.768 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-26T15:43:29.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:29.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-26T15:43:29.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:29.860 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-26T15:43:29.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:29.942 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-26T15:43:30.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:30.058 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-26T15:43:30.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-26T15:43:30.104 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-26T15:43:30.235 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-05-26T15:43:30.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:43:30.241 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-26T15:43:30.251 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-26T15:43:30.251 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:43:30.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.474+0000 7f26aa800640 1 Processor -- start 2024-05-26T15:43:30.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.475+0000 7f26aa800640 1 -- start start 2024-05-26T15:43:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.476+0000 7f26aa800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f26a4161030 0x7f26a40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.476+0000 7f26aa800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415cf60 0x7f26a40cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.476+0000 7f26aa800640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a41617e0 con 0x7f26a415cb80 2024-05-26T15:43:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.476+0000 7f26aa800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a40cce00 con 0x7f26a4161030 2024-05-26T15:43:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.476+0000 7f26aa800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4161500 con 0x7f26a415cf60 2024-05-26T15:43:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.477+0000 7f26a3400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f26a415cb80 0x7f26a4160920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:32990/0 (socket says 172.21.15.8:32990) 2024-05-26T15:43:30.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.477+0000 7f26a3400640 1 -- 172.21.15.8:0/3970647610 learned_addr learned my addr 172.21.15.8:0/3970647610 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.477+0000 7f26a3e00640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415cf60 0x7f26a40cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.477+0000 7f26a2a00640 1 --2- 172.21.15.8:0/3970647610 >> v2:172.21.15.47:3300/0 conn(0x7f26a4161030 0x7f26a40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.477+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315225649 0 0) 0x7f26a41617e0 con 0x7f26a415cb80 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.477+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2684003520 con 0x7f26a415cb80 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201205478 0 0) 0x7f2684003520 con 0x7f26a415cb80 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415cf60 msgr2=0x7f26a40cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415cf60 0x7f26a40cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 >> v2:172.21.15.47:3300/0 conn(0x7f26a4161030 msgr2=0x7f26a40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 --2- 172.21.15.8:0/3970647610 >> v2:172.21.15.47:3300/0 conn(0x7f26a4161030 0x7f26a40cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a40cd470 con 0x7f26a415cb80 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f2694001670 con 0x7f26a415cb80 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 >> v1:172.21.15.8:6789/0 conn(0x7f26a415cb80 legacy=0x7f26a4160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2684003970 0x7f2684003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26840047c0 0x7f2684004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415cf60 0x7f2684005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40cce00 con 0x7f2684003970 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4161500 con 0x7f26840047c0 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268400b9d0 con 0x7f26a415cf60 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.478+0000 7f26a3400640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2684003970 0x7f2684003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.479+0000 7f26a3e00640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415cf60 0x7f2684005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.479+0000 7f26a2a00640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26840047c0 0x7f2684004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.479+0000 7f26a3400640 1 -- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415cf60 msgr2=0x7f2684005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.479+0000 7f26a3400640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415cf60 0x7f2684005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.479+0000 7f26a3400640 1 -- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26840047c0 msgr2=0x7f2684004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.479+0000 7f26a3400640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26840047c0 0x7f2684004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.479+0000 7f26a3400640 1 -- 172.21.15.8:0/3970647610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2684003520 con 0x7f2684003970 2024-05-26T15:43:30.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.479+0000 7f26a3e00640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415cf60 0x7f2684005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:30.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.480+0000 7f26a3400640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2684003970 0x7f2684003d90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f269400c190 tx=0x7f26840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b69ccef30754082 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:30.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.480+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694005ad0 con 0x7f2684003970 2024-05-26T15:43:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.480+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269402d070 con 0x7f2684003970 2024-05-26T15:43:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.480+0000 7f26a2000640 1 -- 172.21.15.8:0/3970647610 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694005e70 con 0x7f2684003970 2024-05-26T15:43:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.481+0000 7f26aa800640 1 -- 172.21.15.8:0/3970647610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2684003970 msgr2=0x7f2684003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.481+0000 7f26aa800640 1 --2- 172.21.15.8:0/3970647610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2684003970 0x7f2684003d90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f269400c190 tx=0x7f26840057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.481+0000 7f26a3e00640 1 -- 172.21.15.8:0/3970647610 reap_dead start 2024-05-26T15:43:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.481+0000 7f26aa800640 1 -- 172.21.15.8:0/3970647610 shutdown_connections 2024-05-26T15:43:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.481+0000 7f26aa800640 1 -- 172.21.15.8:0/3970647610 >> 172.21.15.8:0/3970647610 conn(0x7f26a40b0570 msgr2=0x7f26a40b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.481+0000 7f26aa800640 1 -- 172.21.15.8:0/3970647610 shutdown_connections 2024-05-26T15:43:30.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.481+0000 7f26aa800640 1 -- 172.21.15.8:0/3970647610 wait complete. 2024-05-26T15:43:30.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.483+0000 7f26aa800640 1 Processor -- start 2024-05-26T15:43:30.482 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.483+0000 7f26aa800640 1 -- start start 2024-05-26T15:43:30.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.484+0000 7f26aa800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26a41f5ad0 0x7f26a41f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.484+0000 7f26aa800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415edc0 0x7f26a41539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.484+0000 7f26aa800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26a415f220 0x7f26a4153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.484+0000 7f26aa800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a414f710 con 0x7f26a41f5ad0 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.484+0000 7f26aa800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4150220 con 0x7f26a415f220 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.484+0000 7f26aa800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4150500 con 0x7f26a415edc0 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.485+0000 7f26a3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26a41f5ad0 0x7f26a41f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.485+0000 7f26a3400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26a41f5ad0 0x7f26a41f2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:39314/0 (socket says 172.21.15.8:39314) 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.485+0000 7f26a3400640 1 -- 172.21.15.8:0/3028322761 learned_addr learned my addr 172.21.15.8:0/3028322761 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.485+0000 7f26a2a00640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415edc0 0x7f26a41539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.485+0000 7f26a3e00640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26a415f220 0x7f26a4153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.485+0000 7f26a3400640 1 -- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415edc0 msgr2=0x7f26a41539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.485+0000 7f26a3400640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415edc0 0x7f26a41539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.485+0000 7f26a3400640 1 -- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26a415f220 msgr2=0x7f26a4153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.485+0000 7f26a3400640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26a415f220 0x7f26a4153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.485+0000 7f26a3400640 1 -- 172.21.15.8:0/3028322761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a41507e0 con 0x7f26a41f5ad0 2024-05-26T15:43:30.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.486+0000 7f26a3400640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26a41f5ad0 0x7f26a41f2c60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2694000c00 tx=0x7f2694000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.486+0000 7f269b400640 1 -- 172.21.15.8:0/3028322761 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694004cb0 con 0x7f26a41f5ad0 2024-05-26T15:43:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.486+0000 7f269b400640 1 -- 172.21.15.8:0/3028322761 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2694004e10 con 0x7f26a41f5ad0 2024-05-26T15:43:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.486+0000 7f269b400640 1 -- 172.21.15.8:0/3028322761 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26940072b0 con 0x7f26a41f5ad0 2024-05-26T15:43:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.486+0000 7f26aa800640 1 -- 172.21.15.8:0/3028322761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a4150ac0 con 0x7f26a41f5ad0 2024-05-26T15:43:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.486+0000 7f26aa800640 1 -- 172.21.15.8:0/3028322761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a41f5eb0 con 0x7f26a41f5ad0 2024-05-26T15:43:30.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.487+0000 7f26aa800640 1 -- 172.21.15.8:0/3028322761 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a40681d0 con 0x7f26a41f5ad0 2024-05-26T15:43:30.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.489+0000 7f269b400640 1 -- 172.21.15.8:0/3028322761 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f269402f030 con 0x7f26a41f5ad0 2024-05-26T15:43:30.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.489+0000 7f269b400640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f268006ac00 0x7f268006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.490+0000 7f269b400640 1 -- 172.21.15.8:0/3028322761 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f26940a8a20 con 0x7f26a41f5ad0 2024-05-26T15:43:30.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.490+0000 7f26a2a00640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f268006ac00 0x7f268006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.490 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.491+0000 7f26a2a00640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f268006ac00 0x7f268006d0c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f268c009fd0 tx=0x7f268c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:30.493 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.494+0000 7f269b400640 1 -- 172.21.15.8:0/3028322761 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2694077810 con 0x7f26a41f5ad0 2024-05-26T15:43:30.688 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.689+0000 7f26aa800640 1 -- 172.21.15.8:0/3028322761 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26a40cda30 con 0x7f268006ac00 2024-05-26T15:43:30.694 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.696+0000 7f269b400640 1 -- 172.21.15.8:0/3028322761 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48207 (secure 0 0 0) 0x7f268c00f050 con 0x7f268006ac00 2024-05-26T15:43:30.695 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:30.696 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:43:30.697 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 -- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f268006ac00 msgr2=0x7f268006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f268006ac00 0x7f268006d0c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f268c009fd0 tx=0x7f268c00b040 comp rx=0 tx=0).stop 2024-05-26T15:43:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 -- 172.21.15.8:0/3028322761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26a41f5ad0 msgr2=0x7f26a41f2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26a41f5ad0 0x7f26a41f2c60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f2694000c00 tx=0x7f2694000fe0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 -- 172.21.15.8:0/3028322761 shutdown_connections 2024-05-26T15:43:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f268006ac00 0x7f268006d0c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f26a415f220 0x7f26a4153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f26a415edc0 0x7f26a41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 --2- 172.21.15.8:0/3028322761 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f26a41f5ad0 0x7f26a41f2c60 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 -- 172.21.15.8:0/3028322761 >> 172.21.15.8:0/3028322761 conn(0x7f26a40b0570 msgr2=0x7f26a40b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:30.698 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 -- 172.21.15.8:0/3028322761 shutdown_connections 2024-05-26T15:43:30.699 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.699+0000 7f26aa800640 1 -- 172.21.15.8:0/3028322761 wait complete. 2024-05-26T15:43:30.718 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-05-26T15:43:30.251102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255948,"kb_used_data":7020,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754718772,"statfs":{"total":773094113280,"available":772832022528,"internally_reserved":0,"allocated":7188480,"data_stored":3901169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9613,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-77,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.424910"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-26T15:43:24.965224+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:43:24.965224+0000","last_peered":"2024-05-26T15:43:24.965224+0000","last_clean":"2024-05-26T15:43:24.965224+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:43:24.965224+0000","last_undegraded":"2024-05-26T15:43:24.965224+0000","last_fullsized":"2024-05-26T15:43:24.965224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1343488,"data_stored":928525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.1739999999999999,"15min":1.1579999999999999},"min":{"1min":0.98899999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.7849999999999999,"5min":1.802,"15min":1.802},"last":1.552},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1439999999999999,"15min":1.1299999999999999},"min":{"1min":0.89700000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.224,"15min":1.2310000000000001},"min":{"1min":0.71199999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5720000000000001,"5min":1.887,"15min":1.887},"last":1.327},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.264,"15min":1.27},"min":{"1min":0.89300000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.601,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.339,"15min":1.327},"min":{"1min":0.83799999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7170000000000001,"5min":1.865,"15min":1.865},"last":1.149},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2969999999999999,"15min":1.323},"min":{"1min":0.872,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.9059999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.85299999999999998}]},{"osd":3,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3149999999999999},"min":{"1min":1.0129999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7210000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.502,"5min":1.486,"15min":1.4850000000000001},"min":{"1min":1.234,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.8720000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.4490000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.4319999999999999,"15min":1.4399999999999999},"min":{"1min":1.0840000000000001,"5min":0.87,"15min":0.87},"max":{"1min":1.716,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.226},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.5720000000000001,"15min":1.569},"min":{"1min":1.2350000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.04,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.661}]},{"osd":5,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.5089999999999999,"15min":1.5409999999999999},"min":{"1min":1.0449999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.6759999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.577,"5min":1.6519999999999999,"15min":1.6559999999999999},"min":{"1min":1.272,"5min":0.998,"15min":0.998},"max":{"1min":1.8109999999999999,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.046}]},{"osd":6,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.653,"15min":1.6779999999999999},"min":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"max":{"1min":1.847,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.7849999999999999,"15min":1.8089999999999999},"min":{"1min":1.343,"5min":1.343,"15min":1.343},"max":{"1min":1.8839999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.304}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":749568,"data_stored":338685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.145,"15min":1.159},"min":{"1min":0.79500000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3180000000000001,"5min":1.736,"15min":1.736},"last":1.355},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1359999999999999,"15min":1.1040000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.627,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.82499999999999996}]},{"osd":1,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1919999999999999,"15min":1.196},"min":{"1min":0.73999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5549999999999999,"5min":1.931,"15min":1.931},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.2490000000000001,"15min":1.238},"min":{"1min":0.77200000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.649,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.778}]},{"osd":2,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.286,"15min":1.3069999999999999},"min":{"1min":0.90600000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":2.157,"15min":2.157},"last":1.246},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4610000000000001,"15min":1.502},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.794,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.4299999999999999}]},{"osd":3,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.3640000000000001,"15min":1.401},"min":{"1min":0.871,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.629,"5min":2.169,"15min":2.169},"last":1.478},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.5820000000000001,"15min":1.6639999999999999},"min":{"1min":1.0680000000000001,"5min":0.754,"15min":0.754},"max":{"1min":1.821,"5min":4.452,"15min":4.452},"last":1.925}]},{"osd":4,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.5700000000000001,"15min":1.635},"min":{"1min":1.054,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.9319999999999999,"5min":3.282,"15min":3.282},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.4730000000000001,"15min":1.5109999999999999},"min":{"1min":0.96499999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.7869999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.95}]},{"osd":5,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.6539999999999999,"15min":1.7210000000000001},"min":{"1min":1.0640000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.907,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":2.0619999999999998},{"interface":"front","average":{"1min":1.522,"5min":1.587,"15min":1.635},"min":{"1min":1.1799999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9219999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":2.0030000000000001}]},{"osd":7,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.722,"15min":1.792},"min":{"1min":1.117,"5min":0.755,"15min":0.755},"max":{"1min":2.0049999999999999,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.855},{"interface":"front","average":{"1min":1.593,"5min":1.7410000000000001,"15min":1.804},"min":{"1min":1.177,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.982,"5min":2.843,"15min":2.843},"last":2.1560000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":737280,"data_stored":337014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.115,"15min":1.139},"min":{"1min":0.72499999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.679,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.1339999999999999,"15min":1.0860000000000001},"min":{"1min":0.80500000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.454}]},{"osd":1,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.149,"15min":1.0980000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.73,"5min":1.758,"15min":1.758},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.1699999999999999,"15min":1.1379999999999999},"min":{"1min":0.81999999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.704,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.536}]},{"osd":2,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1850000000000001,"15min":1.1799999999999999},"min":{"1min":0.89000000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6160000000000001,"5min":1.659,"15min":1.659},"last":1.131},{"interface":"front","average":{"1min":1.254,"5min":1.29,"15min":1.2809999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.722,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.583}]},{"osd":3,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.333,"15min":1.343},"min":{"1min":0.97199999999999998,"5min":0.871,"15min":0.871},"max":{"1min":1.806,"5min":1.879,"15min":1.879},"last":1.284},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.4079999999999999,"15min":1.4239999999999999},"min":{"1min":0.97599999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6819999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.3740000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3380000000000001,"15min":1.3360000000000001},"min":{"1min":0.85199999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.823,"5min":2.077,"15min":2.077},"last":1},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5640000000000001,"15min":1.5800000000000001},"min":{"1min":1.3009999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.9470000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.613}]},{"osd":6,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.494,"15min":1.5269999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.96,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.502},{"interface":"front","average":{"1min":1.472,"5min":1.4730000000000001,"15min":1.4630000000000001},"min":{"1min":1.0920000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.9099999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.335}]},{"osd":7,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.6040000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.036,"15min":1.036},"max":{"1min":1.889,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.698},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.629,"15min":1.645},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.0449999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.6459999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":749568,"data_stored":338622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.173,"15min":1.1699999999999999},"min":{"1min":0.76300000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":3.5049999999999999,"5min":3.5049999999999999,"15min":3.5049999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.232,"15min":1.246},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.7330000000000001,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.393}]},{"osd":1,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.264,"15min":1.264},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.129},"min":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7190000000000001,"5min":1.75,"15min":1.75},"last":1.4670000000000001}]},{"osd":2,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.282,"15min":1.268},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3049999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6779999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.81899999999999995}]},{"osd":3,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.278,"15min":1.276},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.472,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.462,"15min":1.484},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.8089999999999999,"5min":2.734,"15min":2.734},"last":1.4339999999999999}]},{"osd":5,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.478,"15min":1.494},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.794,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.101},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.476,"15min":1.5029999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.7689999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.5880000000000001}]},{"osd":6,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.538,"15min":1.575},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.8680000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.653},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.6220000000000001,"15min":1.6519999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.931,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.2829999999999999}]},{"osd":7,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.609,"15min":1.6619999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8300000000000001,"5min":4.008,"15min":4.008},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.7190000000000001,"15min":1.7609999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.96,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.9079999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":761856,"data_stored":346863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.89300000000000002,"15min":0.90300000000000002},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.284,"5min":1.508,"15min":1.508},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.97299999999999998,"15min":0.95599999999999996},"min":{"1min":0.69499999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.492,"5min":1.659,"15min":1.659},"last":0.56399999999999995}]},{"osd":1,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.96099999999999997,"15min":0.99199999999999999},"min":{"1min":0.59899999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2310000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.03},{"interface":"front","average":{"1min":1.103,"5min":1.1739999999999999,"15min":1.208},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.4650000000000001}]},{"osd":2,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.125,"15min":1.161},"min":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7969999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.157},{"interface":"front","average":{"1min":1.3,"5min":1.2310000000000001,"15min":1.2170000000000001},"min":{"1min":0.78800000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8340000000000001,"5min":1.954,"15min":1.954},"last":1.2569999999999999}]},{"osd":4,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.3100000000000001,"15min":1.306},"min":{"1min":1.0269999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.9019999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.4039999999999999,"15min":1.4359999999999999},"min":{"1min":1.0069999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.696,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.512}]},{"osd":5,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.464,"15min":1.488},"min":{"1min":1.034,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.845,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4199999999999999,"15min":1.4219999999999999},"min":{"1min":1.099,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7909999999999999,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.679}]},{"osd":6,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5049999999999999,"15min":1.534},"min":{"1min":1.2290000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.0459999999999998,"5min":2.863,"15min":2.863},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.589,"15min":1.6040000000000001},"min":{"1min":1.26,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.2589999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.7210000000000001}]},{"osd":7,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.4910000000000001,"15min":1.5029999999999999},"min":{"1min":1.0820000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.921,"5min":2.306,"15min":2.306},"last":1.401},{"interface":"front","average":{"1min":1.548,"5min":1.5649999999999999,"15min":1.5880000000000001},"min":{"1min":1.2150000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.99,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.5980000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":753664,"data_stored":345822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0009999999999999,"15min":1.022},"min":{"1min":0.59999999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.262,"5min":1.47,"15min":1.47},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.141,"15min":1.127},"min":{"1min":0.74199999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.76100000000000001}]},{"osd":1,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.03,"15min":1.0529999999999999},"min":{"1min":0.70999999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.876},{"interface":"front","average":{"1min":1.056,"5min":1.1910000000000001,"15min":1.1879999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3819999999999999,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.79900000000000004}]},{"osd":3,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.0700000000000001,"15min":1.0449999999999999},"min":{"1min":0.76000000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.726,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2430000000000001,"15min":1.282},"min":{"1min":0.66800000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.77,"5min":2.903,"15min":2.903},"last":1.0740000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.528,"15min":1.4930000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.7949999999999999,"5min":10.438000000000001,"15min":10.438000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4590000000000001,"15min":1.4770000000000001},"min":{"1min":0.98599999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.9990000000000001,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.5700000000000001}]},{"osd":5,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.502,"15min":1.518},"min":{"1min":1.171,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1970000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.6739999999999999,"15min":1.6559999999999999},"min":{"1min":1.1879999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.1930000000000001,"5min":10.798999999999999,"15min":10.798999999999999},"last":1.3180000000000001}]},{"osd":6,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.6259999999999999,"15min":1.6000000000000001},"min":{"1min":1.155,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":2.0840000000000001,"5min":7.851,"15min":7.851},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.6950000000000001,"15min":1.6359999999999999},"min":{"1min":1.127,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.1019999999999999,"5min":10.672000000000001,"15min":10.672000000000001},"last":1.4219999999999999}]},{"osd":7,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.7669999999999999,"15min":1.7450000000000001},"min":{"1min":1.224,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":2.262,"5min":10.249000000000001,"15min":10.249000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.6180000000000001,"15min":1.6140000000000001},"min":{"1min":1.3839999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.99,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.629}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":753664,"data_stored":338200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.95699999999999996,"15min":1.052},"min":{"1min":0.45000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.4410000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0369999999999999,"15min":1.1060000000000001},"min":{"1min":0.626,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.4650000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.377}]},{"osd":2,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54600000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3200000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1910000000000001,"15min":1.2769999999999999},"min":{"1min":0.69299999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.601,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.4350000000000001}]},{"osd":3,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2789999999999999,"15min":1.3520000000000001},"min":{"1min":0.89300000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.694,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.141,"15min":1.24},"min":{"1min":0.65500000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.714,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.65500000000000003}]},{"osd":4,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.331,"15min":1.371},"min":{"1min":0.98799999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.8300000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.323},{"interface":"front","average":{"1min":1.343,"5min":1.3480000000000001,"15min":1.4019999999999999},"min":{"1min":1.1100000000000001,"5min":0.75,"15min":0.75},"max":{"1min":1.6639999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.496}]},{"osd":5,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3859999999999999,"15min":1.4810000000000001},"min":{"1min":0.95099999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8140000000000001,"5min":2.621,"15min":2.621},"last":1.575},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.524,"15min":1.615},"min":{"1min":1.026,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.802,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.7969999999999999}]},{"osd":6,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4450000000000001,"15min":1.5189999999999999},"min":{"1min":0.86899999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.6639999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.6459999999999999},"min":{"1min":0.95999999999999996,"5min":0.755,"15min":0.755},"max":{"1min":1.9790000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.627}]},{"osd":7,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.6040000000000001,"15min":1.7010000000000001},"min":{"1min":1.196,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.954,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.907},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.5309999999999999,"15min":1.611},"min":{"1min":0.93899999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8600000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.518}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1339392,"data_stored":927438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.91400000000000003},"min":{"1min":0.379,"5min":0.307,"15min":0.307},"max":{"1min":1.2250000000000001,"5min":1.454,"15min":1.454},"last":1.4810000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.95299999999999996,"15min":0.999},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.2909999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.048,"15min":1.097},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5589999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":1.006,"15min":1.032},"min":{"1min":0.53500000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4810000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2290000000000001,"15min":1.2949999999999999},"min":{"1min":0.61399999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.615,"5min":4.024,"15min":4.024},"last":1.161},{"interface":"front","average":{"1min":1.008,"5min":1.1899999999999999,"15min":1.2509999999999999},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.599,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":1.1180000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.379,"15min":1.4650000000000001},"min":{"1min":0.81899999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.452,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.302},{"interface":"front","average":{"1min":1.048,"5min":1.1299999999999999,"15min":1.1479999999999999},"min":{"1min":0.89200000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.448,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.81899999999999995}]},{"osd":5,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4810000000000001,"15min":1.54},"min":{"1min":0.88400000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.6699999999999999,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.399},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4670000000000001,"15min":1.524},"min":{"1min":0.95999999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.708,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.3560000000000001}]},{"osd":6,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.2170000000000001,"15min":1.2629999999999999},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4850000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.446,"15min":1.522},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.7729999999999999,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.2350000000000001}]},{"osd":7,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.5640000000000001,"15min":1.629},"min":{"1min":1.0469999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.6990000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.571},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.3260000000000001,"15min":1.365},"min":{"1min":0.78900000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.752,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.264}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:43:30.720 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:43:30.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.931+0000 7f1483e00640 1 Processor -- start 2024-05-26T15:43:30.930 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.931+0000 7f1483e00640 1 -- start start 2024-05-26T15:43:30.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.933+0000 7f1483e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f147c14af90 0x7f147c0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.933+0000 7f1483e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c0af330 con 0x7f147c0c4090 2024-05-26T15:43:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.933+0000 7f1483e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147c0ae720 con 0x7f147c0c3cb0 2024-05-26T15:43:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.933+0000 7f1483e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147c0aea00 con 0x7f147c14af90 2024-05-26T15:43:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.933+0000 7f1481e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f147c14af90 0x7f147c0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.933+0000 7f1480a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f147c0c4090 0x7f147c14a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34800/0 (socket says 172.21.15.8:34800) 2024-05-26T15:43:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.933+0000 7f1480a00640 1 -- 172.21.15.8:0/2651366620 learned_addr learned my addr 172.21.15.8:0/2651366620 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:30.932 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.934+0000 7f1481e00640 1 -- 172.21.15.8:0/2651366620 >> v1:172.21.15.47:6789/0 conn(0x7f147c0c3cb0 legacy=0x7f147c06b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.934+0000 7f1481e00640 1 -- 172.21.15.8:0/2651366620 >> v1:172.21.15.8:6789/0 conn(0x7f147c0c4090 legacy=0x7f147c14a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.934+0000 7f1481e00640 1 -- 172.21.15.8:0/2651366620 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c0aece0 con 0x7f147c14af90 2024-05-26T15:43:30.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.935+0000 7f1481e00640 1 --2- 172.21.15.8:0/2651366620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c14af90 0x7f147c0ae090 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1474009d90 tx=0x7f147402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19df75cb53df8b84 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.935+0000 7f147be00640 1 -- 172.21.15.8:0/2651366620 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474007740 con 0x7f147c14af90 2024-05-26T15:43:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.935+0000 7f147be00640 1 -- 172.21.15.8:0/2651366620 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147402d050 con 0x7f147c14af90 2024-05-26T15:43:30.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.935+0000 7f147be00640 1 -- 172.21.15.8:0/2651366620 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1474007ac0 con 0x7f147c14af90 2024-05-26T15:43:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.936+0000 7f1483e00640 1 -- 172.21.15.8:0/2651366620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c14af90 msgr2=0x7f147c0ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.936+0000 7f1483e00640 1 --2- 172.21.15.8:0/2651366620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c14af90 0x7f147c0ae090 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1474009d90 tx=0x7f147402a6f0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.936+0000 7f1483e00640 1 -- 172.21.15.8:0/2651366620 shutdown_connections 2024-05-26T15:43:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.936+0000 7f1483e00640 1 --2- 172.21.15.8:0/2651366620 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c14af90 0x7f147c0ae090 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.936+0000 7f1483e00640 1 -- 172.21.15.8:0/2651366620 >> 172.21.15.8:0/2651366620 conn(0x7f147c0b2560 msgr2=0x7f147c0b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.936+0000 7f1483e00640 1 -- 172.21.15.8:0/2651366620 shutdown_connections 2024-05-26T15:43:30.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.936+0000 7f1483e00640 1 -- 172.21.15.8:0/2651366620 wait complete. 2024-05-26T15:43:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.939+0000 7f1483e00640 1 Processor -- start 2024-05-26T15:43:30.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.939+0000 7f1483e00640 1 -- start start 2024-05-26T15:43:30.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.940+0000 7f1483e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f147c0c3cb0 0x7f147c0c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.940+0000 7f1483e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c0c4090 0x7f147c15fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.940+0000 7f1483e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f147c14af90 0x7f147c098b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.940+0000 7f1483e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0c5000 con 0x7f147c0c4090 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.940+0000 7f1483e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0c52e0 con 0x7f147c0c3cb0 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.940+0000 7f1483e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c0c55c0 con 0x7f147c14af90 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1480a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c0c4090 0x7f147c15fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1480a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c0c4090 0x7f147c15fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34056/0 (socket says 172.21.15.8:34056) 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1480a00640 1 -- 172.21.15.8:0/4022277622 learned_addr learned my addr 172.21.15.8:0/4022277622 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1481400640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f147c0c3cb0 0x7f147c0c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1481e00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f147c14af90 0x7f147c098b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1480a00640 1 -- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f147c14af90 msgr2=0x7f147c098b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1480a00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f147c14af90 0x7f147c098b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1480a00640 1 -- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f147c0c3cb0 msgr2=0x7f147c0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:30.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1480a00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f147c0c3cb0 0x7f147c0c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1480a00640 1 -- 172.21.15.8:0/4022277622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009a70 con 0x7f147c0c4090 2024-05-26T15:43:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1481e00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f147c14af90 0x7f147c098b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.941+0000 7f1480a00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c0c4090 0x7f147c15fd30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f146800c4a0 tx=0x7f146800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:30.941 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.942+0000 7f1479600640 1 -- 172.21.15.8:0/4022277622 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468005ce0 con 0x7f147c0c4090 2024-05-26T15:43:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.942+0000 7f1479600640 1 -- 172.21.15.8:0/4022277622 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468005e40 con 0x7f147c0c4090 2024-05-26T15:43:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.942+0000 7f1479600640 1 -- 172.21.15.8:0/4022277622 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468007270 con 0x7f147c0c4090 2024-05-26T15:43:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.942+0000 7f1483e00640 1 -- 172.21.15.8:0/4022277622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c0c58a0 con 0x7f147c0c4090 2024-05-26T15:43:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.942+0000 7f1483e00640 1 -- 172.21.15.8:0/4022277622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147c15cfa0 con 0x7f147c0c4090 2024-05-26T15:43:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.943+0000 7f1483e00640 1 -- 172.21.15.8:0/4022277622 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147c0681d0 con 0x7f147c0c4090 2024-05-26T15:43:30.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.944+0000 7f1479600640 1 -- 172.21.15.8:0/4022277622 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f14680073d0 con 0x7f147c0c4090 2024-05-26T15:43:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.945+0000 7f1479600640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f145c06ac30 0x7f145c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:30.943 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.945+0000 7f1479600640 1 -- 172.21.15.8:0/4022277622 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f14680885b0 con 0x7f147c0c4090 2024-05-26T15:43:30.944 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.946+0000 7f1481400640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f145c06ac30 0x7f145c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:30.945 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.947+0000 7f1481400640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f145c06ac30 0x7f145c06d0f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f147c09e580 tx=0x7f1470009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:30.949 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:30.951+0000 7f1479600640 1 -- 172.21.15.8:0/4022277622 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1468053a30 con 0x7f147c0c4090 2024-05-26T15:43:31.147 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.149+0000 7f1483e00640 1 -- 172.21.15.8:0/4022277622 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f147c0b22d0 con 0x7f145c06ac30 2024-05-26T15:43:31.154 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.155+0000 7f1479600640 1 -- 172.21.15.8:0/4022277622 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48207 (secure 0 0 0) 0x7f1470001c70 con 0x7f145c06ac30 2024-05-26T15:43:31.155 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:31.155 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 -- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f145c06ac30 msgr2=0x7f145c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f145c06ac30 0x7f145c06d0f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f147c09e580 tx=0x7f1470009040 comp rx=0 tx=0).stop 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 -- 172.21.15.8:0/4022277622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c0c4090 msgr2=0x7f147c15fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c0c4090 0x7f147c15fd30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f146800c4a0 tx=0x7f146800c960 comp rx=0 tx=0).stop 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 -- 172.21.15.8:0/4022277622 shutdown_connections 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f147c14af90 0x7f147c098b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f147c0c4090 0x7f147c15fd30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f145c06ac30 0x7f145c06d0f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 --2- 172.21.15.8:0/4022277622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f147c0c3cb0 0x7f147c0c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 -- 172.21.15.8:0/4022277622 >> 172.21.15.8:0/4022277622 conn(0x7f147c0b2560 msgr2=0x7f147c0b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 -- 172.21.15.8:0/4022277622 shutdown_connections 2024-05-26T15:43:31.157 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.158+0000 7f1483e00640 1 -- 172.21.15.8:0/4022277622 wait complete. 2024-05-26T15:43:31.175 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-05-26T15:43:30.251102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255948,"kb_used_data":7020,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754718772,"statfs":{"total":773094113280,"available":772832022528,"internally_reserved":0,"allocated":7188480,"data_stored":3901169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9613,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-77,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.424910"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-26T15:43:24.965224+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:43:24.965224+0000","last_peered":"2024-05-26T15:43:24.965224+0000","last_clean":"2024-05-26T15:43:24.965224+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:43:24.965224+0000","last_undegraded":"2024-05-26T15:43:24.965224+0000","last_fullsized":"2024-05-26T15:43:24.965224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1343488,"data_stored":928525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.1739999999999999,"15min":1.1579999999999999},"min":{"1min":0.98899999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.7849999999999999,"5min":1.802,"15min":1.802},"last":1.552},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1439999999999999,"15min":1.1299999999999999},"min":{"1min":0.89700000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.224,"15min":1.2310000000000001},"min":{"1min":0.71199999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5720000000000001,"5min":1.887,"15min":1.887},"last":1.327},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.264,"15min":1.27},"min":{"1min":0.89300000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.601,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.339,"15min":1.327},"min":{"1min":0.83799999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7170000000000001,"5min":1.865,"15min":1.865},"last":1.149},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2969999999999999,"15min":1.323},"min":{"1min":0.872,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.9059999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.85299999999999998}]},{"osd":3,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3149999999999999},"min":{"1min":1.0129999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7210000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.502,"5min":1.486,"15min":1.4850000000000001},"min":{"1min":1.234,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.8720000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.4490000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.4319999999999999,"15min":1.4399999999999999},"min":{"1min":1.0840000000000001,"5min":0.87,"15min":0.87},"max":{"1min":1.716,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.226},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.5720000000000001,"15min":1.569},"min":{"1min":1.2350000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.04,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.661}]},{"osd":5,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.5089999999999999,"15min":1.5409999999999999},"min":{"1min":1.0449999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.6759999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.577,"5min":1.6519999999999999,"15min":1.6559999999999999},"min":{"1min":1.272,"5min":0.998,"15min":0.998},"max":{"1min":1.8109999999999999,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.046}]},{"osd":6,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.653,"15min":1.6779999999999999},"min":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"max":{"1min":1.847,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.7849999999999999,"15min":1.8089999999999999},"min":{"1min":1.343,"5min":1.343,"15min":1.343},"max":{"1min":1.8839999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.304}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":749568,"data_stored":338685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.145,"15min":1.159},"min":{"1min":0.79500000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3180000000000001,"5min":1.736,"15min":1.736},"last":1.355},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1359999999999999,"15min":1.1040000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.627,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.82499999999999996}]},{"osd":1,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1919999999999999,"15min":1.196},"min":{"1min":0.73999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5549999999999999,"5min":1.931,"15min":1.931},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.2490000000000001,"15min":1.238},"min":{"1min":0.77200000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.649,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.778}]},{"osd":2,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.286,"15min":1.3069999999999999},"min":{"1min":0.90600000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":2.157,"15min":2.157},"last":1.246},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4610000000000001,"15min":1.502},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.794,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.4299999999999999}]},{"osd":3,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.3640000000000001,"15min":1.401},"min":{"1min":0.871,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.629,"5min":2.169,"15min":2.169},"last":1.478},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.5820000000000001,"15min":1.6639999999999999},"min":{"1min":1.0680000000000001,"5min":0.754,"15min":0.754},"max":{"1min":1.821,"5min":4.452,"15min":4.452},"last":1.925}]},{"osd":4,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.5700000000000001,"15min":1.635},"min":{"1min":1.054,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.9319999999999999,"5min":3.282,"15min":3.282},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.4730000000000001,"15min":1.5109999999999999},"min":{"1min":0.96499999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.7869999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.95}]},{"osd":5,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.6539999999999999,"15min":1.7210000000000001},"min":{"1min":1.0640000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.907,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":2.0619999999999998},{"interface":"front","average":{"1min":1.522,"5min":1.587,"15min":1.635},"min":{"1min":1.1799999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9219999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":2.0030000000000001}]},{"osd":7,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.722,"15min":1.792},"min":{"1min":1.117,"5min":0.755,"15min":0.755},"max":{"1min":2.0049999999999999,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.855},{"interface":"front","average":{"1min":1.593,"5min":1.7410000000000001,"15min":1.804},"min":{"1min":1.177,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.982,"5min":2.843,"15min":2.843},"last":2.1560000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":737280,"data_stored":337014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.115,"15min":1.139},"min":{"1min":0.72499999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.679,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.1339999999999999,"15min":1.0860000000000001},"min":{"1min":0.80500000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.454}]},{"osd":1,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.149,"15min":1.0980000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.73,"5min":1.758,"15min":1.758},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.1699999999999999,"15min":1.1379999999999999},"min":{"1min":0.81999999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.704,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.536}]},{"osd":2,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1850000000000001,"15min":1.1799999999999999},"min":{"1min":0.89000000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6160000000000001,"5min":1.659,"15min":1.659},"last":1.131},{"interface":"front","average":{"1min":1.254,"5min":1.29,"15min":1.2809999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.722,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.583}]},{"osd":3,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.333,"15min":1.343},"min":{"1min":0.97199999999999998,"5min":0.871,"15min":0.871},"max":{"1min":1.806,"5min":1.879,"15min":1.879},"last":1.284},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.4079999999999999,"15min":1.4239999999999999},"min":{"1min":0.97599999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6819999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.3740000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3380000000000001,"15min":1.3360000000000001},"min":{"1min":0.85199999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.823,"5min":2.077,"15min":2.077},"last":1},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5640000000000001,"15min":1.5800000000000001},"min":{"1min":1.3009999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.9470000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.613}]},{"osd":6,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.494,"15min":1.5269999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.96,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.502},{"interface":"front","average":{"1min":1.472,"5min":1.4730000000000001,"15min":1.4630000000000001},"min":{"1min":1.0920000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.9099999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.335}]},{"osd":7,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.6040000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.036,"15min":1.036},"max":{"1min":1.889,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.698},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.629,"15min":1.645},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.0449999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.6459999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":749568,"data_stored":338622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.173,"15min":1.1699999999999999},"min":{"1min":0.76300000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":3.5049999999999999,"5min":3.5049999999999999,"15min":3.5049999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.232,"15min":1.246},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.7330000000000001,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.393}]},{"osd":1,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.264,"15min":1.264},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.129},"min":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7190000000000001,"5min":1.75,"15min":1.75},"last":1.4670000000000001}]},{"osd":2,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.282,"15min":1.268},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3049999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6779999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.81899999999999995}]},{"osd":3,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.278,"15min":1.276},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.472,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.462,"15min":1.484},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.8089999999999999,"5min":2.734,"15min":2.734},"last":1.4339999999999999}]},{"osd":5,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.478,"15min":1.494},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.794,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.101},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.476,"15min":1.5029999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.7689999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.5880000000000001}]},{"osd":6,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.538,"15min":1.575},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.8680000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.653},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.6220000000000001,"15min":1.6519999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.931,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.2829999999999999}]},{"osd":7,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.609,"15min":1.6619999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8300000000000001,"5min":4.008,"15min":4.008},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.7190000000000001,"15min":1.7609999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.96,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.9079999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":761856,"data_stored":346863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.89300000000000002,"15min":0.90300000000000002},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.284,"5min":1.508,"15min":1.508},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.97299999999999998,"15min":0.95599999999999996},"min":{"1min":0.69499999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.492,"5min":1.659,"15min":1.659},"last":0.56399999999999995}]},{"osd":1,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.96099999999999997,"15min":0.99199999999999999},"min":{"1min":0.59899999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2310000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.03},{"interface":"front","average":{"1min":1.103,"5min":1.1739999999999999,"15min":1.208},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.4650000000000001}]},{"osd":2,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.125,"15min":1.161},"min":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7969999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.157},{"interface":"front","average":{"1min":1.3,"5min":1.2310000000000001,"15min":1.2170000000000001},"min":{"1min":0.78800000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8340000000000001,"5min":1.954,"15min":1.954},"last":1.2569999999999999}]},{"osd":4,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.3100000000000001,"15min":1.306},"min":{"1min":1.0269999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.9019999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.4039999999999999,"15min":1.4359999999999999},"min":{"1min":1.0069999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.696,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.512}]},{"osd":5,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.464,"15min":1.488},"min":{"1min":1.034,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.845,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4199999999999999,"15min":1.4219999999999999},"min":{"1min":1.099,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7909999999999999,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.679}]},{"osd":6,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5049999999999999,"15min":1.534},"min":{"1min":1.2290000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.0459999999999998,"5min":2.863,"15min":2.863},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.589,"15min":1.6040000000000001},"min":{"1min":1.26,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.2589999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.7210000000000001}]},{"osd":7,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.4910000000000001,"15min":1.5029999999999999},"min":{"1min":1.0820000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.921,"5min":2.306,"15min":2.306},"last":1.401},{"interface":"front","average":{"1min":1.548,"5min":1.5649999999999999,"15min":1.5880000000000001},"min":{"1min":1.2150000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.99,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.5980000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":753664,"data_stored":345822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0009999999999999,"15min":1.022},"min":{"1min":0.59999999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.262,"5min":1.47,"15min":1.47},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.141,"15min":1.127},"min":{"1min":0.74199999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.76100000000000001}]},{"osd":1,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.03,"15min":1.0529999999999999},"min":{"1min":0.70999999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.876},{"interface":"front","average":{"1min":1.056,"5min":1.1910000000000001,"15min":1.1879999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3819999999999999,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.79900000000000004}]},{"osd":3,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.0700000000000001,"15min":1.0449999999999999},"min":{"1min":0.76000000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.726,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2430000000000001,"15min":1.282},"min":{"1min":0.66800000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.77,"5min":2.903,"15min":2.903},"last":1.0740000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.528,"15min":1.4930000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.7949999999999999,"5min":10.438000000000001,"15min":10.438000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4590000000000001,"15min":1.4770000000000001},"min":{"1min":0.98599999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.9990000000000001,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.5700000000000001}]},{"osd":5,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.502,"15min":1.518},"min":{"1min":1.171,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1970000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.6739999999999999,"15min":1.6559999999999999},"min":{"1min":1.1879999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.1930000000000001,"5min":10.798999999999999,"15min":10.798999999999999},"last":1.3180000000000001}]},{"osd":6,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.6259999999999999,"15min":1.6000000000000001},"min":{"1min":1.155,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":2.0840000000000001,"5min":7.851,"15min":7.851},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.6950000000000001,"15min":1.6359999999999999},"min":{"1min":1.127,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.1019999999999999,"5min":10.672000000000001,"15min":10.672000000000001},"last":1.4219999999999999}]},{"osd":7,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.7669999999999999,"15min":1.7450000000000001},"min":{"1min":1.224,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":2.262,"5min":10.249000000000001,"15min":10.249000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.6180000000000001,"15min":1.6140000000000001},"min":{"1min":1.3839999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.99,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.629}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":753664,"data_stored":338200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.95699999999999996,"15min":1.052},"min":{"1min":0.45000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.4410000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0369999999999999,"15min":1.1060000000000001},"min":{"1min":0.626,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.4650000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.377}]},{"osd":2,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54600000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3200000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1910000000000001,"15min":1.2769999999999999},"min":{"1min":0.69299999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.601,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.4350000000000001}]},{"osd":3,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2789999999999999,"15min":1.3520000000000001},"min":{"1min":0.89300000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.694,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.141,"15min":1.24},"min":{"1min":0.65500000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.714,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.65500000000000003}]},{"osd":4,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.331,"15min":1.371},"min":{"1min":0.98799999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.8300000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.323},{"interface":"front","average":{"1min":1.343,"5min":1.3480000000000001,"15min":1.4019999999999999},"min":{"1min":1.1100000000000001,"5min":0.75,"15min":0.75},"max":{"1min":1.6639999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.496}]},{"osd":5,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3859999999999999,"15min":1.4810000000000001},"min":{"1min":0.95099999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8140000000000001,"5min":2.621,"15min":2.621},"last":1.575},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.524,"15min":1.615},"min":{"1min":1.026,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.802,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.7969999999999999}]},{"osd":6,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4450000000000001,"15min":1.5189999999999999},"min":{"1min":0.86899999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.6639999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.6459999999999999},"min":{"1min":0.95999999999999996,"5min":0.755,"15min":0.755},"max":{"1min":1.9790000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.627}]},{"osd":7,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.6040000000000001,"15min":1.7010000000000001},"min":{"1min":1.196,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.954,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.907},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.5309999999999999,"15min":1.611},"min":{"1min":0.93899999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8600000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.518}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1339392,"data_stored":927438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.91400000000000003},"min":{"1min":0.379,"5min":0.307,"15min":0.307},"max":{"1min":1.2250000000000001,"5min":1.454,"15min":1.454},"last":1.4810000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.95299999999999996,"15min":0.999},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.2909999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.048,"15min":1.097},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5589999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":1.006,"15min":1.032},"min":{"1min":0.53500000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4810000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2290000000000001,"15min":1.2949999999999999},"min":{"1min":0.61399999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.615,"5min":4.024,"15min":4.024},"last":1.161},{"interface":"front","average":{"1min":1.008,"5min":1.1899999999999999,"15min":1.2509999999999999},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.599,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":1.1180000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.379,"15min":1.4650000000000001},"min":{"1min":0.81899999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.452,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.302},{"interface":"front","average":{"1min":1.048,"5min":1.1299999999999999,"15min":1.1479999999999999},"min":{"1min":0.89200000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.448,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.81899999999999995}]},{"osd":5,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4810000000000001,"15min":1.54},"min":{"1min":0.88400000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.6699999999999999,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.399},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4670000000000001,"15min":1.524},"min":{"1min":0.95999999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.708,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.3560000000000001}]},{"osd":6,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.2170000000000001,"15min":1.2629999999999999},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4850000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.446,"15min":1.522},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.7729999999999999,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.2350000000000001}]},{"osd":7,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.5640000000000001,"15min":1.629},"min":{"1min":1.0469999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.6990000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.571},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.3260000000000001,"15min":1.365},"min":{"1min":0.78900000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.752,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.264}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:43:31.177 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-26T15:43:31.177 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:43:31.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.390+0000 7f6374a00640 1 Processor -- start 2024-05-26T15:43:31.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.390+0000 7f6374a00640 1 -- start start 2024-05-26T15:43:31.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.392+0000 7f6374a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6370154f50 0x7f63700b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.392+0000 7f6374a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f637015ae70 0x7f637015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.392+0000 7f6374a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637015b640 con 0x7f637015f0c0 2024-05-26T15:43:31.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.392+0000 7f6374a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637015bee0 con 0x7f637015ae70 2024-05-26T15:43:31.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.392+0000 7f6374a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63700b0ba0 con 0x7f6370154f50 2024-05-26T15:43:31.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.392+0000 7f6367e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f637015ae70 0x7f637015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.392+0000 7f6367e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f637015ae70 0x7f637015eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34070/0 (socket says 172.21.15.8:34070) 2024-05-26T15:43:31.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.392+0000 7f6367e00640 1 -- 172.21.15.8:0/1166225126 learned_addr learned my addr 172.21.15.8:0/1166225126 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:31.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.392+0000 7f636e800640 1 --2- 172.21.15.8:0/1166225126 >> v2:172.21.15.47:3300/0 conn(0x7f6370154f50 0x7f63700b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.393+0000 7f6367e00640 1 -- 172.21.15.8:0/1166225126 >> v2:172.21.15.47:3300/0 conn(0x7f6370154f50 msgr2=0x7f63700b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:31.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.393+0000 7f6367e00640 1 --2- 172.21.15.8:0/1166225126 >> v2:172.21.15.47:3300/0 conn(0x7f6370154f50 0x7f63700b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.393+0000 7f6367e00640 1 -- 172.21.15.8:0/1166225126 >> v1:172.21.15.47:6789/0 conn(0x7f637015f0c0 legacy=0x7f63700c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:31.392 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.393+0000 7f6367e00640 1 -- 172.21.15.8:0/1166225126 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637015b920 con 0x7f637015ae70 2024-05-26T15:43:31.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.394+0000 7f6367e00640 1 --2- 172.21.15.8:0/1166225126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637015ae70 0x7f637015eb80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f63700ce600 tx=0x7f635802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a46533674ea440a server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:31.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.394+0000 7f636de00640 1 -- 172.21.15.8:0/1166225126 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358032440 con 0x7f637015ae70 2024-05-26T15:43:31.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.394+0000 7f636de00640 1 -- 172.21.15.8:0/1166225126 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63580325a0 con 0x7f637015ae70 2024-05-26T15:43:31.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.394+0000 7f636de00640 1 -- 172.21.15.8:0/1166225126 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358032930 con 0x7f637015ae70 2024-05-26T15:43:31.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.395+0000 7f6374a00640 1 -- 172.21.15.8:0/1166225126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637015ae70 msgr2=0x7f637015eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.395+0000 7f6374a00640 1 --2- 172.21.15.8:0/1166225126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637015ae70 0x7f637015eb80 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f63700ce600 tx=0x7f635802a230 comp rx=0 tx=0).stop 2024-05-26T15:43:31.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.395+0000 7f6374a00640 1 -- 172.21.15.8:0/1166225126 shutdown_connections 2024-05-26T15:43:31.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.395+0000 7f6374a00640 1 --2- 172.21.15.8:0/1166225126 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f637015ae70 0x7f637015eb80 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.395+0000 7f6374a00640 1 --2- 172.21.15.8:0/1166225126 >> v2:172.21.15.47:3300/0 conn(0x7f6370154f50 0x7f63700b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.395+0000 7f6374a00640 1 -- 172.21.15.8:0/1166225126 >> 172.21.15.8:0/1166225126 conn(0x7f6370070480 msgr2=0x7f6370070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:31.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.395+0000 7f6374a00640 1 -- 172.21.15.8:0/1166225126 shutdown_connections 2024-05-26T15:43:31.394 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.395+0000 7f6374a00640 1 -- 172.21.15.8:0/1166225126 wait complete. 2024-05-26T15:43:31.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.397+0000 7f6374a00640 1 Processor -- start 2024-05-26T15:43:31.395 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.397+0000 7f6374a00640 1 -- start start 2024-05-26T15:43:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.398+0000 7f6374a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6370154f50 0x7f6370141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.398+0000 7f6374a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f637015ae70 0x7f63700c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.398+0000 7f6374a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f637015f0c0 0x7f63700c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.398+0000 7f6374a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63700ca2c0 con 0x7f6370154f50 2024-05-26T15:43:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.398+0000 7f6374a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63700ca030 con 0x7f637015f0c0 2024-05-26T15:43:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.398+0000 7f6374a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637013f400 con 0x7f637015ae70 2024-05-26T15:43:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.398+0000 7f636e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6370154f50 0x7f6370141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.398+0000 7f636e800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6370154f50 0x7f6370141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34078/0 (socket says 172.21.15.8:34078) 2024-05-26T15:43:31.397 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.398+0000 7f636e800640 1 -- 172.21.15.8:0/1083832242 learned_addr learned my addr 172.21.15.8:0/1083832242 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f636e800640 1 -- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f637015ae70 msgr2=0x7f63700c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f636e800640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f637015ae70 0x7f63700c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.398 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f636e800640 1 -- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f637015f0c0 msgr2=0x7f63700c42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f636f200640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f637015f0c0 0x7f63700c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f636e800640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f637015f0c0 0x7f63700c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f636e800640 1 -- 172.21.15.8:0/1083832242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63580094d0 con 0x7f6370154f50 2024-05-26T15:43:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f636e800640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6370154f50 0x7f6370141e20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f636000d800 tx=0x7f636000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f6366a00640 1 -- 172.21.15.8:0/1083832242 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000b6c0 con 0x7f6370154f50 2024-05-26T15:43:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f6366a00640 1 -- 172.21.15.8:0/1083832242 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636000b820 con 0x7f6370154f50 2024-05-26T15:43:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f6366a00640 1 -- 172.21.15.8:0/1083832242 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000bbb0 con 0x7f6370154f50 2024-05-26T15:43:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.399+0000 7f6374a00640 1 -- 172.21.15.8:0/1083832242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637013f6e0 con 0x7f6370154f50 2024-05-26T15:43:31.399 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.400+0000 7f6374a00640 1 -- 172.21.15.8:0/1083832242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637013fca0 con 0x7f6370154f50 2024-05-26T15:43:31.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.401+0000 7f6374a00640 1 -- 172.21.15.8:0/1083832242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637013fe30 con 0x7f6370154f50 2024-05-26T15:43:31.400 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.402+0000 7f6366a00640 1 -- 172.21.15.8:0/1083832242 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f636000bd10 con 0x7f6370154f50 2024-05-26T15:43:31.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.403+0000 7f6366a00640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f634c06ac00 0x7f634c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.401 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.403+0000 7f6366a00640 1 -- 172.21.15.8:0/1083832242 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f63600897a0 con 0x7f6370154f50 2024-05-26T15:43:31.402 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.403+0000 7f6367e00640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f634c06ac00 0x7f634c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.403 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.405+0000 7f6367e00640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f634c06ac00 0x7f634c06d0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6358034000 tx=0x7f635802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:31.406 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.407+0000 7f6366a00640 1 -- 172.21.15.8:0/1083832242 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6360054ae0 con 0x7f6370154f50 2024-05-26T15:43:31.606 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.607+0000 7f6374a00640 1 -- 172.21.15.8:0/1083832242 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63700711b0 con 0x7f634c06ac00 2024-05-26T15:43:31.612 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.614+0000 7f6366a00640 1 -- 172.21.15.8:0/1083832242 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48207 (secure 0 0 0) 0x7f63700711b0 con 0x7f634c06ac00 2024-05-26T15:43:31.613 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:31.614 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:43:31.615 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 -- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f634c06ac00 msgr2=0x7f634c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f634c06ac00 0x7f634c06d0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6358034000 tx=0x7f635802c000 comp rx=0 tx=0).stop 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 -- 172.21.15.8:0/1083832242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6370154f50 msgr2=0x7f6370141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6370154f50 0x7f6370141e20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f636000d800 tx=0x7f636000dcc0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 -- 172.21.15.8:0/1083832242 shutdown_connections 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f634c06ac00 0x7f634c06d0c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f637015f0c0 0x7f63700c42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f637015ae70 0x7f63700c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 --2- 172.21.15.8:0/1083832242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6370154f50 0x7f6370141e20 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 -- 172.21.15.8:0/1083832242 >> 172.21.15.8:0/1083832242 conn(0x7f6370070480 msgr2=0x7f6370154200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 -- 172.21.15.8:0/1083832242 shutdown_connections 2024-05-26T15:43:31.616 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.617+0000 7f6374a00640 1 -- 172.21.15.8:0/1083832242 wait complete. 2024-05-26T15:43:31.634 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-05-26T15:43:30.251102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255948,"kb_used_data":7020,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754718772,"statfs":{"total":773094113280,"available":772832022528,"internally_reserved":0,"allocated":7188480,"data_stored":3901169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-9613,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-77,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.424910"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-26T15:43:24.965224+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:43:24.965224+0000","last_peered":"2024-05-26T15:43:24.965224+0000","last_clean":"2024-05-26T15:43:24.965224+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:43:24.965224+0000","last_undegraded":"2024-05-26T15:43:24.965224+0000","last_fullsized":"2024-05-26T15:43:24.965224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1343488,"data_stored":928525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.1739999999999999,"15min":1.1579999999999999},"min":{"1min":0.98899999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.7849999999999999,"5min":1.802,"15min":1.802},"last":1.552},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1439999999999999,"15min":1.1299999999999999},"min":{"1min":0.89700000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.224,"15min":1.2310000000000001},"min":{"1min":0.71199999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5720000000000001,"5min":1.887,"15min":1.887},"last":1.327},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.264,"15min":1.27},"min":{"1min":0.89300000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.601,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.339,"15min":1.327},"min":{"1min":0.83799999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.7170000000000001,"5min":1.865,"15min":1.865},"last":1.149},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.2969999999999999,"15min":1.323},"min":{"1min":0.872,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.9059999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.85299999999999998}]},{"osd":3,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3149999999999999},"min":{"1min":1.0129999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7210000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.502,"5min":1.486,"15min":1.4850000000000001},"min":{"1min":1.234,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.8720000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.4490000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.4319999999999999,"15min":1.4399999999999999},"min":{"1min":1.0840000000000001,"5min":0.87,"15min":0.87},"max":{"1min":1.716,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.226},{"interface":"front","average":{"1min":1.6060000000000001,"5min":1.5720000000000001,"15min":1.569},"min":{"1min":1.2350000000000001,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":2.04,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.661}]},{"osd":5,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.5089999999999999,"15min":1.5409999999999999},"min":{"1min":1.0449999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.6759999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.577,"5min":1.6519999999999999,"15min":1.6559999999999999},"min":{"1min":1.272,"5min":0.998,"15min":0.998},"max":{"1min":1.8109999999999999,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.046}]},{"osd":6,"last update":"Sun May 26 15:42:28 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":1.653,"15min":1.6779999999999999},"min":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"max":{"1min":1.847,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.7849999999999999,"15min":1.8089999999999999},"min":{"1min":1.343,"5min":1.343,"15min":1.343},"max":{"1min":1.8839999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.304}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":749568,"data_stored":338685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.145,"15min":1.159},"min":{"1min":0.79500000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3180000000000001,"5min":1.736,"15min":1.736},"last":1.355},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1359999999999999,"15min":1.1040000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.627,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.82499999999999996}]},{"osd":1,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1919999999999999,"15min":1.196},"min":{"1min":0.73999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.5549999999999999,"5min":1.931,"15min":1.931},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.2490000000000001,"15min":1.238},"min":{"1min":0.77200000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.649,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.778}]},{"osd":2,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.286,"15min":1.3069999999999999},"min":{"1min":0.90600000000000003,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":2.157,"15min":2.157},"last":1.246},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4610000000000001,"15min":1.502},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.794,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.4299999999999999}]},{"osd":3,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.3640000000000001,"15min":1.401},"min":{"1min":0.871,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.629,"5min":2.169,"15min":2.169},"last":1.478},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.5820000000000001,"15min":1.6639999999999999},"min":{"1min":1.0680000000000001,"5min":0.754,"15min":0.754},"max":{"1min":1.821,"5min":4.452,"15min":4.452},"last":1.925}]},{"osd":4,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.5700000000000001,"15min":1.635},"min":{"1min":1.054,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.9319999999999999,"5min":3.282,"15min":3.282},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.4730000000000001,"15min":1.5109999999999999},"min":{"1min":0.96499999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.7869999999999999,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.95}]},{"osd":5,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.6539999999999999,"15min":1.7210000000000001},"min":{"1min":1.0640000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.907,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":2.0619999999999998},{"interface":"front","average":{"1min":1.522,"5min":1.587,"15min":1.635},"min":{"1min":1.1799999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9219999999999999,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":2.0030000000000001}]},{"osd":7,"last update":"Sun May 26 15:42:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.722,"15min":1.792},"min":{"1min":1.117,"5min":0.755,"15min":0.755},"max":{"1min":2.0049999999999999,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.855},{"interface":"front","average":{"1min":1.593,"5min":1.7410000000000001,"15min":1.804},"min":{"1min":1.177,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.982,"5min":2.843,"15min":2.843},"last":2.1560000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":737280,"data_stored":337014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.115,"15min":1.139},"min":{"1min":0.72499999999999998,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.679,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.1339999999999999,"15min":1.0860000000000001},"min":{"1min":0.80500000000000005,"5min":0.751,"15min":0.751},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.454}]},{"osd":1,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.149,"15min":1.0980000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.73,"5min":1.758,"15min":1.758},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.254,"5min":1.1699999999999999,"15min":1.1379999999999999},"min":{"1min":0.81999999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.704,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.536}]},{"osd":2,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.1850000000000001,"15min":1.1799999999999999},"min":{"1min":0.89000000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6160000000000001,"5min":1.659,"15min":1.659},"last":1.131},{"interface":"front","average":{"1min":1.254,"5min":1.29,"15min":1.2809999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.722,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.583}]},{"osd":3,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.333,"15min":1.343},"min":{"1min":0.97199999999999998,"5min":0.871,"15min":0.871},"max":{"1min":1.806,"5min":1.879,"15min":1.879},"last":1.284},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.4079999999999999,"15min":1.4239999999999999},"min":{"1min":0.97599999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.6819999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.3740000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3380000000000001,"15min":1.3360000000000001},"min":{"1min":0.85199999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.823,"5min":2.077,"15min":2.077},"last":1},{"interface":"front","average":{"1min":1.5469999999999999,"5min":1.5640000000000001,"15min":1.5800000000000001},"min":{"1min":1.3009999999999999,"5min":0.875,"15min":0.875},"max":{"1min":1.9470000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.613}]},{"osd":6,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.494,"15min":1.5269999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.96,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.502},{"interface":"front","average":{"1min":1.472,"5min":1.4730000000000001,"15min":1.4630000000000001},"min":{"1min":1.0920000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":1.9099999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.335}]},{"osd":7,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.5409999999999999,"5min":1.6040000000000001,"15min":1.6240000000000001},"min":{"1min":1.048,"5min":1.036,"15min":1.036},"max":{"1min":1.889,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.698},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.629,"15min":1.645},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.0449999999999999,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.6459999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":749568,"data_stored":338622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.173,"15min":1.1699999999999999},"min":{"1min":0.76300000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":3.5049999999999999,"5min":3.5049999999999999,"15min":3.5049999999999999},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.232,"15min":1.246},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.7330000000000001,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.393}]},{"osd":1,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.264,"15min":1.264},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.8940000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.115,"5min":1.1359999999999999,"15min":1.129},"min":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.7190000000000001,"5min":1.75,"15min":1.75},"last":1.4670000000000001}]},{"osd":2,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.282,"15min":1.268},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3049999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6779999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.81899999999999995}]},{"osd":3,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.278,"15min":1.276},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.472,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.462,"15min":1.484},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.8089999999999999,"5min":2.734,"15min":2.734},"last":1.4339999999999999}]},{"osd":5,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.478,"15min":1.494},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.794,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.101},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.476,"15min":1.5029999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.7689999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.5880000000000001}]},{"osd":6,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.538,"15min":1.575},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.8680000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.653},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.6220000000000001,"15min":1.6519999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.931,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.2829999999999999}]},{"osd":7,"last update":"Sun May 26 15:42:24 2024","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":1.609,"15min":1.6619999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.8300000000000001,"5min":4.008,"15min":4.008},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.6259999999999999,"5min":1.7190000000000001,"15min":1.7609999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.96,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.9079999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":761856,"data_stored":346863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.89300000000000002,"15min":0.90300000000000002},"min":{"1min":0.46700000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.284,"5min":1.508,"15min":1.508},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.97299999999999998,"15min":0.95599999999999996},"min":{"1min":0.69499999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.492,"5min":1.659,"15min":1.659},"last":0.56399999999999995}]},{"osd":1,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.96099999999999997,"15min":0.99199999999999999},"min":{"1min":0.59899999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2310000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.03},{"interface":"front","average":{"1min":1.103,"5min":1.1739999999999999,"15min":1.208},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.4650000000000001}]},{"osd":2,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.125,"15min":1.161},"min":{"1min":0.57999999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.7969999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.157},{"interface":"front","average":{"1min":1.3,"5min":1.2310000000000001,"15min":1.2170000000000001},"min":{"1min":0.78800000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.8340000000000001,"5min":1.954,"15min":1.954},"last":1.2569999999999999}]},{"osd":4,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.3100000000000001,"15min":1.306},"min":{"1min":1.0269999999999999,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.9019999999999999,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.4039999999999999,"15min":1.4359999999999999},"min":{"1min":1.0069999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.696,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.512}]},{"osd":5,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.464,"15min":1.488},"min":{"1min":1.034,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.845,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4199999999999999,"15min":1.4219999999999999},"min":{"1min":1.099,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.7909999999999999,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.679}]},{"osd":6,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.5049999999999999,"15min":1.534},"min":{"1min":1.2290000000000001,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.0459999999999998,"5min":2.863,"15min":2.863},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.589,"15min":1.6040000000000001},"min":{"1min":1.26,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":2.2589999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.7210000000000001}]},{"osd":7,"last update":"Sun May 26 15:42:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.4910000000000001,"15min":1.5029999999999999},"min":{"1min":1.0820000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.921,"5min":2.306,"15min":2.306},"last":1.401},{"interface":"front","average":{"1min":1.548,"5min":1.5649999999999999,"15min":1.5880000000000001},"min":{"1min":1.2150000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.99,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.5980000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":753664,"data_stored":345822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0009999999999999,"15min":1.022},"min":{"1min":0.59999999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.262,"5min":1.47,"15min":1.47},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.141,"15min":1.127},"min":{"1min":0.74199999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.76100000000000001}]},{"osd":1,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.03,"15min":1.0529999999999999},"min":{"1min":0.70999999999999996,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.876},{"interface":"front","average":{"1min":1.056,"5min":1.1910000000000001,"15min":1.1879999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3819999999999999,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":0.79900000000000004}]},{"osd":3,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.0700000000000001,"15min":1.0449999999999999},"min":{"1min":0.76000000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.726,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.2430000000000001,"15min":1.282},"min":{"1min":0.66800000000000004,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.77,"5min":2.903,"15min":2.903},"last":1.0740000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.528,"15min":1.4930000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.7949999999999999,"5min":10.438000000000001,"15min":10.438000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4590000000000001,"15min":1.4770000000000001},"min":{"1min":0.98599999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.9990000000000001,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.5700000000000001}]},{"osd":5,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.502,"15min":1.518},"min":{"1min":1.171,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1970000000000001,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.6739999999999999,"15min":1.6559999999999999},"min":{"1min":1.1879999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.1930000000000001,"5min":10.798999999999999,"15min":10.798999999999999},"last":1.3180000000000001}]},{"osd":6,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.6259999999999999,"15min":1.6000000000000001},"min":{"1min":1.155,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":2.0840000000000001,"5min":7.851,"15min":7.851},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.6950000000000001,"15min":1.6359999999999999},"min":{"1min":1.127,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.1019999999999999,"5min":10.672000000000001,"15min":10.672000000000001},"last":1.4219999999999999}]},{"osd":7,"last update":"Sun May 26 15:42:31 2024","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.7669999999999999,"15min":1.7450000000000001},"min":{"1min":1.224,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":2.262,"5min":10.249000000000001,"15min":10.249000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.6180000000000001,"15min":1.6140000000000001},"min":{"1min":1.3839999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.99,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.629}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":753664,"data_stored":338200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.95699999999999996,"15min":1.052},"min":{"1min":0.45000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.4410000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0369999999999999,"15min":1.1060000000000001},"min":{"1min":0.626,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.4650000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.377}]},{"osd":2,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54600000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3200000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1910000000000001,"15min":1.2769999999999999},"min":{"1min":0.69299999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.601,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.4350000000000001}]},{"osd":3,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2789999999999999,"15min":1.3520000000000001},"min":{"1min":0.89300000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.694,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.141,"15min":1.24},"min":{"1min":0.65500000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.714,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.65500000000000003}]},{"osd":4,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.331,"15min":1.371},"min":{"1min":0.98799999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.8300000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.323},{"interface":"front","average":{"1min":1.343,"5min":1.3480000000000001,"15min":1.4019999999999999},"min":{"1min":1.1100000000000001,"5min":0.75,"15min":0.75},"max":{"1min":1.6639999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.496}]},{"osd":5,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3859999999999999,"15min":1.4810000000000001},"min":{"1min":0.95099999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8140000000000001,"5min":2.621,"15min":2.621},"last":1.575},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.524,"15min":1.615},"min":{"1min":1.026,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.802,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.7969999999999999}]},{"osd":6,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4450000000000001,"15min":1.5189999999999999},"min":{"1min":0.86899999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.6639999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.6459999999999999},"min":{"1min":0.95999999999999996,"5min":0.755,"15min":0.755},"max":{"1min":1.9790000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.627}]},{"osd":7,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.6040000000000001,"15min":1.7010000000000001},"min":{"1min":1.196,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.954,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.907},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.5309999999999999,"15min":1.611},"min":{"1min":0.93899999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8600000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.518}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1339392,"data_stored":927438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.86499999999999999,"15min":0.91400000000000003},"min":{"1min":0.379,"5min":0.307,"15min":0.307},"max":{"1min":1.2250000000000001,"5min":1.454,"15min":1.454},"last":1.4810000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.95299999999999996,"15min":0.999},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.2909999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.048,"15min":1.097},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.5589999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":1.006,"15min":1.032},"min":{"1min":0.53500000000000003,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.4810000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2290000000000001,"15min":1.2949999999999999},"min":{"1min":0.61399999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.615,"5min":4.024,"15min":4.024},"last":1.161},{"interface":"front","average":{"1min":1.008,"5min":1.1899999999999999,"15min":1.2509999999999999},"min":{"1min":0.60399999999999998,"5min":0.505,"15min":0.505},"max":{"1min":1.599,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":1.1180000000000001}]},{"osd":4,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.379,"15min":1.4650000000000001},"min":{"1min":0.81899999999999995,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.452,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.302},{"interface":"front","average":{"1min":1.048,"5min":1.1299999999999999,"15min":1.1479999999999999},"min":{"1min":0.89200000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.448,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.81899999999999995}]},{"osd":5,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.4810000000000001,"15min":1.54},"min":{"1min":0.88400000000000001,"5min":0.752,"15min":0.752},"max":{"1min":1.6699999999999999,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.399},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4670000000000001,"15min":1.524},"min":{"1min":0.95999999999999996,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.708,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.3560000000000001}]},{"osd":6,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.2170000000000001,"15min":1.2629999999999999},"min":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.4850000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.446,"15min":1.522},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.7729999999999999,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.2350000000000001}]},{"osd":7,"last update":"Sun May 26 15:42:25 2024","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.5640000000000001,"15min":1.629},"min":{"1min":1.0469999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":1.6990000000000001,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.571},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.3260000000000001,"15min":1.365},"min":{"1min":0.78900000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.752,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.264}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:43:31.636 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-26T15:43:31.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.841+0000 7efe33200640 1 Processor -- start 2024-05-26T15:43:31.840 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.841+0000 7efe33200640 1 -- start start 2024-05-26T15:43:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.843+0000 7efe33200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe34154f50 0x7efe340b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.843+0000 7efe33200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe3415ae70 0x7efe3415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.843+0000 7efe33200640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3415b640 con 0x7efe3415f0c0 2024-05-26T15:43:31.842 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.843+0000 7efe33200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3415bee0 con 0x7efe34154f50 2024-05-26T15:43:31.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.843+0000 7efe33200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe340b0ba0 con 0x7efe3415ae70 2024-05-26T15:43:31.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.843+0000 7efe32800640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7efe3415f0c0 0x7efe340c36c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34810/0 (socket says 172.21.15.8:34810) 2024-05-26T15:43:31.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.843+0000 7efe32800640 1 -- 172.21.15.8:0/1307403401 learned_addr learned my addr 172.21.15.8:0/1307403401 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:31.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe31e00640 1 --2- 172.21.15.8:0/1307403401 >> v2:172.21.15.47:3300/0 conn(0x7efe34154f50 0x7efe340b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe31400640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe3415ae70 0x7efe3415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298190666 0 0) 0x7efe3415b640 con 0x7efe3415f0c0 2024-05-26T15:43:31.843 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe14003520 con 0x7efe3415f0c0 2024-05-26T15:43:31.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 953847695 0 0) 0x7efe14003520 con 0x7efe3415f0c0 2024-05-26T15:43:31.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe3415ae70 msgr2=0x7efe3415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:31.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe3415ae70 0x7efe3415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.844 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 >> v2:172.21.15.47:3300/0 conn(0x7efe34154f50 msgr2=0x7efe340b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 --2- 172.21.15.8:0/1307403401 >> v2:172.21.15.47:3300/0 conn(0x7efe34154f50 0x7efe340b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3415b920 con 0x7efe3415f0c0 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7efe2c001670 con 0x7efe3415f0c0 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 >> v1:172.21.15.8:6789/0 conn(0x7efe3415f0c0 legacy=0x7efe340c36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe140039a0 0x7efe14003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe3415ae70 0x7efe140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe14004d00 0x7efe14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3415bee0 con 0x7efe140039a0 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1400b980 con 0x7efe14004d00 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.844+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1400baf0 con 0x7efe3415ae70 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.845+0000 7efe31e00640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe140039a0 0x7efe14003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.845+0000 7efe31e00640 1 -- 172.21.15.8:0/1307403401 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe3415ae70 msgr2=0x7efe140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.845+0000 7efe32800640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe14004d00 0x7efe14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.845 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.845+0000 7efe31e00640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe3415ae70 0x7efe140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.845+0000 7efe31e00640 1 -- 172.21.15.8:0/1307403401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe14004d00 msgr2=0x7efe14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.845+0000 7efe31e00640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe14004d00 0x7efe14005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.846 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.845+0000 7efe31e00640 1 -- 172.21.15.8:0/1307403401 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe14003520 con 0x7efe140039a0 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.846+0000 7efe31e00640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe140039a0 0x7efe14003dc0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efe24009ac0 tx=0x7efe140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f340f7c98f978866 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.847+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24031400 con 0x7efe140039a0 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.847+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2402d050 con 0x7efe140039a0 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.847+0000 7efe30a00640 1 -- 172.21.15.8:0/1307403401 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24031780 con 0x7efe140039a0 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.847+0000 7efe33200640 1 -- 172.21.15.8:0/1307403401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe140039a0 msgr2=0x7efe14003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.847+0000 7efe33200640 1 --2- 172.21.15.8:0/1307403401 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe140039a0 0x7efe14003dc0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7efe24009ac0 tx=0x7efe140057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.847+0000 7efe32800640 1 -- 172.21.15.8:0/1307403401 reap_dead start 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.847+0000 7efe33200640 1 -- 172.21.15.8:0/1307403401 shutdown_connections 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.847+0000 7efe33200640 1 -- 172.21.15.8:0/1307403401 >> 172.21.15.8:0/1307403401 conn(0x7efe34070480 msgr2=0x7efe34070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.847+0000 7efe33200640 1 -- 172.21.15.8:0/1307403401 shutdown_connections 2024-05-26T15:43:31.847 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.848+0000 7efe33200640 1 -- 172.21.15.8:0/1307403401 wait complete. 2024-05-26T15:43:31.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.849+0000 7efe33200640 1 Processor -- start 2024-05-26T15:43:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.850+0000 7efe33200640 1 -- start start 2024-05-26T15:43:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe33200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe140039a0 0x7efe34150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe33200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe341529d0 0x7efe34150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe33200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe3414c740 0x7efe340c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.855 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe33200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34151ac0 con 0x7efe341529d0 2024-05-26T15:43:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe33200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34151000 con 0x7efe3414c740 2024-05-26T15:43:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe33200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe34151220 con 0x7efe140039a0 2024-05-26T15:43:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe31400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe341529d0 0x7efe34150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe31400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe341529d0 0x7efe34150ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34090/0 (socket says 172.21.15.8:34090) 2024-05-26T15:43:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe31400640 1 -- 172.21.15.8:0/1063936433 learned_addr learned my addr 172.21.15.8:0/1063936433 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:31.856 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe31e00640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe140039a0 0x7efe34150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe31400640 1 -- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe140039a0 msgr2=0x7efe34150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe31400640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe140039a0 0x7efe34150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe32800640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe3414c740 0x7efe340c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe31400640 1 -- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe3414c740 msgr2=0x7efe340c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe31400640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe3414c740 0x7efe340c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe31400640 1 -- 172.21.15.8:0/1063936433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe34151500 con 0x7efe341529d0 2024-05-26T15:43:31.857 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.851+0000 7efe31e00640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe140039a0 0x7efe34150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.852+0000 7efe31400640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe341529d0 0x7efe34150ac0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00ef10 tx=0x7efe1c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.852+0000 7efe2a000640 1 -- 172.21.15.8:0/1063936433 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c010040 con 0x7efe341529d0 2024-05-26T15:43:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.852+0000 7efe2a000640 1 -- 172.21.15.8:0/1063936433 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c014400 con 0x7efe341529d0 2024-05-26T15:43:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.852+0000 7efe2a000640 1 -- 172.21.15.8:0/1063936433 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c014790 con 0x7efe341529d0 2024-05-26T15:43:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.852+0000 7efe33200640 1 -- 172.21.15.8:0/1063936433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe341517e0 con 0x7efe341529d0 2024-05-26T15:43:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.852+0000 7efe33200640 1 -- 172.21.15.8:0/1063936433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe340c8150 con 0x7efe341529d0 2024-05-26T15:43:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.853+0000 7efe33200640 1 -- 172.21.15.8:0/1063936433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3414dfc0 con 0x7efe341529d0 2024-05-26T15:43:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.854+0000 7efe2a000640 1 -- 172.21.15.8:0/1063936433 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efe1c0148f0 con 0x7efe341529d0 2024-05-26T15:43:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.855+0000 7efe2a000640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efe1006ac00 0x7efe1006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:31.858 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.855+0000 7efe2a000640 1 -- 172.21.15.8:0/1063936433 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7efe1c089be0 con 0x7efe341529d0 2024-05-26T15:43:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.856+0000 7efe31e00640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efe1006ac00 0x7efe1006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:31.859 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.857+0000 7efe31e00640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efe1006ac00 0x7efe1006d0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efe24033000 tx=0x7efe24008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:31.861 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:31.863+0000 7efe2a000640 1 -- 172.21.15.8:0/1063936433 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efe1c054fb0 con 0x7efe341529d0 2024-05-26T15:43:32.066 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.067+0000 7efe33200640 1 -- 172.21.15.8:0/1063936433 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe3404e280 con 0x7efe341529d0 2024-05-26T15:43:32.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.069+0000 7efe2a000640 1 -- 172.21.15.8:0/1063936433 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+12755 (secure 0 0 0) 0x7efe1c009c60 con 0x7efe341529d0 2024-05-26T15:43:32.068 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:32.068 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":64,"fsid":"03132396-4584-4cf0-b2e0-b5ae6040045e","created":"2024-05-26T15:39:08.916008+0000","modified":"2024-05-26T15:43:26.847115+0000","last_up_change":"2024-05-26T15:39:20.892545+0000","last_in_change":"2024-05-26T15:39:12.140210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-26T15:39:22.226598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce28be81-d7be-482d-974c-53260ab6f22c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":36926},{"type":"v1","addr":"172.21.15.8:6819","nonce":36926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":36926},{"type":"v1","addr":"172.21.15.8:6824","nonce":36926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":36926},{"type":"v1","addr":"172.21.15.8:6831","nonce":36926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":36926},{"type":"v1","addr":"172.21.15.8:6828","nonce":36926}]},"public_addr":"172.21.15.8:6819/36926","cluster_addr":"172.21.15.8:6824/36926","heartbeat_back_addr":"172.21.15.8:6831/36926","heartbeat_front_addr":"172.21.15.8:6828/36926","state":["exists","up"]},{"osd":1,"uuid":"29f22fca-6669-4bb9-8ef8-c5933d5ea9f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":36923},{"type":"v1","addr":"172.21.15.8:6809","nonce":36923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":36923},{"type":"v1","addr":"172.21.15.8:6811","nonce":36923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":36923},{"type":"v1","addr":"172.21.15.8:6821","nonce":36923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":36923},{"type":"v1","addr":"172.21.15.8:6816","nonce":36923}]},"public_addr":"172.21.15.8:6809/36923","cluster_addr":"172.21.15.8:6811/36923","heartbeat_back_addr":"172.21.15.8:6821/36923","heartbeat_front_addr":"172.21.15.8:6816/36923","state":["exists","up"]},{"osd":2,"uuid":"02fbf9f1-e104-4477-8d87-9b891ed0ab4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":36922},{"type":"v1","addr":"172.21.15.8:6801","nonce":36922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":36922},{"type":"v1","addr":"172.21.15.8:6803","nonce":36922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":36922},{"type":"v1","addr":"172.21.15.8:6807","nonce":36922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":36922},{"type":"v1","addr":"172.21.15.8:6805","nonce":36922}]},"public_addr":"172.21.15.8:6801/36922","cluster_addr":"172.21.15.8:6803/36922","heartbeat_back_addr":"172.21.15.8:6807/36922","heartbeat_front_addr":"172.21.15.8:6805/36922","state":["exists","up"]},{"osd":3,"uuid":"89fd069f-7f95-430a-be25-5064903c9cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6813","nonce":36924},{"type":"v1","addr":"172.21.15.8:6815","nonce":36924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6817","nonce":36924},{"type":"v1","addr":"172.21.15.8:6820","nonce":36924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6827","nonce":36924},{"type":"v1","addr":"172.21.15.8:6829","nonce":36924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6823","nonce":36924},{"type":"v1","addr":"172.21.15.8:6825","nonce":36924}]},"public_addr":"172.21.15.8:6815/36924","cluster_addr":"172.21.15.8:6820/36924","heartbeat_back_addr":"172.21.15.8:6829/36924","heartbeat_front_addr":"172.21.15.8:6825/36924","state":["exists","up"]},{"osd":4,"uuid":"65a1860d-cd7a-40de-9302-f373e8890ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":37314},{"type":"v1","addr":"172.21.15.47:6801","nonce":37314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":37314},{"type":"v1","addr":"172.21.15.47:6803","nonce":37314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":37314},{"type":"v1","addr":"172.21.15.47:6807","nonce":37314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":37314},{"type":"v1","addr":"172.21.15.47:6805","nonce":37314}]},"public_addr":"172.21.15.47:6801/37314","cluster_addr":"172.21.15.47:6803/37314","heartbeat_back_addr":"172.21.15.47:6807/37314","heartbeat_front_addr":"172.21.15.47:6805/37314","state":["exists","up"]},{"osd":5,"uuid":"aef034e4-0e41-4167-ac67-bedb934892f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":37316},{"type":"v1","addr":"172.21.15.47:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":37316},{"type":"v1","addr":"172.21.15.47:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":37316},{"type":"v1","addr":"172.21.15.47:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":37316},{"type":"v1","addr":"172.21.15.47:6829","nonce":37316}]},"public_addr":"172.21.15.47:6825/37316","cluster_addr":"172.21.15.47:6827/37316","heartbeat_back_addr":"172.21.15.47:6831/37316","heartbeat_front_addr":"172.21.15.47:6829/37316","state":["exists","up"]},{"osd":6,"uuid":"e328e30e-60f5-4cba-9d1b-39ba2e4da81e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":37315},{"type":"v1","addr":"172.21.15.47:6809","nonce":37315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":37315},{"type":"v1","addr":"172.21.15.47:6811","nonce":37315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":37315},{"type":"v1","addr":"172.21.15.47:6815","nonce":37315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":37315},{"type":"v1","addr":"172.21.15.47:6813","nonce":37315}]},"public_addr":"172.21.15.47:6809/37315","cluster_addr":"172.21.15.47:6811/37315","heartbeat_back_addr":"172.21.15.47:6815/37315","heartbeat_front_addr":"172.21.15.47:6813/37315","state":["exists","up"]},{"osd":7,"uuid":"11e891d6-7f59-40fc-aeeb-75d0c607c5c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":37317},{"type":"v1","addr":"172.21.15.47:6817","nonce":37317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":37317},{"type":"v1","addr":"172.21.15.47:6819","nonce":37317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":37317},{"type":"v1","addr":"172.21.15.47:6823","nonce":37317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":37317},{"type":"v1","addr":"172.21.15.47:6821","nonce":37317}]},"public_addr":"172.21.15.47:6817/37317","cluster_addr":"172.21.15.47:6819/37317","heartbeat_back_addr":"172.21.15.47:6823/37317","heartbeat_front_addr":"172.21.15.47:6821/37317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.566431+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.794476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.290403+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.551477+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.426677+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.364892+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.511851+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-26T15:39:17.519734+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:6834/3351700355":"2024-05-27T15:43:23.820534+0000","172.21.15.47:6836/3388176100":"2024-05-27T15:42:25.245849+0000","172.21.15.8:6832/3351700355":"2024-05-27T15:43:23.820534+0000","172.21.15.47:6834/3388176100":"2024-05-27T15:42:25.245849+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-26T15:43:32.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.072+0000 7efe33200640 1 -- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efe1006ac00 msgr2=0x7efe1006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:32.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.072+0000 7efe33200640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efe1006ac00 0x7efe1006d0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efe24033000 tx=0x7efe24008030 comp rx=0 tx=0).stop 2024-05-26T15:43:32.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.072+0000 7efe33200640 1 -- 172.21.15.8:0/1063936433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe341529d0 msgr2=0x7efe34150ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:32.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.072+0000 7efe33200640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe341529d0 0x7efe34150ac0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00ef10 tx=0x7efe1c00b480 comp rx=0 tx=0).stop 2024-05-26T15:43:32.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.072+0000 7efe33200640 1 -- 172.21.15.8:0/1063936433 shutdown_connections 2024-05-26T15:43:32.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.072+0000 7efe33200640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efe1006ac00 0x7efe1006d0c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:32.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.072+0000 7efe33200640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe3414c740 0x7efe340c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:32.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.072+0000 7efe33200640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe341529d0 0x7efe34150ac0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:32.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.072+0000 7efe33200640 1 --2- 172.21.15.8:0/1063936433 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efe140039a0 0x7efe34150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:32.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.072+0000 7efe33200640 1 -- 172.21.15.8:0/1063936433 >> 172.21.15.8:0/1063936433 conn(0x7efe34070480 msgr2=0x7efe3415e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:32.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.073+0000 7efe33200640 1 -- 172.21.15.8:0/1063936433 shutdown_connections 2024-05-26T15:43:32.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:32.073+0000 7efe33200640 1 -- 172.21.15.8:0/1063936433 wait complete. 2024-05-26T15:43:33.093 INFO:tasks.ceph:Scrubbing osd.0 2024-05-26T15:43:33.093 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-26T15:43:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.323+0000 7efd2da00640 1 Processor -- start 2024-05-26T15:43:33.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.324+0000 7efd2da00640 1 -- start start 2024-05-26T15:43:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.325+0000 7efd2da00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efd280cd020 0x7efd2806ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.325+0000 7efd2da00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd280662a0 con 0x7efd28146330 2024-05-26T15:43:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.325+0000 7efd2da00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2806d230 con 0x7efd2806e6d0 2024-05-26T15:43:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.325+0000 7efd2da00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2806cc20 con 0x7efd280cd020 2024-05-26T15:43:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.326+0000 7efd27e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7efd28146330 0x7efd280cc910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34812/0 (socket says 172.21.15.8:34812) 2024-05-26T15:43:33.324 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.326+0000 7efd27e00640 1 -- 172.21.15.8:0/556774119 learned_addr learned my addr 172.21.15.8:0/556774119 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:33.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.326+0000 7efd27400640 1 --2- 172.21.15.8:0/556774119 >> v2:172.21.15.47:3300/0 conn(0x7efd280cd020 0x7efd2806ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.326+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291006925 0 0) 0x7efd280662a0 con 0x7efd28146330 2024-05-26T15:43:33.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.326+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd0c003520 con 0x7efd28146330 2024-05-26T15:43:33.326 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4209727678 0 0) 0x7efd0c003520 con 0x7efd28146330 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 >> v2:172.21.15.47:3300/0 conn(0x7efd280cd020 msgr2=0x7efd2806ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 --2- 172.21.15.8:0/556774119 >> v2:172.21.15.47:3300/0 conn(0x7efd280cd020 0x7efd2806ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 >> v1:172.21.15.47:6789/0 conn(0x7efd2806e6d0 legacy=0x7efd28166640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2806b470 con 0x7efd28146330 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7efd180019f0 con 0x7efd28146330 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 >> v1:172.21.15.8:6789/0 conn(0x7efd28146330 legacy=0x7efd280cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd0c003970 0x7efd0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd0c0047c0 0x7efd0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0052a0 0x7efd0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2806cc20 con 0x7efd0c0052a0 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c00c170 con 0x7efd0c0047c0 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c00c330 con 0x7efd0c003970 2024-05-26T15:43:33.327 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd2d000640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0052a0 0x7efd0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd27400640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd0c0047c0 0x7efd0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.327+0000 7efd27e00640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd0c003970 0x7efd0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.328+0000 7efd2d000640 1 -- 172.21.15.8:0/556774119 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd0c003970 msgr2=0x7efd0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:33.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.328+0000 7efd2d000640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd0c003970 0x7efd0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.328+0000 7efd2d000640 1 -- 172.21.15.8:0/556774119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd0c0047c0 msgr2=0x7efd0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:33.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.328+0000 7efd2d000640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd0c0047c0 0x7efd0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.328+0000 7efd2d000640 1 -- 172.21.15.8:0/556774119 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c003520 con 0x7efd0c0052a0 2024-05-26T15:43:33.328 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.328+0000 7efd27400640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd0c0047c0 0x7efd0c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-26T15:43:33.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.329+0000 7efd2d000640 1 -- 172.21.15.8:0/556774119 reap_dead start 2024-05-26T15:43:33.329 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.329+0000 7efd2d000640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0052a0 0x7efd0c00b980 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7efd20001720 tx=0x7efd0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490e3c52e6fd3a87 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.329+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200052d0 con 0x7efd0c0052a0 2024-05-26T15:43:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.329+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd20005430 con 0x7efd0c0052a0 2024-05-26T15:43:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.329+0000 7efd26a00640 1 -- 172.21.15.8:0/556774119 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2002abc0 con 0x7efd0c0052a0 2024-05-26T15:43:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.330+0000 7efd2da00640 1 -- 172.21.15.8:0/556774119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0052a0 msgr2=0x7efd0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.330+0000 7efd2da00640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0052a0 0x7efd0c00b980 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7efd20001720 tx=0x7efd0c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.330+0000 7efd2da00640 1 -- 172.21.15.8:0/556774119 shutdown_connections 2024-05-26T15:43:33.330 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.330+0000 7efd2da00640 1 --2- 172.21.15.8:0/556774119 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd0c0052a0 0x7efd0c00b980 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.330+0000 7efd2da00640 1 -- 172.21.15.8:0/556774119 >> 172.21.15.8:0/556774119 conn(0x7efd280cb7c0 msgr2=0x7efd280cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.330+0000 7efd2da00640 1 -- 172.21.15.8:0/556774119 shutdown_connections 2024-05-26T15:43:33.331 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.330+0000 7efd2da00640 1 -- 172.21.15.8:0/556774119 wait complete. 2024-05-26T15:43:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.332+0000 7efd2da00640 1 Processor -- start 2024-05-26T15:43:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.332+0000 7efd2da00640 1 -- start start 2024-05-26T15:43:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.333+0000 7efd2da00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd0c0052a0 0x7efd281e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.333+0000 7efd2da00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd2814ab10 0x7efd280c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.333+0000 7efd2da00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd280c6a90 0x7efd280b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.332 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.333+0000 7efd2da00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2815bfe0 con 0x7efd280c6a90 2024-05-26T15:43:33.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.333+0000 7efd2da00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280c6f40 con 0x7efd0c0052a0 2024-05-26T15:43:33.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.333+0000 7efd2da00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd280c71a0 con 0x7efd2814ab10 2024-05-26T15:43:33.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.333+0000 7efd2d000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd280c6a90 0x7efd280b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.333+0000 7efd2d000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd280c6a90 0x7efd280b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34122/0 (socket says 172.21.15.8:34122) 2024-05-26T15:43:33.333 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.333+0000 7efd2d000640 1 -- 172.21.15.8:0/2143996703 learned_addr learned my addr 172.21.15.8:0/2143996703 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:33.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd27400640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd2814ab10 0x7efd280c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.334 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd27e00640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd0c0052a0 0x7efd281e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd2d000640 1 -- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd2814ab10 msgr2=0x7efd280c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd2d000640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7efd2814ab10 0x7efd280c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd2d000640 1 -- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd0c0052a0 msgr2=0x7efd281e9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd2d000640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd0c0052a0 0x7efd281e9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd2d000640 1 -- 172.21.15.8:0/2143996703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd280c7480 con 0x7efd280c6a90 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd27e00640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd0c0052a0 0x7efd281e9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd2d000640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd280c6a90 0x7efd280b2910 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7efd20001840 tx=0x7efd20001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd1fe00640 1 -- 172.21.15.8:0/2143996703 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20007a30 con 0x7efd280c6a90 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd1fe00640 1 -- 172.21.15.8:0/2143996703 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd20003bb0 con 0x7efd280c6a90 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd1fe00640 1 -- 172.21.15.8:0/2143996703 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2003d450 con 0x7efd280c6a90 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.334+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd280c7760 con 0x7efd280c6a90 2024-05-26T15:43:33.335 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.335+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd280c7d20 con 0x7efd280c6a90 2024-05-26T15:43:33.336 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.336+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd2806b750 con 0x7efd280c6a90 2024-05-26T15:43:33.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.337+0000 7efd1fe00640 1 -- 172.21.15.8:0/2143996703 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd20032440 con 0x7efd280c6a90 2024-05-26T15:43:33.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.338+0000 7efd1fe00640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efd0806ac00 0x7efd0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.338+0000 7efd1fe00640 1 -- 172.21.15.8:0/2143996703 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7efd200a8170 con 0x7efd280c6a90 2024-05-26T15:43:33.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.338+0000 7efd1fe00640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] conn(0x7efd08070fa0 0x7efd080733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.338+0000 7efd1fe00640 1 -- 172.21.15.8:0/2143996703 --> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd08073ab0 con 0x7efd08070fa0 2024-05-26T15:43:33.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.338+0000 7efd1fe00640 1 -- 172.21.15.8:0/2143996703 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd200aa750 con 0x7efd280c6a90 2024-05-26T15:43:33.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.338+0000 7efd27400640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] conn(0x7efd08070fa0 0x7efd080733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.337 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.339+0000 7efd27e00640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efd0806ac00 0x7efd0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.339+0000 7efd27400640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] conn(0x7efd08070fa0 0x7efd080733e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:33.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.340+0000 7efd1fe00640 1 -- 172.21.15.8:0/2143996703 <== osd.0 v2:172.21.15.8:6814/36926 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7efd08073ab0 con 0x7efd08070fa0 2024-05-26T15:43:33.338 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.340+0000 7efd27e00640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efd0806ac00 0x7efd0806d0c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd2815c2d0 tx=0x7efd18001360 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:33.352 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.354+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 --> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efd2804e210 con 0x7efd08070fa0 2024-05-26T15:43:33.353 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.354+0000 7efd1fe00640 1 -- 172.21.15.8:0/2143996703 <== osd.0 v2:172.21.15.8:6814/36926 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efd2804e210 con 0x7efd08070fa0 2024-05-26T15:43:33.353 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:43:33.353 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-26T15:43:33.353 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:43:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.355+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 >> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] conn(0x7efd08070fa0 msgr2=0x7efd080733e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.355+0000 7efd2da00640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.8:6814/36926,v1:172.21.15.8:6819/36926] conn(0x7efd08070fa0 0x7efd080733e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.355+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efd0806ac00 msgr2=0x7efd0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.355+0000 7efd2da00640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7efd0806ac00 0x7efd0806d0c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd2815c2d0 tx=0x7efd18001360 comp rx=0 tx=0).stop 2024-05-26T15:43:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.355+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd280c6a90 msgr2=0x7efd280b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.354 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.355+0000 7efd2da00640 1 --2- 172.21.15.8:0/2143996703 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd280c6a90 0x7efd280b2910 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7efd20001840 tx=0x7efd20001190 comp rx=0 tx=0).stop 2024-05-26T15:43:33.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.355+0000 7efd2d000640 1 -- 172.21.15.8:0/2143996703 reap_dead start 2024-05-26T15:43:33.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.355+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 shutdown_connections 2024-05-26T15:43:33.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.355+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 >> 172.21.15.8:0/2143996703 conn(0x7efd280cb7c0 msgr2=0x7efd280abe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:33.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.356+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 shutdown_connections 2024-05-26T15:43:33.355 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.356+0000 7efd2da00640 1 -- 172.21.15.8:0/2143996703 wait complete. 2024-05-26T15:43:33.373 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-26T15:43:33.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.587+0000 7f6aac400640 1 Processor -- start 2024-05-26T15:43:33.586 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.587+0000 7f6aac400640 1 -- start start 2024-05-26T15:43:33.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.589+0000 7f6aac400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6aa4144270 0x7f6aa40b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.589+0000 7f6aac400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6aa4070660 0x7f6aa4070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.589+0000 7f6aac400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa40cbba0 con 0x7f6aa40cd4d0 2024-05-26T15:43:33.587 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.589+0000 7f6aac400640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa40cbe80 con 0x7f6aa4144270 2024-05-26T15:43:33.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.589+0000 7f6aac400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa4071020 con 0x7f6aa4070660 2024-05-26T15:43:33.588 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.589+0000 7f6aa9a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6aa4144270 0x7f6aa40b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.589+0000 7f6aaa400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6aa40cd4d0 0x7f6aa40cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34822/0 (socket says 172.21.15.8:34822) 2024-05-26T15:43:33.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.589+0000 7f6aa9a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6aa4144270 0x7f6aa40b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34128/0 (socket says 172.21.15.8:34128) 2024-05-26T15:43:33.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.589+0000 7f6aaa400640 1 -- 172.21.15.8:0/267202281 learned_addr learned my addr 172.21.15.8:0/267202281 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:33.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.590+0000 7f6aa9000640 1 --2- 172.21.15.8:0/267202281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6aa4070660 0x7f6aa4070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.590+0000 7f6aa9a00640 1 -- 172.21.15.8:0/267202281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6aa4070660 msgr2=0x7f6aa4070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:33.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.590+0000 7f6aa9a00640 1 --2- 172.21.15.8:0/267202281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6aa4070660 0x7f6aa4070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.589 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.590+0000 7f6aa9a00640 1 -- 172.21.15.8:0/267202281 >> v1:172.21.15.8:6789/0 conn(0x7f6aa40cd4d0 legacy=0x7f6aa40cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.590+0000 7f6aa9a00640 1 -- 172.21.15.8:0/267202281 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa40cc9f0 con 0x7f6aa4144270 2024-05-26T15:43:33.590 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.590+0000 7f6aa3e00640 1 -- 172.21.15.8:0/267202281 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490604366 0 0) 0x7f6aa40cbba0 con 0x7f6aa40cd4d0 2024-05-26T15:43:33.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.591+0000 7f6aa9a00640 1 --2- 172.21.15.8:0/267202281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 0x7f6aa40b1870 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6a940097a0 tx=0x7f6a9402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26549cb660d3b81 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:33.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.591+0000 7f6aa3e00640 1 -- 172.21.15.8:0/267202281 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94032440 con 0x7f6aa4144270 2024-05-26T15:43:33.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.591+0000 7f6aa3e00640 1 -- 172.21.15.8:0/267202281 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a940325a0 con 0x7f6aa4144270 2024-05-26T15:43:33.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.591+0000 7f6aa3e00640 1 -- 172.21.15.8:0/267202281 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94032930 con 0x7f6aa4144270 2024-05-26T15:43:33.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.592+0000 7f6aac400640 1 -- 172.21.15.8:0/267202281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 msgr2=0x7f6aa40b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.592+0000 7f6aac400640 1 --2- 172.21.15.8:0/267202281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 0x7f6aa40b1870 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6a940097a0 tx=0x7f6a9402a180 comp rx=0 tx=0).stop 2024-05-26T15:43:33.591 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.592+0000 7f6aac400640 1 -- 172.21.15.8:0/267202281 shutdown_connections 2024-05-26T15:43:33.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.592+0000 7f6aac400640 1 --2- 172.21.15.8:0/267202281 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6aa4070660 0x7f6aa4070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.592+0000 7f6aac400640 1 --2- 172.21.15.8:0/267202281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 0x7f6aa40b1870 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.592+0000 7f6aac400640 1 -- 172.21.15.8:0/267202281 >> 172.21.15.8:0/267202281 conn(0x7f6aa40b0570 msgr2=0x7f6aa40b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:33.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.592+0000 7f6aac400640 1 -- 172.21.15.8:0/267202281 shutdown_connections 2024-05-26T15:43:33.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.592+0000 7f6aac400640 1 -- 172.21.15.8:0/267202281 wait complete. 2024-05-26T15:43:33.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.594+0000 7f6aac400640 1 Processor -- start 2024-05-26T15:43:33.592 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.594+0000 7f6aac400640 1 -- start start 2024-05-26T15:43:33.593 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.595+0000 7f6aac400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6aa4070660 0x7f6aa4142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.595+0000 7f6aac400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6aa40cd4d0 0x7f6aa4153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.595+0000 7f6aac400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 0x7f6aa41f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.595+0000 7f6aac400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa41433d0 con 0x7f6aa4144270 2024-05-26T15:43:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.595+0000 7f6aac400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa415ddc0 con 0x7f6aa4070660 2024-05-26T15:43:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.595+0000 7f6aac400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa415e0a0 con 0x7f6aa40cd4d0 2024-05-26T15:43:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.595+0000 7f6aaa400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 0x7f6aa41f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.595+0000 7f6aaa400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 0x7f6aa41f38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34140/0 (socket says 172.21.15.8:34140) 2024-05-26T15:43:33.594 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.595+0000 7f6aaa400640 1 -- 172.21.15.8:0/2394534808 learned_addr learned my addr 172.21.15.8:0/2394534808 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:33.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aaa400640 1 -- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6aa40cd4d0 msgr2=0x7f6aa4153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aa9000640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6aa40cd4d0 0x7f6aa4153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aaa400640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6aa40cd4d0 0x7f6aa4153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aaa400640 1 -- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6aa4070660 msgr2=0x7f6aa4142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.595 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aaa400640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6aa4070660 0x7f6aa4142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aaa400640 1 -- 172.21.15.8:0/2394534808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a94009400 con 0x7f6aa4144270 2024-05-26T15:43:33.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aaa400640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 0x7f6aa41f38b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00c7e0 tx=0x7f6a9c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:33.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aa1600640 1 -- 172.21.15.8:0/2394534808 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00a640 con 0x7f6aa4144270 2024-05-26T15:43:33.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aa1600640 1 -- 172.21.15.8:0/2394534808 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9c00a7c0 con 0x7f6aa4144270 2024-05-26T15:43:33.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aa1600640 1 -- 172.21.15.8:0/2394534808 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c00ab70 con 0x7f6aa4144270 2024-05-26T15:43:33.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.596+0000 7f6aac400640 1 -- 172.21.15.8:0/2394534808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa415e380 con 0x7f6aa4144270 2024-05-26T15:43:33.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.597+0000 7f6aac400640 1 -- 172.21.15.8:0/2394534808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa415e940 con 0x7f6aa4144270 2024-05-26T15:43:33.596 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.598+0000 7f6aac400640 1 -- 172.21.15.8:0/2394534808 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa415eb30 con 0x7f6aa4144270 2024-05-26T15:43:33.597 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.598+0000 7f6aa1600640 1 -- 172.21.15.8:0/2394534808 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a9c00acd0 con 0x7f6aa4144270 2024-05-26T15:43:33.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.599+0000 7f6aa1600640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a8406ac00 0x7f6a8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:33.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.599+0000 7f6aa1600640 1 -- 172.21.15.8:0/2394534808 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f6a9c088880 con 0x7f6aa4144270 2024-05-26T15:43:33.598 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.600+0000 7f6aa9a00640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a8406ac00 0x7f6a8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:33.599 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.601+0000 7f6aa9a00640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a8406ac00 0x7f6a8406d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6a94034000 tx=0x7f6a9402c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:33.602 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.604+0000 7f6aa1600640 1 -- 172.21.15.8:0/2394534808 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6a9c053b20 con 0x7f6aa4144270 2024-05-26T15:43:33.806 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.807+0000 7f6aac400640 1 -- 172.21.15.8:0/2394534808 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6aa4144650 con 0x7f6a8406ac00 2024-05-26T15:43:33.807 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.808+0000 7f6aa1600640 1 -- 172.21.15.8:0/2394534808 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a94004020 con 0x7f6a8406ac00 2024-05-26T15:43:33.807 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 0 to deep-scrub 2024-05-26T15:43:33.810 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.811+0000 7f6aac400640 1 -- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a8406ac00 msgr2=0x7f6a8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.811+0000 7f6aac400640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a8406ac00 0x7f6a8406d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6a94034000 tx=0x7f6a9402c000 comp rx=0 tx=0).stop 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.811+0000 7f6aac400640 1 -- 172.21.15.8:0/2394534808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 msgr2=0x7f6aa41f38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.811+0000 7f6aac400640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 0x7f6aa41f38b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00c7e0 tx=0x7f6a9c00cca0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.812+0000 7f6aac400640 1 -- 172.21.15.8:0/2394534808 shutdown_connections 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.812+0000 7f6aac400640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6aa4144270 0x7f6aa41f38b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.812+0000 7f6aac400640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f6aa40cd4d0 0x7f6aa4153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.812+0000 7f6aac400640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f6a8406ac00 0x7f6a8406d0c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.812+0000 7f6aac400640 1 --2- 172.21.15.8:0/2394534808 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6aa4070660 0x7f6aa4142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.812+0000 7f6aac400640 1 -- 172.21.15.8:0/2394534808 >> 172.21.15.8:0/2394534808 conn(0x7f6aa40b0570 msgr2=0x7f6aa415c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.812+0000 7f6aac400640 1 -- 172.21.15.8:0/2394534808 shutdown_connections 2024-05-26T15:43:33.811 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:33.812+0000 7f6aac400640 1 -- 172.21.15.8:0/2394534808 wait complete. 2024-05-26T15:43:33.831 INFO:tasks.ceph:Scrubbing osd.1 2024-05-26T15:43:33.831 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-26T15:43:34.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.050+0000 7fc247e00640 1 Processor -- start 2024-05-26T15:43:34.049 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.050+0000 7fc247e00640 1 -- start start 2024-05-26T15:43:34.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.052+0000 7fc247e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc248143660 0x7fc24806d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.055 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.052+0000 7fc247e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2480cd460 con 0x7fc248143280 2024-05-26T15:43:34.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.052+0000 7fc247e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24806d940 con 0x7fc2480cb8d0 2024-05-26T15:43:34.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.052+0000 7fc247e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24806df00 con 0x7fc248143660 2024-05-26T15:43:34.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.052+0000 7fc246a00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc248143280 0x7fc2480cb1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34834/0 (socket says 172.21.15.8:34834) 2024-05-26T15:43:34.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.052+0000 7fc246a00640 1 -- 172.21.15.8:0/405305725 learned_addr learned my addr 172.21.15.8:0/405305725 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:34.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.052+0000 7fc247400640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc248143660 0x7fc24806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.056 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.052+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672273986 0 0) 0x7fc2480cd460 con 0x7fc248143280 2024-05-26T15:43:34.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.052+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc22c003520 con 0x7fc248143280 2024-05-26T15:43:34.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2789572845 0 0) 0x7fc22c003520 con 0x7fc248143280 2024-05-26T15:43:34.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc248143660 msgr2=0x7fc24806d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:34.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc248143660 0x7fc24806d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.057 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 >> v1:172.21.15.47:6789/0 conn(0x7fc2480cb8d0 legacy=0x7fc24806cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24806dc20 con 0x7fc248143280 2024-05-26T15:43:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fc238001690 con 0x7fc248143280 2024-05-26T15:43:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 >> v1:172.21.15.8:6789/0 conn(0x7fc248143280 legacy=0x7fc2480cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc22c0039a0 0x7fc22c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc22c0047c0 0x7fc22c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.058 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc248143660 0x7fc22c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24806df00 con 0x7fc22c0047c0 2024-05-26T15:43:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c00bb70 con 0x7fc22c0039a0 2024-05-26T15:43:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c00bd30 con 0x7fc248143660 2024-05-26T15:43:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.053+0000 7fc246000640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc22c0047c0 0x7fc22c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.054+0000 7fc247400640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc248143660 0x7fc22c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.059 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.054+0000 7fc246a00640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc22c0039a0 0x7fc22c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.054+0000 7fc246000640 1 -- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc248143660 msgr2=0x7fc22c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.054+0000 7fc246000640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc248143660 0x7fc22c005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.054+0000 7fc246000640 1 -- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc22c0039a0 msgr2=0x7fc22c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.054+0000 7fc246000640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc22c0039a0 0x7fc22c003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.054+0000 7fc246000640 1 -- 172.21.15.8:0/405305725 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c003520 con 0x7fc22c0047c0 2024-05-26T15:43:34.060 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.055+0000 7fc246000640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc22c0047c0 0x7fc22c004c40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc234001720 tx=0x7fc22c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f575a3a027645b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.055+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340052d0 con 0x7fc22c0047c0 2024-05-26T15:43:34.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.055+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234005430 con 0x7fc22c0047c0 2024-05-26T15:43:34.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.055+0000 7fc245600640 1 -- 172.21.15.8:0/405305725 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23402ab90 con 0x7fc22c0047c0 2024-05-26T15:43:34.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.056+0000 7fc247e00640 1 -- 172.21.15.8:0/405305725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc22c0047c0 msgr2=0x7fc22c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.056+0000 7fc247e00640 1 --2- 172.21.15.8:0/405305725 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc22c0047c0 0x7fc22c004c40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fc234001720 tx=0x7fc22c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.061 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.056+0000 7fc247400640 1 -- 172.21.15.8:0/405305725 reap_dead start 2024-05-26T15:43:34.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.056+0000 7fc247e00640 1 -- 172.21.15.8:0/405305725 shutdown_connections 2024-05-26T15:43:34.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.056+0000 7fc247e00640 1 -- 172.21.15.8:0/405305725 >> 172.21.15.8:0/405305725 conn(0x7fc248069e70 msgr2=0x7fc24806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:34.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.056+0000 7fc247e00640 1 -- 172.21.15.8:0/405305725 shutdown_connections 2024-05-26T15:43:34.062 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.056+0000 7fc247e00640 1 -- 172.21.15.8:0/405305725 wait complete. 2024-05-26T15:43:34.067 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.058+0000 7fc247e00640 1 Processor -- start 2024-05-26T15:43:34.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.058+0000 7fc247e00640 1 -- start start 2024-05-26T15:43:34.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.059+0000 7fc247e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc22c0047c0 0x7fc2480b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.059+0000 7fc247e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2481e66d0 0x7fc2481e55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.059+0000 7fc247e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2481e6b50 0x7fc2481e5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.059+0000 7fc247e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2481e5190 con 0x7fc2481e6b50 2024-05-26T15:43:34.068 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.059+0000 7fc247e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2481e4300 con 0x7fc2481e66d0 2024-05-26T15:43:34.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.059+0000 7fc247e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2481e4510 con 0x7fc22c0047c0 2024-05-26T15:43:34.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.059+0000 7fc247400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2481e6b50 0x7fc2481e5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.059+0000 7fc247400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2481e6b50 0x7fc2481e5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34154/0 (socket says 172.21.15.8:34154) 2024-05-26T15:43:34.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.059+0000 7fc247400640 1 -- 172.21.15.8:0/188793881 learned_addr learned my addr 172.21.15.8:0/188793881 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:34.069 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.060+0000 7fc246000640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2481e66d0 0x7fc2481e55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.060+0000 7fc246a00640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc22c0047c0 0x7fc2480b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.060+0000 7fc247400640 1 -- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc22c0047c0 msgr2=0x7fc2480b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.060+0000 7fc247400640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc22c0047c0 0x7fc2480b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.060+0000 7fc247400640 1 -- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2481e66d0 msgr2=0x7fc2481e55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.060+0000 7fc247400640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2481e66d0 0x7fc2481e55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.070 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.060+0000 7fc247400640 1 -- 172.21.15.8:0/188793881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2481e47f0 con 0x7fc2481e6b50 2024-05-26T15:43:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.060+0000 7fc247400640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2481e6b50 0x7fc2481e5af0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc2480ccfd0 tx=0x7fc240009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.061+0000 7fc23ea00640 1 -- 172.21.15.8:0/188793881 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240007cf0 con 0x7fc2481e6b50 2024-05-26T15:43:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.061+0000 7fc23ea00640 1 -- 172.21.15.8:0/188793881 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240007e70 con 0x7fc2481e6b50 2024-05-26T15:43:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.061+0000 7fc23ea00640 1 -- 172.21.15.8:0/188793881 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240014620 con 0x7fc2481e6b50 2024-05-26T15:43:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.061+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2481e4ad0 con 0x7fc2481e6b50 2024-05-26T15:43:34.071 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.061+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24813b430 con 0x7fc2481e6b50 2024-05-26T15:43:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.062+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2480cd9e0 con 0x7fc2481e6b50 2024-05-26T15:43:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.063+0000 7fc23ea00640 1 -- 172.21.15.8:0/188793881 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc24001d3b0 con 0x7fc2481e6b50 2024-05-26T15:43:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.064+0000 7fc23ea00640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc22806ac00 0x7fc22806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.064+0000 7fc23ea00640 1 -- 172.21.15.8:0/188793881 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc240088f70 con 0x7fc2481e6b50 2024-05-26T15:43:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.064+0000 7fc23ea00640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] conn(0x7fc228070fa0 0x7fc2280733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.072 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.064+0000 7fc23ea00640 1 -- 172.21.15.8:0/188793881 --> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc228073ab0 con 0x7fc228070fa0 2024-05-26T15:43:34.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.064+0000 7fc23ea00640 1 -- 172.21.15.8:0/188793881 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc24008b630 con 0x7fc2481e6b50 2024-05-26T15:43:34.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.065+0000 7fc246000640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] conn(0x7fc228070fa0 0x7fc2280733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.065+0000 7fc246a00640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc22806ac00 0x7fc22806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.065+0000 7fc246000640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] conn(0x7fc228070fa0 0x7fc2280733e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.066+0000 7fc246a00640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc22806ac00 0x7fc22806d0c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc238000c00 tx=0x7fc238009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.073 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.066+0000 7fc23ea00640 1 -- 172.21.15.8:0/188793881 <== osd.1 v2:172.21.15.8:6808/36923 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc228073ab0 con 0x7fc228070fa0 2024-05-26T15:43:34.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.081+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 --> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc2481e52d0 con 0x7fc228070fa0 2024-05-26T15:43:34.079 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.081+0000 7fc23ea00640 1 -- 172.21.15.8:0/188793881 <== osd.1 v2:172.21.15.8:6808/36923 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc2481e52d0 con 0x7fc228070fa0 2024-05-26T15:43:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:43:34.080 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-26T15:43:34.080 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.081+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 >> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] conn(0x7fc228070fa0 msgr2=0x7fc2280733e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.081+0000 7fc247e00640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.8:6808/36923,v1:172.21.15.8:6809/36923] conn(0x7fc228070fa0 0x7fc2280733e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.082+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc22806ac00 msgr2=0x7fc22806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.082+0000 7fc247e00640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc22806ac00 0x7fc22806d0c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc238000c00 tx=0x7fc238009040 comp rx=0 tx=0).stop 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.082+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2481e6b50 msgr2=0x7fc2481e5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.082+0000 7fc247e00640 1 --2- 172.21.15.8:0/188793881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc2481e6b50 0x7fc2481e5af0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc2480ccfd0 tx=0x7fc240009d30 comp rx=0 tx=0).stop 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.082+0000 7fc247400640 1 -- 172.21.15.8:0/188793881 reap_dead start 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.082+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 shutdown_connections 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.082+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 >> 172.21.15.8:0/188793881 conn(0x7fc248069e70 msgr2=0x7fc248159e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.082+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 shutdown_connections 2024-05-26T15:43:34.081 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.082+0000 7fc247e00640 1 -- 172.21.15.8:0/188793881 wait complete. 2024-05-26T15:43:34.099 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-26T15:43:34.309 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.310+0000 7faf0a200640 1 Processor -- start 2024-05-26T15:43:34.310 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.310+0000 7faf0a200640 1 -- start start 2024-05-26T15:43:34.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.311+0000 7faf0a200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faf040b0630 0x7faf040b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.311+0000 7faf0a200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faf040cb890 0x7faf040cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.311+0000 7faf0a200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf040cc1e0 con 0x7faf040cdfe0 2024-05-26T15:43:34.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.311+0000 7faf0a200640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0415be70 con 0x7faf040b0630 2024-05-26T15:43:34.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.311+0000 7faf0a200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0415b2f0 con 0x7faf040cb890 2024-05-26T15:43:34.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.312+0000 7faf03e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faf040b0630 0x7faf040b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.312+0000 7faf08e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7faf040cdfe0 0x7faf0406c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:54760/0 (socket says 172.21.15.8:54760) 2024-05-26T15:43:34.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.312+0000 7faf08e00640 1 -- 172.21.15.8:0/1649754204 learned_addr learned my addr 172.21.15.8:0/1649754204 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:34.311 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.312+0000 7faf09800640 1 --2- 172.21.15.8:0/1649754204 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faf040cb890 0x7faf040cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.313+0000 7faf03e00640 1 -- 172.21.15.8:0/1649754204 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faf040cb890 msgr2=0x7faf040cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:34.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.313+0000 7faf03e00640 1 --2- 172.21.15.8:0/1649754204 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faf040cb890 0x7faf040cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.313+0000 7faf03e00640 1 -- 172.21.15.8:0/1649754204 >> v1:172.21.15.47:6789/0 conn(0x7faf040cdfe0 legacy=0x7faf0406c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.313+0000 7faf03e00640 1 -- 172.21.15.8:0/1649754204 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0415b5d0 con 0x7faf040b0630 2024-05-26T15:43:34.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.314+0000 7faf03e00640 1 --2- 172.21.15.8:0/1649754204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 0x7faf040b0ae0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7faef00097a0 tx=0x7faef002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b02219a65d12a1c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.314+0000 7faf03400640 1 -- 172.21.15.8:0/1649754204 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0032440 con 0x7faf040b0630 2024-05-26T15:43:34.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.314+0000 7faf03400640 1 -- 172.21.15.8:0/1649754204 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef00325a0 con 0x7faf040b0630 2024-05-26T15:43:34.313 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.314+0000 7faf03400640 1 -- 172.21.15.8:0/1649754204 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0032930 con 0x7faf040b0630 2024-05-26T15:43:34.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.315+0000 7faf0a200640 1 -- 172.21.15.8:0/1649754204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 msgr2=0x7faf040b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.315+0000 7faf0a200640 1 --2- 172.21.15.8:0/1649754204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 0x7faf040b0ae0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7faef00097a0 tx=0x7faef002a180 comp rx=0 tx=0).stop 2024-05-26T15:43:34.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.315+0000 7faf0a200640 1 -- 172.21.15.8:0/1649754204 shutdown_connections 2024-05-26T15:43:34.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.315+0000 7faf0a200640 1 --2- 172.21.15.8:0/1649754204 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faf040cb890 0x7faf040cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.315+0000 7faf0a200640 1 --2- 172.21.15.8:0/1649754204 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 0x7faf040b0ae0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.315+0000 7faf0a200640 1 -- 172.21.15.8:0/1649754204 >> 172.21.15.8:0/1649754204 conn(0x7faf04069e70 msgr2=0x7faf0406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:34.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.315+0000 7faf0a200640 1 -- 172.21.15.8:0/1649754204 shutdown_connections 2024-05-26T15:43:34.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.315+0000 7faf0a200640 1 -- 172.21.15.8:0/1649754204 wait complete. 2024-05-26T15:43:34.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.317+0000 7faf0a200640 1 Processor -- start 2024-05-26T15:43:34.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.317+0000 7faf0a200640 1 -- start start 2024-05-26T15:43:34.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf0a200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 0x7faf041409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf0a200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faf040cb890 0x7faf040af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf0a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf040cdfe0 0x7faf040afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf0a200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040a76c0 con 0x7faf040b0630 2024-05-26T15:43:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf0a200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf04140f20 con 0x7faf040cdfe0 2024-05-26T15:43:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf0a200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf04142f90 con 0x7faf040cb890 2024-05-26T15:43:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf08e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 0x7faf041409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf08e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 0x7faf041409e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34160/0 (socket says 172.21.15.8:34160) 2024-05-26T15:43:34.317 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf08e00640 1 -- 172.21.15.8:0/3412812398 learned_addr learned my addr 172.21.15.8:0/3412812398 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:34.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf08e00640 1 -- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faf040cb890 msgr2=0x7faf040af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf08e00640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faf040cb890 0x7faf040af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf08e00640 1 -- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf040cdfe0 msgr2=0x7faf040afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf08e00640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf040cdfe0 0x7faf040afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.318+0000 7faf08e00640 1 -- 172.21.15.8:0/3412812398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef0009400 con 0x7faf040b0630 2024-05-26T15:43:34.318 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.319+0000 7faf08e00640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 0x7faf041409e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7faef800c480 tx=0x7faef800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.319+0000 7faf00c00640 1 -- 172.21.15.8:0/3412812398 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8005ce0 con 0x7faf040b0630 2024-05-26T15:43:34.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.319+0000 7faf00c00640 1 -- 172.21.15.8:0/3412812398 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef8005e40 con 0x7faf040b0630 2024-05-26T15:43:34.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.319+0000 7faf00c00640 1 -- 172.21.15.8:0/3412812398 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef80072f0 con 0x7faf040b0630 2024-05-26T15:43:34.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.319+0000 7faf0a200640 1 -- 172.21.15.8:0/3412812398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf04141ef0 con 0x7faf040b0630 2024-05-26T15:43:34.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.319+0000 7faf0a200640 1 -- 172.21.15.8:0/3412812398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf041424b0 con 0x7faf040b0630 2024-05-26T15:43:34.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.320+0000 7faf0a200640 1 -- 172.21.15.8:0/3412812398 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0406ae00 con 0x7faf040b0630 2024-05-26T15:43:34.319 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.321+0000 7faf00c00640 1 -- 172.21.15.8:0/3412812398 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faef8007510 con 0x7faf040b0630 2024-05-26T15:43:34.320 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.322+0000 7faf00c00640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faee406ac00 0x7faee406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.322+0000 7faf00c00640 1 -- 172.21.15.8:0/3412812398 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7faef8088700 con 0x7faf040b0630 2024-05-26T15:43:34.321 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.323+0000 7faf03e00640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faee406ac00 0x7faee406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.322 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.324+0000 7faf03e00640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faee406ac00 0x7faee406d0c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faef0034000 tx=0x7faef002c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.325 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.327+0000 7faf00c00640 1 -- 172.21.15.8:0/3412812398 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faef8053ae0 con 0x7faf040b0630 2024-05-26T15:43:34.523 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.524+0000 7faf0a200640 1 -- 172.21.15.8:0/3412812398 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7faf0415bb90 con 0x7faee406ac00 2024-05-26T15:43:34.524 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.526+0000 7faf00c00640 1 -- 172.21.15.8:0/3412812398 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faef0006e10 con 0x7faee406ac00 2024-05-26T15:43:34.524 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 1 to deep-scrub 2024-05-26T15:43:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.528+0000 7faf0a200640 1 -- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faee406ac00 msgr2=0x7faee406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.528+0000 7faf0a200640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faee406ac00 0x7faee406d0c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faef0034000 tx=0x7faef002c000 comp rx=0 tx=0).stop 2024-05-26T15:43:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.528+0000 7faf0a200640 1 -- 172.21.15.8:0/3412812398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 msgr2=0x7faf041409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.527 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.528+0000 7faf0a200640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 0x7faf041409e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7faef800c480 tx=0x7faef800c940 comp rx=0 tx=0).stop 2024-05-26T15:43:34.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.528+0000 7faf0a200640 1 -- 172.21.15.8:0/3412812398 shutdown_connections 2024-05-26T15:43:34.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.528+0000 7faf0a200640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7faee406ac00 0x7faee406d0c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.528+0000 7faf0a200640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faf040cdfe0 0x7faf040afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.528+0000 7faf0a200640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7faf040cb890 0x7faf040af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.528+0000 7faf0a200640 1 --2- 172.21.15.8:0/3412812398 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faf040b0630 0x7faf041409e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.528+0000 7faf0a200640 1 -- 172.21.15.8:0/3412812398 >> 172.21.15.8:0/3412812398 conn(0x7faf04069e70 msgr2=0x7faf040ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:34.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.529+0000 7faf0a200640 1 -- 172.21.15.8:0/3412812398 shutdown_connections 2024-05-26T15:43:34.528 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.529+0000 7faf0a200640 1 -- 172.21.15.8:0/3412812398 wait complete. 2024-05-26T15:43:34.547 INFO:tasks.ceph:Scrubbing osd.2 2024-05-26T15:43:34.547 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-26T15:43:34.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.761+0000 7f13e9600640 1 Processor -- start 2024-05-26T15:43:34.760 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.761+0000 7f13e9600640 1 -- start start 2024-05-26T15:43:34.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.763+0000 7f13e9600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e415d260 0x7f13e40ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.763+0000 7f13e9600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f13e415d640 0x7f13e415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.763+0000 7f13e9600640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e4146930 con 0x7f13e40b38f0 2024-05-26T15:43:34.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.763+0000 7f13e9600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e40abfd0 con 0x7f13e415d640 2024-05-26T15:43:34.762 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.763+0000 7f13e9600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e40b4640 con 0x7f13e415d260 2024-05-26T15:43:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.764+0000 7f13e3400640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f13e40b38f0 0x7f13e40b3d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34838/0 (socket says 172.21.15.8:34838) 2024-05-26T15:43:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.764+0000 7f13e3400640 1 -- 172.21.15.8:0/3301242336 learned_addr learned my addr 172.21.15.8:0/3301242336 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.764+0000 7f13e2a00640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e415d260 0x7f13e40ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.764+0000 7f13dbe00640 1 --2- 172.21.15.8:0/3301242336 >> v2:172.21.15.47:3300/0 conn(0x7f13e415d640 0x7f13e415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.764+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743306731 0 0) 0x7f13e4146930 con 0x7f13e40b38f0 2024-05-26T15:43:34.763 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.764+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c8003520 con 0x7f13e40b38f0 2024-05-26T15:43:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 867969475 0 0) 0x7f13c8003520 con 0x7f13e40b38f0 2024-05-26T15:43:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e415d260 msgr2=0x7f13e40ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:34.764 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e415d260 0x7f13e40ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 >> v2:172.21.15.47:3300/0 conn(0x7f13e415d640 msgr2=0x7f13e415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 --2- 172.21.15.8:0/3301242336 >> v2:172.21.15.47:3300/0 conn(0x7f13e415d640 0x7f13e415dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e40b4920 con 0x7f13e40b38f0 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f13dc0019f0 con 0x7f13e40b38f0 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 >> v1:172.21.15.8:6789/0 conn(0x7f13e40b38f0 legacy=0x7f13e40b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 0x7f13c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e415d260 0x7f13c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c8004d00 0x7f13c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e40abfd0 con 0x7f13c8003970 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e40b4640 con 0x7f13c8004d00 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c800b9b0 con 0x7f13e415d260 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.765+0000 7f13e2a00640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 0x7f13c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.766+0000 7f13dbe00640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e415d260 0x7f13c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.766+0000 7f13e2a00640 1 -- 172.21.15.8:0/3301242336 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e415d260 msgr2=0x7f13c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.766+0000 7f13e2a00640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e415d260 0x7f13c80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.765 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.766+0000 7f13e2a00640 1 -- 172.21.15.8:0/3301242336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c8004d00 msgr2=0x7f13c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.766+0000 7f13e2a00640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13c8004d00 0x7f13c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.766 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.766+0000 7f13e2a00640 1 -- 172.21.15.8:0/3301242336 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c8003520 con 0x7f13c8003970 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.767+0000 7f13e2a00640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 0x7f13c8003d90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009ac0 tx=0x7f13c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7b52fa831df1ca server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.767+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4031400 con 0x7f13c8003970 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.767+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d402d050 con 0x7f13c8003970 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.767+0000 7f13e2000640 1 -- 172.21.15.8:0/3301242336 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4031780 con 0x7f13c8003970 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.768+0000 7f13e9600640 1 -- 172.21.15.8:0/3301242336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 msgr2=0x7f13c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.768+0000 7f13e9600640 1 --2- 172.21.15.8:0/3301242336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 0x7f13c8003d90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009ac0 tx=0x7f13c80057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.768+0000 7f13e3400640 1 -- 172.21.15.8:0/3301242336 reap_dead start 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.768+0000 7f13e9600640 1 -- 172.21.15.8:0/3301242336 shutdown_connections 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.768+0000 7f13e9600640 1 -- 172.21.15.8:0/3301242336 >> 172.21.15.8:0/3301242336 conn(0x7f13e406a660 msgr2=0x7f13e40b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.768+0000 7f13e9600640 1 -- 172.21.15.8:0/3301242336 shutdown_connections 2024-05-26T15:43:34.767 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.768+0000 7f13e9600640 1 -- 172.21.15.8:0/3301242336 wait complete. 2024-05-26T15:43:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.770+0000 7f13e9600640 1 Processor -- start 2024-05-26T15:43:34.768 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.770+0000 7f13e9600640 1 -- start start 2024-05-26T15:43:34.769 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.771+0000 7f13e9600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 0x7f13e4138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.771+0000 7f13e9600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e413e2b0 0x7f13e4142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.771+0000 7f13e9600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13e413e730 0x7f13e4143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.771+0000 7f13e9600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e4142b60 con 0x7f13c8003970 2024-05-26T15:43:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.771+0000 7f13e9600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e413ed00 con 0x7f13e413e730 2024-05-26T15:43:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.771+0000 7f13e9600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e413efe0 con 0x7f13e413e2b0 2024-05-26T15:43:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.771+0000 7f13e2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 0x7f13e4138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.771+0000 7f13e2a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 0x7f13e4138ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34172/0 (socket says 172.21.15.8:34172) 2024-05-26T15:43:34.770 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.771+0000 7f13e2a00640 1 -- 172.21.15.8:0/3967430912 learned_addr learned my addr 172.21.15.8:0/3967430912 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.772+0000 7f13e2a00640 1 -- 172.21.15.8:0/3967430912 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e413e2b0 msgr2=0x7f13e4142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.772+0000 7f13e2a00640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f13e413e2b0 0x7f13e4142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.772+0000 7f13e2a00640 1 -- 172.21.15.8:0/3967430912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13e413e730 msgr2=0x7f13e4143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.772+0000 7f13e2a00640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f13e413e730 0x7f13e4143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.772+0000 7f13e2a00640 1 -- 172.21.15.8:0/3967430912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e41427f0 con 0x7f13c8003970 2024-05-26T15:43:34.771 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.772+0000 7f13e2a00640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 0x7f13e4138ae0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009ac0 tx=0x7f13d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.772+0000 7f13daa00640 1 -- 172.21.15.8:0/3967430912 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4003bd0 con 0x7f13c8003970 2024-05-26T15:43:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.772+0000 7f13daa00640 1 -- 172.21.15.8:0/3967430912 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d4003d30 con 0x7f13c8003970 2024-05-26T15:43:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.772+0000 7f13daa00640 1 -- 172.21.15.8:0/3967430912 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4003ea0 con 0x7f13c8003970 2024-05-26T15:43:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.772+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e415c5c0 con 0x7f13c8003970 2024-05-26T15:43:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.773+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e4143c50 con 0x7f13c8003970 2024-05-26T15:43:34.772 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.773+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13e415e000 con 0x7f13c8003970 2024-05-26T15:43:34.773 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.775+0000 7f13daa00640 1 -- 172.21.15.8:0/3967430912 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13d4038070 con 0x7f13c8003970 2024-05-26T15:43:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.775+0000 7f13daa00640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f13c006ac00 0x7f13c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.776+0000 7f13daa00640 1 -- 172.21.15.8:0/3967430912 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f13d40a9310 con 0x7f13c8003970 2024-05-26T15:43:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.776+0000 7f13daa00640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] conn(0x7f13c0070fa0 0x7f13c00733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.776+0000 7f13daa00640 1 -- 172.21.15.8:0/3967430912 --> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13c0073ab0 con 0x7f13c0070fa0 2024-05-26T15:43:34.774 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.776+0000 7f13daa00640 1 -- 172.21.15.8:0/3967430912 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13d40ab9d0 con 0x7f13c8003970 2024-05-26T15:43:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.776+0000 7f13dbe00640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f13c006ac00 0x7f13c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.776+0000 7f13e3400640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] conn(0x7f13c0070fa0 0x7f13c00733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.777+0000 7f13e3400640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] conn(0x7f13c0070fa0 0x7f13c00733e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.775 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.777+0000 7f13dbe00640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f13c006ac00 0x7f13c006d0c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f13e413c730 tx=0x7f13cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:34.776 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.778+0000 7f13daa00640 1 -- 172.21.15.8:0/3967430912 <== osd.2 v2:172.21.15.8:6800/36922 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f13c0073ab0 con 0x7f13c0070fa0 2024-05-26T15:43:34.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.792+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 --> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f13e40ac500 con 0x7f13c0070fa0 2024-05-26T15:43:34.791 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.792+0000 7f13daa00640 1 -- 172.21.15.8:0/3967430912 <== osd.2 v2:172.21.15.8:6800/36922 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f13dc001e00 con 0x7f13c0070fa0 2024-05-26T15:43:34.791 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:43:34.791 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-26T15:43:34.791 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:43:34.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 >> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] conn(0x7f13c0070fa0 msgr2=0x7f13c00733e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e9600640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.8:6800/36922,v1:172.21.15.8:6801/36922] conn(0x7f13c0070fa0 0x7f13c00733e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:34.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f13c006ac00 msgr2=0x7f13c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e9600640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f13c006ac00 0x7f13c006d0c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f13e413c730 tx=0x7f13cc008040 comp rx=0 tx=0).stop 2024-05-26T15:43:34.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 msgr2=0x7f13e4138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:34.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e9600640 1 --2- 172.21.15.8:0/3967430912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f13c8003970 0x7f13e4138ae0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009ac0 tx=0x7f13d4004730 comp rx=0 tx=0).stop 2024-05-26T15:43:34.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e3400640 1 -- 172.21.15.8:0/3967430912 reap_dead start 2024-05-26T15:43:34.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 shutdown_connections 2024-05-26T15:43:34.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 >> 172.21.15.8:0/3967430912 conn(0x7f13e406a660 msgr2=0x7f13e40cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:34.792 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 shutdown_connections 2024-05-26T15:43:34.793 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:34.793+0000 7f13e9600640 1 -- 172.21.15.8:0/3967430912 wait complete. 2024-05-26T15:43:34.808 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-26T15:43:35.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.015+0000 7fab9e600640 1 Processor -- start 2024-05-26T15:43:35.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.015+0000 7fab9e600640 1 -- start start 2024-05-26T15:43:35.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab9e600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fab9815cd10 0x7fab980d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab9e600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab980d2a90 0x7fab9815e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab9e600640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fab980cfa60 0x7fab980cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab9e600640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab980d0450 con 0x7fab980cfa60 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab9e600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab980d2f90 con 0x7fab9815cd10 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab9e600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab980d3270 con 0x7fab980d2a90 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab97e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fab980cfa60 0x7fab980cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab97e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fab980cfa60 0x7fab980cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34180/0 (socket says 172.21.15.8:34180) 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab97e00640 1 -- 172.21.15.8:0/494201989 learned_addr learned my addr 172.21.15.8:0/494201989 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab97400640 1 --2- 172.21.15.8:0/494201989 >> v2:172.21.15.47:3300/0 conn(0x7fab9815cd10 0x7fab980d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.017+0000 7fab96a00640 1 --2- 172.21.15.8:0/494201989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab980d2a90 0x7fab9815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.018+0000 7fab97e00640 1 -- 172.21.15.8:0/494201989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab980d2a90 msgr2=0x7fab9815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.018+0000 7fab97e00640 1 --2- 172.21.15.8:0/494201989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab980d2a90 0x7fab9815e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.018+0000 7fab97e00640 1 -- 172.21.15.8:0/494201989 >> v2:172.21.15.47:3300/0 conn(0x7fab9815cd10 msgr2=0x7fab980d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.018+0000 7fab97e00640 1 --2- 172.21.15.8:0/494201989 >> v2:172.21.15.47:3300/0 conn(0x7fab9815cd10 0x7fab980d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.018+0000 7fab97e00640 1 -- 172.21.15.8:0/494201989 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980d3550 con 0x7fab980cfa60 2024-05-26T15:43:35.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.018+0000 7fab97400640 1 --2- 172.21.15.8:0/494201989 >> v2:172.21.15.47:3300/0 conn(0x7fab9815cd10 0x7fab980d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:35.018 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.018+0000 7fab96a00640 1 --2- 172.21.15.8:0/494201989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab980d2a90 0x7fab9815e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.019+0000 7fab97e00640 1 --2- 172.21.15.8:0/494201989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980cfa60 0x7fab980cff10 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fab980cfa30 tx=0x7fab9002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff66773ec2a78d53 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.019+0000 7fab96000640 1 -- 172.21.15.8:0/494201989 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90031600 con 0x7fab980cfa60 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.019+0000 7fab96000640 1 -- 172.21.15.8:0/494201989 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9002d050 con 0x7fab980cfa60 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.019+0000 7fab96000640 1 -- 172.21.15.8:0/494201989 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90031980 con 0x7fab980cfa60 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.020+0000 7fab9e600640 1 -- 172.21.15.8:0/494201989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980cfa60 msgr2=0x7fab980cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.020+0000 7fab9e600640 1 --2- 172.21.15.8:0/494201989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980cfa60 0x7fab980cff10 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fab980cfa30 tx=0x7fab9002a730 comp rx=0 tx=0).stop 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.020+0000 7fab9e600640 1 -- 172.21.15.8:0/494201989 shutdown_connections 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.020+0000 7fab9e600640 1 --2- 172.21.15.8:0/494201989 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980cfa60 0x7fab980cff10 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.020+0000 7fab9e600640 1 --2- 172.21.15.8:0/494201989 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab980d2a90 0x7fab9815e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.020+0000 7fab9e600640 1 --2- 172.21.15.8:0/494201989 >> v2:172.21.15.47:3300/0 conn(0x7fab9815cd10 0x7fab980d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.019 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.020+0000 7fab9e600640 1 -- 172.21.15.8:0/494201989 >> 172.21.15.8:0/494201989 conn(0x7fab98071990 msgr2=0x7fab98071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:35.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.020+0000 7fab9e600640 1 -- 172.21.15.8:0/494201989 shutdown_connections 2024-05-26T15:43:35.020 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.020+0000 7fab9e600640 1 -- 172.21.15.8:0/494201989 wait complete. 2024-05-26T15:43:35.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.023+0000 7fab9e600640 1 Processor -- start 2024-05-26T15:43:35.021 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.023+0000 7fab9e600640 1 -- start start 2024-05-26T15:43:35.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.024+0000 7fab9e600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab980cfa60 0x7fab980c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.024+0000 7fab9e600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980d2a90 0x7fab9815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.024+0000 7fab9e600640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab9815cd10 0x7fab980b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.024+0000 7fab9e600640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980c70e0 con 0x7fab980d2a90 2024-05-26T15:43:35.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.024+0000 7fab9e600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980c73c0 con 0x7fab980cfa60 2024-05-26T15:43:35.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.024+0000 7fab9e600640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab980c76a0 con 0x7fab9815cd10 2024-05-26T15:43:35.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.024+0000 7fab96a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980d2a90 0x7fab9815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.025+0000 7fab96a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980d2a90 0x7fab9815bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34190/0 (socket says 172.21.15.8:34190) 2024-05-26T15:43:35.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.025+0000 7fab96a00640 1 -- 172.21.15.8:0/3735103408 learned_addr learned my addr 172.21.15.8:0/3735103408 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.025+0000 7fab97400640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab980cfa60 0x7fab980c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.025+0000 7fab96a00640 1 -- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab9815cd10 msgr2=0x7fab980b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.025+0000 7fab96a00640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab9815cd10 0x7fab980b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.025+0000 7fab96a00640 1 -- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab980cfa60 msgr2=0x7fab980c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.025+0000 7fab96a00640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab980cfa60 0x7fab980c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.025+0000 7fab96a00640 1 -- 172.21.15.8:0/3735103408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90009b30 con 0x7fab980d2a90 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.025+0000 7fab97400640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab980cfa60 0x7fab980c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.025+0000 7fab96a00640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980d2a90 0x7fab9815bb10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fab8000c7c0 tx=0x7fab8000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.026+0000 7fab8f400640 1 -- 172.21.15.8:0/3735103408 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab80007a30 con 0x7fab980d2a90 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.026+0000 7fab8f400640 1 -- 172.21.15.8:0/3735103408 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab80007b90 con 0x7fab980d2a90 2024-05-26T15:43:35.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.026+0000 7fab8f400640 1 -- 172.21.15.8:0/3735103408 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8000ce70 con 0x7fab980d2a90 2024-05-26T15:43:35.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.026+0000 7fab9e600640 1 -- 172.21.15.8:0/3735103408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab980c7980 con 0x7fab980d2a90 2024-05-26T15:43:35.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.026+0000 7fab9e600640 1 -- 172.21.15.8:0/3735103408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab980c6df0 con 0x7fab980d2a90 2024-05-26T15:43:35.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.027+0000 7fab9e600640 1 -- 172.21.15.8:0/3735103408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab980c7ea0 con 0x7fab980d2a90 2024-05-26T15:43:35.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.028+0000 7fab8f400640 1 -- 172.21.15.8:0/3735103408 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab800113f0 con 0x7fab980d2a90 2024-05-26T15:43:35.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.029+0000 7fab8f400640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab7406ac30 0x7fab7406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.030+0000 7fab8f400640 1 -- 172.21.15.8:0/3735103408 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fab800893c0 con 0x7fab980d2a90 2024-05-26T15:43:35.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.030+0000 7fab97400640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab7406ac30 0x7fab7406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.030 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.031+0000 7fab97400640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab7406ac30 0x7fab7406d0f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fab88006fd0 tx=0x7fab88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:35.033 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.035+0000 7fab8f400640 1 -- 172.21.15.8:0/3735103408 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fab980c7ea0 con 0x7fab980d2a90 2024-05-26T15:43:35.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.234+0000 7fab9e600640 1 -- 172.21.15.8:0/3735103408 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fab9815e8d0 con 0x7fab7406ac30 2024-05-26T15:43:35.234 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.235+0000 7fab8f400640 1 -- 172.21.15.8:0/3735103408 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fab8800c040 con 0x7fab7406ac30 2024-05-26T15:43:35.234 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 2 to deep-scrub 2024-05-26T15:43:35.237 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.238+0000 7fab9e600640 1 -- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab7406ac30 msgr2=0x7fab7406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.238+0000 7fab9e600640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab7406ac30 0x7fab7406d0f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fab88006fd0 tx=0x7fab88008040 comp rx=0 tx=0).stop 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.238+0000 7fab9e600640 1 -- 172.21.15.8:0/3735103408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980d2a90 msgr2=0x7fab9815bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.238+0000 7fab9e600640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980d2a90 0x7fab9815bb10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fab8000c7c0 tx=0x7fab8000cc80 comp rx=0 tx=0).stop 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.239+0000 7fab9e600640 1 -- 172.21.15.8:0/3735103408 shutdown_connections 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.239+0000 7fab9e600640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fab9815cd10 0x7fab980b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.239+0000 7fab9e600640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fab980d2a90 0x7fab9815bb10 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.239+0000 7fab9e600640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fab7406ac30 0x7fab7406d0f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.239+0000 7fab9e600640 1 --2- 172.21.15.8:0/3735103408 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fab980cfa60 0x7fab980c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.239+0000 7fab9e600640 1 -- 172.21.15.8:0/3735103408 >> 172.21.15.8:0/3735103408 conn(0x7fab98071990 msgr2=0x7fab9815ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.239+0000 7fab9e600640 1 -- 172.21.15.8:0/3735103408 shutdown_connections 2024-05-26T15:43:35.238 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.239+0000 7fab9e600640 1 -- 172.21.15.8:0/3735103408 wait complete. 2024-05-26T15:43:35.256 INFO:tasks.ceph:Scrubbing osd.3 2024-05-26T15:43:35.257 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-26T15:43:35.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.473+0000 7f565e200640 1 Processor -- start 2024-05-26T15:43:35.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.473+0000 7f565e200640 1 -- start start 2024-05-26T15:43:35.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.475+0000 7f565e200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5658160200 0x7f5658099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.475+0000 7f565e200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f56580b1e30 0x7f56580cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.475+0000 7f565e200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56580cf2c0 con 0x7f5658099d70 2024-05-26T15:43:35.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.475+0000 7f565e200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56580cf610 con 0x7f5658160200 2024-05-26T15:43:35.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.475+0000 7f565e200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56581605e0 con 0x7f56580b1e30 2024-05-26T15:43:35.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.476+0000 7f565ce00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5658160200 0x7f5658099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.476+0000 7f5657e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f56580b1e30 0x7f56580cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.476+0000 7f565ce00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5658160200 0x7f5658099830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:57828/0 (socket says 172.21.15.8:57828) 2024-05-26T15:43:35.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.476+0000 7f565ce00640 1 -- 172.21.15.8:0/2749463799 learned_addr learned my addr 172.21.15.8:0/2749463799 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:35.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.477+0000 7f565ce00640 1 -- 172.21.15.8:0/2749463799 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f56580b1e30 msgr2=0x7f56580cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:35.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.477+0000 7f565ce00640 1 --2- 172.21.15.8:0/2749463799 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f56580b1e30 0x7f56580cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.477+0000 7f565ce00640 1 -- 172.21.15.8:0/2749463799 >> v1:172.21.15.47:6789/0 conn(0x7f5658099d70 legacy=0x7f56580cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.477+0000 7f565ce00640 1 -- 172.21.15.8:0/2749463799 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565806ba30 con 0x7f5658160200 2024-05-26T15:43:35.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.478+0000 7f565ce00640 1 --2- 172.21.15.8:0/2749463799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658160200 0x7f5658099830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f564c009870 tx=0x7f564c02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=987bd88bf39ea46c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:35.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.479+0000 7f5657400640 1 -- 172.21.15.8:0/2749463799 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c032640 con 0x7f5658160200 2024-05-26T15:43:35.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.479+0000 7f5657400640 1 -- 172.21.15.8:0/2749463799 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c0327a0 con 0x7f5658160200 2024-05-26T15:43:35.477 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.479+0000 7f5657400640 1 -- 172.21.15.8:0/2749463799 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c032b30 con 0x7f5658160200 2024-05-26T15:43:35.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.479+0000 7f565e200640 1 -- 172.21.15.8:0/2749463799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658160200 msgr2=0x7f5658099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.479+0000 7f565e200640 1 --2- 172.21.15.8:0/2749463799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658160200 0x7f5658099830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f564c009870 tx=0x7f564c02a300 comp rx=0 tx=0).stop 2024-05-26T15:43:35.478 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.480+0000 7f565e200640 1 -- 172.21.15.8:0/2749463799 shutdown_connections 2024-05-26T15:43:35.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.480+0000 7f565e200640 1 --2- 172.21.15.8:0/2749463799 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f56580b1e30 0x7f56580cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.480+0000 7f565e200640 1 --2- 172.21.15.8:0/2749463799 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658160200 0x7f5658099830 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.480+0000 7f565e200640 1 -- 172.21.15.8:0/2749463799 >> 172.21.15.8:0/2749463799 conn(0x7f56580b2210 msgr2=0x7f56580b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:35.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.480+0000 7f565e200640 1 -- 172.21.15.8:0/2749463799 shutdown_connections 2024-05-26T15:43:35.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.480+0000 7f565e200640 1 -- 172.21.15.8:0/2749463799 wait complete. 2024-05-26T15:43:35.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.482+0000 7f565e200640 1 Processor -- start 2024-05-26T15:43:35.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.482+0000 7f565e200640 1 -- start start 2024-05-26T15:43:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.483+0000 7f565e200640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5658099d70 0x7f565815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.483+0000 7f565e200640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f56580b1e30 0x7f56580c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.483+0000 7f565e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658160200 0x7f56580c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.483+0000 7f565e200640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56580c4c70 con 0x7f5658099d70 2024-05-26T15:43:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.483+0000 7f565e200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56580c6680 con 0x7f5658160200 2024-05-26T15:43:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.483+0000 7f565e200640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56580c6960 con 0x7f56580b1e30 2024-05-26T15:43:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.483+0000 7f565ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5658099d70 0x7f565815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.483+0000 7f565ce00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5658099d70 0x7f565815a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34202/0 (socket says 172.21.15.8:34202) 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.483+0000 7f565ce00640 1 -- 172.21.15.8:0/945234495 learned_addr learned my addr 172.21.15.8:0/945234495 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.484+0000 7f565d800640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658160200 0x7f56580c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.484+0000 7f5657e00640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f56580b1e30 0x7f56580c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.484+0000 7f565ce00640 1 -- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f56580b1e30 msgr2=0x7f56580c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.484+0000 7f565ce00640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f56580b1e30 0x7f56580c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.484+0000 7f565ce00640 1 -- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658160200 msgr2=0x7f56580c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.484+0000 7f565ce00640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658160200 0x7f56580c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.484+0000 7f565ce00640 1 -- 172.21.15.8:0/945234495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0094d0 con 0x7f5658099d70 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.484+0000 7f565d800640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5658160200 0x7f56580c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.484+0000 7f565ce00640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5658099d70 0x7f565815a060 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f564c009870 tx=0x7f564c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.484+0000 7f5654c00640 1 -- 172.21.15.8:0/945234495 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c03b8d0 con 0x7f5658099d70 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.485+0000 7f5654c00640 1 -- 172.21.15.8:0/945234495 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c03ba30 con 0x7f5658099d70 2024-05-26T15:43:35.484 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.485+0000 7f5654c00640 1 -- 172.21.15.8:0/945234495 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c03bde0 con 0x7f5658099d70 2024-05-26T15:43:35.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.485+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56580c6c40 con 0x7f5658099d70 2024-05-26T15:43:35.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.485+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56580c7200 con 0x7f5658099d70 2024-05-26T15:43:35.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.486+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f565806bff0 con 0x7f5658099d70 2024-05-26T15:43:35.485 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.487+0000 7f5654c00640 1 -- 172.21.15.8:0/945234495 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f564c039040 con 0x7f5658099d70 2024-05-26T15:43:35.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.488+0000 7f5654c00640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f563c06ac00 0x7f563c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.486 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.488+0000 7f5654c00640 1 -- 172.21.15.8:0/945234495 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f564c0a9970 con 0x7f5658099d70 2024-05-26T15:43:35.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.488+0000 7f5654c00640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x7f563c070fa0 0x7f563c0733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.488+0000 7f5654c00640 1 -- 172.21.15.8:0/945234495 --> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f563c073ab0 con 0x7f563c070fa0 2024-05-26T15:43:35.487 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.489+0000 7f5654c00640 1 -- 172.21.15.8:0/945234495 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f564c0ae2a0 con 0x7f5658099d70 2024-05-26T15:43:35.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.489+0000 7f5657e00640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f563c06ac00 0x7f563c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.489+0000 7f565d800640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x7f563c070fa0 0x7f563c0733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.490+0000 7f565d800640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x7f563c070fa0 0x7f563c0733e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:35.488 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.490+0000 7f5657e00640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f563c06ac00 0x7f563c06d0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f565809e7b0 tx=0x7f5648008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:35.489 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.490+0000 7f5654c00640 1 -- 172.21.15.8:0/945234495 <== osd.3 v2:172.21.15.8:6813/36924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f563c073ab0 con 0x7f563c070fa0 2024-05-26T15:43:35.503 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.505+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 --> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f565804e210 con 0x7f563c070fa0 2024-05-26T15:43:35.504 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.505+0000 7f5654c00640 1 -- 172.21.15.8:0/945234495 <== osd.3 v2:172.21.15.8:6813/36924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f565804e210 con 0x7f563c070fa0 2024-05-26T15:43:35.504 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:43:35.504 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-26T15:43:35.504 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:43:35.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x7f563c070fa0 msgr2=0x7f563c0733e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565e200640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.8:6813/36924,v1:172.21.15.8:6815/36924] conn(0x7f563c070fa0 0x7f563c0733e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.505 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f563c06ac00 msgr2=0x7f563c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565e200640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f563c06ac00 0x7f563c06d0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f565809e7b0 tx=0x7f5648008040 comp rx=0 tx=0).stop 2024-05-26T15:43:35.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5658099d70 msgr2=0x7f565815a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565e200640 1 --2- 172.21.15.8:0/945234495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5658099d70 0x7f565815a060 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f564c009870 tx=0x7f564c0046c0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565d800640 1 -- 172.21.15.8:0/945234495 reap_dead start 2024-05-26T15:43:35.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 shutdown_connections 2024-05-26T15:43:35.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 >> 172.21.15.8:0/945234495 conn(0x7f56580b2210 msgr2=0x7f56580b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:35.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 shutdown_connections 2024-05-26T15:43:35.506 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.506+0000 7f565e200640 1 -- 172.21.15.8:0/945234495 wait complete. 2024-05-26T15:43:35.525 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-26T15:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.737+0000 7f18ae800640 1 Processor -- start 2024-05-26T15:43:35.736 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.738+0000 7f18ae800640 1 -- start start 2024-05-26T15:43:35.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.739+0000 7f18ae800640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f18a80b32e0 0x7f18a806d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.739+0000 7f18ae800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18a80b36c0 0x7f18a815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.738 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.739+0000 7f18ae800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a80ae1c0 con 0x7f18a815d930 2024-05-26T15:43:35.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.739+0000 7f18ae800640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a80cc1f0 con 0x7f18a80b32e0 2024-05-26T15:43:35.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.739+0000 7f18ae800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a806e370 con 0x7f18a80b36c0 2024-05-26T15:43:35.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.740+0000 7f18ad400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f18a80b32e0 0x7f18a806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.740+0000 7f18ad400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f18a80b32e0 0x7f18a806d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34218/0 (socket says 172.21.15.8:34218) 2024-05-26T15:43:35.739 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.740+0000 7f18ad400640 1 -- 172.21.15.8:0/1196557458 learned_addr learned my addr 172.21.15.8:0/1196557458 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.740+0000 7f18aca00640 1 --2- 172.21.15.8:0/1196557458 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18a80b36c0 0x7f18a815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.740+0000 7f18ad400640 1 -- 172.21.15.8:0/1196557458 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18a80b36c0 msgr2=0x7f18a815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.740+0000 7f18ad400640 1 --2- 172.21.15.8:0/1196557458 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18a80b36c0 0x7f18a815d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.740+0000 7f18ad400640 1 -- 172.21.15.8:0/1196557458 >> v1:172.21.15.47:6789/0 conn(0x7f18a815d930 legacy=0x7f18a80b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.740+0000 7f18ad400640 1 -- 172.21.15.8:0/1196557458 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a815ddc0 con 0x7f18a80b32e0 2024-05-26T15:43:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.740+0000 7f18aca00640 1 --2- 172.21.15.8:0/1196557458 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18a80b36c0 0x7f18a815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:35.740 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.742+0000 7f18ad400640 1 --2- 172.21.15.8:0/1196557458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 0x7f18a806d160 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f189c00bb40 tx=0x7f189c02c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adfb53dde69cd33 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:35.741 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.742+0000 7f18a7e00640 1 -- 172.21.15.8:0/1196557458 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c032790 con 0x7f18a80b32e0 2024-05-26T15:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.742+0000 7f18a7e00640 1 -- 172.21.15.8:0/1196557458 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c0328f0 con 0x7f18a80b32e0 2024-05-26T15:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.742+0000 7f18a7e00640 1 -- 172.21.15.8:0/1196557458 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c032c80 con 0x7f18a80b32e0 2024-05-26T15:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.743+0000 7f18ae800640 1 -- 172.21.15.8:0/1196557458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 msgr2=0x7f18a806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.743+0000 7f18ae800640 1 --2- 172.21.15.8:0/1196557458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 0x7f18a806d160 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f189c00bb40 tx=0x7f189c02c8d0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.743+0000 7f18ae800640 1 -- 172.21.15.8:0/1196557458 shutdown_connections 2024-05-26T15:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.743+0000 7f18ae800640 1 --2- 172.21.15.8:0/1196557458 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18a80b36c0 0x7f18a815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.743+0000 7f18ae800640 1 --2- 172.21.15.8:0/1196557458 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 0x7f18a806d160 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.743+0000 7f18ae800640 1 -- 172.21.15.8:0/1196557458 >> 172.21.15.8:0/1196557458 conn(0x7f18a8069e70 msgr2=0x7f18a806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.743+0000 7f18ae800640 1 -- 172.21.15.8:0/1196557458 shutdown_connections 2024-05-26T15:43:35.742 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.743+0000 7f18ae800640 1 -- 172.21.15.8:0/1196557458 wait complete. 2024-05-26T15:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.745+0000 7f18ae800640 1 Processor -- start 2024-05-26T15:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.745+0000 7f18ae800640 1 -- start start 2024-05-26T15:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.746+0000 7f18ae800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 0x7f18a8143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.746+0000 7f18ae800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18a80b36c0 0x7f18a80aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.746+0000 7f18ae800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18a815d930 0x7f18a80af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.746+0000 7f18ae800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a8143a10 con 0x7f18a80b32e0 2024-05-26T15:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.746+0000 7f18ae800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a8143cf0 con 0x7f18a815d930 2024-05-26T15:43:35.747 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.746+0000 7f18ae800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a8141140 con 0x7f18a80b36c0 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.746+0000 7f18ad400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 0x7f18a8143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.747+0000 7f18ad400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 0x7f18a8143130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34234/0 (socket says 172.21.15.8:34234) 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.747+0000 7f18ad400640 1 -- 172.21.15.8:0/2144231131 learned_addr learned my addr 172.21.15.8:0/2144231131 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.747+0000 7f18ad400640 1 -- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18a80b36c0 msgr2=0x7f18a80aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.747+0000 7f18ad400640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18a80b36c0 0x7f18a80aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.747+0000 7f18ad400640 1 -- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18a815d930 msgr2=0x7f18a80af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.747+0000 7f18ad400640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18a815d930 0x7f18a80af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.747+0000 7f18ad400640 1 -- 172.21.15.8:0/2144231131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c00b770 con 0x7f18a80b32e0 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.747+0000 7f18ad400640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 0x7f18a8143130 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f189c000c00 tx=0x7f189c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.748+0000 7f18a5600640 1 -- 172.21.15.8:0/2144231131 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c03c830 con 0x7f18a80b32e0 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.748+0000 7f18a5600640 1 -- 172.21.15.8:0/2144231131 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c03c9b0 con 0x7f18a80b32e0 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.748+0000 7f18a5600640 1 -- 172.21.15.8:0/2144231131 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c03cd60 con 0x7f18a80b32e0 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.748+0000 7f18ae800640 1 -- 172.21.15.8:0/2144231131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a8141420 con 0x7f18a80b32e0 2024-05-26T15:43:35.748 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.748+0000 7f18ae800640 1 -- 172.21.15.8:0/2144231131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a8143670 con 0x7f18a80b32e0 2024-05-26T15:43:35.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.749+0000 7f18ae800640 1 -- 172.21.15.8:0/2144231131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a8141660 con 0x7f18a80b32e0 2024-05-26T15:43:35.749 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.750+0000 7f18a5600640 1 -- 172.21.15.8:0/2144231131 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f189c033420 con 0x7f18a80b32e0 2024-05-26T15:43:35.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.752+0000 7f18a5600640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f188806ac00 0x7f188806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:35.750 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.752+0000 7f18a5600640 1 -- 172.21.15.8:0/2144231131 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f189c0aa0a0 con 0x7f18a80b32e0 2024-05-26T15:43:35.751 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.753+0000 7f18aca00640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f188806ac00 0x7f188806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:35.752 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.754+0000 7f18aca00640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f188806ac00 0x7f188806d0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1894006fd0 tx=0x7f1894008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:35.755 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.757+0000 7f18a5600640 1 -- 172.21.15.8:0/2144231131 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f18a8141660 con 0x7f18a80b32e0 2024-05-26T15:43:35.955 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.956+0000 7f18ae800640 1 -- 172.21.15.8:0/2144231131 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f18a806d6a0 con 0x7f188806ac00 2024-05-26T15:43:35.956 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.957+0000 7f18a5600640 1 -- 172.21.15.8:0/2144231131 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f189400ae40 con 0x7f188806ac00 2024-05-26T15:43:35.956 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 3 to deep-scrub 2024-05-26T15:43:35.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.960+0000 7f18ae800640 1 -- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f188806ac00 msgr2=0x7f188806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.960+0000 7f18ae800640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f188806ac00 0x7f188806d0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1894006fd0 tx=0x7f1894008040 comp rx=0 tx=0).stop 2024-05-26T15:43:35.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.960+0000 7f18ae800640 1 -- 172.21.15.8:0/2144231131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 msgr2=0x7f18a8143130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:35.959 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.960+0000 7f18ae800640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 0x7f18a8143130 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f189c000c00 tx=0x7f189c004730 comp rx=0 tx=0).stop 2024-05-26T15:43:35.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.961+0000 7f18ae800640 1 -- 172.21.15.8:0/2144231131 shutdown_connections 2024-05-26T15:43:35.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.961+0000 7f18ae800640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f188806ac00 0x7f188806d0c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.961+0000 7f18ae800640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18a815d930 0x7f18a80af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.961+0000 7f18ae800640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f18a80b36c0 0x7f18a80aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.961+0000 7f18ae800640 1 --2- 172.21.15.8:0/2144231131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18a80b32e0 0x7f18a8143130 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:35.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.961+0000 7f18ae800640 1 -- 172.21.15.8:0/2144231131 >> 172.21.15.8:0/2144231131 conn(0x7f18a8069e70 msgr2=0x7f18a815b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:35.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.961+0000 7f18ae800640 1 -- 172.21.15.8:0/2144231131 shutdown_connections 2024-05-26T15:43:35.960 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:35.961+0000 7f18ae800640 1 -- 172.21.15.8:0/2144231131 wait complete. 2024-05-26T15:43:35.979 INFO:tasks.ceph:Scrubbing osd.4 2024-05-26T15:43:35.979 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-26T15:43:36.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.199+0000 7f026ac00640 1 Processor -- start 2024-05-26T15:43:36.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.199+0000 7f026ac00640 1 -- start start 2024-05-26T15:43:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.201+0000 7f026ac00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f026415d260 0x7f02640ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.201+0000 7f026ac00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f026415d640 0x7f026415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.201+0000 7f026ac00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0264146930 con 0x7f02640b38f0 2024-05-26T15:43:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.201+0000 7f026ac00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02640abfd0 con 0x7f026415d640 2024-05-26T15:43:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.201+0000 7f026ac00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02640b4640 con 0x7f026415d260 2024-05-26T15:43:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.201+0000 7f0263400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f026415d640 0x7f026415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.202+0000 7f0263400640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f026415d640 0x7f026415daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34238/0 (socket says 172.21.15.8:34238) 2024-05-26T15:43:36.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.202+0000 7f0263400640 1 -- 172.21.15.8:0/3804242411 learned_addr learned my addr 172.21.15.8:0/3804242411 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.202+0000 7f0263400640 1 -- 172.21.15.8:0/3804242411 >> v2:172.21.15.47:3300/0 conn(0x7f026415d260 msgr2=0x7f02640ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.202+0000 7f0263e00640 1 --2- 172.21.15.8:0/3804242411 >> v2:172.21.15.47:3300/0 conn(0x7f026415d260 0x7f02640ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.202+0000 7f0263400640 1 --2- 172.21.15.8:0/3804242411 >> v2:172.21.15.47:3300/0 conn(0x7f026415d260 0x7f02640ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.202+0000 7f0263400640 1 -- 172.21.15.8:0/3804242411 >> v1:172.21.15.8:6789/0 conn(0x7f02640b38f0 legacy=0x7f02640b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.202+0000 7f0263400640 1 -- 172.21.15.8:0/3804242411 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02640b4920 con 0x7f026415d640 2024-05-26T15:43:36.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.202+0000 7f0263e00640 1 --2- 172.21.15.8:0/3804242411 >> v2:172.21.15.47:3300/0 conn(0x7f026415d260 0x7f02640ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.203+0000 7f0263400640 1 --2- 172.21.15.8:0/3804242411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026415d640 0x7f026415daf0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f02640b1060 tx=0x7f024c02a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe48c742bf0998b server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.203+0000 7f0262a00640 1 -- 172.21.15.8:0/3804242411 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c032440 con 0x7f026415d640 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.204+0000 7f0262a00640 1 -- 172.21.15.8:0/3804242411 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0325a0 con 0x7f026415d640 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.204+0000 7f0262a00640 1 -- 172.21.15.8:0/3804242411 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c032930 con 0x7f026415d640 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.204+0000 7f026ac00640 1 -- 172.21.15.8:0/3804242411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026415d640 msgr2=0x7f026415daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.204+0000 7f026ac00640 1 --2- 172.21.15.8:0/3804242411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026415d640 0x7f026415daf0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f02640b1060 tx=0x7f024c02a1f0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.204+0000 7f026ac00640 1 -- 172.21.15.8:0/3804242411 shutdown_connections 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.204+0000 7f026ac00640 1 --2- 172.21.15.8:0/3804242411 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026415d640 0x7f026415daf0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.204+0000 7f026ac00640 1 --2- 172.21.15.8:0/3804242411 >> v2:172.21.15.47:3300/0 conn(0x7f026415d260 0x7f02640ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.204+0000 7f026ac00640 1 -- 172.21.15.8:0/3804242411 >> 172.21.15.8:0/3804242411 conn(0x7f026406a660 msgr2=0x7f02640b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:36.203 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.204+0000 7f026ac00640 1 -- 172.21.15.8:0/3804242411 shutdown_connections 2024-05-26T15:43:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.204+0000 7f026ac00640 1 -- 172.21.15.8:0/3804242411 wait complete. 2024-05-26T15:43:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.206+0000 7f026ac00640 1 Processor -- start 2024-05-26T15:43:36.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.206+0000 7f026ac00640 1 -- start start 2024-05-26T15:43:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.207+0000 7f026ac00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02640b38f0 0x7f02641f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.207+0000 7f026ac00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f026415d260 0x7f0264143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.207+0000 7f026ac00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026415d640 0x7f026413a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.207+0000 7f026ac00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02641452d0 con 0x7f026415d640 2024-05-26T15:43:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.207+0000 7f026ac00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0264144460 con 0x7f026415d260 2024-05-26T15:43:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.207+0000 7f026ac00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0264144650 con 0x7f02640b38f0 2024-05-26T15:43:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.207+0000 7f0268c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026415d640 0x7f026413a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0268c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026415d640 0x7f026413a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34248/0 (socket says 172.21.15.8:34248) 2024-05-26T15:43:36.206 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0268c00640 1 -- 172.21.15.8:0/3493574592 learned_addr learned my addr 172.21.15.8:0/3493574592 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0263400640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f026415d260 0x7f0264143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0263e00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02640b38f0 0x7f02641f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0268c00640 1 -- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02640b38f0 msgr2=0x7f02641f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0268c00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f02640b38f0 0x7f02641f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0268c00640 1 -- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f026415d260 msgr2=0x7f0264143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0268c00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f026415d260 0x7f0264143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0268c00640 1 -- 172.21.15.8:0/3493574592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0094d0 con 0x7f026415d640 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0263400640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f026415d260 0x7f0264143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.208+0000 7f0268c00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026415d640 0x7f026413a390 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f025c00c7a0 tx=0x7f025c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.209+0000 7f025be00640 1 -- 172.21.15.8:0/3493574592 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c003b70 con 0x7f026415d640 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.209+0000 7f025be00640 1 -- 172.21.15.8:0/3493574592 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c003cf0 con 0x7f026415d640 2024-05-26T15:43:36.208 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.209+0000 7f025be00640 1 -- 172.21.15.8:0/3493574592 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c003ea0 con 0x7f026415d640 2024-05-26T15:43:36.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.209+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0264144930 con 0x7f026415d640 2024-05-26T15:43:36.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.209+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0264144ef0 con 0x7f026415d640 2024-05-26T15:43:36.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.210+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f026415e030 con 0x7f026415d640 2024-05-26T15:43:36.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.211+0000 7f025be00640 1 -- 172.21.15.8:0/3493574592 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f025c00aa90 con 0x7f026415d640 2024-05-26T15:43:36.210 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.212+0000 7f025be00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f024006ac00 0x7f024006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.212+0000 7f025be00640 1 -- 172.21.15.8:0/3493574592 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f025c088fd0 con 0x7f026415d640 2024-05-26T15:43:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.212+0000 7f025be00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] conn(0x7f0240070fa0 0x7f02400733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.212+0000 7f025be00640 1 -- 172.21.15.8:0/3493574592 --> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0240073ab0 con 0x7f0240070fa0 2024-05-26T15:43:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.212+0000 7f025be00640 1 -- 172.21.15.8:0/3493574592 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f025c08b690 con 0x7f026415d640 2024-05-26T15:43:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.213+0000 7f0263e00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f024006ac00 0x7f024006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.211 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.213+0000 7f0263400640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] conn(0x7f0240070fa0 0x7f02400733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.212 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.214+0000 7f0263e00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f024006ac00 0x7f024006d0c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0254008850 tx=0x7f0254008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.213 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.214+0000 7f0263400640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] conn(0x7f0240070fa0 0x7f02400733e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.215 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.217+0000 7f025be00640 1 -- 172.21.15.8:0/3493574592 <== osd.4 v2:172.21.15.47:6800/37314 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0240073ab0 con 0x7f0240070fa0 2024-05-26T15:43:36.229 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.231+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 --> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f02640ac500 con 0x7f0240070fa0 2024-05-26T15:43:36.231 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.232+0000 7f025be00640 1 -- 172.21.15.8:0/3493574592 <== osd.4 v2:172.21.15.47:6800/37314 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f024c004040 con 0x7f0240070fa0 2024-05-26T15:43:36.231 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:43:36.231 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-26T15:43:36.231 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:43:36.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] conn(0x7f0240070fa0 msgr2=0x7f02400733e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f026ac00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:6800/37314,v1:172.21.15.47:6801/37314] conn(0x7f0240070fa0 0x7f02400733e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f024006ac00 msgr2=0x7f024006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f026ac00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f024006ac00 0x7f024006d0c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0254008850 tx=0x7f0254008040 comp rx=0 tx=0).stop 2024-05-26T15:43:36.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026415d640 msgr2=0x7f026413a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.232 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f026ac00640 1 --2- 172.21.15.8:0/3493574592 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f026415d640 0x7f026413a390 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f025c00c7a0 tx=0x7f025c00cc60 comp rx=0 tx=0).stop 2024-05-26T15:43:36.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f0268c00640 1 -- 172.21.15.8:0/3493574592 reap_dead start 2024-05-26T15:43:36.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 shutdown_connections 2024-05-26T15:43:36.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 >> 172.21.15.8:0/3493574592 conn(0x7f026406a660 msgr2=0x7f026415f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:36.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 shutdown_connections 2024-05-26T15:43:36.233 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.233+0000 7f026ac00640 1 -- 172.21.15.8:0/3493574592 wait complete. 2024-05-26T15:43:36.249 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-26T15:43:36.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.462+0000 7f259f400640 1 Processor -- start 2024-05-26T15:43:36.461 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.462+0000 7f259f400640 1 -- start start 2024-05-26T15:43:36.462 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.464+0000 7f259f400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25980cb8d0 0x7f25980cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.464+0000 7f259f400640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25980cce30 con 0x7f2598161030 2024-05-26T15:43:36.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.464+0000 7f259f400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25981617c0 con 0x7f259815cbf0 2024-05-26T15:43:36.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.464+0000 7f259f400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25981614e0 con 0x7f25980cb8d0 2024-05-26T15:43:36.463 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.464+0000 7f258fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f2598161030 0x7f25980cb1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34856/0 (socket says 172.21.15.8:34856) 2024-05-26T15:43:36.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.464+0000 7f258fe00640 1 -- 172.21.15.8:0/3068116412 learned_addr learned my addr 172.21.15.8:0/3068116412 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:36.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.465+0000 7f259d400640 1 --2- 172.21.15.8:0/3068116412 >> v2:172.21.15.47:3300/0 conn(0x7f25980cb8d0 0x7f25980cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.465+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515899347 0 0) 0x7f25980cce30 con 0x7f2598161030 2024-05-26T15:43:36.464 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.465+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f257c003520 con 0x7f2598161030 2024-05-26T15:43:36.465 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3149166601 0 0) 0x7f257c003520 con 0x7f2598161030 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 >> v2:172.21.15.47:3300/0 conn(0x7f25980cb8d0 msgr2=0x7f25980cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 --2- 172.21.15.8:0/3068116412 >> v2:172.21.15.47:3300/0 conn(0x7f25980cb8d0 0x7f25980cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 >> v1:172.21.15.47:6789/0 conn(0x7f259815cbf0 legacy=0x7f2598160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25980cd3e0 con 0x7f2598161030 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f2580001670 con 0x7f2598161030 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 >> v1:172.21.15.8:6789/0 conn(0x7f2598161030 legacy=0x7f25980cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f257c003970 0x7f257c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f257c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c005180 0x7f257c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25981614e0 con 0x7f257c0047c0 2024-05-26T15:43:36.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c00c020 con 0x7f257c005180 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c00c1e0 con 0x7f257c003970 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f258fe00640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f257c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f259d400640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c005180 0x7f257c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.466+0000 7f259ca00640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f257c003970 0x7f257c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.467+0000 7f258fe00640 1 -- 172.21.15.8:0/3068116412 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f257c003970 msgr2=0x7f257c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.467+0000 7f258fe00640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f257c003970 0x7f257c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.467+0000 7f258fe00640 1 -- 172.21.15.8:0/3068116412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c005180 msgr2=0x7f257c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.467+0000 7f258fe00640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c005180 0x7f257c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.467+0000 7f258fe00640 1 -- 172.21.15.8:0/3068116412 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c003520 con 0x7f257c0047c0 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.467+0000 7f259d400640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f257c005180 0x7f257c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:36.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.467+0000 7f259d400640 1 -- 172.21.15.8:0/3068116412 reap_dead start 2024-05-26T15:43:36.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.468+0000 7f258fe00640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f257c004c40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f258000c240 tx=0x7f257c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364b19201f94f56 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.468+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580005ad0 con 0x7f257c0047c0 2024-05-26T15:43:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.468+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258002d070 con 0x7f257c0047c0 2024-05-26T15:43:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.468+0000 7f2597e00640 1 -- 172.21.15.8:0/3068116412 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580007070 con 0x7f257c0047c0 2024-05-26T15:43:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.469+0000 7f259f400640 1 -- 172.21.15.8:0/3068116412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 msgr2=0x7f257c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.469+0000 7f259f400640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f257c004c40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f258000c240 tx=0x7f257c0057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.469+0000 7f259f400640 1 -- 172.21.15.8:0/3068116412 shutdown_connections 2024-05-26T15:43:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.469+0000 7f259f400640 1 --2- 172.21.15.8:0/3068116412 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f257c004c40 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.469+0000 7f259f400640 1 -- 172.21.15.8:0/3068116412 >> 172.21.15.8:0/3068116412 conn(0x7f25980b0570 msgr2=0x7f25980b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.469+0000 7f259f400640 1 -- 172.21.15.8:0/3068116412 shutdown_connections 2024-05-26T15:43:36.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.469+0000 7f259f400640 1 -- 172.21.15.8:0/3068116412 wait complete. 2024-05-26T15:43:36.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.471+0000 7f259f400640 1 Processor -- start 2024-05-26T15:43:36.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.471+0000 7f259f400640 1 -- start start 2024-05-26T15:43:36.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.472+0000 7f259f400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f259815b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.472+0000 7f259f400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25981f2410 0x7f259814ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.472+0000 7f259f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f259814b280 0x7f25980ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.472+0000 7f259f400640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259814b730 con 0x7f257c0047c0 2024-05-26T15:43:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.472+0000 7f259f400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2598158d70 con 0x7f259814b280 2024-05-26T15:43:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.472+0000 7f259f400640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25980ad090 con 0x7f25981f2410 2024-05-26T15:43:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.472+0000 7f259ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f259815b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.472+0000 7f259ca00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f259815b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34264/0 (socket says 172.21.15.8:34264) 2024-05-26T15:43:36.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.472+0000 7f259ca00640 1 -- 172.21.15.8:0/1095042009 learned_addr learned my addr 172.21.15.8:0/1095042009 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f259ca00640 1 -- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25981f2410 msgr2=0x7f259814ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f259ca00640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25981f2410 0x7f259814ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f259d400640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f259814b280 0x7f25980ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f259ca00640 1 -- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f259814b280 msgr2=0x7f25980ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f259ca00640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f259814b280 0x7f25980ac340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f259ca00640 1 -- 172.21.15.8:0/1095042009 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2598158fc0 con 0x7f257c0047c0 2024-05-26T15:43:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f259ca00640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f259815b380 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f258800d8e0 tx=0x7f258800dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f2595600640 1 -- 172.21.15.8:0/1095042009 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2588003da0 con 0x7f257c0047c0 2024-05-26T15:43:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f2595600640 1 -- 172.21.15.8:0/1095042009 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258800b6b0 con 0x7f257c0047c0 2024-05-26T15:43:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f2595600640 1 -- 172.21.15.8:0/1095042009 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258800ba20 con 0x7f257c0047c0 2024-05-26T15:43:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f259f400640 1 -- 172.21.15.8:0/1095042009 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25981592a0 con 0x7f257c0047c0 2024-05-26T15:43:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.473+0000 7f259f400640 1 -- 172.21.15.8:0/1095042009 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259815b8c0 con 0x7f257c0047c0 2024-05-26T15:43:36.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.474+0000 7f259f400640 1 -- 172.21.15.8:0/1095042009 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259815ba50 con 0x7f257c0047c0 2024-05-26T15:43:36.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.475+0000 7f2595600640 1 -- 172.21.15.8:0/1095042009 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f258800bb80 con 0x7f257c0047c0 2024-05-26T15:43:36.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.476+0000 7f2595600640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f257406ac30 0x7f257406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.476+0000 7f2595600640 1 -- 172.21.15.8:0/1095042009 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f2588089530 con 0x7f257c0047c0 2024-05-26T15:43:36.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.477+0000 7f258fe00640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f257406ac30 0x7f257406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.476 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.478+0000 7f258fe00640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f257406ac30 0x7f257406d0f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2580032000 tx=0x7f2580009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.479 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.480+0000 7f2595600640 1 -- 172.21.15.8:0/1095042009 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2588054860 con 0x7f257c0047c0 2024-05-26T15:43:36.677 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.679+0000 7f259f400640 1 -- 172.21.15.8:0/1095042009 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f25980cd9a0 con 0x7f257406ac30 2024-05-26T15:43:36.678 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.680+0000 7f2595600640 1 -- 172.21.15.8:0/1095042009 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2580001640 con 0x7f257406ac30 2024-05-26T15:43:36.679 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 4 to deep-scrub 2024-05-26T15:43:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 -- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f257406ac30 msgr2=0x7f257406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f257406ac30 0x7f257406d0f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2580032000 tx=0x7f2580009030 comp rx=0 tx=0).stop 2024-05-26T15:43:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 -- 172.21.15.8:0/1095042009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 msgr2=0x7f259815b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f259815b380 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f258800d8e0 tx=0x7f258800dda0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 -- 172.21.15.8:0/1095042009 shutdown_connections 2024-05-26T15:43:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f257406ac30 0x7f257406d0f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f259814b280 0x7f25980ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f25981f2410 0x7f259814ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 --2- 172.21.15.8:0/1095042009 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f257c0047c0 0x7f259815b380 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 -- 172.21.15.8:0/1095042009 >> 172.21.15.8:0/1095042009 conn(0x7f25980b0570 msgr2=0x7f259806d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:36.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 -- 172.21.15.8:0/1095042009 shutdown_connections 2024-05-26T15:43:36.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.683+0000 7f259f400640 1 -- 172.21.15.8:0/1095042009 wait complete. 2024-05-26T15:43:36.702 INFO:tasks.ceph:Scrubbing osd.5 2024-05-26T15:43:36.702 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-26T15:43:36.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.923+0000 7f5f41800640 1 Processor -- start 2024-05-26T15:43:36.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.923+0000 7f5f41800640 1 -- start start 2024-05-26T15:43:36.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.924+0000 7f5f41800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5f3c0715a0 0x7f5f3c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.924+0000 7f5f41800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f3c0b5c50 0x7f5f3c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.924+0000 7f5f41800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c15d1a0 con 0x7f5f3c0d2000 2024-05-26T15:43:36.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.925+0000 7f5f41800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0d1b70 con 0x7f5f3c0715a0 2024-05-26T15:43:36.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.925+0000 7f5f41800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c071ec0 con 0x7f5f3c0b5c50 2024-05-26T15:43:36.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.926+0000 7f5f3aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5f3c0715a0 0x7f5f3c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.926+0000 7f5f3b400640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f3c0b5c50 0x7f5f3c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.926+0000 7f5f3aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5f3c0715a0 0x7f5f3c071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.8:57894/0 (socket says 172.21.15.8:57894) 2024-05-26T15:43:36.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.926+0000 7f5f3aa00640 1 -- 172.21.15.8:0/4113239452 learned_addr learned my addr 172.21.15.8:0/4113239452 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:36.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.926+0000 7f5f33e00640 1 --1- 172.21.15.8:0/4113239452 >> v1:172.21.15.47:6789/0 conn(0x7f5f3c0d2000 0x7f5f3c0b84d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.8:54776/0 (socket says 172.21.15.8:54776) 2024-05-26T15:43:36.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.926+0000 7f5f3aa00640 1 -- 172.21.15.8:0/4113239452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f3c0b5c50 msgr2=0x7f5f3c0b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:36.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.926+0000 7f5f3aa00640 1 --2- 172.21.15.8:0/4113239452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f3c0b5c50 0x7f5f3c0b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.926+0000 7f5f3aa00640 1 -- 172.21.15.8:0/4113239452 >> v1:172.21.15.47:6789/0 conn(0x7f5f3c0d2000 legacy=0x7f5f3c0b84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.927+0000 7f5f3aa00640 1 -- 172.21.15.8:0/4113239452 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0d0c80 con 0x7f5f3c0715a0 2024-05-26T15:43:36.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.928+0000 7f5f3aa00640 1 --2- 172.21.15.8:0/4113239452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f3c0715a0 0x7f5f3c071980 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009870 tx=0x7f5f2c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51ad8f4a6c7fe56a server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.929+0000 7f5f3a000640 1 -- 172.21.15.8:0/4113239452 <== mon.1 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c032440 con 0x7f5f3c0715a0 2024-05-26T15:43:36.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.929+0000 7f5f3a000640 1 -- 172.21.15.8:0/4113239452 <== mon.1 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c0325a0 con 0x7f5f3c0715a0 2024-05-26T15:43:36.927 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.929+0000 7f5f3a000640 1 -- 172.21.15.8:0/4113239452 <== mon.1 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c032930 con 0x7f5f3c0715a0 2024-05-26T15:43:36.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.930+0000 7f5f41800640 1 -- 172.21.15.8:0/4113239452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f3c0715a0 msgr2=0x7f5f3c071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.930+0000 7f5f41800640 1 --2- 172.21.15.8:0/4113239452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f3c0715a0 0x7f5f3c071980 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009870 tx=0x7f5f2c02a1c0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.930+0000 7f5f41800640 1 -- 172.21.15.8:0/4113239452 shutdown_connections 2024-05-26T15:43:36.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.930+0000 7f5f41800640 1 --2- 172.21.15.8:0/4113239452 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f3c0b5c50 0x7f5f3c0b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.930+0000 7f5f41800640 1 --2- 172.21.15.8:0/4113239452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f3c0715a0 0x7f5f3c071980 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.930+0000 7f5f41800640 1 -- 172.21.15.8:0/4113239452 >> 172.21.15.8:0/4113239452 conn(0x7f5f3c0cf5e0 msgr2=0x7f5f3c0cf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:36.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.930+0000 7f5f41800640 1 -- 172.21.15.8:0/4113239452 shutdown_connections 2024-05-26T15:43:36.929 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.930+0000 7f5f41800640 1 -- 172.21.15.8:0/4113239452 wait complete. 2024-05-26T15:43:36.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.932+0000 7f5f41800640 1 Processor -- start 2024-05-26T15:43:36.931 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.933+0000 7f5f41800640 1 -- start start 2024-05-26T15:43:36.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.934+0000 7f5f41800640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f3c0715a0 0x7f5f3c0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.934+0000 7f5f41800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f3c0b5c50 0x7f5f3c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.934+0000 7f5f41800640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f3c0d2000 0x7f5f3c155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.934+0000 7f5f41800640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c157d40 con 0x7f5f3c0d2000 2024-05-26T15:43:36.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.934+0000 7f5f41800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c158020 con 0x7f5f3c0b5c50 2024-05-26T15:43:36.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.934+0000 7f5f41800640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c158300 con 0x7f5f3c0715a0 2024-05-26T15:43:36.933 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.935+0000 7f5f3b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f3c0d2000 0x7f5f3c155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.935+0000 7f5f3b400640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f3c0d2000 0x7f5f3c155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34280/0 (socket says 172.21.15.8:34280) 2024-05-26T15:43:36.934 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.935+0000 7f5f3b400640 1 -- 172.21.15.8:0/1405710633 learned_addr learned my addr 172.21.15.8:0/1405710633 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.935+0000 7f5f33e00640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f3c0b5c50 0x7f5f3c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.935+0000 7f5f3aa00640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f3c0715a0 0x7f5f3c0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.935+0000 7f5f3b400640 1 -- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f3c0715a0 msgr2=0x7f5f3c0cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.935+0000 7f5f3b400640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f5f3c0715a0 0x7f5f3c0cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.935+0000 7f5f3b400640 1 -- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f3c0b5c50 msgr2=0x7f5f3c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.935+0000 7f5f3b400640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f3c0b5c50 0x7f5f3c157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.935+0000 7f5f3b400640 1 -- 172.21.15.8:0/1405710633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c0094d0 con 0x7f5f3c0d2000 2024-05-26T15:43:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.936+0000 7f5f3b400640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f3c0d2000 0x7f5f3c155cc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400efc0 tx=0x7f5f3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.935 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.936+0000 7f5f32a00640 1 -- 172.21.15.8:0/1405710633 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34014480 con 0x7f5f3c0d2000 2024-05-26T15:43:36.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.936+0000 7f5f32a00640 1 -- 172.21.15.8:0/1405710633 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400f040 con 0x7f5f3c0d2000 2024-05-26T15:43:36.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.936+0000 7f5f32a00640 1 -- 172.21.15.8:0/1405710633 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34014820 con 0x7f5f3c0d2000 2024-05-26T15:43:36.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.936+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c1585e0 con 0x7f5f3c0d2000 2024-05-26T15:43:36.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.936+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c0cc630 con 0x7f5f3c0d2000 2024-05-26T15:43:36.936 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.937+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f3c0caf20 con 0x7f5f3c0d2000 2024-05-26T15:43:36.937 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.939+0000 7f5f32a00640 1 -- 172.21.15.8:0/1405710633 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f34014980 con 0x7f5f3c0d2000 2024-05-26T15:43:36.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.940+0000 7f5f32a00640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f1806ac00 0x7f5f1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.940+0000 7f5f32a00640 1 -- 172.21.15.8:0/1405710633 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f5f3408a940 con 0x7f5f3c0d2000 2024-05-26T15:43:36.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.940+0000 7f5f32a00640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] conn(0x7f5f18070fa0 0x7f5f180733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:36.938 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.940+0000 7f5f32a00640 1 -- 172.21.15.8:0/1405710633 --> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f18073ab0 con 0x7f5f18070fa0 2024-05-26T15:43:36.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.940+0000 7f5f32a00640 1 -- 172.21.15.8:0/1405710633 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f3408acb0 con 0x7f5f3c0d2000 2024-05-26T15:43:36.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.940+0000 7f5f3aa00640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f1806ac00 0x7f5f1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.939 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.941+0000 7f5f33e00640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] conn(0x7f5f18070fa0 0x7f5f180733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:36.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.942+0000 7f5f3aa00640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f1806ac00 0x7f5f1806d0c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c034000 tx=0x7f5f2c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.940 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.942+0000 7f5f33e00640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] conn(0x7f5f18070fa0 0x7f5f180733e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:36.942 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.944+0000 7f5f32a00640 1 -- 172.21.15.8:0/1405710633 <== osd.5 v2:172.21.15.47:6824/37316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5f18073ab0 con 0x7f5f18070fa0 2024-05-26T15:43:36.957 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.958+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 --> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5f3c0d1520 con 0x7f5f18070fa0 2024-05-26T15:43:36.958 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.959+0000 7f5f32a00640 1 -- 172.21.15.8:0/1405710633 <== osd.5 v2:172.21.15.47:6824/37316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5f240047e0 con 0x7f5f18070fa0 2024-05-26T15:43:36.958 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:43:36.959 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-26T15:43:36.959 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:43:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.960+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] conn(0x7f5f18070fa0 msgr2=0x7f5f180733e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.960+0000 7f5f41800640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:6824/37316,v1:172.21.15.47:6825/37316] conn(0x7f5f18070fa0 0x7f5f180733e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.960+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f1806ac00 msgr2=0x7f5f1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.961 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.960+0000 7f5f41800640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f5f1806ac00 0x7f5f1806d0c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c034000 tx=0x7f5f2c02e000 comp rx=0 tx=0).stop 2024-05-26T15:43:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.960+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f3c0d2000 msgr2=0x7f5f3c155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.960+0000 7f5f41800640 1 --2- 172.21.15.8:0/1405710633 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f3c0d2000 0x7f5f3c155cc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400efc0 tx=0x7f5f3400c490 comp rx=0 tx=0).stop 2024-05-26T15:43:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.960+0000 7f5f3b400640 1 -- 172.21.15.8:0/1405710633 reap_dead start 2024-05-26T15:43:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.960+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 shutdown_connections 2024-05-26T15:43:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.960+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 >> 172.21.15.8:0/1405710633 conn(0x7f5f3c0cf5e0 msgr2=0x7f5f3c0b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:36.962 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.961+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 shutdown_connections 2024-05-26T15:43:36.963 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:36.961+0000 7f5f41800640 1 -- 172.21.15.8:0/1405710633 wait complete. 2024-05-26T15:43:36.977 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-26T15:43:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.189+0000 7f0ffbe00640 1 Processor -- start 2024-05-26T15:43:37.188 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.190+0000 7f0ffbe00640 1 -- start start 2024-05-26T15:43:37.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.191+0000 7f0ffbe00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ffc0cdfe0 0x7f0ffc06c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.191+0000 7f0ffbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ffc0b0630 0x7f0ffc0b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.190 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.191+0000 7f0ffbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0ffc0cb890 0x7f0ffc0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.191+0000 7f0ffbe00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc15be70 con 0x7f0ffc0cdfe0 2024-05-26T15:43:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.191+0000 7f0ffbe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc0cc220 con 0x7f0ffc0cb890 2024-05-26T15:43:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.191+0000 7f0ffbe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc15b2f0 con 0x7f0ffc0b0630 2024-05-26T15:43:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.192+0000 7f0ffaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ffc0cdfe0 0x7f0ffc06c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.192+0000 7f0ffaa00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f0ffc0cdfe0 0x7f0ffc06c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34296/0 (socket says 172.21.15.8:34296) 2024-05-26T15:43:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.192+0000 7f0ffaa00640 1 -- 172.21.15.8:0/3271112929 learned_addr learned my addr 172.21.15.8:0/3271112929 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.192+0000 7f0ffb400640 1 --2- 172.21.15.8:0/3271112929 >> v2:172.21.15.47:3300/0 conn(0x7f0ffc0cb890 0x7f0ffc0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.191 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.192+0000 7f0ff3e00640 1 --2- 172.21.15.8:0/3271112929 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ffc0b0630 0x7f0ffc0b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.193+0000 7f0ffaa00640 1 -- 172.21.15.8:0/3271112929 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ffc0b0630 msgr2=0x7f0ffc0b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:37.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.193+0000 7f0ffaa00640 1 --2- 172.21.15.8:0/3271112929 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ffc0b0630 0x7f0ffc0b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.193+0000 7f0ffaa00640 1 -- 172.21.15.8:0/3271112929 >> v2:172.21.15.47:3300/0 conn(0x7f0ffc0cb890 msgr2=0x7f0ffc0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:37.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.193+0000 7f0ffaa00640 1 --2- 172.21.15.8:0/3271112929 >> v2:172.21.15.47:3300/0 conn(0x7f0ffc0cb890 0x7f0ffc0cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.193+0000 7f0ffaa00640 1 -- 172.21.15.8:0/3271112929 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc15b5d0 con 0x7f0ffc0cdfe0 2024-05-26T15:43:37.192 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.193+0000 7f0ffb400640 1 --2- 172.21.15.8:0/3271112929 >> v2:172.21.15.47:3300/0 conn(0x7f0ffc0cb890 0x7f0ffc0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-26T15:43:37.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.194+0000 7f0ffaa00640 1 --2- 172.21.15.8:0/3271112929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0cdfe0 0x7f0ffc06c830 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc070480 tx=0x7f0fec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab124815ce53c27 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:37.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.195+0000 7f0ffa000640 1 -- 172.21.15.8:0/3271112929 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec032440 con 0x7f0ffc0cdfe0 2024-05-26T15:43:37.193 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.195+0000 7f0ffa000640 1 -- 172.21.15.8:0/3271112929 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec0325a0 con 0x7f0ffc0cdfe0 2024-05-26T15:43:37.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.195+0000 7f0ffa000640 1 -- 172.21.15.8:0/3271112929 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec032930 con 0x7f0ffc0cdfe0 2024-05-26T15:43:37.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.196+0000 7f0ffbe00640 1 -- 172.21.15.8:0/3271112929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0cdfe0 msgr2=0x7f0ffc06c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.194 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.196+0000 7f0ffbe00640 1 --2- 172.21.15.8:0/3271112929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0cdfe0 0x7f0ffc06c830 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc070480 tx=0x7f0fec02a1e0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.196+0000 7f0ffbe00640 1 -- 172.21.15.8:0/3271112929 shutdown_connections 2024-05-26T15:43:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.196+0000 7f0ffbe00640 1 --2- 172.21.15.8:0/3271112929 >> v2:172.21.15.47:3300/0 conn(0x7f0ffc0cb890 0x7f0ffc0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.196+0000 7f0ffbe00640 1 --2- 172.21.15.8:0/3271112929 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ffc0b0630 0x7f0ffc0b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.196+0000 7f0ffbe00640 1 --2- 172.21.15.8:0/3271112929 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0cdfe0 0x7f0ffc06c830 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.196+0000 7f0ffbe00640 1 -- 172.21.15.8:0/3271112929 >> 172.21.15.8:0/3271112929 conn(0x7f0ffc069e70 msgr2=0x7f0ffc06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.196+0000 7f0ffbe00640 1 -- 172.21.15.8:0/3271112929 shutdown_connections 2024-05-26T15:43:37.195 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.196+0000 7f0ffbe00640 1 -- 172.21.15.8:0/3271112929 wait complete. 2024-05-26T15:43:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.198+0000 7f0ffbe00640 1 Processor -- start 2024-05-26T15:43:37.196 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.198+0000 7f0ffbe00640 1 -- start start 2024-05-26T15:43:37.197 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.199+0000 7f0ffbe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0b0630 0x7f0ffc0ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.199+0000 7f0ffbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ffc0cb890 0x7f0ffc1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.199+0000 7f0ffbe00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ffc0cdfe0 0x7f0ffc159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.199+0000 7f0ffbe00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0ad230 con 0x7f0ffc0b0630 2024-05-26T15:43:37.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.199+0000 7f0ffbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0ab980 con 0x7f0ffc0cb890 2024-05-26T15:43:37.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.199+0000 7f0ffbe00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc135a60 con 0x7f0ffc0cdfe0 2024-05-26T15:43:37.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.199+0000 7f0ffaa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0b0630 0x7f0ffc0ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.199+0000 7f0ffaa00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0b0630 0x7f0ffc0ab440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34312/0 (socket says 172.21.15.8:34312) 2024-05-26T15:43:37.198 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.199+0000 7f0ffaa00640 1 -- 172.21.15.8:0/305314638 learned_addr learned my addr 172.21.15.8:0/305314638 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:37.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ffaa00640 1 -- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ffc0cdfe0 msgr2=0x7f0ffc159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.199 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ffaa00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ffc0cdfe0 0x7f0ffc159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ff3e00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ffc0cb890 0x7f0ffc1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ffaa00640 1 -- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ffc0cb890 msgr2=0x7f0ffc1598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ffaa00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ffc0cb890 0x7f0ffc1598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ffaa00640 1 -- 172.21.15.8:0/305314638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4009a70 con 0x7f0ffc0b0630 2024-05-26T15:43:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ffaa00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0b0630 0x7f0ffc0ab440 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0fec02a220 tx=0x7f0fec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ff2a00640 1 -- 172.21.15.8:0/305314638 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec032440 con 0x7f0ffc0b0630 2024-05-26T15:43:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ff2a00640 1 -- 172.21.15.8:0/305314638 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec030900 con 0x7f0ffc0b0630 2024-05-26T15:43:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ff2a00640 1 -- 172.21.15.8:0/305314638 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec030c90 con 0x7f0ffc0b0630 2024-05-26T15:43:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.200+0000 7f0ffbe00640 1 -- 172.21.15.8:0/305314638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec0094d0 con 0x7f0ffc0b0630 2024-05-26T15:43:37.200 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.201+0000 7f0ffbe00640 1 -- 172.21.15.8:0/305314638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ffc1382f0 con 0x7f0ffc0b0630 2024-05-26T15:43:37.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.202+0000 7f0ffbe00640 1 -- 172.21.15.8:0/305314638 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ffc06ae00 con 0x7f0ffc0b0630 2024-05-26T15:43:37.201 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.203+0000 7f0ff2a00640 1 -- 172.21.15.8:0/305314638 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0fec039040 con 0x7f0ffc0b0630 2024-05-26T15:43:37.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.204+0000 7f0ff2a00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fd806ac00 0x7f0fd806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.204+0000 7f0ff2a00640 1 -- 172.21.15.8:0/305314638 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f0fec0a9aa0 con 0x7f0ffc0b0630 2024-05-26T15:43:37.202 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.204+0000 7f0ff3e00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fd806ac00 0x7f0fd806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.204 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.206+0000 7f0ff3e00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fd806ac00 0x7f0fd806d0c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4006fd0 tx=0x7f0fe4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:37.209 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.211+0000 7f0ff2a00640 1 -- 172.21.15.8:0/305314638 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0fec074de0 con 0x7f0ffc0b0630 2024-05-26T15:43:37.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.412+0000 7f0ffbe00640 1 -- 172.21.15.8:0/305314638 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ffc06cd70 con 0x7f0fd806ac00 2024-05-26T15:43:37.411 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.413+0000 7f0ff2a00640 1 -- 172.21.15.8:0/305314638 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0fe4015440 con 0x7f0fd806ac00 2024-05-26T15:43:37.411 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 5 to deep-scrub 2024-05-26T15:43:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 -- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fd806ac00 msgr2=0x7f0fd806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fd806ac00 0x7f0fd806d0c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4006fd0 tx=0x7f0fe4008040 comp rx=0 tx=0).stop 2024-05-26T15:43:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 -- 172.21.15.8:0/305314638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0b0630 msgr2=0x7f0ffc0ab440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0b0630 0x7f0ffc0ab440 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0fec02a220 tx=0x7f0fec0046c0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 -- 172.21.15.8:0/305314638 shutdown_connections 2024-05-26T15:43:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f0ffc0cdfe0 0x7f0ffc159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f0fd806ac00 0x7f0fd806d0c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ffc0cb890 0x7f0ffc1598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.415 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 --2- 172.21.15.8:0/305314638 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0ffc0b0630 0x7f0ffc0ab440 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 -- 172.21.15.8:0/305314638 >> 172.21.15.8:0/305314638 conn(0x7f0ffc069e70 msgr2=0x7f0ffc06d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:37.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 -- 172.21.15.8:0/305314638 shutdown_connections 2024-05-26T15:43:37.416 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.416+0000 7f0ffbe00640 1 -- 172.21.15.8:0/305314638 wait complete. 2024-05-26T15:43:37.435 INFO:tasks.ceph:Scrubbing osd.6 2024-05-26T15:43:37.435 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-26T15:43:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.651+0000 7fc0a5e00640 1 Processor -- start 2024-05-26T15:43:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.651+0000 7fc0a5e00640 1 -- start start 2024-05-26T15:43:37.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.653+0000 7fc0a5e00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fc0a00ae1c0 0x7fc0a006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.653+0000 7fc0a5e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a006cc20 con 0x7fc0a006b110 2024-05-26T15:43:37.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.653+0000 7fc0a5e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a00caf50 con 0x7fc0a00cdaa0 2024-05-26T15:43:37.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.653+0000 7fc0a5e00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00ae650 con 0x7fc0a00ae1c0 2024-05-26T15:43:37.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.653+0000 7fc09fe00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc0a006b110 0x7fc0a006d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34868/0 (socket says 172.21.15.8:34868) 2024-05-26T15:43:37.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.653+0000 7fc09fe00640 1 -- 172.21.15.8:0/1905727340 learned_addr learned my addr 172.21.15.8:0/1905727340 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:37.652 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.653+0000 7fc0a5400640 1 --2- 172.21.15.8:0/1905727340 >> v2:172.21.15.8:3300/0 conn(0x7fc0a00ae1c0 0x7fc0a006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.654+0000 7fc09f400640 1 -- 172.21.15.8:0/1905727340 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477519380 0 0) 0x7fc0a006cc20 con 0x7fc0a006b110 2024-05-26T15:43:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.654+0000 7fc0a5400640 1 -- 172.21.15.8:0/1905727340 >> v1:172.21.15.47:6789/0 conn(0x7fc0a00cdaa0 legacy=0x7fc0a00cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.654+0000 7fc0a5400640 1 -- 172.21.15.8:0/1905727340 >> v1:172.21.15.8:6789/0 conn(0x7fc0a006b110 legacy=0x7fc0a006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.654+0000 7fc0a5400640 1 -- 172.21.15.8:0/1905727340 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a00cb230 con 0x7fc0a00ae1c0 2024-05-26T15:43:37.653 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.655+0000 7fc0a5400640 1 --2- 172.21.15.8:0/1905727340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00ae1c0 0x7fc0a006dac0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc098009d90 tx=0x7fc09802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b52faaa7c44f51 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:37.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.655+0000 7fc09f400640 1 -- 172.21.15.8:0/1905727340 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098007740 con 0x7fc0a00ae1c0 2024-05-26T15:43:37.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.656+0000 7fc09f400640 1 -- 172.21.15.8:0/1905727340 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09802d050 con 0x7fc0a00ae1c0 2024-05-26T15:43:37.654 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.656+0000 7fc09f400640 1 -- 172.21.15.8:0/1905727340 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098007ac0 con 0x7fc0a00ae1c0 2024-05-26T15:43:37.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.656+0000 7fc0a5e00640 1 -- 172.21.15.8:0/1905727340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00ae1c0 msgr2=0x7fc0a006dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.656+0000 7fc0a5e00640 1 --2- 172.21.15.8:0/1905727340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00ae1c0 0x7fc0a006dac0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc098009d90 tx=0x7fc09802a6f0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.656+0000 7fc0a5e00640 1 -- 172.21.15.8:0/1905727340 shutdown_connections 2024-05-26T15:43:37.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.656+0000 7fc0a5e00640 1 --2- 172.21.15.8:0/1905727340 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a00ae1c0 0x7fc0a006dac0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.656+0000 7fc0a5e00640 1 -- 172.21.15.8:0/1905727340 >> 172.21.15.8:0/1905727340 conn(0x7fc0a00cb7c0 msgr2=0x7fc0a00cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:37.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.656+0000 7fc0a5e00640 1 -- 172.21.15.8:0/1905727340 shutdown_connections 2024-05-26T15:43:37.655 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.656+0000 7fc0a5e00640 1 -- 172.21.15.8:0/1905727340 wait complete. 2024-05-26T15:43:37.656 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.658+0000 7fc0a5e00640 1 Processor -- start 2024-05-26T15:43:37.657 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.658+0000 7fc0a5e00640 1 -- start start 2024-05-26T15:43:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.659+0000 7fc0a5e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a006b110 0x7fc0a015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.659+0000 7fc0a5e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0a00ae1c0 0x7fc0a0154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.659+0000 7fc0a5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0a00cdaa0 0x7fc0a00ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.659+0000 7fc0a5e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00c7770 con 0x7fc0a006b110 2024-05-26T15:43:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.659+0000 7fc0a5e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00b19a0 con 0x7fc0a00cdaa0 2024-05-26T15:43:37.658 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.659+0000 7fc0a5e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0154870 con 0x7fc0a00ae1c0 2024-05-26T15:43:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.660+0000 7fc0a4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a006b110 0x7fc0a015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.660+0000 7fc0a4a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a006b110 0x7fc0a015a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34326/0 (socket says 172.21.15.8:34326) 2024-05-26T15:43:37.659 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.660+0000 7fc0a4a00640 1 -- 172.21.15.8:0/2674418135 learned_addr learned my addr 172.21.15.8:0/2674418135 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.660+0000 7fc09fe00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0a00ae1c0 0x7fc0a0154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.660 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.660+0000 7fc0a4a00640 1 -- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0a00ae1c0 msgr2=0x7fc0a0154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.660+0000 7fc0a4a00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fc0a00ae1c0 0x7fc0a0154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.660+0000 7fc0a4a00640 1 -- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0a00cdaa0 msgr2=0x7fc0a00ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.660+0000 7fc0a5400640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0a00cdaa0 0x7fc0a00ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.660+0000 7fc0a4a00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc0a00cdaa0 0x7fc0a00ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.660+0000 7fc0a4a00640 1 -- 172.21.15.8:0/2674418135 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc098009a70 con 0x7fc0a006b110 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.661+0000 7fc0a4a00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a006b110 0x7fc0a015a9c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc09400c430 tx=0x7fc09400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.661+0000 7fc09cc00640 1 -- 172.21.15.8:0/2674418135 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940052d0 con 0x7fc0a006b110 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.661+0000 7fc09cc00640 1 -- 172.21.15.8:0/2674418135 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094005430 con 0x7fc0a006b110 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.661+0000 7fc09cc00640 1 -- 172.21.15.8:0/2674418135 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094003830 con 0x7fc0a006b110 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.661+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a015b010 con 0x7fc0a006b110 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.661+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a00c7390 con 0x7fc0a006b110 2024-05-26T15:43:37.661 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.662+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0a00cb510 con 0x7fc0a006b110 2024-05-26T15:43:37.662 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.663+0000 7fc09cc00640 1 -- 172.21.15.8:0/2674418135 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc094003990 con 0x7fc0a006b110 2024-05-26T15:43:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.664+0000 7fc09cc00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc08006ac00 0x7fc08006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.664+0000 7fc09cc00640 1 -- 172.21.15.8:0/2674418135 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc0940887b0 con 0x7fc0a006b110 2024-05-26T15:43:37.663 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.664+0000 7fc09cc00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] conn(0x7fc080070fa0 0x7fc0800733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.665+0000 7fc09cc00640 1 -- 172.21.15.8:0/2674418135 --> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc080073ab0 con 0x7fc080070fa0 2024-05-26T15:43:37.664 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.665+0000 7fc09cc00640 1 -- 172.21.15.8:0/2674418135 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc09408ad30 con 0x7fc0a006b110 2024-05-26T15:43:37.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.665+0000 7fc09fe00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc08006ac00 0x7fc08006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.665+0000 7fc0a5400640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] conn(0x7fc080070fa0 0x7fc0800733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.666+0000 7fc09fe00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc08006ac00 0x7fc08006d0c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc08c007fd0 tx=0x7fc08c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:37.665 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.666+0000 7fc0a5400640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] conn(0x7fc080070fa0 0x7fc0800733e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:37.667 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.669+0000 7fc09cc00640 1 -- 172.21.15.8:0/2674418135 <== osd.6 v2:172.21.15.47:6808/37315 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc080073ab0 con 0x7fc080070fa0 2024-05-26T15:43:37.681 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.683+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 --> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc0a004e210 con 0x7fc080070fa0 2024-05-26T15:43:37.682 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.684+0000 7fc09cc00640 1 -- 172.21.15.8:0/2674418135 <== osd.6 v2:172.21.15.47:6808/37315 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc0a004e210 con 0x7fc080070fa0 2024-05-26T15:43:37.682 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:43:37.682 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-26T15:43:37.683 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:43:37.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.684+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] conn(0x7fc080070fa0 msgr2=0x7fc0800733e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.684+0000 7fc0a5e00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:6808/37315,v1:172.21.15.47:6809/37315] conn(0x7fc080070fa0 0x7fc0800733e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.684+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc08006ac00 msgr2=0x7fc08006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.684+0000 7fc0a5e00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fc08006ac00 0x7fc08006d0c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc08c007fd0 tx=0x7fc08c009040 comp rx=0 tx=0).stop 2024-05-26T15:43:37.683 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.684+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a006b110 msgr2=0x7fc0a015a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.684+0000 7fc0a5e00640 1 --2- 172.21.15.8:0/2674418135 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc0a006b110 0x7fc0a015a9c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc09400c430 tx=0x7fc09400c8f0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.684+0000 7fc0a5400640 1 -- 172.21.15.8:0/2674418135 reap_dead start 2024-05-26T15:43:37.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.684+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 shutdown_connections 2024-05-26T15:43:37.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.684+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 >> 172.21.15.8:0/2674418135 conn(0x7fc0a00cb7c0 msgr2=0x7fc0a0069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:37.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.685+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 shutdown_connections 2024-05-26T15:43:37.684 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.685+0000 7fc0a5e00640 1 -- 172.21.15.8:0/2674418135 wait complete. 2024-05-26T15:43:37.701 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-26T15:43:37.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.910+0000 7f2449a00640 1 Processor -- start 2024-05-26T15:43:37.909 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.910+0000 7f2449a00640 1 -- start start 2024-05-26T15:43:37.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.912+0000 7f2449a00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f24440b36c0 0x7f244415a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.912+0000 7f2449a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f244415d3f0 0x7f244415d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.912+0000 7f2449a00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440ae1c0 con 0x7f24440b32e0 2024-05-26T15:43:37.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.912+0000 7f2449a00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24440cc1f0 con 0x7f24440b36c0 2024-05-26T15:43:37.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.912+0000 7f2449a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244406e370 con 0x7f244415d3f0 2024-05-26T15:43:37.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.912+0000 7f2443e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f24440b32e0 0x7f244406d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34880/0 (socket says 172.21.15.8:34880) 2024-05-26T15:43:37.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.912+0000 7f2443e00640 1 -- 172.21.15.8:0/1700177822 learned_addr learned my addr 172.21.15.8:0/1700177822 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:37.911 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.912+0000 7f2443400640 1 --2- 172.21.15.8:0/1700177822 >> v2:172.21.15.8:3300/0 conn(0x7f24440b36c0 0x7f244415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.913+0000 7f2449000640 1 --2- 172.21.15.8:0/1700177822 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f244415d3f0 0x7f244415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.913+0000 7f2443400640 1 -- 172.21.15.8:0/1700177822 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f244415d3f0 msgr2=0x7f244415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:37.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.913+0000 7f2443400640 1 --2- 172.21.15.8:0/1700177822 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f244415d3f0 0x7f244415d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.913+0000 7f2443400640 1 -- 172.21.15.8:0/1700177822 >> v1:172.21.15.8:6789/0 conn(0x7f24440b32e0 legacy=0x7f244406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.912 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.913+0000 7f2443400640 1 -- 172.21.15.8:0/1700177822 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244415ddc0 con 0x7f24440b36c0 2024-05-26T15:43:37.913 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.914+0000 7f2443400640 1 --2- 172.21.15.8:0/1700177822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b36c0 0x7f244415a910 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f242c009800 tx=0x7f242c02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b3ce9d1eb5bfec server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:37.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.916+0000 7f2442a00640 1 -- 172.21.15.8:0/1700177822 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c02ae70 con 0x7f24440b36c0 2024-05-26T15:43:37.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.917+0000 7f2442a00640 1 -- 172.21.15.8:0/1700177822 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c032440 con 0x7f24440b36c0 2024-05-26T15:43:37.915 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.917+0000 7f2442a00640 1 -- 172.21.15.8:0/1700177822 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c0327d0 con 0x7f24440b36c0 2024-05-26T15:43:37.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.917+0000 7f2449a00640 1 -- 172.21.15.8:0/1700177822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b36c0 msgr2=0x7f244415a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.917+0000 7f2449a00640 1 --2- 172.21.15.8:0/1700177822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b36c0 0x7f244415a910 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f242c009800 tx=0x7f242c02a160 comp rx=0 tx=0).stop 2024-05-26T15:43:37.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.917+0000 7f2449a00640 1 -- 172.21.15.8:0/1700177822 shutdown_connections 2024-05-26T15:43:37.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.917+0000 7f2449a00640 1 --2- 172.21.15.8:0/1700177822 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f244415d3f0 0x7f244415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.917+0000 7f2449a00640 1 --2- 172.21.15.8:0/1700177822 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b36c0 0x7f244415a910 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.917+0000 7f2449a00640 1 -- 172.21.15.8:0/1700177822 >> 172.21.15.8:0/1700177822 conn(0x7f2444069e70 msgr2=0x7f244406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:37.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.918+0000 7f2449a00640 1 -- 172.21.15.8:0/1700177822 shutdown_connections 2024-05-26T15:43:37.916 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.918+0000 7f2449a00640 1 -- 172.21.15.8:0/1700177822 wait complete. 2024-05-26T15:43:37.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.919+0000 7f2449a00640 1 Processor -- start 2024-05-26T15:43:37.918 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.920+0000 7f2449a00640 1 -- start start 2024-05-26T15:43:37.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.920+0000 7f2449a00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b32e0 0x7f24441f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.920+0000 7f2449a00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f24440b36c0 0x7f244414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.919 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.920+0000 7f2449a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f244415d3f0 0x7f24440ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2449a00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441f64b0 con 0x7f24440b32e0 2024-05-26T15:43:37.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2449a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441f5ec0 con 0x7f244415d3f0 2024-05-26T15:43:37.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2449a00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24441f6e10 con 0x7f24440b36c0 2024-05-26T15:43:37.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2443e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b32e0 0x7f24441f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2443e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b32e0 0x7f24441f68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34340/0 (socket says 172.21.15.8:34340) 2024-05-26T15:43:37.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2443e00640 1 -- 172.21.15.8:0/1303540012 learned_addr learned my addr 172.21.15.8:0/1303540012 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:37.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2443400640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f24440b36c0 0x7f244414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.920 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2449000640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f244415d3f0 0x7f24440ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2443e00640 1 -- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f24440b36c0 msgr2=0x7f244414f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2443e00640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f24440b36c0 0x7f244414f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2443e00640 1 -- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f244415d3f0 msgr2=0x7f24440ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:37.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2443e00640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f244415d3f0 0x7f24440ac7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:37.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.921+0000 7f2443e00640 1 -- 172.21.15.8:0/1303540012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c009400 con 0x7f24440b32e0 2024-05-26T15:43:37.921 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.922+0000 7f2443e00640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b32e0 0x7f24441f68d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f243400c4a0 tx=0x7f243400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:37.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.922+0000 7f243be00640 1 -- 172.21.15.8:0/1303540012 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434005ce0 con 0x7f24440b32e0 2024-05-26T15:43:37.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.922+0000 7f243be00640 1 -- 172.21.15.8:0/1303540012 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2434005e40 con 0x7f24440b32e0 2024-05-26T15:43:37.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.922+0000 7f243be00640 1 -- 172.21.15.8:0/1303540012 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2434007270 con 0x7f24440b32e0 2024-05-26T15:43:37.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.922+0000 7f2449a00640 1 -- 172.21.15.8:0/1303540012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24440ad120 con 0x7f24440b32e0 2024-05-26T15:43:37.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.922+0000 7f2449a00640 1 -- 172.21.15.8:0/1303540012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24441f60d0 con 0x7f24440b32e0 2024-05-26T15:43:37.922 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.924+0000 7f2449a00640 1 -- 172.21.15.8:0/1303540012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24441f6720 con 0x7f24440b32e0 2024-05-26T15:43:37.923 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.924+0000 7f243be00640 1 -- 172.21.15.8:0/1303540012 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f24340073d0 con 0x7f24440b32e0 2024-05-26T15:43:37.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.926+0000 7f243be00640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f242006ac30 0x7f242006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:37.924 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.926+0000 7f243be00640 1 -- 172.21.15.8:0/1303540012 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f24340885f0 con 0x7f24440b32e0 2024-05-26T15:43:37.925 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.927+0000 7f2443400640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f242006ac30 0x7f242006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:37.926 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.928+0000 7f2443400640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f242006ac30 0x7f242006d0f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f242c034000 tx=0x7f242c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:37.928 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:37.930+0000 7f243be00640 1 -- 172.21.15.8:0/1303540012 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f24340539e0 con 0x7f24440b32e0 2024-05-26T15:43:38.131 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.132+0000 7f2449a00640 1 -- 172.21.15.8:0/1303540012 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f244406dfe0 con 0x7f242006ac30 2024-05-26T15:43:38.132 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.134+0000 7f243be00640 1 -- 172.21.15.8:0/1303540012 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f244406dfe0 con 0x7f242006ac30 2024-05-26T15:43:38.132 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 6 to deep-scrub 2024-05-26T15:43:38.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.136+0000 7f2449a00640 1 -- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f242006ac30 msgr2=0x7f242006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.136+0000 7f2449a00640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f242006ac30 0x7f242006d0f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f242c034000 tx=0x7f242c02e000 comp rx=0 tx=0).stop 2024-05-26T15:43:38.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.136+0000 7f2449a00640 1 -- 172.21.15.8:0/1303540012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b32e0 msgr2=0x7f24441f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.135 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.136+0000 7f2449a00640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b32e0 0x7f24441f68d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f243400c4a0 tx=0x7f243400c960 comp rx=0 tx=0).stop 2024-05-26T15:43:38.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.137+0000 7f2449a00640 1 -- 172.21.15.8:0/1303540012 shutdown_connections 2024-05-26T15:43:38.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.137+0000 7f2449a00640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f242006ac30 0x7f242006d0f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.137+0000 7f2449a00640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f244415d3f0 0x7f24440ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.137+0000 7f2449a00640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f24440b36c0 0x7f244414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.137+0000 7f2449a00640 1 --2- 172.21.15.8:0/1303540012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440b32e0 0x7f24441f68d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.136 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.137+0000 7f2449a00640 1 -- 172.21.15.8:0/1303540012 >> 172.21.15.8:0/1303540012 conn(0x7f2444069e70 msgr2=0x7f24440af200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:38.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.138+0000 7f2449a00640 1 -- 172.21.15.8:0/1303540012 shutdown_connections 2024-05-26T15:43:38.137 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.138+0000 7f2449a00640 1 -- 172.21.15.8:0/1303540012 wait complete. 2024-05-26T15:43:38.156 INFO:tasks.ceph:Scrubbing osd.7 2024-05-26T15:43:38.156 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-26T15:43:38.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.375+0000 7fe206000640 1 Processor -- start 2024-05-26T15:43:38.374 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.375+0000 7fe206000640 1 -- start start 2024-05-26T15:43:38.375 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.377+0000 7fe206000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe2000addb0 0x7fe2000abb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.377+0000 7fe206000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2000ac070 con 0x7fe2000acd70 2024-05-26T15:43:38.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.377+0000 7fe206000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20015ceb0 con 0x7fe2000ac990 2024-05-26T15:43:38.376 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.377+0000 7fe206000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20015d170 con 0x7fe2000addb0 2024-05-26T15:43:38.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.377+0000 7fe205600640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe2000acd70 0x7fe2000ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34882/0 (socket says 172.21.15.8:34882) 2024-05-26T15:43:38.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.378+0000 7fe205600640 1 -- 172.21.15.8:0/3846408347 learned_addr learned my addr 172.21.15.8:0/3846408347 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:38.377 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.378+0000 7fe1ffe00640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe2000addb0 0x7fe2000abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.378+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083146436 0 0) 0x7fe2000ac070 con 0x7fe2000acd70 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.378+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e8003520 con 0x7fe2000acd70 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.378+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3316678788 0 0) 0x7fe1e8003520 con 0x7fe2000acd70 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.378+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe2000addb0 msgr2=0x7fe2000abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.378+0000 7fe1ff400640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe2000addb0 0x7fe2000abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.378+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 >> v1:172.21.15.47:6789/0 conn(0x7fe2000ac990 legacy=0x7fe2000ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.378+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20015d450 con 0x7fe2000acd70 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.378+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fe1f8001a10 con 0x7fe2000acd70 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 >> v1:172.21.15.8:6789/0 conn(0x7fe2000acd70 legacy=0x7fe2000ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ff400640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe1e80039a0 0x7fe1e8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.378 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ff400640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1e8004350 0x7fe1e8004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ff400640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1e8005020 0x7fe1e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20015d170 con 0x7fe1e8004350 2024-05-26T15:43:38.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e800bec0 con 0x7fe1e8005020 2024-05-26T15:43:38.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e800c050 con 0x7fe1e80039a0 2024-05-26T15:43:38.379 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ffe00640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1e8004350 0x7fe1e8004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe205600640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1e8005020 0x7fe1e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ffe00640 1 -- 172.21.15.8:0/3846408347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe1e80039a0 msgr2=0x7fe1e8003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:38.380 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ffe00640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe1e80039a0 0x7fe1e8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ffe00640 1 -- 172.21.15.8:0/3846408347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1e8005020 msgr2=0x7fe1e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ffe00640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe1e8005020 0x7fe1e800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.379+0000 7fe1ffe00640 1 -- 172.21.15.8:0/3846408347 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e8003520 con 0x7fe1e8004350 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.380+0000 7fe1ffe00640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1e8004350 0x7fe1e8004820 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009a90 tx=0x7fe1e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90e720bc28b946c server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.381+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec031400 con 0x7fe1e8004350 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.381+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec02d050 con 0x7fe1e8004350 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.381+0000 7fe1ff400640 1 -- 172.21.15.8:0/3846408347 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec031780 con 0x7fe1e8004350 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.381+0000 7fe206000640 1 -- 172.21.15.8:0/3846408347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1e8004350 msgr2=0x7fe1e8004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.381+0000 7fe206000640 1 --2- 172.21.15.8:0/3846408347 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe1e8004350 0x7fe1e8004820 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009a90 tx=0x7fe1e80057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.381+0000 7fe205600640 1 -- 172.21.15.8:0/3846408347 reap_dead start 2024-05-26T15:43:38.381 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.382+0000 7fe206000640 1 -- 172.21.15.8:0/3846408347 shutdown_connections 2024-05-26T15:43:38.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.382+0000 7fe206000640 1 -- 172.21.15.8:0/3846408347 >> 172.21.15.8:0/3846408347 conn(0x7fe200069e70 msgr2=0x7fe20006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:38.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.382+0000 7fe206000640 1 -- 172.21.15.8:0/3846408347 shutdown_connections 2024-05-26T15:43:38.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.382+0000 7fe206000640 1 -- 172.21.15.8:0/3846408347 wait complete. 2024-05-26T15:43:38.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.384+0000 7fe206000640 1 Processor -- start 2024-05-26T15:43:38.382 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.384+0000 7fe206000640 1 -- start start 2024-05-26T15:43:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.385+0000 7fe206000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe1e8004350 0x7fe20014b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.385+0000 7fe206000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe20013f2c0 0x7fe20013e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.385+0000 7fe206000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2001492f0 0x7fe20013ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.385+0000 7fe206000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20014c120 con 0x7fe20013f2c0 2024-05-26T15:43:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.385+0000 7fe206000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000cda30 con 0x7fe2001492f0 2024-05-26T15:43:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.385+0000 7fe206000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000cdd10 con 0x7fe1e8004350 2024-05-26T15:43:38.384 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe1ffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe20013f2c0 0x7fe20013e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe1ffe00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe20013f2c0 0x7fe20013e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34350/0 (socket says 172.21.15.8:34350) 2024-05-26T15:43:38.385 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe1ffe00640 1 -- 172.21.15.8:0/560337987 learned_addr learned my addr 172.21.15.8:0/560337987 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe204c00640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe1e8004350 0x7fe20014b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe205600640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2001492f0 0x7fe20013ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe1ffe00640 1 -- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe1e8004350 msgr2=0x7fe20014b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe1ffe00640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe1e8004350 0x7fe20014b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe1ffe00640 1 -- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2001492f0 msgr2=0x7fe20013ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe1ffe00640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2001492f0 0x7fe20013ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.386 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe1ffe00640 1 -- 172.21.15.8:0/560337987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20014bd40 con 0x7fe20013f2c0 2024-05-26T15:43:38.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.386+0000 7fe205600640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2001492f0 0x7fe20013ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:43:38.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.387+0000 7fe1ffe00640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe20013f2c0 0x7fe20013e730 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec02aae0 tx=0x7fe1ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:38.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.387+0000 7fe1fcc00640 1 -- 172.21.15.8:0/560337987 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec003c50 con 0x7fe20013f2c0 2024-05-26T15:43:38.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.387+0000 7fe1fcc00640 1 -- 172.21.15.8:0/560337987 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec003db0 con 0x7fe20013f2c0 2024-05-26T15:43:38.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.387+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2000cd6e0 con 0x7fe20013f2c0 2024-05-26T15:43:38.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.387+0000 7fe1fcc00640 1 -- 172.21.15.8:0/560337987 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec044610 con 0x7fe20013f2c0 2024-05-26T15:43:38.387 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.387+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20014b770 con 0x7fe20013f2c0 2024-05-26T15:43:38.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.388+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe20014c720 con 0x7fe20013f2c0 2024-05-26T15:43:38.388 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.389+0000 7fe1fcc00640 1 -- 172.21.15.8:0/560337987 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe1ec038070 con 0x7fe20013f2c0 2024-05-26T15:43:38.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.390+0000 7fe1fcc00640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe1e006ac00 0x7fe1e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.390+0000 7fe1fcc00640 1 -- 172.21.15.8:0/560337987 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fe1ec0a9920 con 0x7fe20013f2c0 2024-05-26T15:43:38.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.391+0000 7fe1fcc00640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] conn(0x7fe1e0070fa0 0x7fe1e00733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.391+0000 7fe1fcc00640 1 -- 172.21.15.8:0/560337987 --> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1e0073ab0 con 0x7fe1e0070fa0 2024-05-26T15:43:38.389 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.391+0000 7fe1fcc00640 1 -- 172.21.15.8:0/560337987 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1ec0a9c90 con 0x7fe20013f2c0 2024-05-26T15:43:38.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.391+0000 7fe204c00640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe1e006ac00 0x7fe1e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.390 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.391+0000 7fe205600640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] conn(0x7fe1e0070fa0 0x7fe1e00733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.392+0000 7fe204c00640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe1e006ac00 0x7fe1e006d0c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40016f0 tx=0x7fe1f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:38.391 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.393+0000 7fe205600640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] conn(0x7fe1e0070fa0 0x7fe1e00733e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:38.393 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.395+0000 7fe1fcc00640 1 -- 172.21.15.8:0/560337987 <== osd.7 v2:172.21.15.47:6816/37317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe1e0073ab0 con 0x7fe1e0070fa0 2024-05-26T15:43:38.409 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.411+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 --> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe20015da10 con 0x7fe1e0070fa0 2024-05-26T15:43:38.410 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.412+0000 7fe1fcc00640 1 -- 172.21.15.8:0/560337987 <== osd.7 v2:172.21.15.47:6816/37317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe1f800d040 con 0x7fe1e0070fa0 2024-05-26T15:43:38.411 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2024-05-26T15:43:38.411 INFO:teuthology.orchestra.run.smithi008.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-26T15:43:38.411 INFO:teuthology.orchestra.run.smithi008.stdout:} 2024-05-26T15:43:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.412+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] conn(0x7fe1e0070fa0 msgr2=0x7fe1e00733e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.412+0000 7fe206000640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:6816/37317,v1:172.21.15.47:6817/37317] conn(0x7fe1e0070fa0 0x7fe1e00733e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.412+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe1e006ac00 msgr2=0x7fe1e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.412+0000 7fe206000640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe1e006ac00 0x7fe1e006d0c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40016f0 tx=0x7fe1f4009040 comp rx=0 tx=0).stop 2024-05-26T15:43:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.412+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe20013f2c0 msgr2=0x7fe20013e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.412+0000 7fe206000640 1 --2- 172.21.15.8:0/560337987 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe20013f2c0 0x7fe20013e730 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec02aae0 tx=0x7fe1ec004730 comp rx=0 tx=0).stop 2024-05-26T15:43:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.413+0000 7fe205600640 1 -- 172.21.15.8:0/560337987 reap_dead start 2024-05-26T15:43:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.413+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 shutdown_connections 2024-05-26T15:43:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.413+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 >> 172.21.15.8:0/560337987 conn(0x7fe200069e70 msgr2=0x7fe200160680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:38.412 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.413+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 shutdown_connections 2024-05-26T15:43:38.413 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.413+0000 7fe206000640 1 -- 172.21.15.8:0/560337987 wait complete. 2024-05-26T15:43:38.431 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-26T15:43:38.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.637+0000 7f4be9c00640 1 Processor -- start 2024-05-26T15:43:38.635 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.637+0000 7f4be9c00640 1 -- start start 2024-05-26T15:43:38.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.638+0000 7f4be9c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4be40b36c0 0x7f4be415a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.638+0000 7f4be9c00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4be415d3f0 0x7f4be415d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.638+0000 7f4be9c00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be40ae1c0 con 0x7f4be40b32e0 2024-05-26T15:43:38.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.638+0000 7f4be9c00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be40cc1f0 con 0x7f4be415d3f0 2024-05-26T15:43:38.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.638+0000 7f4be9c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be406e370 con 0x7f4be40b36c0 2024-05-26T15:43:38.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.639+0000 7f4be9200640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f4be415d3f0 0x7f4be415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.639+0000 7f4be3e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4be40b32e0 0x7f4be406d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34898/0 (socket says 172.21.15.8:34898) 2024-05-26T15:43:38.637 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.639+0000 7f4be3e00640 1 -- 172.21.15.8:0/2938477445 learned_addr learned my addr 172.21.15.8:0/2938477445 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:38.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.639+0000 7f4bdbe00640 1 --2- 172.21.15.8:0/2938477445 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4be40b36c0 0x7f4be415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.639+0000 7f4be9200640 1 -- 172.21.15.8:0/2938477445 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4be40b36c0 msgr2=0x7f4be415a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:38.638 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.639+0000 7f4be9200640 1 --2- 172.21.15.8:0/2938477445 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4be40b36c0 0x7f4be415a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.639+0000 7f4be9200640 1 -- 172.21.15.8:0/2938477445 >> v1:172.21.15.8:6789/0 conn(0x7f4be40b32e0 legacy=0x7f4be406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.639+0000 7f4be9200640 1 -- 172.21.15.8:0/2938477445 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be415ddc0 con 0x7f4be415d3f0 2024-05-26T15:43:38.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.639+0000 7f4be3400640 1 -- 172.21.15.8:0/2938477445 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690915084 0 0) 0x7f4be40ae1c0 con 0x7f4be40b32e0 2024-05-26T15:43:38.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.640+0000 7f4be9200640 1 --2- 172.21.15.8:0/2938477445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be415d3f0 0x7f4be415d880 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009dc0 tx=0x7f4bdc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7830545c79257bc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:38.639 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be3400640 1 -- 172.21.15.8:0/2938477445 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc007740 con 0x7f4be415d3f0 2024-05-26T15:43:38.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be3400640 1 -- 172.21.15.8:0/2938477445 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc02d050 con 0x7f4be415d3f0 2024-05-26T15:43:38.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be3400640 1 -- 172.21.15.8:0/2938477445 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc007ac0 con 0x7f4be415d3f0 2024-05-26T15:43:38.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be9c00640 1 -- 172.21.15.8:0/2938477445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be415d3f0 msgr2=0x7f4be415d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be9c00640 1 --2- 172.21.15.8:0/2938477445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be415d3f0 0x7f4be415d880 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009dc0 tx=0x7f4bdc02a5f0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be9c00640 1 -- 172.21.15.8:0/2938477445 shutdown_connections 2024-05-26T15:43:38.640 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be9c00640 1 --2- 172.21.15.8:0/2938477445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be415d3f0 0x7f4be415d880 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be9c00640 1 --2- 172.21.15.8:0/2938477445 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4be40b36c0 0x7f4be415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be9c00640 1 -- 172.21.15.8:0/2938477445 >> 172.21.15.8:0/2938477445 conn(0x7f4be4069e70 msgr2=0x7f4be406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:38.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be9c00640 1 -- 172.21.15.8:0/2938477445 shutdown_connections 2024-05-26T15:43:38.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.641+0000 7f4be9c00640 1 -- 172.21.15.8:0/2938477445 wait complete. 2024-05-26T15:43:38.641 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.643+0000 7f4be9c00640 1 Processor -- start 2024-05-26T15:43:38.642 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.643+0000 7f4be9c00640 1 -- start start 2024-05-26T15:43:38.643 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.644+0000 7f4be9c00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be40b32e0 0x7f4be40ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.644+0000 7f4be9c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be40b36c0 0x7f4be4158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.644+0000 7f4be9c00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4be415d3f0 0x7f4be4149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.644+0000 7f4be9c00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40c7dd0 con 0x7f4be40b32e0 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.644+0000 7f4be9c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40c7a80 con 0x7f4be40b36c0 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.644+0000 7f4be9c00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be4152620 con 0x7f4be415d3f0 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.644+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be40b32e0 0x7f4be40ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.645+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be40b32e0 0x7f4be40ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34364/0 (socket says 172.21.15.8:34364) 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.645+0000 7f4be3e00640 1 -- 172.21.15.8:0/602164055 learned_addr learned my addr 172.21.15.8:0/602164055 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.645+0000 7f4be3e00640 1 -- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4be415d3f0 msgr2=0x7f4be4149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.645+0000 7f4bdbe00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be40b36c0 0x7f4be4158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.645+0000 7f4be9200640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4be415d3f0 0x7f4be4149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.645+0000 7f4be3e00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4be415d3f0 0x7f4be4149be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.645+0000 7f4be3e00640 1 -- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be40b36c0 msgr2=0x7f4be4158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.644 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.645+0000 7f4be3e00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be40b36c0 0x7f4be4158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.645+0000 7f4be3e00640 1 -- 172.21.15.8:0/602164055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc009a70 con 0x7f4be40b32e0 2024-05-26T15:43:38.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.645+0000 7f4be3e00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be40b32e0 0x7f4be40ca6e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400c500 tx=0x7f4bd400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:38.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.646+0000 7f4be0c00640 1 -- 172.21.15.8:0/602164055 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4007560 con 0x7f4be40b32e0 2024-05-26T15:43:38.645 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.646+0000 7f4be0c00640 1 -- 172.21.15.8:0/602164055 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd40047e0 con 0x7f4be40b32e0 2024-05-26T15:43:38.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.646+0000 7f4be0c00640 1 -- 172.21.15.8:0/602164055 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4004b90 con 0x7f4be40b32e0 2024-05-26T15:43:38.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.646+0000 7f4be9c00640 1 -- 172.21.15.8:0/602164055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be4157b00 con 0x7f4be40b32e0 2024-05-26T15:43:38.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.646+0000 7f4be9c00640 1 -- 172.21.15.8:0/602164055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be41580c0 con 0x7f4be40b32e0 2024-05-26T15:43:38.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.647+0000 7f4be9c00640 1 -- 172.21.15.8:0/602164055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be40c7f10 con 0x7f4be40b32e0 2024-05-26T15:43:38.646 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.648+0000 7f4be0c00640 1 -- 172.21.15.8:0/602164055 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4bd4004cf0 con 0x7f4be40b32e0 2024-05-26T15:43:38.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.649+0000 7f4be0c00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bc006ac00 0x7f4bc006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:38.647 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.649+0000 7f4be0c00640 1 -- 172.21.15.8:0/602164055 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f4bd4088390 con 0x7f4be40b32e0 2024-05-26T15:43:38.648 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.650+0000 7f4bdbe00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bc006ac00 0x7f4bc006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:38.649 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.651+0000 7f4bdbe00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bc006ac00 0x7f4bc006d0c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4be40b03f0 tx=0x7f4bcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:38.651 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.653+0000 7f4be0c00640 1 -- 172.21.15.8:0/602164055 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4bd40536c0 con 0x7f4be40b32e0 2024-05-26T15:43:38.848 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.850+0000 7f4be9c00640 1 -- 172.21.15.8:0/602164055 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f4be406c680 con 0x7f4bc006ac00 2024-05-26T15:43:38.849 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.851+0000 7f4be0c00640 1 -- 172.21.15.8:0/602164055 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4bcc009d60 con 0x7f4bc006ac00 2024-05-26T15:43:38.850 INFO:teuthology.orchestra.run.smithi008.stderr:instructed osd(s) 7 to deep-scrub 2024-05-26T15:43:38.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 -- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bc006ac00 msgr2=0x7f4bc006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bc006ac00 0x7f4bc006d0c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4be40b03f0 tx=0x7f4bcc008040 comp rx=0 tx=0).stop 2024-05-26T15:43:38.852 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 -- 172.21.15.8:0/602164055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be40b32e0 msgr2=0x7f4be40ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be40b32e0 0x7f4be40ca6e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400c500 tx=0x7f4bd400c9c0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 -- 172.21.15.8:0/602164055 shutdown_connections 2024-05-26T15:43:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f4be415d3f0 0x7f4be4149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f4bc006ac00 0x7f4bc006d0c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4be40b36c0 0x7f4be4158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 --2- 172.21.15.8:0/602164055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4be40b32e0 0x7f4be40ca6e0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:38.853 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 -- 172.21.15.8:0/602164055 >> 172.21.15.8:0/602164055 conn(0x7f4be4069e70 msgr2=0x7f4be40b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:38.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 -- 172.21.15.8:0/602164055 shutdown_connections 2024-05-26T15:43:38.854 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:38.854+0000 7f4be9c00640 1 -- 172.21.15.8:0/602164055 wait complete. 2024-05-26T15:43:38.872 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:43:39.088 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.089+0000 7f1db3e00640 1 Processor -- start 2024-05-26T15:43:39.089 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.089+0000 7f1db3e00640 1 -- start start 2024-05-26T15:43:39.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.091+0000 7f1db3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db41571a0 0x7f1db40caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:39.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.091+0000 7f1db3e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db415d480 con 0x7f1db415cfe0 2024-05-26T15:43:39.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.091+0000 7f1db3e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db415d760 con 0x7f1db40b0ef0 2024-05-26T15:43:39.090 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.091+0000 7f1db3e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db415e090 con 0x7f1db41571a0 2024-05-26T15:43:39.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.092+0000 7f1daa000640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f1db415cfe0 0x7f1db40b07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:34904/0 (socket says 172.21.15.8:34904) 2024-05-26T15:43:39.091 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.092+0000 7f1daa000640 1 -- 172.21.15.8:0/2811512662 learned_addr learned my addr 172.21.15.8:0/2811512662 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.092+0000 7f1db2a00640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db41571a0 0x7f1db40caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.092+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706704193 0 0) 0x7f1db415d480 con 0x7f1db415cfe0 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.092+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d94003520 con 0x7f1db415cfe0 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2599188248 0 0) 0x7f1d94003520 con 0x7f1db415cfe0 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db41571a0 msgr2=0x7f1db40caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db41571a0 0x7f1db40caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 >> v1:172.21.15.47:6789/0 conn(0x7f1db40b0ef0 legacy=0x7f1db40c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db415da40 con 0x7f1db415cfe0 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7f1d9c001670 con 0x7f1db415cfe0 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 >> v1:172.21.15.8:6789/0 conn(0x7f1db415cfe0 legacy=0x7f1db40b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:39.093 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db41571a0 0x7f1d940039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d94003f20 0x7f1d940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d94004d00 0x7f1d94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db415e090 con 0x7f1d94003f20 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9400ba60 con 0x7f1d94004d00 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9400bc20 con 0x7f1db41571a0 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1daa000640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d94003f20 0x7f1d940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db2a00640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db41571a0 0x7f1d940039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.093+0000 7f1db3400640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d94004d00 0x7f1d94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.094+0000 7f1daa000640 1 -- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db41571a0 msgr2=0x7f1d940039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.094+0000 7f1daa000640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db41571a0 0x7f1d940039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.094+0000 7f1daa000640 1 -- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d94004d00 msgr2=0x7f1d94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.094+0000 7f1daa000640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d94004d00 0x7f1d94005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:39.094 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.094+0000 7f1daa000640 1 -- 172.21.15.8:0/2811512662 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94003520 con 0x7f1d94003f20 2024-05-26T15:43:39.095 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.095+0000 7f1daa000640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d94003f20 0x7f1d940047c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00c240 tx=0x7f1d940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147749e1f54a57f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:39.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.096+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c02e070 con 0x7f1d94003f20 2024-05-26T15:43:39.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.096+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c0058d0 con 0x7f1d94003f20 2024-05-26T15:43:39.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.096+0000 7f1db2000640 1 -- 172.21.15.8:0/2811512662 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c005d00 con 0x7f1d94003f20 2024-05-26T15:43:39.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.096+0000 7f1db3e00640 1 -- 172.21.15.8:0/2811512662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d94003f20 msgr2=0x7f1d940047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:39.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.096+0000 7f1db3e00640 1 --2- 172.21.15.8:0/2811512662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d94003f20 0x7f1d940047c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00c240 tx=0x7f1d940057f0 comp rx=0 tx=0).stop 2024-05-26T15:43:39.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.096+0000 7f1db3400640 1 -- 172.21.15.8:0/2811512662 reap_dead start 2024-05-26T15:43:39.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.096+0000 7f1db3e00640 1 -- 172.21.15.8:0/2811512662 shutdown_connections 2024-05-26T15:43:39.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.096+0000 7f1db3e00640 1 -- 172.21.15.8:0/2811512662 >> 172.21.15.8:0/2811512662 conn(0x7f1db4070480 msgr2=0x7f1db4070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:39.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.096+0000 7f1db3e00640 1 -- 172.21.15.8:0/2811512662 shutdown_connections 2024-05-26T15:43:39.096 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.096+0000 7f1db3e00640 1 -- 172.21.15.8:0/2811512662 wait complete. 2024-05-26T15:43:39.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.098+0000 7f1db3e00640 1 Processor -- start 2024-05-26T15:43:39.097 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.098+0000 7f1db3e00640 1 -- start start 2024-05-26T15:43:39.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.099+0000 7f1db3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d94003f20 0x7f1db415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:39.098 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.099+0000 7f1db3e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1db41f5ca0 0x7f1db413d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.099+0000 7f1db3e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db4157580 0x7f1db4157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.099+0000 7f1db3e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db41f6120 con 0x7f1db41f5ca0 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.099+0000 7f1db3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4157f40 con 0x7f1d94003f20 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.099+0000 7f1db3e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db41f6bd0 con 0x7f1db4157580 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.100+0000 7f1daa000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1db41f5ca0 0x7f1db413d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.100+0000 7f1daa000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1db41f5ca0 0x7f1db413d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34374/0 (socket says 172.21.15.8:34374) 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.100+0000 7f1daa000640 1 -- 172.21.15.8:0/3251863640 learned_addr learned my addr 172.21.15.8:0/3251863640 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.100+0000 7f1db2a00640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d94003f20 0x7f1db415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.100+0000 7f1db3400640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db4157580 0x7f1db4157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.100+0000 7f1daa000640 1 -- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db4157580 msgr2=0x7f1db4157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.100+0000 7f1daa000640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db4157580 0x7f1db4157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.100+0000 7f1daa000640 1 -- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d94003f20 msgr2=0x7f1db415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:39.099 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.100+0000 7f1daa000640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d94003f20 0x7f1db415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:39.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.100+0000 7f1daa000640 1 -- 172.21.15.8:0/3251863640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db413dbd0 con 0x7f1db41f5ca0 2024-05-26T15:43:39.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.101+0000 7f1daa000640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1db41f5ca0 0x7f1db413d690 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c02ad70 tx=0x7f1d9c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:39.100 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.101+0000 7f1dab400640 1 -- 172.21.15.8:0/3251863640 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c007070 con 0x7f1db41f5ca0 2024-05-26T15:43:39.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.101+0000 7f1dab400640 1 -- 172.21.15.8:0/3251863640 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c0071d0 con 0x7f1db41f5ca0 2024-05-26T15:43:39.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.101+0000 7f1dab400640 1 -- 172.21.15.8:0/3251863640 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c007540 con 0x7f1db41f5ca0 2024-05-26T15:43:39.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.101+0000 7f1db3e00640 1 -- 172.21.15.8:0/3251863640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db41f6330 con 0x7f1db41f5ca0 2024-05-26T15:43:39.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.101+0000 7f1db3e00640 1 -- 172.21.15.8:0/3251863640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db41f68f0 con 0x7f1db41f5ca0 2024-05-26T15:43:39.101 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.103+0000 7f1db3e00640 1 -- 172.21.15.8:0/3251863640 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db404e280 con 0x7f1db41f5ca0 2024-05-26T15:43:39.102 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.104+0000 7f1dab400640 1 -- 172.21.15.8:0/3251863640 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d9c033420 con 0x7f1db41f5ca0 2024-05-26T15:43:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.104+0000 7f1dab400640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d9006ac00 0x7f1d9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.105+0000 7f1dab400640 1 -- 172.21.15.8:0/3251863640 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f1d9c0a9220 con 0x7f1db41f5ca0 2024-05-26T15:43:39.103 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.105+0000 7f1db2a00640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d9006ac00 0x7f1d9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:39.105 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.106+0000 7f1db2a00640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d9006ac00 0x7f1d9006d0c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009a10 tx=0x7f1da4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:39.108 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.110+0000 7f1dab400640 1 -- 172.21.15.8:0/3251863640 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1d9c0745f0 con 0x7f1db41f5ca0 2024-05-26T15:43:39.305 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.307+0000 7f1db3e00640 1 -- 172.21.15.8:0/3251863640 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1db40ca7d0 con 0x7f1d9006ac00 2024-05-26T15:43:39.312 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.313+0000 7f1dab400640 1 -- 172.21.15.8:0/3251863640 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47564 (secure 0 0 0) 0x7f1da4013a10 con 0x7f1d9006ac00 2024-05-26T15:43:39.313 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:39.313 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:43:39.314 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 -- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d9006ac00 msgr2=0x7f1d9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d9006ac00 0x7f1d9006d0c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009a10 tx=0x7f1da4008040 comp rx=0 tx=0).stop 2024-05-26T15:43:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 -- 172.21.15.8:0/3251863640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1db41f5ca0 msgr2=0x7f1db413d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1db41f5ca0 0x7f1db413d690 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c02ad70 tx=0x7f1d9c001a00 comp rx=0 tx=0).stop 2024-05-26T15:43:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 -- 172.21.15.8:0/3251863640 shutdown_connections 2024-05-26T15:43:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f1db4157580 0x7f1db4157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1db41f5ca0 0x7f1db413d690 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f1d9006ac00 0x7f1d9006d0c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 --2- 172.21.15.8:0/3251863640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1d94003f20 0x7f1db415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:39.315 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 -- 172.21.15.8:0/3251863640 >> 172.21.15.8:0/3251863640 conn(0x7f1db4070480 msgr2=0x7f1db415b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:39.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 -- 172.21.15.8:0/3251863640 shutdown_connections 2024-05-26T15:43:39.316 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:39.316+0000 7f1db3e00640 1 -- 172.21.15.8:0/3251863640 wait complete. 2024-05-26T15:43:39.335 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-05-26T15:43:38.253415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":256148,"kb_used_data":7196,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754718572,"statfs":{"total":773094113280,"available":772831817728,"internally_reserved":0,"allocated":7368704,"data_stored":3981719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.393552"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-05-26T15:43:26.235938+0000","last_change":"2024-05-26T15:39:23.474057+0000","last_active":"2024-05-26T15:43:26.235938+0000","last_peered":"2024-05-26T15:43:26.235938+0000","last_clean":"2024-05-26T15:43:26.235938+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:43:26.235938+0000","last_undegraded":"2024-05-26T15:43:26.235938+0000","last_fullsized":"2024-05-26T15:43:26.235938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-26T15:39:22.228224+0000","last_clean_scrub_stamp":"2024-05-26T15:39:22.228224+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T20:01:06.931944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1368064,"data_stored":940873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.165,"15min":1.155},"min":{"1min":0.83499999999999996,"5min":0.622,"15min":0.622},"max":{"1min":1.552,"5min":1.802,"15min":1.802},"last":1.206},{"interface":"front","average":{"1min":1.101,"5min":1.1399999999999999,"15min":1.1279999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.95499999999999996}]},{"osd":1,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2230000000000001,"15min":1.2310000000000001},"min":{"1min":0.94899999999999995,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.536,"5min":1.887,"15min":1.887},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2470000000000001,"15min":1.264},"min":{"1min":0.79500000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4810000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.242}]},{"osd":2,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.343,"15min":1.3280000000000001},"min":{"1min":1.0740000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.627,"5min":1.865,"15min":1.865},"last":1.347},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3029999999999999,"15min":1.325},"min":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6539999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.72099999999999997}]},{"osd":3,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.3520000000000001,"15min":1.3220000000000001},"min":{"1min":0.91200000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7430000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.524},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.4970000000000001,"15min":1.4890000000000001},"min":{"1min":1.139,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.827,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.552}]},{"osd":4,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4410000000000001,"15min":1.4430000000000001},"min":{"1min":1.1839999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.9019999999999999,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.371},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.5760000000000001,"15min":1.5700000000000001},"min":{"1min":1.268,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.831,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.417}]},{"osd":5,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.5049999999999999,"15min":1.5389999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.9259999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.151},{"interface":"front","average":{"1min":1.601,"5min":1.641,"15min":1.653},"min":{"1min":1.046,"5min":0.998,"15min":0.998},"max":{"1min":2.117,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.1200000000000001}]},{"osd":6,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":1.6459999999999999,"15min":1.6759999999999999},"min":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":2.0369999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.768,"15min":1.804},"min":{"1min":1.3,"5min":1.3,"15min":1.3},"max":{"1min":2.2949999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.601}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31876,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":774144,"data_stored":350505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.147,"15min":1.159},"min":{"1min":0.82699999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6719999999999999,"5min":1.736,"15min":1.736},"last":1.9019999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.161,"15min":1.1120000000000001},"min":{"1min":0.82499999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7809999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.1699999999999999}]},{"osd":1,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1919999999999999,"15min":1.196},"min":{"1min":0.80900000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7010000000000001,"5min":1.931,"15min":1.931},"last":1.607},{"interface":"front","average":{"1min":1.244,"5min":1.2509999999999999,"15min":1.2390000000000001},"min":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.778,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.548}]},{"osd":2,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.266,"15min":1.3},"min":{"1min":0.72899999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.675,"5min":2.157,"15min":2.157},"last":1.353},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4339999999999999,"15min":1.4930000000000001},"min":{"1min":0.995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.589,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.696}]},{"osd":3,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.337,"15min":1.3919999999999999},"min":{"1min":0.96099999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.569,"5min":2.169,"15min":2.169},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.5169999999999999,"15min":1.6419999999999999},"min":{"1min":0.99199999999999999,"5min":0.754,"15min":0.754},"max":{"1min":1.925,"5min":4.452,"15min":4.452},"last":1.9790000000000001}]},{"osd":4,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.5289999999999999,"15min":1.621},"min":{"1min":0.92800000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.841,"5min":3.282,"15min":3.282},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.411,"5min":1.4490000000000001,"15min":1.5029999999999999},"min":{"1min":0.95399999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.95,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.736}]},{"osd":5,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.605,"15min":1.7050000000000001},"min":{"1min":1.1930000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0619999999999998,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.843},{"interface":"front","average":{"1min":1.488,"5min":1.5529999999999999,"15min":1.6240000000000001},"min":{"1min":0.93400000000000005,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.0030000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.6599999999999999}]},{"osd":7,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.6739999999999999,"15min":1.776},"min":{"1min":1.3180000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.909,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.778},{"interface":"front","average":{"1min":1.595,"5min":1.6919999999999999,"15min":1.788},"min":{"1min":1.0049999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1560000000000001,"5min":2.843,"15min":2.843},"last":1.7909999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":770048,"data_stored":349486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1100000000000001,"15min":1.1379999999999999},"min":{"1min":0.76100000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3959999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.036},{"interface":"front","average":{"1min":1.133,"5min":1.1479999999999999,"15min":1.091},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.659,"5min":1.873,"15min":1.873},"last":1.0900000000000001}]},{"osd":1,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.1930000000000001,"15min":1.113},"min":{"1min":0.88800000000000001,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.151},{"interface":"front","average":{"1min":1.25,"5min":1.196,"15min":1.1459999999999999},"min":{"1min":0.92800000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.536,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.329}]},{"osd":2,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.216,"15min":1.1899999999999999},"min":{"1min":0.95699999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.9970000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.306,"15min":1.286},"min":{"1min":0.75,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7110000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.677}]},{"osd":3,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.329,"15min":1.341},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6419999999999999,"5min":1.879,"15min":1.879},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.4059999999999999,"15min":1.4239999999999999},"min":{"1min":0.82599999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.8120000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.5569999999999999}]},{"osd":4,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3220000000000001,"15min":1.331},"min":{"1min":0.78600000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7569999999999999,"5min":2.077,"15min":2.077},"last":1.607},{"interface":"front","average":{"1min":1.518,"5min":1.55,"15min":1.575},"min":{"1min":0.94999999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.7829999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":2.1440000000000001}]},{"osd":6,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4770000000000001,"15min":1.5209999999999999},"min":{"1min":1.014,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.7789999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.456,"15min":1.4570000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.6879999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.7310000000000001}]},{"osd":7,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.5860000000000001,"15min":1.6180000000000001},"min":{"1min":1.0609999999999999,"5min":1.036,"15min":1.036},"max":{"1min":1.9690000000000001,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":2.2149999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.6180000000000001,"15min":1.641},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":2.1160000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":774144,"data_stored":350505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.159,"15min":1.165},"min":{"1min":0.72699999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.742,"5min":3.5049999999999999,"15min":3.5049999999999999},"last":1.038},{"interface":"front","average":{"1min":1.153,"5min":1.212,"15min":1.2390000000000001},"min":{"1min":0.83999999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.601,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.516}]},{"osd":1,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.258,"15min":1.262},"min":{"1min":0.91400000000000003,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7450000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.157,"15min":1.1359999999999999},"min":{"1min":0.81299999999999994,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.615,"5min":1.75,"15min":1.75},"last":0.999}]},{"osd":2,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.284,"15min":1.2689999999999999},"min":{"1min":0.70599999999999996,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6950000000000001,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.3},{"interface":"front","average":{"1min":1.341,"5min":1.3080000000000001,"15min":1.3069999999999999},"min":{"1min":0.81899999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.696,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.2549999999999999}]},{"osd":3,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2929999999999999,"15min":1.2809999999999999},"min":{"1min":0.84799999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.835,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.123},{"interface":"front","average":{"1min":1.482,"5min":1.46,"15min":1.484},"min":{"1min":1.095,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.837,"5min":2.734,"15min":2.734},"last":1.6040000000000001}]},{"osd":5,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.472,"15min":1.492},"min":{"1min":1.101,"5min":0.502,"15min":0.502},"max":{"1min":1.863,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.448},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.444,"15min":1.492},"min":{"1min":0.91500000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6850000000000001,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.3999999999999999}]},{"osd":6,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5209999999999999,"15min":1.569},"min":{"1min":1.1819999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.867,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.601,"15min":1.645},"min":{"1min":1.226,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.857,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.694}]},{"osd":7,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.579,"15min":1.6519999999999999},"min":{"1min":1.2450000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.917,"5min":4.008,"15min":4.008},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.7010000000000001,"15min":1.7549999999999999},"min":{"1min":1.2749999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.929,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.49}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":774144,"data_stored":350505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.873,"15min":0.89600000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.87},{"interface":"front","average":{"1min":1.077,"5min":0.998,"15min":0.96399999999999997},"min":{"1min":0.52400000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.657,"5min":1.659,"15min":1.659},"last":1.4259999999999999}]},{"osd":1,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.93700000000000006,"15min":0.98399999999999999},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.216,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.131,"15min":1.194},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4650000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":0.96999999999999997}]},{"osd":2,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1240000000000001,"15min":1.1599999999999999},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6639999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.042},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.214,"15min":1.2110000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.623,"5min":1.954,"15min":1.954},"last":1.083}]},{"osd":4,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.298,"15min":1.302},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.593,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.208},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.3959999999999999,"15min":1.4330000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.8759999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.4650000000000001}]},{"osd":5,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.456,"15min":1.486},"min":{"1min":0.876,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.0569999999999999,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.514},{"interface":"front","average":{"1min":1.399,"5min":1.4159999999999999,"15min":1.4199999999999999},"min":{"1min":0.84099999999999997,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.948,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.948}]},{"osd":6,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5009999999999999,"15min":1.5329999999999999},"min":{"1min":0.91300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.0979999999999999,"5min":2.863,"15min":2.863},"last":1.631},{"interface":"front","average":{"1min":1.49,"5min":1.5649999999999999,"15min":1.5960000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.2639999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.373}]},{"osd":7,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.478,"15min":1.498},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0310000000000001,"5min":2.306,"15min":2.306},"last":2.0310000000000001},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5620000000000001,"15min":1.587},"min":{"1min":0.97299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.3130000000000002,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.5649999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":770048,"data_stored":349486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.526},{"interface":"front","average":{"1min":1.137,"5min":1.145,"15min":1.1279999999999999},"min":{"1min":0.54300000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.484,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.0469999999999999}]},{"osd":1,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.0009999999999999,"15min":1.0429999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.365,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.751},{"interface":"front","average":{"1min":1.107,"5min":1.175,"15min":1.1830000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.528,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":1.079}]},{"osd":3,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.079,"15min":1.048},"min":{"1min":0.501,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.484,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.879},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2270000000000001,"15min":1.2769999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6459999999999999,"5min":2.903,"15min":2.903},"last":1.3700000000000001}]},{"osd":4,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.516,"15min":1.4890000000000001},"min":{"1min":1.1160000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.716,"5min":10.438000000000001,"15min":10.438000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4259999999999999,"15min":1.466},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.5700000000000001,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.4510000000000001}]},{"osd":5,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.4750000000000001,"15min":1.5089999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0009999999999999,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.159},{"interface":"front","average":{"1min":1.45,"5min":1.635,"15min":1.643},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.734,"5min":10.798999999999999,"15min":10.798999999999999},"last":1.198}]},{"osd":6,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.6000000000000001,"15min":1.5920000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.9239999999999999,"5min":7.851,"15min":7.851},"last":1.335},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.6779999999999999,"15min":1.6299999999999999},"min":{"1min":1.0189999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.724,"5min":10.672000000000001,"15min":10.672000000000001},"last":1.387}]},{"osd":7,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.73,"15min":1.732},"min":{"1min":1.1990000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":1.827,"5min":10.249000000000001,"15min":10.249000000000001},"last":1.423},{"interface":"front","average":{"1min":1.577,"5min":1.611,"15min":1.611},"min":{"1min":0.96799999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.254}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31876,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":774144,"data_stored":350505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.95699999999999996,"15min":1.052},"min":{"1min":0.45000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.4410000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0369999999999999,"15min":1.1060000000000001},"min":{"1min":0.626,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.4650000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.286}]},{"osd":2,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54600000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3200000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1910000000000001,"15min":1.2769999999999999},"min":{"1min":0.69299999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.601,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.6259999999999999}]},{"osd":3,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2789999999999999,"15min":1.3520000000000001},"min":{"1min":0.89300000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.694,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.141,"15min":1.24},"min":{"1min":0.65500000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.714,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":0.92700000000000005}]},{"osd":4,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.331,"15min":1.371},"min":{"1min":0.98799999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.8300000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.111},{"interface":"front","average":{"1min":1.343,"5min":1.3480000000000001,"15min":1.4019999999999999},"min":{"1min":1.1100000000000001,"5min":0.75,"15min":0.75},"max":{"1min":1.6639999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.4099999999999999}]},{"osd":5,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3859999999999999,"15min":1.4810000000000001},"min":{"1min":0.95099999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8140000000000001,"5min":2.621,"15min":2.621},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.524,"15min":1.615},"min":{"1min":1.026,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.802,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.6970000000000001}]},{"osd":6,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4450000000000001,"15min":1.5189999999999999},"min":{"1min":0.86899999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.6639999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.069},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.6459999999999999},"min":{"1min":0.95999999999999996,"5min":0.755,"15min":0.755},"max":{"1min":1.9790000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.6020000000000001}]},{"osd":7,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.6040000000000001,"15min":1.7010000000000001},"min":{"1min":1.196,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.954,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.532},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.5309999999999999,"15min":1.611},"min":{"1min":0.93899999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8600000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.5700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1363968,"data_stored":939854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.91200000000000003},"min":{"1min":0.54600000000000004,"5min":0.307,"15min":0.307},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.94099999999999995,"15min":0.995},"min":{"1min":0.57699999999999996,"5min":0.377,"15min":0.377},"max":{"1min":1.843,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.24}]},{"osd":2,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0169999999999999,"15min":1.087},"min":{"1min":0.61699999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.391,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.292},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0189999999999999,"15min":1.036},"min":{"1min":0.54800000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.4450000000000001}]},{"osd":3,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.194,"15min":1.2829999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6759999999999999,"5min":4.024,"15min":4.024},"last":1.518},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.1879999999999999,"15min":1.25},"min":{"1min":0.66700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.72,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":1.55}]},{"osd":4,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.331,"15min":1.4490000000000001},"min":{"1min":0.80200000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6930000000000001,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.401},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.139,"15min":1.151},"min":{"1min":0.81899999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6200000000000001,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.3360000000000001}]},{"osd":5,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.4670000000000001,"15min":1.5349999999999999},"min":{"1min":1.0589999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.8859999999999999,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.647},{"interface":"front","average":{"1min":1.391,"5min":1.4339999999999999,"15min":1.5129999999999999},"min":{"1min":0.81899999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.7290000000000001,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":2.3069999999999999}]},{"osd":6,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.22,"15min":1.264},"min":{"1min":0.80400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.766,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.482},{"interface":"front","average":{"1min":1.377,"5min":1.409,"15min":1.5089999999999999},"min":{"1min":0.999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8779999999999999,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":2.4420000000000002}]},{"osd":7,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5389999999999999,"15min":1.621},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.004,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.728},{"interface":"front","average":{"1min":1.393,"5min":1.327,"15min":1.365},"min":{"1min":1.0169999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.931,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.603}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:43:39.339 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-26T15:39:22.228224+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=26, tm_hour=15, tm_min=39, tm_sec=22, tm_wday=6, tm_yday=147, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=26, tm_hour=15, tm_min=43, tm_sec=32, tm_wday=6, tm_yday=147, tm_isdst=0) 2024-05-26T15:43:39.340 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-26T15:43:59.144 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:43:59.152 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:43:59.340 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-26T15:43:59.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.562+0000 7f4622000640 1 Processor -- start 2024-05-26T15:43:59.560 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.562+0000 7f4622000640 1 -- start start 2024-05-26T15:43:59.562 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.564+0000 7f4622000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f461c0cdde0 0x7f461c167710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.564+0000 7f4622000640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0d11e0 con 0x7f461c15cb60 2024-05-26T15:43:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.564+0000 7f4622000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0d1440 con 0x7f461c0b8470 2024-05-26T15:43:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.564+0000 7f4622000640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c0d1720 con 0x7f461c0cdde0 2024-05-26T15:43:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.564+0000 7f4620c00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f461c15cb60 0x7f461c0d0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52084/0 (socket says 172.21.15.8:52084) 2024-05-26T15:43:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.564+0000 7f4620c00640 1 -- 172.21.15.8:0/2964407362 learned_addr learned my addr 172.21.15.8:0/2964407362 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:43:59.563 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.564+0000 7f4621600640 1 --2- 172.21.15.8:0/2964407362 >> v2:172.21.15.8:3300/0 conn(0x7f461c0cdde0 0x7f461c167710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.564+0000 7f461b400640 1 -- 172.21.15.8:0/2964407362 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560098153 0 0) 0x7f461c0d11e0 con 0x7f461c15cb60 2024-05-26T15:43:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.565+0000 7f461b400640 1 -- 172.21.15.8:0/2964407362 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4604003520 con 0x7f461c15cb60 2024-05-26T15:43:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.565+0000 7f4621600640 1 -- 172.21.15.8:0/2964407362 >> v1:172.21.15.47:6789/0 conn(0x7f461c0b8470 legacy=0x7f461c0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:43:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.565+0000 7f4621600640 1 -- 172.21.15.8:0/2964407362 >> v1:172.21.15.8:6789/0 conn(0x7f461c15cb60 legacy=0x7f461c0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.565+0000 7f4621600640 1 -- 172.21.15.8:0/2964407362 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0d1a00 con 0x7f461c0cdde0 2024-05-26T15:43:59.564 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.566+0000 7f4621600640 1 --2- 172.21.15.8:0/2964407362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c0cdde0 0x7f461c167710 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4614009d90 tx=0x7f461402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fae8d13faa76c86 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:59.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.566+0000 7f461b400640 1 -- 172.21.15.8:0/2964407362 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614007740 con 0x7f461c0cdde0 2024-05-26T15:43:59.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.566+0000 7f461b400640 1 -- 172.21.15.8:0/2964407362 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461402d050 con 0x7f461c0cdde0 2024-05-26T15:43:59.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.566+0000 7f461b400640 1 -- 172.21.15.8:0/2964407362 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614007ac0 con 0x7f461c0cdde0 2024-05-26T15:43:59.565 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.567+0000 7f4622000640 1 -- 172.21.15.8:0/2964407362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c0cdde0 msgr2=0x7f461c167710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.567+0000 7f4622000640 1 --2- 172.21.15.8:0/2964407362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c0cdde0 0x7f461c167710 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4614009d90 tx=0x7f461402a6a0 comp rx=0 tx=0).stop 2024-05-26T15:43:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.567+0000 7f4622000640 1 -- 172.21.15.8:0/2964407362 shutdown_connections 2024-05-26T15:43:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.567+0000 7f4622000640 1 --2- 172.21.15.8:0/2964407362 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c0cdde0 0x7f461c167710 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.567+0000 7f4622000640 1 -- 172.21.15.8:0/2964407362 >> 172.21.15.8:0/2964407362 conn(0x7f461c0cf480 msgr2=0x7f461c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.567+0000 7f4622000640 1 -- 172.21.15.8:0/2964407362 shutdown_connections 2024-05-26T15:43:59.566 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.567+0000 7f4622000640 1 -- 172.21.15.8:0/2964407362 wait complete. 2024-05-26T15:43:59.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.569+0000 7f4622000640 1 Processor -- start 2024-05-26T15:43:59.567 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.569+0000 7f4622000640 1 -- start start 2024-05-26T15:43:59.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.570+0000 7f4622000640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f461c0b8470 0x7f461c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:59.569 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.570+0000 7f4622000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f461c0cdde0 0x7f461c15f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:59.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.570+0000 7f4622000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c15cb60 0x7f461c1520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:59.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.570+0000 7f4622000640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c15df40 con 0x7f461c15cb60 2024-05-26T15:43:59.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.570+0000 7f4622000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0c7820 con 0x7f461c0cdde0 2024-05-26T15:43:59.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.570+0000 7f4622000640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c0c7b00 con 0x7f461c0b8470 2024-05-26T15:43:59.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.570+0000 7f4621600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c15cb60 0x7f461c1520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:59.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.570+0000 7f4621600640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c15cb60 0x7f461c1520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54426/0 (socket says 172.21.15.8:54426) 2024-05-26T15:43:59.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.570+0000 7f4621600640 1 -- 172.21.15.8:0/2776181974 learned_addr learned my addr 172.21.15.8:0/2776181974 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:43:59.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.571+0000 7f4620c00640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f461c0b8470 0x7f461c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:59.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.571+0000 7f461be00640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f461c0cdde0 0x7f461c15f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:59.570 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.571+0000 7f4621600640 1 -- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f461c0b8470 msgr2=0x7f461c152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:59.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.571+0000 7f4621600640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f461c0b8470 0x7f461c152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:59.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.571+0000 7f4621600640 1 -- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f461c0cdde0 msgr2=0x7f461c15f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:59.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.571+0000 7f4621600640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f461c0cdde0 0x7f461c15f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:59.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.571+0000 7f4621600640 1 -- 172.21.15.8:0/2776181974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614009a70 con 0x7f461c15cb60 2024-05-26T15:43:59.571 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.571+0000 7f4621600640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c15cb60 0x7f461c1520e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4614009d90 tx=0x7f4614004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:59.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.571+0000 7f4618c00640 1 -- 172.21.15.8:0/2776181974 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461403c830 con 0x7f461c15cb60 2024-05-26T15:43:59.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.571+0000 7f4618c00640 1 -- 172.21.15.8:0/2776181974 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461403c990 con 0x7f461c15cb60 2024-05-26T15:43:59.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.572+0000 7f4618c00640 1 -- 172.21.15.8:0/2776181974 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461403cd00 con 0x7f461c15cb60 2024-05-26T15:43:59.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.572+0000 7f4622000640 1 -- 172.21.15.8:0/2776181974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c0c7de0 con 0x7f461c15cb60 2024-05-26T15:43:59.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.572+0000 7f4622000640 1 -- 172.21.15.8:0/2776181974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c15fe00 con 0x7f461c15cb60 2024-05-26T15:43:59.572 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.573+0000 7f4622000640 1 -- 172.21.15.8:0/2776181974 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c04e280 con 0x7f461c15cb60 2024-05-26T15:43:59.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.574+0000 7f4618c00640 1 -- 172.21.15.8:0/2776181974 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4614031400 con 0x7f461c15cb60 2024-05-26T15:43:59.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.575+0000 7f4618c00640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f45fc06ac00 0x7f45fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:43:59.573 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.575+0000 7f4618c00640 1 -- 172.21.15.8:0/2776181974 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f46140aab20 con 0x7f461c15cb60 2024-05-26T15:43:59.574 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.575+0000 7f4620c00640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f45fc06ac00 0x7f45fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:43:59.575 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.577+0000 7f4620c00640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f45fc06ac00 0x7f45fc06d0c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4610005880 tx=0x7f4610009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:43:59.578 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.580+0000 7f4618c00640 1 -- 172.21.15.8:0/2776181974 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4614075dd0 con 0x7f461c15cb60 2024-05-26T15:43:59.779 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.781+0000 7f4622000640 1 -- 172.21.15.8:0/2776181974 --> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f461c15cf40 con 0x7f45fc06ac00 2024-05-26T15:43:59.786 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.787+0000 7f4618c00640 1 -- 172.21.15.8:0/2776181974 <== mgr.4104 v2:172.21.15.47:6832/36734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47887 (secure 0 0 0) 0x7f4610001c60 con 0x7f45fc06ac00 2024-05-26T15:43:59.787 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:43:59.787 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2024-05-26T15:43:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.790+0000 7f4622000640 1 -- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f45fc06ac00 msgr2=0x7f45fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.790+0000 7f4622000640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f45fc06ac00 0x7f45fc06d0c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4610005880 tx=0x7f4610009040 comp rx=0 tx=0).stop 2024-05-26T15:43:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.790+0000 7f4622000640 1 -- 172.21.15.8:0/2776181974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c15cb60 msgr2=0x7f461c1520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:43:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.790+0000 7f4622000640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c15cb60 0x7f461c1520e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4614009d90 tx=0x7f4614004a40 comp rx=0 tx=0).stop 2024-05-26T15:43:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.790+0000 7f4622000640 1 -- 172.21.15.8:0/2776181974 shutdown_connections 2024-05-26T15:43:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.790+0000 7f4622000640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f461c15cb60 0x7f461c1520e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:59.789 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.790+0000 7f4622000640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7f45fc06ac00 0x7f45fc06d0c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.790+0000 7f4622000640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f461c0cdde0 0x7f461c15f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.790+0000 7f4622000640 1 --2- 172.21.15.8:0/2776181974 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7f461c0b8470 0x7f461c152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:43:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.790+0000 7f4622000640 1 -- 172.21.15.8:0/2776181974 >> 172.21.15.8:0/2776181974 conn(0x7f461c0cf480 msgr2=0x7f461c0b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:43:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.791+0000 7f4622000640 1 -- 172.21.15.8:0/2776181974 shutdown_connections 2024-05-26T15:43:59.790 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:43:59.791+0000 7f4622000640 1 -- 172.21.15.8:0/2776181974 wait complete. 2024-05-26T15:43:59.808 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-05-26T15:43:58.259145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":256128,"kb_used_data":7196,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754718592,"statfs":{"total":773094113280,"available":772831838208,"internally_reserved":0,"allocated":7368704,"data_stored":3981719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003474"},"pg_stats":[{"pgid":"1.0","version":"64'119","reported_seq":212,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-05-26T15:43:39.943087+0000","last_change":"2024-05-26T15:43:39.943306+0000","last_active":"2024-05-26T15:43:39.943087+0000","last_peered":"2024-05-26T15:43:39.943087+0000","last_clean":"2024-05-26T15:43:39.943087+0000","last_became_active":"2024-05-26T15:39:23.471375+0000","last_became_peered":"2024-05-26T15:39:23.471375+0000","last_unstale":"2024-05-26T15:43:39.943087+0000","last_undegraded":"2024-05-26T15:43:39.943087+0000","last_fullsized":"2024-05-26T15:43:39.943087+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'119","last_scrub_stamp":"2024-05-26T15:43:39.943034+0000","last_deep_scrub":"64'119","last_deep_scrub_stamp":"2024-05-26T15:43:39.943034+0000","last_clean_scrub_stamp":"2024-05-26T15:43:39.943034+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-27T19:02:26.560365+0000","scrub_duration":0.011624532,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1368064,"data_stored":940873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.165,"15min":1.155},"min":{"1min":0.83499999999999996,"5min":0.622,"15min":0.622},"max":{"1min":1.552,"5min":1.802,"15min":1.802},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.101,"5min":1.1399999999999999,"15min":1.1279999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.89700000000000002}]},{"osd":1,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2230000000000001,"15min":1.2310000000000001},"min":{"1min":0.94899999999999995,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.536,"5min":1.887,"15min":1.887},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2470000000000001,"15min":1.264},"min":{"1min":0.79500000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.4810000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.1519999999999999}]},{"osd":2,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.343,"15min":1.3280000000000001},"min":{"1min":1.0740000000000001,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.627,"5min":1.865,"15min":1.865},"last":1.123},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3029999999999999,"15min":1.325},"min":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":1.6539999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.2070000000000001}]},{"osd":3,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.3520000000000001,"15min":1.3220000000000001},"min":{"1min":0.91200000000000003,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7430000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.042},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.4970000000000001,"15min":1.4890000000000001},"min":{"1min":1.139,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.827,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":1.2869999999999999}]},{"osd":4,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4410000000000001,"15min":1.4430000000000001},"min":{"1min":1.1839999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.9019999999999999,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.5900000000000001,"5min":1.5760000000000001,"15min":1.5700000000000001},"min":{"1min":1.268,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.831,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.1870000000000001}]},{"osd":5,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.54,"5min":1.5049999999999999,"15min":1.5389999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.9259999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.601,"5min":1.641,"15min":1.653},"min":{"1min":1.046,"5min":0.998,"15min":0.998},"max":{"1min":2.117,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":1.5680000000000001}]},{"osd":6,"last update":"Sun May 26 15:43:29 2024","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":1.6459999999999999,"15min":1.6759999999999999},"min":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":2.0369999999999999,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.768,"15min":1.804},"min":{"1min":1.3,"5min":1.3,"15min":1.3},"max":{"1min":2.2949999999999999,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.764}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31876,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":774144,"data_stored":350505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.147,"15min":1.159},"min":{"1min":0.82699999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.6719999999999999,"5min":1.736,"15min":1.736},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.161,"15min":1.1120000000000001},"min":{"1min":0.82499999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7809999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2370000000000001}]},{"osd":1,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1919999999999999,"15min":1.196},"min":{"1min":0.80900000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7010000000000001,"5min":1.931,"15min":1.931},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.244,"5min":1.2509999999999999,"15min":1.2390000000000001},"min":{"1min":0.72499999999999998,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.778,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":0.89800000000000002}]},{"osd":2,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.266,"15min":1.3},"min":{"1min":0.72899999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.675,"5min":2.157,"15min":2.157},"last":1.423},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4339999999999999,"15min":1.4930000000000001},"min":{"1min":0.995,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.589,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.4710000000000001}]},{"osd":3,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.337,"15min":1.3919999999999999},"min":{"1min":0.96099999999999997,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.569,"5min":2.169,"15min":2.169},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.5169999999999999,"15min":1.6419999999999999},"min":{"1min":0.99199999999999999,"5min":0.754,"15min":0.754},"max":{"1min":1.925,"5min":4.452,"15min":4.452},"last":1.1950000000000001}]},{"osd":4,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.5289999999999999,"15min":1.621},"min":{"1min":0.92800000000000005,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.841,"5min":3.282,"15min":3.282},"last":1.345},{"interface":"front","average":{"1min":1.411,"5min":1.4490000000000001,"15min":1.5029999999999999},"min":{"1min":0.95399999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.95,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":0.78800000000000003}]},{"osd":5,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.605,"15min":1.7050000000000001},"min":{"1min":1.1930000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.0619999999999998,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.268},{"interface":"front","average":{"1min":1.488,"5min":1.5529999999999999,"15min":1.6240000000000001},"min":{"1min":0.93400000000000005,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.0030000000000001,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.3959999999999999}]},{"osd":7,"last update":"Sun May 26 15:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.6739999999999999,"15min":1.776},"min":{"1min":1.3180000000000001,"5min":0.755,"15min":0.755},"max":{"1min":1.909,"5min":3.4180000000000001,"15min":3.4180000000000001},"last":1.536},{"interface":"front","average":{"1min":1.595,"5min":1.6919999999999999,"15min":1.788},"min":{"1min":1.0049999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.1560000000000001,"5min":2.843,"15min":2.843},"last":1.2949999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":770048,"data_stored":349486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1100000000000001,"15min":1.1379999999999999},"min":{"1min":0.76100000000000001,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3959999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.1479999999999999,"15min":1.091},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.659,"5min":1.873,"15min":1.873},"last":1.615}]},{"osd":1,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.1930000000000001,"15min":1.113},"min":{"1min":0.88800000000000001,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":1.135},{"interface":"front","average":{"1min":1.25,"5min":1.196,"15min":1.1459999999999999},"min":{"1min":0.92800000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.536,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.3129999999999999}]},{"osd":2,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.216,"15min":1.1899999999999999},"min":{"1min":0.95699999999999996,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.306,"15min":1.286},"min":{"1min":0.75,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.7110000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.5249999999999999}]},{"osd":3,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.329,"15min":1.341},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.6419999999999999,"5min":1.879,"15min":1.879},"last":1.361},{"interface":"front","average":{"1min":1.423,"5min":1.4059999999999999,"15min":1.4239999999999999},"min":{"1min":0.82599999999999996,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.8120000000000001,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.4019999999999999}]},{"osd":4,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3220000000000001,"15min":1.331},"min":{"1min":0.78600000000000003,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7569999999999999,"5min":2.077,"15min":2.077},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.518,"5min":1.55,"15min":1.575},"min":{"1min":0.94999999999999996,"5min":0.875,"15min":0.875},"max":{"1min":1.7829999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.677}]},{"osd":6,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4770000000000001,"15min":1.5209999999999999},"min":{"1min":1.014,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.375,"5min":1.456,"15min":1.4570000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.6879999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.4279999999999999}]},{"osd":7,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.5860000000000001,"15min":1.6180000000000001},"min":{"1min":1.0609999999999999,"5min":1.036,"15min":1.036},"max":{"1min":1.9690000000000001,"5min":3.0659999999999998,"15min":3.0659999999999998},"last":1.474},{"interface":"front","average":{"1min":1.597,"5min":1.6180000000000001,"15min":1.641},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.25}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":774144,"data_stored":350505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.159,"15min":1.165},"min":{"1min":0.72699999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.742,"5min":3.5049999999999999,"15min":3.5049999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.212,"15min":1.2390000000000001},"min":{"1min":0.83999999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.601,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.6379999999999999}]},{"osd":1,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.258,"15min":1.262},"min":{"1min":0.91400000000000003,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.7450000000000001,"5min":2.8940000000000001,"15min":2.8940000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.157,"15min":1.1359999999999999},"min":{"1min":0.81299999999999994,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.615,"5min":1.75,"15min":1.75},"last":1.1359999999999999}]},{"osd":2,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.284,"15min":1.2689999999999999},"min":{"1min":0.70599999999999996,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6950000000000001,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.3080000000000001,"15min":1.3069999999999999},"min":{"1min":0.81899999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.696,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.498}]},{"osd":3,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2929999999999999,"15min":1.2809999999999999},"min":{"1min":0.84799999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.835,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.482,"5min":1.46,"15min":1.484},"min":{"1min":1.095,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.837,"5min":2.734,"15min":2.734},"last":1.353}]},{"osd":5,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.476,"5min":1.472,"15min":1.492},"min":{"1min":1.101,"5min":0.502,"15min":0.502},"max":{"1min":1.863,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.405},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.444,"15min":1.492},"min":{"1min":0.91500000000000004,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6850000000000001,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":0.92900000000000005}]},{"osd":6,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5209999999999999,"15min":1.569},"min":{"1min":1.1819999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.867,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.593},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.601,"15min":1.645},"min":{"1min":1.226,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.857,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.7390000000000001}]},{"osd":7,"last update":"Sun May 26 15:43:27 2024","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.579,"15min":1.6519999999999999},"min":{"1min":1.2450000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.917,"5min":4.008,"15min":4.008},"last":1.536},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.7010000000000001,"15min":1.7549999999999999},"min":{"1min":1.2749999999999999,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.929,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.4690000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":774144,"data_stored":350505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.873,"15min":0.89600000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.077,"5min":0.998,"15min":0.96399999999999997},"min":{"1min":0.52400000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.657,"5min":1.659,"15min":1.659},"last":0.84599999999999997}]},{"osd":1,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.93700000000000006,"15min":0.98399999999999999},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.216,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.131,"15min":1.194},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4650000000000001,"5min":2.3740000000000001,"15min":2.3740000000000001},"last":1.27}]},{"osd":2,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1240000000000001,"15min":1.1599999999999999},"min":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6639999999999999,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.038},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.214,"15min":1.2110000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.623,"5min":1.954,"15min":1.954},"last":1.5349999999999999}]},{"osd":4,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.298,"15min":1.302},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.593,"5min":2.7629999999999999,"15min":2.7629999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.3959999999999999,"15min":1.4330000000000001},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.8759999999999999,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.169}]},{"osd":5,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.456,"15min":1.486},"min":{"1min":0.876,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.0569999999999999,"5min":2.9180000000000001,"15min":2.9180000000000001},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.4159999999999999,"15min":1.4199999999999999},"min":{"1min":0.84099999999999997,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.948,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":1.2370000000000001}]},{"osd":6,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.5269999999999999,"5min":1.5009999999999999,"15min":1.5329999999999999},"min":{"1min":0.91300000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.0979999999999999,"5min":2.863,"15min":2.863},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.5649999999999999,"15min":1.5960000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":2.2639999999999998,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.702}]},{"osd":7,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.478,"15min":1.498},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.0310000000000001,"5min":2.306,"15min":2.306},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5620000000000001,"15min":1.587},"min":{"1min":0.97299999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.3130000000000002,"5min":2.7010000000000001,"15min":2.7010000000000001},"last":1.4850000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31868,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":770048,"data_stored":349486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.97299999999999998,"15min":1.0129999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.137,"5min":1.145,"15min":1.1279999999999999},"min":{"1min":0.54300000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.484,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.3580000000000001}]},{"osd":1,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":1.0009999999999999,"15min":1.0429999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.365,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.107,"5min":1.175,"15min":1.1830000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.528,"5min":7.4770000000000003,"15min":7.4770000000000003},"last":1.0680000000000001}]},{"osd":3,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.079,"15min":1.048},"min":{"1min":0.501,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.484,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2270000000000001,"15min":1.2769999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6459999999999999,"5min":2.903,"15min":2.903},"last":1.3149999999999999}]},{"osd":4,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.516,"15min":1.4890000000000001},"min":{"1min":1.1160000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.716,"5min":10.438000000000001,"15min":10.438000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.4259999999999999,"15min":1.466},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.5700000000000001,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.581}]},{"osd":5,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.4750000000000001,"15min":1.5089999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.0009999999999999,"5min":2.9820000000000002,"15min":2.9820000000000002},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.45,"5min":1.635,"15min":1.643},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.734,"5min":10.798999999999999,"15min":10.798999999999999},"last":1.5649999999999999}]},{"osd":6,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.6000000000000001,"15min":1.5920000000000001},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.9239999999999999,"5min":7.851,"15min":7.851},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.6779999999999999,"15min":1.6299999999999999},"min":{"1min":1.0189999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.724,"5min":10.672000000000001,"15min":10.672000000000001},"last":1.542}]},{"osd":7,"last update":"Sun May 26 15:43:33 2024","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.73,"15min":1.732},"min":{"1min":1.1990000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":1.827,"5min":10.249000000000001,"15min":10.249000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.611,"15min":1.611},"min":{"1min":0.96799999999999997,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.927,"5min":2.7989999999999999,"15min":2.7989999999999999},"last":1.6639999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31876,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":774144,"data_stored":350505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.95699999999999996,"15min":1.052},"min":{"1min":0.45000000000000001,"5min":0.377,"15min":0.377},"max":{"1min":1.4410000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0369999999999999,"15min":1.1060000000000001},"min":{"1min":0.626,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.4650000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.98499999999999999}]},{"osd":2,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.94599999999999995,"15min":0.999},"min":{"1min":0.54600000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3200000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.272},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1910000000000001,"15min":1.2769999999999999},"min":{"1min":0.69299999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.601,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.1699999999999999}]},{"osd":3,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2789999999999999,"15min":1.3520000000000001},"min":{"1min":0.89300000000000002,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.694,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.141,"15min":1.24},"min":{"1min":0.65500000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.714,"5min":2.7160000000000002,"15min":2.7160000000000002},"last":1.3220000000000001}]},{"osd":4,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.331,"15min":1.371},"min":{"1min":0.98799999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.8300000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.3480000000000001,"15min":1.4019999999999999},"min":{"1min":1.1100000000000001,"5min":0.75,"15min":0.75},"max":{"1min":1.6639999999999999,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.5900000000000001}]},{"osd":5,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3859999999999999,"15min":1.4810000000000001},"min":{"1min":0.95099999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.8140000000000001,"5min":2.621,"15min":2.621},"last":1.78},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.524,"15min":1.615},"min":{"1min":1.026,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.802,"5min":3.0089999999999999,"15min":3.0089999999999999},"last":1.5269999999999999}]},{"osd":6,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4450000000000001,"15min":1.5189999999999999},"min":{"1min":0.86899999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.6639999999999999,"5min":2.3460000000000001,"15min":2.3460000000000001},"last":1.206},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.6459999999999999},"min":{"1min":0.95999999999999996,"5min":0.755,"15min":0.755},"max":{"1min":1.9790000000000001,"5min":2.7999999999999998,"15min":2.7999999999999998},"last":1.857}]},{"osd":7,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.6040000000000001,"15min":1.7010000000000001},"min":{"1min":1.196,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.954,"5min":2.9780000000000002,"15min":2.9780000000000002},"last":1.631},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.5309999999999999,"15min":1.611},"min":{"1min":0.93899999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.8600000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":1.5620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1363968,"data_stored":939854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.85999999999999999,"15min":0.91200000000000003},"min":{"1min":0.54600000000000004,"5min":0.307,"15min":0.307},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.94099999999999995,"15min":0.995},"min":{"1min":0.57699999999999996,"5min":0.377,"15min":0.377},"max":{"1min":1.843,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.754}]},{"osd":2,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.0169999999999999,"15min":1.087},"min":{"1min":0.61699999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.391,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.0189999999999999,"15min":1.036},"min":{"1min":0.54800000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":1.3839999999999999}]},{"osd":3,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.194,"15min":1.2829999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.6759999999999999,"5min":4.024,"15min":4.024},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.1879999999999999,"15min":1.25},"min":{"1min":0.66700000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.72,"5min":3.0899999999999999,"15min":3.0899999999999999},"last":1.123}]},{"osd":4,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.331,"15min":1.4490000000000001},"min":{"1min":0.80200000000000005,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.6930000000000001,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.175},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.139,"15min":1.151},"min":{"1min":0.81899999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.6200000000000001,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.236}]},{"osd":5,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.4670000000000001,"15min":1.5349999999999999},"min":{"1min":1.0589999999999999,"5min":0.752,"15min":0.752},"max":{"1min":1.8859999999999999,"5min":2.5470000000000002,"15min":2.5470000000000002},"last":1.421},{"interface":"front","average":{"1min":1.391,"5min":1.4339999999999999,"15min":1.5129999999999999},"min":{"1min":0.81899999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.7290000000000001,"5min":4.0490000000000004,"15min":4.0490000000000004},"last":1.5109999999999999}]},{"osd":6,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.22,"15min":1.264},"min":{"1min":0.80400000000000005,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.766,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.409,"15min":1.5089999999999999},"min":{"1min":0.999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.8779999999999999,"5min":3.6680000000000001,"15min":3.6680000000000001},"last":1.6100000000000001}]},{"osd":7,"last update":"Sun May 26 15:43:26 2024","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5389999999999999,"15min":1.621},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.004,"5min":3.0209999999999999,"15min":3.0209999999999999},"last":1.355},{"interface":"front","average":{"1min":1.393,"5min":1.327,"15min":1.365},"min":{"1min":1.0169999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.931,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.49}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-26T15:43:59.810 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-26T15:44:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.008+0000 7fe5a0e00640 1 Processor -- start 2024-05-26T15:44:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.009+0000 7fe5a0e00640 1 -- start start 2024-05-26T15:44:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.010+0000 7fe5a0e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe59c0abd90 0x7fe59c069e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.010+0000 7fe5a0e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c06a3b0 0x7fe59c0ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.010+0000 7fe5a0e00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c0b3440 con 0x7fe59c06b2b0 2024-05-26T15:44:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.010+0000 7fe5a0e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c0b25b0 con 0x7fe59c0abd90 2024-05-26T15:44:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.011+0000 7fe5a0e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c06a810 con 0x7fe59c06a3b0 2024-05-26T15:44:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.011+0000 7fe599e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fe59c06b2b0 0x7fe59c0b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52086/0 (socket says 172.21.15.8:52086) 2024-05-26T15:44:00.013 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.011+0000 7fe599e00640 1 -- 172.21.15.8:0/3720412289 learned_addr learned my addr 172.21.15.8:0/3720412289 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:44:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.011+0000 7fe59a800640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c06a3b0 0x7fe59c0ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.011+0000 7fe599400640 1 --2- 172.21.15.8:0/3720412289 >> v2:172.21.15.47:3300/0 conn(0x7fe59c0abd90 0x7fe59c069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.011+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398190189 0 0) 0x7fe59c0b3440 con 0x7fe59c06b2b0 2024-05-26T15:44:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.011+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe580003520 con 0x7fe59c06b2b0 2024-05-26T15:44:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2323419172 0 0) 0x7fe580003520 con 0x7fe59c06b2b0 2024-05-26T15:44:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c06a3b0 msgr2=0x7fe59c0ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:44:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c06a3b0 0x7fe59c0ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.014 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 >> v2:172.21.15.47:3300/0 conn(0x7fe59c0abd90 msgr2=0x7fe59c069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:44:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 --2- 172.21.15.8:0/3720412289 >> v2:172.21.15.47:3300/0 conn(0x7fe59c0abd90 0x7fe59c069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c0b3fe0 con 0x7fe59c06b2b0 2024-05-26T15:44:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1798635992 0 0) 0x7fe58c001670 con 0x7fe59c06b2b0 2024-05-26T15:44:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 >> v1:172.21.15.8:6789/0 conn(0x7fe59c06b2b0 legacy=0x7fe59c0b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c06a3b0 0x7fe5800039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 0x7fe5800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe580004d00 0x7fe580005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0b25b0 con 0x7fe580003fb0 2024-05-26T15:44:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c06a810 con 0x7fe580004d00 2024-05-26T15:44:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58000ba80 con 0x7fe59c06a3b0 2024-05-26T15:44:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.012+0000 7fe599400640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 0x7fe5800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.013+0000 7fe599e00640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c06a3b0 0x7fe5800039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.013+0000 7fe599400640 1 -- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c06a3b0 msgr2=0x7fe5800039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:44:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.013+0000 7fe599400640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c06a3b0 0x7fe5800039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.013+0000 7fe599400640 1 -- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe580004d00 msgr2=0x7fe580005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:44:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.013+0000 7fe599400640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe580004d00 0x7fe580005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.013+0000 7fe599400640 1 -- 172.21.15.8:0/3720412289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580003520 con 0x7fe580003fb0 2024-05-26T15:44:00.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.013+0000 7fe599e00640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c06a3b0 0x7fe5800039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:44:00.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.014+0000 7fe599400640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 0x7fe5800047c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe588009ac0 tx=0x7fe5800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2666d748b9e4ff25 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:44:00.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.014+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588031400 con 0x7fe580003fb0 2024-05-26T15:44:00.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.014+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58802d050 con 0x7fe580003fb0 2024-05-26T15:44:00.017 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.014+0000 7fe598a00640 1 -- 172.21.15.8:0/3720412289 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588031780 con 0x7fe580003fb0 2024-05-26T15:44:00.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.015+0000 7fe5a0e00640 1 -- 172.21.15.8:0/3720412289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 msgr2=0x7fe5800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.022 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.015+0000 7fe5a0e00640 1 --2- 172.21.15.8:0/3720412289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 0x7fe5800047c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe588009ac0 tx=0x7fe5800057f0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.015+0000 7fe59a800640 1 -- 172.21.15.8:0/3720412289 reap_dead start 2024-05-26T15:44:00.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.015+0000 7fe5a0e00640 1 -- 172.21.15.8:0/3720412289 shutdown_connections 2024-05-26T15:44:00.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.015+0000 7fe5a0e00640 1 -- 172.21.15.8:0/3720412289 >> 172.21.15.8:0/3720412289 conn(0x7fe59c0cf2c0 msgr2=0x7fe59c0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:44:00.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.015+0000 7fe5a0e00640 1 -- 172.21.15.8:0/3720412289 shutdown_connections 2024-05-26T15:44:00.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.015+0000 7fe5a0e00640 1 -- 172.21.15.8:0/3720412289 wait complete. 2024-05-26T15:44:00.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.017+0000 7fe5a0e00640 1 Processor -- start 2024-05-26T15:44:00.023 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.017+0000 7fe5a0e00640 1 -- start start 2024-05-26T15:44:00.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.018+0000 7fe5a0e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 0x7fe59c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.018+0000 7fe5a0e00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c146010 0x7fe59c15bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.018+0000 7fe5a0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe59c15c260 0x7fe59c15e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.018+0000 7fe5a0e00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c146900 con 0x7fe580003fb0 2024-05-26T15:44:00.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.018+0000 7fe5a0e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c146be0 con 0x7fe59c15c260 2024-05-26T15:44:00.024 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.018+0000 7fe5a0e00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c146ec0 con 0x7fe59c146010 2024-05-26T15:44:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.018+0000 7fe599e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 0x7fe59c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.018+0000 7fe599e00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 0x7fe59c159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54454/0 (socket says 172.21.15.8:54454) 2024-05-26T15:44:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.018+0000 7fe599e00640 1 -- 172.21.15.8:0/2279317907 learned_addr learned my addr 172.21.15.8:0/2279317907 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:44:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.018+0000 7fe599400640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c146010 0x7fe59c15bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe59a800640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe59c15c260 0x7fe59c15e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe599e00640 1 -- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c146010 msgr2=0x7fe59c15bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.025 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe599e00640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c146010 0x7fe59c15bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe599e00640 1 -- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe59c15c260 msgr2=0x7fe59c15e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe599e00640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe59c15c260 0x7fe59c15e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe599e00640 1 -- 172.21.15.8:0/2279317907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c1471a0 con 0x7fe580003fb0 2024-05-26T15:44:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe599400640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c146010 0x7fe59c15bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-26T15:44:00.026 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe599e00640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 0x7fe59c159020 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00d8e0 tx=0x7fe58c00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:44:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe592000640 1 -- 172.21.15.8:0/2279317907 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0074e0 con 0x7fe580003fb0 2024-05-26T15:44:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe592000640 1 -- 172.21.15.8:0/2279317907 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c007640 con 0x7fe580003fb0 2024-05-26T15:44:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe592000640 1 -- 172.21.15.8:0/2279317907 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c004a20 con 0x7fe580003fb0 2024-05-26T15:44:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe5a0e00640 1 -- 172.21.15.8:0/2279317907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c147480 con 0x7fe580003fb0 2024-05-26T15:44:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.019+0000 7fe5a0e00640 1 -- 172.21.15.8:0/2279317907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c155a70 con 0x7fe580003fb0 2024-05-26T15:44:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.021+0000 7fe5a0e00640 1 -- 172.21.15.8:0/2279317907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c04e210 con 0x7fe580003fb0 2024-05-26T15:44:00.027 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.021+0000 7fe592000640 1 -- 172.21.15.8:0/2279317907 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe58c004b80 con 0x7fe580003fb0 2024-05-26T15:44:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.022+0000 7fe592000640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06ac30 0x7fe57c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.022+0000 7fe592000640 1 -- 172.21.15.8:0/2279317907 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fe58c088c90 con 0x7fe580003fb0 2024-05-26T15:44:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.023+0000 7fe599400640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06ac30 0x7fe57c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.028 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.024+0000 7fe599400640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06ac30 0x7fe57c06d0f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe588033000 tx=0x7fe588008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:44:00.029 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.027+0000 7fe592000640 1 -- 172.21.15.8:0/2279317907 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe58c053f30 con 0x7fe580003fb0 2024-05-26T15:44:00.226 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.228+0000 7fe5a0e00640 1 -- 172.21.15.8:0/2279317907 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fe59c0b1cd0 con 0x7fe580003fb0 2024-05-26T15:44:00.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.237+0000 7fe592000640 1 -- 172.21.15.8:0/2279317907 <== mon.0 v2:172.21.15.8:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe58c08f080 con 0x7fe580003fb0 2024-05-26T15:44:00.236 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.237+0000 7fe592000640 1 -- 172.21.15.8:0/2279317907 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe58c019020 con 0x7fe580003fb0 2024-05-26T15:44:00.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.241+0000 7fe5a0e00640 1 -- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06ac30 msgr2=0x7fe57c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.241+0000 7fe5a0e00640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06ac30 0x7fe57c06d0f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe588033000 tx=0x7fe588008030 comp rx=0 tx=0).stop 2024-05-26T15:44:00.240 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.241+0000 7fe5a0e00640 1 -- 172.21.15.8:0/2279317907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 msgr2=0x7fe59c159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.241+0000 7fe5a0e00640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 0x7fe59c159020 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00d8e0 tx=0x7fe58c00dda0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.241+0000 7fe5a0e00640 1 -- 172.21.15.8:0/2279317907 shutdown_connections 2024-05-26T15:44:00.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.241+0000 7fe5a0e00640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fe57c06ac30 0x7fe57c06d0f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.241+0000 7fe5a0e00640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe59c15c260 0x7fe59c15e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.241+0000 7fe5a0e00640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fe59c146010 0x7fe59c15bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.241+0000 7fe5a0e00640 1 --2- 172.21.15.8:0/2279317907 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe580003fb0 0x7fe59c159020 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.241+0000 7fe5a0e00640 1 -- 172.21.15.8:0/2279317907 >> 172.21.15.8:0/2279317907 conn(0x7fe59c0cf2c0 msgr2=0x7fe59c0ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:44:00.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.242+0000 7fe5a0e00640 1 -- 172.21.15.8:0/2279317907 shutdown_connections 2024-05-26T15:44:00.241 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.242+0000 7fe5a0e00640 1 -- 172.21.15.8:0/2279317907 wait complete. 2024-05-26T15:44:00.259 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-26T15:44:00.259 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-26T15:44:00.466 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.468+0000 7fbd3da00640 1 Processor -- start 2024-05-26T15:44:00.467 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.468+0000 7fbd3da00640 1 -- start start 2024-05-26T15:44:00.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.470+0000 7fbd3da00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd380b03d0 0x7fbd380cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.470+0000 7fbd3da00640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbd380cc580 0x7fbd381625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.470+0000 7fbd3da00640 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd38161540 con 0x7fbd38157ff0 2024-05-26T15:44:00.468 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.470+0000 7fbd3da00640 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd381621c0 con 0x7fbd380cc580 2024-05-26T15:44:00.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.470+0000 7fbd3da00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd381583d0 con 0x7fbd380b03d0 2024-05-26T15:44:00.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.470+0000 7fbd3d000640 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbd380cc580 0x7fbd381625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.470+0000 7fbd37e00640 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbd38157ff0 0x7fbd380afcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:52092/0 (socket says 172.21.15.8:52092) 2024-05-26T15:44:00.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.470+0000 7fbd37e00640 1 -- 172.21.15.8:0/929797543 learned_addr learned my addr 172.21.15.8:0/929797543 (peer_addr_for_me v1:172.21.15.8:0/0) 2024-05-26T15:44:00.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.470+0000 7fbd37400640 1 --2- 172.21.15.8:0/929797543 >> v2:172.21.15.47:3300/0 conn(0x7fbd380b03d0 0x7fbd380cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.469 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.471+0000 7fbd3d000640 1 -- 172.21.15.8:0/929797543 >> v2:172.21.15.47:3300/0 conn(0x7fbd380b03d0 msgr2=0x7fbd380cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-26T15:44:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.471+0000 7fbd3d000640 1 --2- 172.21.15.8:0/929797543 >> v2:172.21.15.47:3300/0 conn(0x7fbd380b03d0 0x7fbd380cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.471+0000 7fbd3d000640 1 -- 172.21.15.8:0/929797543 >> v1:172.21.15.8:6789/0 conn(0x7fbd38157ff0 legacy=0x7fbd380afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.471+0000 7fbd3d000640 1 -- 172.21.15.8:0/929797543 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38161820 con 0x7fbd380cc580 2024-05-26T15:44:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.472+0000 7fbd3d000640 1 --2- 172.21.15.8:0/929797543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd380cc580 0x7fbd381625f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fbd38071250 tx=0x7fbd3002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7ed2c54c8553ae server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:44:00.470 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.472+0000 7fbd36a00640 1 -- 172.21.15.8:0/929797543 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3002aea0 con 0x7fbd380cc580 2024-05-26T15:44:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.472+0000 7fbd36a00640 1 -- 172.21.15.8:0/929797543 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbd3002d050 con 0x7fbd380cc580 2024-05-26T15:44:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.472+0000 7fbd36a00640 1 -- 172.21.15.8:0/929797543 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30007980 con 0x7fbd380cc580 2024-05-26T15:44:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.472+0000 7fbd3da00640 1 -- 172.21.15.8:0/929797543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd380cc580 msgr2=0x7fbd381625f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.472+0000 7fbd3da00640 1 --2- 172.21.15.8:0/929797543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd380cc580 0x7fbd381625f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fbd38071250 tx=0x7fbd3002a680 comp rx=0 tx=0).stop 2024-05-26T15:44:00.471 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.473+0000 7fbd3da00640 1 -- 172.21.15.8:0/929797543 shutdown_connections 2024-05-26T15:44:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.473+0000 7fbd3da00640 1 --2- 172.21.15.8:0/929797543 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd380cc580 0x7fbd381625f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.473+0000 7fbd3da00640 1 --2- 172.21.15.8:0/929797543 >> v2:172.21.15.47:3300/0 conn(0x7fbd380b03d0 0x7fbd380cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.473+0000 7fbd3da00640 1 -- 172.21.15.8:0/929797543 >> 172.21.15.8:0/929797543 conn(0x7fbd38070480 msgr2=0x7fbd38070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:44:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.473+0000 7fbd3da00640 1 -- 172.21.15.8:0/929797543 shutdown_connections 2024-05-26T15:44:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.473+0000 7fbd3da00640 1 -- 172.21.15.8:0/929797543 wait complete. 2024-05-26T15:44:00.472 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.474+0000 7fbd3da00640 1 Processor -- start 2024-05-26T15:44:00.473 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.475+0000 7fbd3da00640 1 -- start start 2024-05-26T15:44:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.475+0000 7fbd3da00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd380b03d0 0x7fbd38160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.475+0000 7fbd3da00640 1 --2- >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd380cc580 0x7fbd38152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.474 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.475+0000 7fbd3da00640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38157ff0 0x7fbd381f9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.475+0000 7fbd3da00640 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd38153540 con 0x7fbd38157ff0 2024-05-26T15:44:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.475+0000 7fbd3da00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3814fca0 con 0x7fbd380b03d0 2024-05-26T15:44:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.475+0000 7fbd3da00640 1 -- --> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3814ff80 con 0x7fbd380cc580 2024-05-26T15:44:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.476+0000 7fbd3d000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38157ff0 0x7fbd381f9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.476+0000 7fbd37e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd380b03d0 0x7fbd38160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.476+0000 7fbd3d000640 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38157ff0 0x7fbd381f9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54476/0 (socket says 172.21.15.8:54476) 2024-05-26T15:44:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.476+0000 7fbd3d000640 1 -- 172.21.15.8:0/3592517748 learned_addr learned my addr 172.21.15.8:0/3592517748 (peer_addr_for_me v2:172.21.15.8:0/0) 2024-05-26T15:44:00.475 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.476+0000 7fbd37400640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd380cc580 0x7fbd38152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.476+0000 7fbd3d000640 1 -- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd380cc580 msgr2=0x7fbd38152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.476+0000 7fbd3d000640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd380cc580 0x7fbd38152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.476+0000 7fbd3d000640 1 -- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd380b03d0 msgr2=0x7fbd38160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.476+0000 7fbd3d000640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd380b03d0 0x7fbd38160220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.476+0000 7fbd3d000640 1 -- 172.21.15.8:0/3592517748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30009a70 con 0x7fbd38157ff0 2024-05-26T15:44:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.477+0000 7fbd3d000640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38157ff0 0x7fbd381f9cb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009e80 tx=0x7fbd30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:44:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.477+0000 7fbd2fe00640 1 -- 172.21.15.8:0/3592517748 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30031bc0 con 0x7fbd38157ff0 2024-05-26T15:44:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.477+0000 7fbd2fe00640 1 -- 172.21.15.8:0/3592517748 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbd30031d20 con 0x7fbd38157ff0 2024-05-26T15:44:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.477+0000 7fbd2fe00640 1 -- 172.21.15.8:0/3592517748 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30045680 con 0x7fbd38157ff0 2024-05-26T15:44:00.480 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.477+0000 7fbd3da00640 1 -- 172.21.15.8:0/3592517748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd38150260 con 0x7fbd38157ff0 2024-05-26T15:44:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.477+0000 7fbd3da00640 1 -- 172.21.15.8:0/3592517748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd381f74d0 con 0x7fbd38157ff0 2024-05-26T15:44:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.479+0000 7fbd3da00640 1 -- 172.21.15.8:0/3592517748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3804e280 con 0x7fbd38157ff0 2024-05-26T15:44:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.479+0000 7fbd2fe00640 1 -- 172.21.15.8:0/3592517748 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbd300457e0 con 0x7fbd38157ff0 2024-05-26T15:44:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.480+0000 7fbd2fe00640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd1806ac00 0x7fbd1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-26T15:44:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.480+0000 7fbd2fe00640 1 -- 172.21.15.8:0/3592517748 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fbd300aadc0 con 0x7fbd38157ff0 2024-05-26T15:44:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.481+0000 7fbd37e00640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd1806ac00 0x7fbd1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-26T15:44:00.481 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.482+0000 7fbd37e00640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd1806ac00 0x7fbd1806d0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbd28005880 tx=0x7fbd28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-26T15:44:00.483 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.485+0000 7fbd2fe00640 1 -- 172.21.15.8:0/3592517748 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbd30076110 con 0x7fbd38157ff0 2024-05-26T15:44:00.726 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.727+0000 7fbd3da00640 1 -- 172.21.15.8:0/3592517748 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd381575d0 con 0x7fbd38157ff0 2024-05-26T15:44:00.727 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.728+0000 7fbd2fe00640 1 -- 172.21.15.8:0/3592517748 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fbd3004ade0 con 0x7fbd38157ff0 2024-05-26T15:44:00.727 INFO:teuthology.orchestra.run.smithi008.stdout: 2024-05-26T15:44:00.727 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5063,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3208736150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3208736150},{"type":"v1","addr":"172.21.15.47:6835","nonce":3208736150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5383,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1791112491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6833","nonce":1791112491},{"type":"v1","addr":"172.21.15.8:6835","nonce":1791112491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5389,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6837/1811257410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6836","nonce":1811257410},{"type":"v1","addr":"172.21.15.47:6837","nonce":1811257410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6834/1258674487","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":1258674487},{"type":"v1","addr":"172.21.15.8:6834","nonce":1258674487}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[]} 2024-05-26T15:44:00.728 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 40 2024-05-26T15:44:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.731+0000 7fbd3da00640 1 -- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd1806ac00 msgr2=0x7fbd1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.731+0000 7fbd3da00640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd1806ac00 0x7fbd1806d0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbd28005880 tx=0x7fbd28009040 comp rx=0 tx=0).stop 2024-05-26T15:44:00.730 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.731+0000 7fbd3da00640 1 -- 172.21.15.8:0/3592517748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38157ff0 msgr2=0x7fbd381f9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-26T15:44:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.731+0000 7fbd3da00640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38157ff0 0x7fbd381f9cb0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009e80 tx=0x7fbd30004a40 comp rx=0 tx=0).stop 2024-05-26T15:44:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.732+0000 7fbd3da00640 1 -- 172.21.15.8:0/3592517748 shutdown_connections 2024-05-26T15:44:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.732+0000 7fbd3da00640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd38157ff0 0x7fbd381f9cb0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.732+0000 7fbd3da00640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:3301/0,v1:172.21.15.47:6790/0] conn(0x7fbd380cc580 0x7fbd38152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.732+0000 7fbd3da00640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:6832/36734,v1:172.21.15.47:6833/36734] conn(0x7fbd1806ac00 0x7fbd1806d0c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.732+0000 7fbd3da00640 1 --2- 172.21.15.8:0/3592517748 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd380b03d0 0x7fbd38160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-26T15:44:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.732+0000 7fbd3da00640 1 -- 172.21.15.8:0/3592517748 >> 172.21.15.8:0/3592517748 conn(0x7fbd38070480 msgr2=0x7fbd380cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-26T15:44:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.732+0000 7fbd3da00640 1 -- 172.21.15.8:0/3592517748 shutdown_connections 2024-05-26T15:44:00.731 INFO:teuthology.orchestra.run.smithi008.stderr:2024-05-26T15:44:00.732+0000 7fbd3da00640 1 -- 172.21.15.8:0/3592517748 wait complete. 2024-05-26T15:44:00.751 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-26T15:44:00.751 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-26T15:44:00.751 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-26T15:44:00.751 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:00.770 INFO:tasks.ceph.mds.a:Stopped 2024-05-26T15:44:00.770 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-26T15:44:00.770 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:00.838 INFO:tasks.ceph.mds.c:Stopped 2024-05-26T15:44:00.838 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-26T15:44:00.838 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:00.859 INFO:tasks.ceph.mds.b:Stopped 2024-05-26T15:44:00.859 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-26T15:44:00.859 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:00.919 INFO:tasks.ceph.mds.d:Stopped 2024-05-26T15:44:00.920 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-26T15:44:00.920 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-26T15:44:00.920 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.001 INFO:tasks.ceph.osd.0:Stopped 2024-05-26T15:44:01.001 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-26T15:44:01.001 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.057 INFO:tasks.ceph.osd.1:Stopped 2024-05-26T15:44:01.058 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-26T15:44:01.058 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.130 INFO:tasks.ceph.osd.2:Stopped 2024-05-26T15:44:01.130 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-26T15:44:01.130 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.211 INFO:tasks.ceph.osd.3:Stopped 2024-05-26T15:44:01.211 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-26T15:44:01.212 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.278 INFO:tasks.ceph.osd.4:Stopped 2024-05-26T15:44:01.278 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-26T15:44:01.278 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.341 INFO:tasks.ceph.osd.5:Stopped 2024-05-26T15:44:01.341 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-26T15:44:01.341 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.412 INFO:tasks.ceph.osd.6:Stopped 2024-05-26T15:44:01.412 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-26T15:44:01.413 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.506 INFO:tasks.ceph.osd.7:Stopped 2024-05-26T15:44:01.506 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-26T15:44:01.506 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-26T15:44:01.507 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.597 INFO:tasks.ceph.mgr.y:Stopped 2024-05-26T15:44:01.597 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-26T15:44:01.597 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.682 INFO:tasks.ceph.mgr.x:Stopped 2024-05-26T15:44:01.682 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-26T15:44:01.682 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-26T15:44:01.682 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.734 INFO:tasks.ceph.mon.a:Stopped 2024-05-26T15:44:01.735 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-26T15:44:01.735 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.770 INFO:tasks.ceph.mon.b:Stopped 2024-05-26T15:44:01.770 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-26T15:44:01.771 INFO:teuthology.orchestra.run:waiting for 300 2024-05-26T15:44:01.857 INFO:tasks.ceph.mon.c:Stopped 2024-05-26T15:44:01.858 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-26T15:44:01.858 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-05-26T15:44:01.964 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:44:01.964 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-26T15:44:02.210 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:44:02.211 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-26T15:44:02.444 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:44:02.444 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-26T15:44:02.599 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:44:02.599 DEBUG:teuthology.orchestra.run.smithi008:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-26T15:44:02.740 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:44:02.740 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-26T15:44:02.969 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:44:02.970 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-26T15:44:03.133 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:44:03.133 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-26T15:44:03.272 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:44:03.272 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-26T15:44:03.403 INFO:tasks.ceph:Archiving mon data... 2024-05-26T15:44:03.405 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570/data/mon.a.tgz 2024-05-26T15:44:03.405 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2024-05-26T15:44:03.465 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.55d8pp6IKg 2024-05-26T15:44:03.466 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.55d8pp6IKg 2024-05-26T15:44:03.657 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.55d8pp6IKg 2024-05-26T15:44:03.810 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.55d8pp6IKg is 371KB 2024-05-26T15:44:03.928 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.55d8pp6IKg 2024-05-26T15:44:04.037 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570/data/mon.b.tgz 2024-05-26T15:44:04.038 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-26T15:44:04.103 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.x2G8YKF7dM 2024-05-26T15:44:04.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.x2G8YKF7dM 2024-05-26T15:44:04.343 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.x2G8YKF7dM 2024-05-26T15:44:04.489 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.x2G8YKF7dM is 490KB 2024-05-26T15:44:04.605 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.x2G8YKF7dM 2024-05-26T15:44:04.665 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570/data/mon.c.tgz 2024-05-26T15:44:04.665 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-26T15:44:04.719 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.gWKaHmOhnP 2024-05-26T15:44:04.720 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gWKaHmOhnP 2024-05-26T15:44:04.919 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.gWKaHmOhnP 2024-05-26T15:44:05.064 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.gWKaHmOhnP is 490KB 2024-05-26T15:44:05.182 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.gWKaHmOhnP 2024-05-26T15:44:05.240 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-26T15:44:05.241 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-26T15:44:05.249 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-26T15:44:05.339 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-05-26T15:44:05.340 DEBUG:teuthology.orchestra.run.smithi008:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-26T15:44:05.347 DEBUG:teuthology.orchestra.run.smithi047:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-26T15:44:05.437 INFO:teuthology.orchestra.run.smithi008.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-26T15:44:05.445 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-26T15:44:05.459 INFO:tasks.ceph:Archiving crash dumps... 2024-05-26T15:44:05.461 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570/remote/smithi008/crash 2024-05-26T15:44:05.462 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-26T15:44:05.532 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570/remote/smithi047/crash 2024-05-26T15:44:05.533 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-26T15:44:05.623 INFO:tasks.ceph:Shutting down logrotate 2024-05-26T15:44:05.623 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:44:05.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-26T15:44:05.751 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-26T15:44:05.842 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-26T15:44:05.941 INFO:tasks.ceph:Compressing logs... 2024-05-26T15:44:05.941 DEBUG:teuthology.orchestra.run.smithi008:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-26T15:44:05.949 DEBUG:teuthology.orchestra.run.smithi047:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-26T15:44:10.693 INFO:tasks.ceph:Archiving logs... 2024-05-26T15:44:10.693 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570/remote/smithi008/log 2024-05-26T15:44:10.694 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-26T15:44:11.480 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570/remote/smithi047/log 2024-05-26T15:44:11.481 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-26T15:44:12.035 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-26T15:44:12.044 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-26T15:44:12.045 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-26T15:44:12.053 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-26T15:44:12.204 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-26T15:44:12.213 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-26T15:44:12.213 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-26T15:44:12.221 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-26T15:44:12.273 INFO:teuthology.orchestra.run.smithi008.stderr:bash: line 1: ntpq: command not found 2024-05-26T15:44:12.278 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: ntpq: command not found 2024-05-26T15:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-26T15:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2024-05-26T15:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +445us[ +447us] +/- 54ms 2024-05-26T15:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -938us[ -938us] +/- 54ms 2024-05-26T15:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +645us[ +647us] +/- 74ms 2024-05-26T15:44:12.282 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-26T15:44:12.289 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-26T15:44:12.289 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-05-26T15:44:12.289 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +469us[ +481us] +/- 54ms 2024-05-26T15:44:12.289 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -929us[ -929us] +/- 54ms 2024-05-26T15:44:12.289 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +659us[ +659us] +/- 75ms 2024-05-26T15:44:12.289 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-26T15:44:12.291 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-26T15:44:12.300 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-26T15:44:12.301 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-26T15:44:12.310 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-26T15:44:12.514 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-26T15:44:12.724 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-26T15:44:12.821 INFO:teuthology.orchestra.run.smithi008.stdout:type=AVC msg=audit(1716737406.990:198): avc: denied { checkpoint_restore } for pid=1132 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-05-26T15:44:12.823 DEBUG:teuthology.task.selinux:ubuntu@smithi008.front.sepia.ceph.com has 1 denials 2024-05-26T15:44:12.823 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-26T15:44:12.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:44:12.922 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_b9e3da87b1ec7920937cb4902b7e3fd9eda86b4a/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi008.front.sepia.ceph.com: ['type=AVC msg=audit(1716737406.990:198): avc: denied { checkpoint_restore } for pid=1132 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-05-26T15:44:12.923 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-26T15:44:12.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-26T15:44:12.942 INFO:teuthology.task.internal:Duration was 847.744735 seconds 2024-05-26T15:44:12.943 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-26T15:44:12.951 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-26T15:44:12.951 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-26T15:44:12.959 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-26T15:44:13.085 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-26T15:44:13.102 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-26T15:44:13.568 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-26T15:44:13.568 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2024-05-26T15:44:13.568 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-26T15:44:13.635 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-05-26T15:44:13.636 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-26T15:44:13.714 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-26T15:44:13.714 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-26T15:44:13.722 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-26T15:44:13.809 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-26T15:44:13.810 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-26T15:44:13.815 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-26T15:44:14.000 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-26T15:44:14.011 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-26T15:44:14.011 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-26T15:44:14.091 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-26T15:44:14.176 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-26T15:44:14.211 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-26T15:44:14.219 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-26T15:44:14.316 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2024-05-26T15:44:14.327 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-05-26T15:44:14.370 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-26T15:44:14.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:44:14.424 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-26T15:44:14.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-26T15:44:14.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-26T15:44:14.592 INFO:teuthology.task.internal:Transferring archived files... 2024-05-26T15:44:14.593 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570/remote/smithi008 2024-05-26T15:44:14.593 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-26T15:44:14.696 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-22_22:24:05-fs-reef-distro-default-smithi/7721570/remote/smithi047 2024-05-26T15:44:14.697 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-26T15:44:14.797 INFO:teuthology.task.internal:Removing archive directory... 2024-05-26T15:44:14.797 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-26T15:44:14.805 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-26T15:44:14.863 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-26T15:44:14.873 INFO:teuthology.task.internal:Not uploading archives. 2024-05-26T15:44:14.873 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-26T15:44:14.882 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-26T15:44:14.883 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-26T15:44:14.890 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-26T15:44:14.942 INFO:teuthology.orchestra.run.smithi008.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 26 15:44 /home/ubuntu/cephtest 2024-05-26T15:44:14.950 INFO:teuthology.orchestra.run.smithi047.stdout: 393949 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 26 15:44 /home/ubuntu/cephtest 2024-05-26T15:44:14.953 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-26T15:44:14.963 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-26T15:44:14.974 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi008.front.sepia.ceph.com: ['type=AVC msg=audit(1716737406.990:198): avc: denied { checkpoint_restore } for pid=1132 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-05-26T15:44:14.977 INFO:teuthology.run:Summary data: client.0-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 client.1-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/openfiletable} duration: 847.7447354793549 failure_reason: 'SELinux denials found on ubuntu@smithi008.front.sepia.ceph.com: [''type=AVC msg=audit(1716737406.990:198): avc: denied { checkpoint_restore } for pid=1132 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'']' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-05-26T15:44:14.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-26T15:44:15.065 INFO:teuthology.run:FAIL